It's, you know, what will that mean to my investment? And the announcement with Fusion I.O. is that, you know, we're 25 times faster on read-intensive HBASE applications, the combination. So, as organizations are deploying Hadoop and they're looking at technology changes coming down the pike, they can rest assured that they'll be able to take advantage of those in a much more aggressive fashion with MapR than other distributions. Jack, I got to ask you, we were talking last night at the Hadoop Summit, kind of the kickoff party and you know, everyone was there, all the top execs were there and all the developers.  You guys, Roms, Cloudera, MapR and Hortonworks really at the beginning, the key players early on and Charles from Cloudera was just recently on and he's like, oh no, Santa Prize grade stuff has been kicked around, it's been there from the beginning. You guys have been there from the beginning and MapR has never ever waffled on your messaging. You've always been very clear, hey, we're going to take Hadoop, open source Hadoop and turn it into an enterprise grade product. So that's clear, right? That's you, that's a great. So what's your take on this? Because now enterprise grade is kind of there, I guess the buzz around getting the folks that have crossed the chasm implemented. So what can you comment on that about one, enterprise grade, the reality of it? Certainly from your perspective you have opinion, but others, and then those folks that are now rolling it out for the first time, what can you share with them around what does it mean to be enterprise grade? So enterprise grade is more about the customer experience than a marketing claim. And by enterprise grade, what we're talking about are some of the capabilities and features that they've grown to expect in their other enterprise applications. The ability to meet full SLAs, full HA, recovery from multiple failures, rolling upgrades, data protection with consistent snapshots, business continuity with mirroring, the ability to share a cluster across multiple groups and have volumes. I mean there's a host of features that fall under the umbrella enterprise grade. And when you move from no support for any of those features to support to a few of them, I don't think that's going to HA, it's more like moving to low availability. And there's just a lot of differences in terms of when we say enterprise grade, what those features mean, versus what we view as kind of an incomplete story. So Describe, what do you mean by low availability? Well, I mean it's tongue-in-cheek, it's nice, it's a good term, as everybody's saying, just available when you, sometimes. Is that what you mean? It's not true availability, I mean availability is 99.9%. Right, right, so if you've got an HA solution that can't recover from multiple failures, that's downtime. If you've got an H base application that's running online and you have data that goes down and it takes 10 to 30 minutes to have the region servers recover it from another place in the distribution, that's downtime. If you have snapshots that aren't consistent across the cluster, that doesn't provide data protection. There's no point in time recovery for a cluster. So there's a lot of details underneath that, but what it amounts to is do you have interruptions? Do you have downtime? Do you have the potential for losing data? And our answer is you need a series of features that are hardened and proven to deliver that. What about recoverability, you mentioned that. You guys have done a lot of work in that area with snapshotting, that's kind of being kicked around. Are folks addressing, what are the, what's your competition doing in those areas of recoverability, you just mentioned availability, okay, got that, recoverability, security, compliance, and usability, those are the areas that seem to be the hot focus areas. What's going on in the industry, how would you give them the grade, the letter grade, if you will, candidly, compared to what you guys offer? Well, first of all, let's take recoverability. You know, one of the tendencies, you have a point in time recovery, the ability to restore to a previous point that's consistent across the cluster. And right now there's no point in time recovery for HDFS, for the files, and there's no point in time recovery for HBase tables. So there's snapshot support that's being talked about in the open source community with respect to snapshots, but it's being referred to in the JIRAs as fuzzy snapshots and really compared to copy table. So, Jack, I want to turn the conversation to the kind of the topic we've talked about before, kind of the open versus proprietary, that whole debate, we've heard about that, we talked about that before here on theCUBE. So just kind of reiterate for us your take, I mean, we hear perhaps because of the show where there's a lot of talk about the open sourced nature of Hadoop and some of the purists, as you might call them, are saying it's got to be open source, 100% Apache compatible, et cetera, and then there's others that are taking a different approach. Explain your approach and why you think that's the key way to really spur adoption of Hadoop and make it a enterprise-grade block block. We're a part of the community. We've got commitment going on, we've pioneered and pushed a Apache drill, but we have done innovations as well, and I think that those innovations are really required to support and extend the whole ecosystem. So Canonical distributes our M3 distribution, we've got all our packages are available on GitHub and open source, so it's not a binary debate. And I think the point being that there's companies that have jumped ahead and now the Peloton is pedaling faster and will catch up, will streamline, I think the difference is we re-architected, so we're basically in a race car and are racing ahead with enterprise-grade features that are required and there's a lot of work that still needs to be accomplished before that full re-architecture is in place. Well, I think for me, the proof is really in the pudding when it comes to talk about customers that are doing real things and real production grade, mission-critical applications that they're running. And to me, that shows the successor or relative success of a given approach. So I know you guys are working with companies like Ancestry.com, Live Nation, Quicken Loans. Maybe you could, could you walk us through a couple of those scenarios? Let's take Ancestry.com, obviously they've got a huge amount of data based on the kind of genealogical information. What are you guys doing with them? Yeah, so they've got, I mean, they've got the world's largest family genealogy services available on the web, so there's a massive amount of data that they make accessible and ability for analysis, and then they've rolled out new features and new applications, one of which is to ship a kid out and have people spit in a tube, return back, they do DNA matching and reveal additional details. So really some really fabulous leading edge things that are being done with the use of Hadoop. Interesting, so talk about when you went to work with them, what were some of their key requirements? Was it around, was it more around the enterprise grade, security and uptime kind of equation, or was it more around some of the analytics? Well, what's the kind of the killer use case for them? It's kind of a, you know, it's hard with a specific company or even to generalize across companies because they're really three main areas in terms of ease of use and administration, dependability, which includes the full HA, and then performance, and in some cases it's just one of those that kind of drives it and is used to justify, in other cases it's kind of a collection. The ease of use is being able to use a cluster not only as Hadoop, but to access it and treat it like enterprise storage. So it's a complete POSIX compliance file system underneath that allows the mounting and access and updates and using it in dynamic read-write. So what that means from an application level, it's faster, it's much easier to administer, and it's much easier and reliable for developers to utilize. Jack, I got to ask you about the marketing question because I see, you know, MAPR, you guys have done a good job. Marketing, certainly we want to be thankful to you guys as supporting theCUBE in the past, and you guys have been great supporters of our mission. But now the ecosystem's evolving, a lot more competition. Cloudera mentioned there's eight companies they're tracking in quote Hadoop, and certainly Jeff and I, and we're still going to be looking at, there's a lot more because Hadoop Washing has been going on now for the term Hadoop Washing, I mean jumping in and doing Hadoop, slapping that onto an existing solution. It's not been happening full bore for a year at least. What's the next for you guys to break above the noise? Obviously the communities are very active, projects are coming online, you guys have your mission in the enterprise, what's the strategy for you guys going forward? Is it more the same, anything new you want to share? Yeah, I think as far as breaking above the noise, it will be our customers, their success in their use cases that really put the spotlight on what the differences are in terms of using a big data platform. And I think what companies will start to realize is I'd rather analogy between supply chain and the big revolution in supply chain was focusing on inventory at each stage in the supply chain and how do you reduce that inventory level and how do you speed the flow of goods and the agility of a company for competitive advantage? And I think we're going to view data the same way. So companies instead of raw data that they're copying and moving across different silos if they're able to process data in place and send small results sets, they're going to be faster, more agile and more competitive. And that puts the spotlight on what data platform is out there that can support a broad set of applications and can have the broadest set of functionality. So what we're delivering is a mission grade, enterprise grade mission critical support platform that supports MapReduce and does that high performance, provides NFS, POSIX access, so you can use it like a file system, integrates enterprise grade, no SQL applications. So now you can do high speed, consistent performance, real time operations in addition to batch, streaming, integrated search, et cetera. So it's really exciting to provide that platform and have organizations transform what they're doing. How's the feedback going with Ted Dunning? I've been seeing a lot of buzz on the Twitter sphere. He's getting positive feedback here. He's a tech athlete. He's a guru. He's an expert. He's got his hands in all the pies. He's a scientist type. What's he up to? What's his role within MapR? And he's actually playing in the open source community. What's he up to these days? He's our chief application architect. He's on the leading edge of Mahalak, so machine learning. So sharing insights there. He was speaking at the Storm Meetup two nights ago and sharing how you can integrate long running batch predictive analytics with real time streaming and how the use of snapshots really makes that easy and possible. He travels the world and is helping organizations understand how they can take some very complex, long running processes and really simplify and shorten those. Had a chance to meet him in New York City at Last Duke World at a party and great guy. Fantastic geek and certainly he's doing great work and a shout out to Ted. Congratulations, continue up that support. How's everyone else doing? How's John and Trevis doing? How's the team at MapR? We're fiddling as fast as you can. We're busy growing, growing quickly. Now we're just shifting gears. We're beyond fiddling. Yeah, you're in the engine, you know. Give us an update on the company in terms of the growth and kind of where you guys are moving next. Yeah, we're expanding worldwide. Just this last few months we've opened up offices in London and Munich and Paris. We're expanding in Asia, Japan and Korea. So our sales and services and engineering and basically across the whole company continues to expand rapidly. Some really great, interesting partnerships and a lot of growth, not only as we add customers but it's nice to see customers that continue to really grow their use of MapR within their organization, both in terms of the amount of data that they're analyzing and the number of applications that they're bringing to bear on the platform. Talk about that a little bit because I think one of the trends we do see is when a company brings in big data, a big data platform, they might start experimenting with it, build an application and then maybe in the marketing department and then the sales guys see it and they say, well maybe we can do something with that. Is that typically the kind of the experience you're seeing and how do you support companies that want to start expanding beyond those initial use cases to support other departments, potentially even other physical locations around the world? How do you kind of support that? The beauty of that is if you have a platform that can support those new applications, so if mission critical workloads are not an issue, if you support volume so that you can logically separate, makes it much easier, which we have. So one of our customers, Zion's Bank, they brought in MapR to do fraud detection and pretty soon, the fact that they were able to collect all of that data, they had other departments coming to them and saying, hey, we'd like to use that to do analysis on because we're not getting that data from our existing systems.  You also mentioned as you're expanding internationally, what did you take on the international market for big data to do specifically? Is the US kind of leaps and bounds ahead of the rest of the world in terms of adoption of the technology? What are you seeing out there in terms of where the rest of the world stands? I wouldn't say leaps and bounds. And I think internationally they're able to maybe skip some of the experimental steps. So we're seeing deployment across financial services and telecom and it's fairly broad recruit technologies. They're the largest provider of recruiting services. Indeed.com is one of their subsidiaries. They're doing a lot with Hadoop and MapR specifically. So it's been expanding rapidly. Fantastic. So also, you think about Europe, what's going on with Google and some of the privacy concerns, even here I should say. Is there different regulatory environments you've got to navigate when you're talking about data and how you use data when you're starting to expand to other locales? Yeah, there's typically bi-vertical. There's different requirements, HIPAA and healthcare and Basel II and financial services. And so all of those, it basically it's the same theme of when you're bringing Hadoop into an organization and into a data center, the same sorts of concerns and requirements and privacy that you're applying in other areas will be applied on Hadoop. Now kind of turning back to the technology you mentioned Apache drill, I'd love to get an update on kind of where that stands. You know, and put that into context for people. I hear a lot about the SQL on Hadoop question here. Where does drill fit into that equation? Well, there's a lot of different approaches to provide SQL access. A lot of that is driven by how do you leverage some of the talent and organization that speaks SQL. So there's developments with respect to Hive, there's other projects out there. Apache drill is an open source project getting a lot of community involvement and the design center there is pretty interesting. It started from the beginning as an open source project and two main differences. One was in looking at supporting SQL, let's do full ANSI SQL. So it's full 2003 ANSI SQL, not a SQL like. And that'll support the greatest number of applications and you know, avoid a lot of support and issues. And the second design center is let's support a broad set of data sources. So nested sources like JSON, Scheme on Discovery, it's basically fitting it into an enterprise environment where sometimes it's kind of messy and can get messy as acquisitions happen, et cetera. So it's complimentary, it's about enabling interactive low latency queries. Jack, I want to give you the final word. We're out of time. Thanks for coming on theCUBE. Really appreciate you. Great to see you again, CUBE alumni. But final word and we'll end the segment here on theCUBE is your quick thoughts on what's happening here at Hadoop World. What is this show about? Share with the audience what's the vibe, the summary, quick sound bite on Hadoop. Yeah, I think I'll go back to how we started. It's not if you use Hadoop, it's how you use Hadoop and look at not only the first application but what it's going to look like in multiple applications and pay attention to what enterprise grade means. Okay, there was theCUBE. We got more coverage coming. Jack Norris with MapR. Obviously one of the original big three still on the list in our mind. And the market's mind with a unique approach to Hadoop and they've been doing great. This is theCUBE. I'm John Furrier with Jeff Kelley. I'll be right back after this short break. I don't quite a gap in tech news. There are plenty of tech shows that provide new gadgets and talk about the low latency. Those shows are pretty...


Because what satellite data provides is a snapshot in time, and you can think of them as a series of photographs of where you have glaciers, where you have sea ice, and where you don't. But you have these in a time sequence over 30 or 40 years, over 40 years if we use Landsat data. And so the very same things which James Baylog, which James Baylog was explaining and chasing ice, we do similar things but using satellite data. And frequently we collaborate with James Baylog because they'll have photographs about specific aspects of certain glaciers. And we can use that information to tell where the boundaries are and the satellite data at those specific times where he has their chasing ice photographs. So all these things tie together and they're part of the same approach to study earth science where you need information on the ground. And then you couple that with satellite data and then get a much more comprehensive understanding of what's happened over time.


I don't wear any back, it looks like we're rocking around. So you can, um, go to the little girl who hasn't found a co-begiver, so they relax this morning. Now, she's got a person she can't relax. Oh, pretend I'm not here. I mean, the mom could probably hold her.  He's doing that so sweetly. Oh my God, this is so cute though. Next, in the booth, and then when you're done, I'll just push this little button top, and just mix it out. And then, but obviously you don't put anything in the trash, and then you just come in again. A little bit, a little bit, man.


In this video, we'll be looking at Boolean operators, the small but very important words that are used to connect keywords in a database search. In another video, we talked about identifying keywords by pulling core concepts out of a research topic and listing synonymous and like terms for each of those concepts as shown in this table. But how do we enter these terms in a database? It's not effective to simply type all of the keywords into the search box as the database will only return those results, including all of the keywords we list and few, if any sources will use all of these keywords. What we want the database to do is return results that include at least one of the keywords from each column. In this way, the sources returned in our search could use any combination of the keywords we've listed, provided that each of our core concepts is represented. We can achieve this with Boolean operators, in particular, the words and and or. Linking two words with and has the database return results including both words. Consequently, and is best used between distinct concepts when we want our search results to relate to both. Using or has the database return results including either or both words, as long as at least one of the words is found in the record, the database will include the item in a results list. Or then is best used between synonymous and like terms when we only need to see at least one of the words in the record. In the case of our earlier search strategy, an effective search string using these Boolean operators would look like this. In many databases, you may notice that multiple search lines are provided, and Boolean operators can be selected from drop-down menus. In this case, enter a core concept and it's like terms on each line. Within a line, the terms are combined with or. The lines are then combined with and. This has the database do what we needed to do, which is to return results that include at least one of these words, one of these words, and one of these words. If you're entering your whole search into a single box, be sure to enclose each set of terms in parentheses to ensure that the database understands your logic and carries out the search correctly. This is called nesting. Another kind of Boolean operator, which is used less often, is not. Not has the database remove results that include a particular word. This can be a quick way to remove a number of irrelevant results from your search, but be careful when using it, as you can also unintentionally lose relevant results this way. Keep in mind that and and not will reduce the number of search results while or will increase them. You now know how to structure an effective search comprising multiple concepts and like terms. In other videos, we'll look at a few other helpful search techniques and tools, such as truncation, phrase searching, subject terms, and search filters.


Hello, it's Bridget. Welcome to Above Life Channel. The purpose here is to inspire your spirit and to fill you with hope. Today's topic is boundaries. If you want to be boundless, limitless in your expression and really be open to the possibilities for your life, one of the starting points here that is mission critical for you is to connect with this concept of boundaries. So when I say boundaries, doesn't it sound tight? Doesn't it sound like some tension is there even in the word itself, bound, like tied up boundaries? Ooh, that's a that's a word that's kind of tricky, isn't it? Yes, it is. So let's take a moment to feel into your physical body. Use your intuition of your body. Your body is extremely intuitive and in tune. So let's listen to it. Feel into your body. And when I say the word boundary, boundaries, where in your body do you notice that or feel it? Just take a moment. You can repeat it to yourself boundary boundaries. Where is that in your body? Oftentimes, this will be an indicator for you as to which part of your chakras or your energy centers of the body that your boundaries are being challenged, hidden or resistant in. So for me, I feel it right away in my heart chakra, right across the front of my chest, almost like a badge of honor and not real proud of that, I'm going to say not feeling real proud of that. But I am aware of it. So I'm going to honor that.  And I want you to do some conscious breathing into that. Oh, I know, you're like, Oh, yeah, whatever, breathing. It's just like normal. Yes. Newsflash. If you're listening to the Sunday morning coffee episode newsflash, intuition, energy, healing, psychicness, it's not complicated. It's basic. It's all natural. And if you don't really get that or understand it, then you there's the problem right there. There's your resistance. Okay, open your mind to actually acknowledge the possibility that this is simple and you can do this. You can do it connect. Feel into that part of your body and use the natural rhythm of your breathing to soften that space, go right into that spot. I'm actually going to physically put my hand on the upper part of my chest, just under my throat. It's kind of under my collarbone. I'm gonna breathe into that area. I'm going to exhale out. When you do this, when you simply draw your awareness, you focus on that area, it allows the energy to expand with your breath, to release, to create room and space so that it is palatable. It is workable. The resistance can lighten up and allow for you to then implement this whole energetic process of boundaries. Okay, boundaries, boundary. I want you to start to connect this concept of boundary with the word bound less. Boundless. Boundaries are boundless. Boundaries will help to create space and room so that you can be boundless, limitless, completely creative in your safe and sacred space. And the way to do that is to allow for yourself to have a boundary. So the imagery of the boundary is going to be a circle. We're going to draw a golden circle on the ground. Yes, a nice yellow circle. Why yellow bridge it because that is connected to the solar plexus. That's your spirit. That's the chakra at the belly. That's also referred to as the sun chakra. It's where intuition is in your body. And so this golden circle is to honor that. So we're gonna just draw a big circle around as well.  So there's a big circle of energy starting from that simple singular point of a golden circle on the earth. So just imagine that.   Use your imagination, which is a very close connection to the third eye. Uh huh. Yeah, how do you think all those visual imagery things can happen? How do you think that's possible? Yeah, that's the mind's eye. Yeah, that's the portal of the third eye chakra. Yeah, that's clairvoyance. Just a startin. So allow yourself to visualize that as you're breathing in and exhaling out, allow this energetic space to be created. We're gonna ask you or healing team, your spiritual helpers aligned with your highest good, the energy of your God source creator of earth of the energy of the universe to support you to encourage you to create this freedom within the boundary that you are provided with this golden circle of light or amplifying this energy as a catalyst. We're using light, the golden light energy of the circle. It is now multi dimensional and it can express you can be free. You can be safe. You can be as creative as you choose to be within this sacred space. And by the way, you then can choose a point where you can pass through where others can come in a doorway where you can choose who comes into your space and when and you can choose when you exit your space and when the truth of the matter is wherever you go, there you are.  It's not about keeping others out. It's not about controlling energy. It's about recognizing the energy that you're choosing to have closest to you. Be generous with this safe and sacred space for yourself. Allow yourself some freedom. You've got to have some room to create, to be innovative, to experiment, to feel into and allow your emotions to be free in this space and to include your thoughts and allow yourself to really, really work on your behalf for your greatest good, your highest good in this lifetime and beyond. All right, so boundaries energetically, this is what it means. This is what it is in simplest form. And you can talk to your blue in your face about boundaries and you can journal about it. But I want you to connect the words boundaries and boundless together.  Again, it's not because you need protection and you're afraid. It's because you have so much power that you need a room and a space to create and express that for yourself, you as the audience, you in intimate sacred space. So the next step here then when you're thinking about boundaries is I want you to use your brain, let's use your mind and get out that journal and write what does boundaries mean to you? What does this concept of boundaries mean to you? What does it mean? Define it. Then I want you to do the same thing with boundless. What does that mean to you? When I say the word boundless, what does it mean to you? With both of these questions, you are going to get likely sensory responses. So I want you to include the sensory responses as well. And if you don't get a sensory response, what that would be, you can probe that, you can dig deeper for that. You can ask yourself, how does how does this feel to me? What does boundaries feel like? What does boundless feel like? What color would this be? If it's going to be a color, what color would it be? And why would it be that color? What does that color evoke from me? What does it bring up for me? When I have this connection to the word boundaries, what is the relationship for me that comes up? It could be a relationship with another person. It could be a specific experience or circumstance you've already had in your life. It could be something you're afraid to experience or have in your life. What is the specific circumstance or relationship that you have to boundaries? What is the relationship or the circumstance that you have connected to bound less? I want you to take these things and journal about them, explore them, go deeper. The idea is to create movement, to create flow space so that then you can be aware of the energy that's around you, encompassing you and enfolding you. Therefore, when you create that golden circle of light that then becomes multi dimensional around you, you can be doing it with a consciousness and awareness of what is best for you, what you want versus what you don't want. Instead of creating more of the past, focusing more on what you would like to connect to. In order to do that, we've got to clear some of that and be aware of some of the old patterns. It doesn't have to fix everything. You don't have to step into the sacred pristine space pure. You come as you are absolutely and you can do this sacred work in this space with boundaries and boundless and you can do it inside of this space that you have created for yourself in collaboration with your spiritual helpers and your supportive healing team. Alright, so I hope that with this episode of Sunday morning coffee, I've got you kind of interested in this concept of boundaries and boundless. I know we haven't gone real in depth, real intellectual, but we've got gone kind of spiritual gone into some of the energetic, energetics of it. So trying to overthink it just feel this feel your way into this space. It's extremely important as we're moving forward this concept of boundaries has come in time and time again in my last sessions in the last two weeks. It has come in for me personally with the new full moon energy here. It is very much in my awareness as we step into another season and we're going to have spring equinox here where I live in the Western Hemisphere. And we've got this did I just say Western Hemisphere where we're where I live the energy of the springtime is coming it's approaching quickly and it's really important that as we move into the spring and summer months that we have some sense of boundaries as we redefine relationships we start to begin to foster new goals. We have new dreams and desires around relationships because life has dramatically changed. And we want to take full advantage of this opportunity the boundlessness of the opportunities. We're rewriting rules were recreating things we don't have to go back to the old ways we can start new patterns, create new ways of being in relationship. And in order to do that we've got to understand boundaries. We've got to have a new relationship with boundaries in and of itself that is much more generous and expansive and intimate for you as an individual spirit for you as a heartfelt person for you as an empath, a feeler, a sensor and for you as a person a human being. Alright, so this is Bridget. Thanks so much for listening. I look forward to connecting with you at above life channel on YouTube at my fairy grasshopper YouTube channel as well. Bridget inspired on Facebook and Bridget inspired on Instagram. I hope that this episode this podcast has inspired your spirit and filled you with hope. The purpose is always encouragement for your best life. It's your life after all it truly is. So live it. Just live it. Thanks for listening.


solo per registrazione, quindi potete anche passare con l'olio di decola l'olio e su? dai, questa è guarda, metti questo qui, perché se non si si mette a muoverci poi che... Cioè, sì, ce n'abbiamo un'ambulanza, proprio non so perché il video non è dell'audio... il video dici... l'audio la si... cioè, l'audio la sta funzionando un maggio di sé, adesso stanno vedendo... vado a vedere la controlla e di là si vediamo lo che... Badoom, grazie, grazie molto non è ok, potete mi sentire? non è bene quindi, io lo so... sai le regole, ma io lo do sbagliate quindi... oggi ci sarà una lectura un po' differente dall'ultima volta proviamo a spendere un po' di tempo e a capire cosa la studia di rinforzamento è di quanto può essere interessante proviamo a capire il senso di come funziona e quindi facciamo una questione generale quindi il formato di oggi è abbastanza peculiarmente è molto interruttivo quindi è un esperimento perché ho fatto queste cose in diversi contexti con diversi audience vediamo come va da avanti per farvi pagare a 100% con le matematiche e tutte le cose che devi fare ma per oggi potremmo avere un'interazione e una discussione ok? quindi... proviamo a guardare un short clip ok? mi chiedo di pagare attenzione per questo clip e poi vediamo c'è una cosa molto sorpreta non mi è inserita pensavo che non è una misura non mi pare non mi pare non mi pare non mi pare non mi pare non mi pare non mi pare non mi pare Pettite riuschi 分 c'è un'altra faccia Di enforzioni Jagger you le visite recenti e usate dalla natura, che è un papero che è avuto per print in ottobre 2017. Quindi io voglio attraverso il tuo attenzione su un paio di sentici. Io li vedo per te perché è probabilmente che il font è troppo piccolo. Quindi questo è un programma di intelligenza artificiale chiamato AlphaGo Zero, che ha mostrato il game of go senza alcuna data umana o guide. E poi voglio riuscire a leggere questo paio di sentici per te. Come fa AlphaGo Zero? C'era raffreddito un'automagnetone improvement in molti dei numeri di renna rispetto alla formazione AlphaGo, che ha defeatato Lisadol. Quindi è un game di 5 milioni di traini, piuttosto di 20 milioni, 3 giorni di traini verso 7 mesi, e una macinata per solo con 4 uniti di trasmettia tensore, piuttosto di multa macchinata etc. La nuova versione AlphaGo Zero, senza alcun guide umano di data umano, ha attaccato il versione former 100 al 0. Ok, quindi chi ha un'idea, un'idea generala, che questa погa veniva e che questa pappera è stata? Prendetele da voi. Ok, molto bene. Ora avete un gruppo in piccoli gruppi, diciamo 5 o 6 persone. Facciate attraverso che in ogni persone there is at least one person who has raised the hand now, who elect as a facilitator for the following session. So once you form this group, so please move, make a mess around, change places, switch places. La purpose of these small groups is to confront each other and ask questions. So the outcome, the output of this short 5 minute session will be asking questions. So what do I know, what do I think I've seen, what I didn't understand, what are the challenges, why this thing is relevant, questions. You don't have to come up with knowledge or answer. If you have some knowledge you can help facilitating the discussion but you have to come up with questions. Ok? 5 minutes from now. I will move through. Are you organized? No, no, no, you have to organize yourself. We don't know anything. That's the point. So you don't, nobody, nobody. Matteo. No, c'è sono due o tre in fila. Poi quando sono finiti, sta con la, sta con il microfono. Loro non hanno nessuna idea, poi guidare la discussione.  Is there, is there any group, so question? Question, excuse me, you have attention a second? Excuse me, so are all your groups set, is there any group who is lost in space without any guidance? You are? Good. You're alone. Ok, please form a group over there, I will provide a facilitator for you. No, no, I am. You are a facilitator and then gather someone else over there. Please, please, your attention. Ok, so don't, if you, so if you have joined some other group, don't disperse because you will be asked again to gather in the same group as before, right? So try to find your chairs, move around, try to organize yourself in order not to be shuttling for all time back and forth. Now we will go through all the groups asking for input or feedback from you. So let's start from, there was a group here. There's one spoke person per group, of course the others are free to add more information. So sorry, just a second. I'm asking a technician if you can have a microphone so you can be recorded as well. Can we have a microphone please or I just use my one. I know this one, I'm sure it's one. Is it? Keep disperse? Ok, now it's working. Ok, could you please? Ok, so from what we understand, this is different and more exciting than a computer learning how to play chess. Computers knew how to play chess for a long time now, but chess is different from go how. Chess is, I guess by understanding some kind of deterministic game, you have a set of initial conditions, some moves that you have no choice but to play, and by following those rules you can get to your final desired outcome, that is to say getting checkmate or stalemate or whatever. I think those are only two options for winning. And a computer used to be able to learn how to do that by just repeating, repeating, repeating, practice, practice, practice, learning all of the possible outcomes and then just playing them. It couldn't do that with go, now I've never played go, I've just learned apparently the rules of go, that in some way it is more of a kind of Markovian game. Does that seem correct to people who know about go? Ok, so yeah, and the whole point of playing go is that you can create some kind of bridge from one side to another by placing your color wherever you want and being able to connect the dots in whatever pattern for the end and that's the condition for winning. Ok, so does all this description make sense to all of you or was sort of lost in space again still? It's about, let's go back on that simpler thing. So it's about one computer program that is able to play a difficult game. Ok, so that's the baseline of the discussion. And it's able to do that at such a level that it's largely outperforming humans in this task, especially in this second generation. Ok, so anyone from your group wants to add something, some command? No, so please pass on the microphone to the next group. Yeah, the thing we observed that this computer learned without any human data. I mean it excel in something far to the humans without any input from humans. Ok, so this is already an interesting point of difference. In the first version of this program, AlphaGo, which was the one who defeated Lee Settle, which was champion in this game, this was heavily trained with examples. So just the computer was receiving many, many, many go matches and then looking at this example is sort of based its knowledge. In the second generation is AlphaGo Zero, the recent one. There is no such input. The computer is just given the rules of the game, so it doesn't perform moves which are not allowed. All the rest is just self-teaching. What does that mean? Can you speak up? Self-play, ok, self-play. Self-play repeated games starting from very low level and then going up all the way. You see, it took only a few days to go up to a level where it mastered an enormous ability. Ok, next group? Yeah, the questions that came to mind were precisely what data the machine uses to learn how to play, because there's an exponential number of moves so there's no way of learning all possible moves. And as regards the reinforcement, the only reinforcement is when or lose at the end of the match. That's very good. This is already pointing to some key issues that we will look into in great detail so there are two big problems arising here. The first one is how to represent the chess board. So what does the algorithm see? It cannot just have a list, a table of all possible configurations. They are way too many. They are ready too many for chess. It's a standard large number of configurations that you have. So it doesn't work that way and that's the first problem. And the second problem is it's difficult to build upon this process of self-play because the outcome actually comes only at the end, when you win or you lose. So the signal that tells you you've been doing better or good comes only after the end of a very long process which requires, as all of you play a game, requires planning, requires forecasting. How does it really do this? These are good questions. Please pass on the microphone. Who has the microphone? Oh, please. Let's just ask a question then you will move to the other way. Ok, so in our group we said also the same things. That ok, without rules, just with a process of self-learning the program was able to teach himself to play go and beat any machine or human in the same field. So with the rules of machine learning. So the question is actually yes, how can be devised an algorithm which is able to create and gather data from itself and then build them without any influence of the external world into a winning algorithm. Ok, so that's basically a slightly arranged version of the same question. So how can these things actually be done? So that will be the purpose of this two-week course. Understand the basic, not the nitty-gritty details of how to type this hard, but understand the ideas that lie behind e that allow this progress to be made. Please move the microphone on top. Thank you. Is it possible to extract this learning from the machine or it's like hidden in a set of neurons and so on and is there any symmetry or let's say different scales in the go game? So the question is if I can summarize it correctly if I think it wrong. Do we understand how the machine thinks? Yeah, is it possible? It's possible for us to decode what it's doing. Because then for physics it could be something... Ok, so I can provide an answer in very rough terms to a degree. We don't understand in full what the machine is doing. Much of the process by which decisions are made is obscure to us. Also because it takes place in some abstract space which we don't have the intuition to understand. But this could be much told for many of the actions that humans make. It's very difficult to understand why you came to certain decision. It's a complex thing here. Really sometimes we don't understand the language that the machine is using. And this is a problem potentially. So there are projects, ongoing projects about what is called transparent AI development. So development of artificial intelligence which is understandable by humans. And it's an interesting issue. A little bit more on the futuristic side. So building up safe artificial intelligence one that we can understand dialogue without having machines that are just big black boxes which do things that are not really understandable to us. To a degree we can do it, not all of it. That's a provisional answer. As what regards the question, do we understand what they do and can we decode it? I would just attract your attention by playing back this initial part of the movie. In light of this question, this was a meeting between go players and machines. Let me say that the machine has transformed the way humans play. The machine now is teaching something to humans. It shows that some things that happen in the machine are cool. That's a very surprising move. That was a mistake. So this is a very nice short answer. Let's just play it again to explain the context. So during the game of the first machine up-and-go there were two expert players who were commenting. Looking at chessboard, the moves that machine does and then reproducing them. And look at the expression. So this one is not a world champion but is one of the greatest experts about go in the world. And it looks at this and it's really surprised. And actually what it does, it's not shown in the video, is that he's reproducing the move on the chessboard, here on the magnetic chessboard. It moves this and then looks at this and then puts it back again because it can't believe his own eyes that the AlphaGo had made his move because it was totally surprising. It was a move that no expert player would have played in that context. So the machine is doing something that not only we have a hard time in the coding, but we have intuition why it's doing that. And this is transforming the human play at this level. I just one thing that came to my mind is what do we teach the machine when we say that we have taught, like in the previous version, we taught some set of rules. Rules, we already teach even the second version. But what was the extra information that was there for the first version? For the first version, there are many games which are played. This is very usual for chess. Many, many situations, et cetera. And then we just feed head into the computer. So the computer knows the development of many, many games. Knows who has won in the end, right? So it's a strongly, in a jargon, supervised part of the learning which takes place, which is absent from the second part. But then as someone said there are exponential possibilities of possibilities. We can only teach a finite number of... That's what we were saying before. There's no hope, and these machines don't do that. They create like we don't do. When we play chess or go, we don't just have one configuration and say, okay, from that configuration like compute, I plan, et cetera. You have an overall view, a strategic view, which of course wipes out many, many details and leaves room for many, many errors. But you have a sort of compact, compressed representation of what's happening in the chessboard. We have one. Sometimes we can explain what we see on the chessboard. Sometimes we can't, the machine has another. And we will discuss how to construct this efficient representation of a world which is too large for us to be encompassed into a single table. I just have some questions. The first one is, is any special rule for the corners or not? For the corners. Oh, now you're asking a question about Go. I don't know. I don't know the rules of Go, I admit. Okay, okay. Please, can you tell, do you know how... Sure, sure. Can you pass on the mic? We can answer for you, I hope. Okay, so I used to learn to play Go when I was young. I got amateur photon. And these guys, these professional players, are professional night dons, which is the highest level of Go. So I just want to make a remark of what you were just talking about. So I think one really important thing of Africa brought to us is that you make a lot of moves that was nonsense to us to what I've learned from Go. So the move you just showed to me from a Go player's perspective was okay, it was unexpected, but I can tell what it's doing right there. But a lot of moves made by the later version of Alpha Go, it was just totally nonsense. For example, one of the favorite moves of Alpha Go is called 3-3. When I was learning Go, my teacher told me that that is the worst move you could possibly make in the beginning of the game. That's the favorite move of Alpha Go. So I think like Alpha Go really... I really think that Alpha Go is the single most important events in the history of Go. It's just like it brought so many new things to us. And all the professional players now are studying the moves of Alpha Go and they are trying to, you know, form a completely new understanding about the game. Thank you very much. So there was a technical question you can answer in my place. What was the question again? About the rules of the corner. And some other questions. I don't know I'm able to ask them or not. Are they all about Go? Yes. Ok, so you can address them directly to him. And probably separately because the goal of all this is not to learn about how to play Go. Ok, just to take it as an example I would be failing miserably. But it's about taking this as an outstanding example of what machines can perform at a human level and how they do it, etc. Ok, so you can address directly. Sorry, what's your name? What's your name? Chris. Chris, you can ask Chris all the details. Ok, thank you. Any other questions? Ok. Ah, match your question. You told that in 30 days it was able to beat one champion, right? With 30 days of training. That's what I read. Yes, I already forgot. But 3 days. Ah, 3 days. Ok, so is there a limit for that? I mean if it keeps on training itself is there any limit up to which that machine can learn? It's a hard question. I don't know how to answer. It should provide probably a metric for this. So is it improving? Is it ever improving in what sense? I can't hear you. Is it? The question is you have to provide some metric for this to know whether it still keeps on improving. Like a ranking of a low rating. I see most of us have heard about machine learning but the question is really important for me that AlphaGo Zero is a machine learning platform where it can learn from itself so it played with itself only with the rules given. How? What about learning physics? Can it publish something because it's really important for science that nowadays we have see a lot of phase transitions because of having machine learning but we haven't seen them before. So if we give for example all the rules do it. Can it publish anything? Or can it really learn in the sense that we do everything? Can it learn anything? Or there are some limits on the way that it can learn because if it can publish, if it can learn so, what's the purpose of us here? These are existential questions and of course they are very important I'm not putting them aside. They require an entire different question of discussion. So first of all this is our question about what it means to be to learn for us. Again all these questions first we have to face general questions what is intelligence in general before asking questions about what can artificial intelligence do? So what is intelligence? Is it the ability of just collecting information and coming up with answer? Is something more creative? Is there a gap between what machines can do or it's a continuum? So everybody can have his own opinion at this stage because we don't know, right? So these are all legitimate questions. For the specific point of condensed matter yes these things are already on their way so people are extensively using machine learning in order to classify materials finding materials, exploring so this is something that already exists. On the more general setup it's an interesting question if most of you are interested we can organize another discussion like this on more existential issues or social, no I mean I'm serious this is something I'm very much interested in. So if you are interested just we can find some time later in the week or next week in some afternoon to meet again and discuss like this all together about social, political, legal and ethical and existential issues about artificial intelligence but for now we just keep on more sort of mathematics related part. Any other questions? Concretely how does this algorithm work it's like a neuronal networks or... If I tell you now when the course is over that's exactly what we're gonna do in the next two weeks, okay? Any other questions, comments? Yes please then we'll be on the back after. So about the the surprising moves can we consider them some of them like like a way to deceive opponent or a human? A way to deceive, oh yeah that's interesting yes Might be In fact there is an entire emerging notion of adversarial learning, okay? So might be that it's one thing in a more I don't know for again like I said I'm not a go expert so you should ask Chris for this but it might well be that it's in the benefit of a long range The algorithm reward is doing things that are apparently negative, this is something that happens very often especially when the rewards are very much delayed as we will discuss So here and then there One of the biggest differences between AI and the animals is that using The difference between AI algorithms and animals is usually AI algorithms needs a large amount of training data to learn while animals just need few experiences but here we are dealing with something which trains on self-produced data So can this way of self teaching be an answer to the problem of learning from a small amount of data? First of all I would say that in comparison between AI and animals it's a bit unfair because animals have been around for millions of years for training So it's not training that occurs during development or during their lifetime There's also a lot of training which has been going on through evolution It's a different kind of training, different kind of algorithms but when you compare what animals can do with what machines can do you have to account for that you have to account for what all evolution has provided animals with in order to go for their goals And then on the other side there's a plus to artificial intelligence in that the rate at which experience can be collected is much faster in a virtual environment as compared to the ones that we have to gather in order to do things we have to spend time energy there's not much time that we can allocate for doing tasks and repeating themselves the most obsessed person who plays goal all the time will have to go and eat and pee Right? So we are biologically constrained machines aren't on that side we have some advantages from our millions of years of evolution back machines don't have So I see them more than a opposition I see more as a continuum on a sort of very large dimensional space of abilities and that's my view so everybody is entitled to his own My question is about what we said earlier actually can a machine have the concept of deceive an opponent or in general how can their tactics in a game be related to immense because the notion of deception is a moral notion, right? in the sense that you are freaking her or him into believing something ok? So this is something which concerns ethics and again the question, the larger question is can a machine have an ethical behavior so I could play this move but this move is actually deceiving so I wouldn't play it, I would refrain from doing this or I want to do it because I want to deceive so the notion that you want to do you want to do this because you want to deceive might be available to machines but we don't know I'm not thinking in a moral way I'm thinking more in a tactical way for example when I say deception I mean setting in game traps like make the opponent believe because if you are a player of any game and you know that your opponent is human and thus is fallible you may trick him you may trick him into think that no deception is manipulation is making the opponent think what you want him to think and then exploit this thing like making a trap in chest and waiting for the opponent to fall in it whatever works I'm not sure that so since alpha hero is playing against itself ok? so what it learns from the game it's already shared with the opponent so they always on same footage I'm reluctant to think that it leans on the fact that the other player has some weak points because the same weak points of the other player are his own weak points so this kind of shared information between the two opponents makes it for me more difficult to believe that it's using this strategy deliberately to take advantage of some weak point of the opponent but again I don't know can I I don't know if this is a rather existential question so maybe it's not the right time to ask it but I would like to ask we have seen that these machines are capable of outperform us in tasks which require planning or forecasts or in general logic reasoning I would like to know do we know and if we do what have we done in this direction if these machines are actually capable of doing purely creative processes like drawing a painting composing a music piece or writing actually I think with writing a poem I have seen a but also the painting and also the music ok perfect so the answer the short answer to these questions is yes yes yes so they do this the more interesting question is again when you define creative to define creativity somehow for us humans so if creativity is essentially a combinatorial exercise in which you see many things are different and then you say ok but if I combine this with that then something new emerges so if you feel like and then many scientists think like this way that most of their creativity comes from having vast knowledge and seeing connection between things or seeking this connection if you allow for this definition of creativity then machines can be creative again this is my viewpoint but if you might talk with other people I've been talking with audiences which are very diverse and there were artists and there were senior more senior people and they say no no no creativity is something different something that pops out of nowhere right and then you ask a question it's popping out of nowhere because you just cannot follow the process by which it's been created or it's really something new and I don't know the answer might well be that we do something which is totally really there is a gap substantial gap between doing simple combinatorics and exploring possibilities and combining things and creating something really out of nowhere I don't know how it works my view is that creativity is one form of very smart exploration and ability of connecting things and having large views and is accrued by large knowledge but I might be wrong thank you is the machine aware of who he is playing with sorry can you start over again is the machine aware of the opponent who he is playing with will he know if the opponent has changed because perhaps he could find some weak spots in person if it plays with me he will know I'm a beginner and just try to win very fast there are so many levels to this question so on one level you might ask the question ok is the machine able to detect whether it's playing against a human or against another alpha goes zero so there's also borders on the touring test and all problems so you can decide whether there is a machine or a human on the other end of the line of course very difficult opens up also questions I'm not going to address them all but there's a clear path of references you can look into and there is another question that is the machine building up a model of what the opponent does building a sort of theory of mind of what the opponent is doing I don't know if these algorithms do there is no obstacle to machines doing this we will discuss this how to build models of the environment and use them for improving learning and ability so the answer is again I don't know from a yes or no depending on what kind of generalized you're seeking in your question I'm going to take the last question because we have several other things actually go through ok is the way that the machine learns if I have two alpha goals programs or machines will they play always the same style when they learn from themselves how to play will they play always the same style so can any different styles can be emerged there can be some convergence you can try to avoid this kind of pitfalls of convergence to some specialized behavior which would then be predictable by adding some exploration so there are ways of it's good if you converge to something because you want to converge to something that plays well or best but you also don't know what best is really best so you want to also allow for experimentation so this way of balancing the things of getting all your knowledge into something that you are able to play well and also allowing room for other experiences and changing and being unpredictable which is very important in learning and we will discuss I hope this answers the question very very last question pass on the microphone because they were being recorded so for two same party is the outcome the same I mean given an initial configuration or first so yeah may I just especially in presence of incomplete information which is the general setup in which you don't have perfect control of all configurations of your game or task it often turns out that the best policy is not deterministic so there will be inherent randomness in what you do ok just based on the fact that your knowledge is incomplete so I think this answers the question ok thank you very much very very interesting and helpful if you have further questions and want to discuss first among you that's the purpose of the whole thing and then eventually with me of course very happy to follow up now we see another sequence of videos from a different realm and we go through the same exercise again right we see the videos we gather together then in 5 minutes discussion and of course many of the themes we already been discuss so we have just to discuss what is difference with what we seen previously ok without the new questions that emerge and what kind of curiosities arise from you seeing this and this is the next one there's another small clip again from Boston Dynamics so again gathering groups as before 5 minutes for discussion coming up with questions ok ok ok ok ok ok ok ok ok ok ok Ok ok ok Ok ok ok ok ok Okay, so yeah, um, two words really come into mind when I saw that. Just a sec, just a sec, please. Those two words being mass unemployment. Well, I don't think so, but that's a subject for the other meeting, right? Sure. Yeah, so let's address it just for a sec. I mean so, mass unemployment, where does everybody come from? So the combination of, say, the learning techniques that we saw before with the hardware, you know, how possible could that be, where could that take us? Yeah, so that's a concern, that's a real concern. It's, in the, you can keep your hands down, we'll just move around in a second. So that's a real concern, how this will impact our societal structure, the work will be transformed or erased. Okay, there are many, many interesting issues, nobody knows the answer yet. There are many, many suggestions in how to proceed, so there's a certain something that's very important. Very interesting, very timely to discuss especially for your generation, right? So, again, if we want to meet some other time and discuss all these issues, I would be more than happy to learn from you how do you feel about that, especially. And then I can tell you what your professor thinks about it, okay? Any other comments specific to this? Is that, what's the difference between what we've seen before? So, I would say that what we saw just now is almost less surprising, right? I don't know, am I the only one who feels this way? Yeah? Okay, let's have a poll. Who's surprised from what they've seen? Surprise, okay, let's remove the sort of emotional part for the moment. Let's just think about surprise all, like measure the in-bits, okay? Who was surprised by what they've seen? So, you are surprised or unsurprised depending on whether they live deep learning or not? Just one at the time, sorry, I can't hear you. Can you pass on the microphone? I don't know nothing about this, but it depends on which way the rules are given to the robots. But the question is another, why are you surprised? Yeah, and that depends if I'm surprised or not. If you took them, you have to keep your center of mass in the middle and do everything we do to move. Is that the way you walk? No, I don't know. Is that the way you walk on snow? But, okay, I have to keep my body mass balanced. That's exactly the kind of thing that people have been doing for 60 years now, because these robots, working robots have been around for 60 years, and in the last 59 years, they've been failing miserably because they tried to control every step.  You're falling in the least controlled way. Okay? So people now, they're putting a lot of research into least controlled algorithms in order to achieve tasks which are such natural to us, such as walking down a slope, et cetera. Okay? So it is surprising or not surprising depending on whether you've seen a clip of this kind of robots walking on snow six months ago and basically rolling all over the way hundreds of times. Okay? But I'm taking your answer for what it is. Your degree of surprise depends on how this thing is done. That's what you're saying. Okay? Okay, I want to ask about the algorithm and how it is doing it because first we saw AlphaGo learning how to play Go. But in this case, these machines are learning how to move. Oh, it's only in the hardware. Like the hardware tries to be the most efficient in order to move. Okay. So this points to one big difference between what we've seen before and what we have seen later is that these are physical machines.  Okay? So they have actuators. There's a lot of engineering in how to build feet or something avoiding to slide or a handle, right? There's a lot of technology if you wish in creating a physical interface between the machine and the world, right? Whereas the first, the other case was totally abstract. Just an algorithm proposing moves. The only way it interacted with the environment was just by sending out bits. Whereas here there is a physical interaction with the environment and it's environment which is wildly more variable than the environment of another Go opponent. Okay? At least we'll never stand up and start punching in the face of the machine, okay? Whereas this can happen in the real world when you interact physically with an opponent, like in this case, the environment is a start. Think about stepping on the snow. You don't know.  Everybody, I would think, sorry. I'm talking as a westerner, sorry. Most of you might have experienced what it is to walk in the snow down a slope, okay? If you haven't, you might have other experiences of how it is to walk in very unpredictable situations. Right? Which might be different for snow. Sorry for this horrible whitewashing of the problem. Okay. So, yeah. There was a lot of training induced by... It's not by crafting examples, right? Because, as you've seen, they have been opposing to this in very different ways which are not intuitively predictable by the robot. It's just that it's been sent to the ground, abused many, many times. And it takes a lot of time. Because, again, if when you have a physical interface rather than an algorithmic interface, like we said before, like animals, you have to recapitulate the ability of standing up from the ground in a short lap time which might be months or years of what has been the result of a long evolution. Okay? Now, I have a question related to this characteristic, to be physical. In the AlphaGo Zero, you can... Oh, I mean, this is reinforcement learning too. This is not supervised, right? No. For the robots, it's more complicated than this. There has been initialized supervision because, again... It's not just that they put the robot in an arena and then kill themselves until they are able to stand up and move. So, it's different because you don't have the time allowance for this. The last part is, again, largely important. Yeah, because you cannot train them digitally. And then you cannot train them only digitally simulating an environment because you cannot reproduce the complexity. So, is it a fact that the time you need to train these actual physical machines are... Yeah, is it an issue? The fact that the physical machines need to move actually in the... In one minute, you cannot do a million of trials. Yeah, of course. Clearly, their ability to generalize... These machines are very good at generalizing, in general. Starting from a relatively small subset of experiences to extrapolating how to do it in new... That's key secret, right? When you're able to do this, you do well at least to survive. But there are limits to this, right? No, wouldn't be able to drive a robot and the robot wouldn't be able to play go at no level, right? But probably a lot of difficulty in moving the pieces on the chess board without just fumbling everything around. So, still we are talking about artificial intelligence system which do very well on a relatively narrow task. No, I mean, the question was even in the narrow task that just needs to be reproduced digitally. You can... I mean, in three days that AlphaGo Zero can reach the top level. I don't know the figures, but perhaps Matteo knows. We are trying to recreate these digital environments which they can try to let the robot learn and then transfer what they learn in the computer in the software inside the physical robot. But this is very, very difficult and I think it just... I'm not an expert, of course, but it's just at the beginning. Yeah, this is also one way virtual reality using virtual reality to boost the ability of learning. And another thing that was very important, I don't have an example, but it's also very important in development of AI, it's video gaming, okay? So that's all branch of research I've defined which extensively teaches or allows artificial intelligence systems to play video games, which have a variety of experiences which starts to be comparable to human experience. Even though in that case there is no physical interface, so there's again this added layer of engineering which is also very important. I think that to exist. I think that in the case of the robots what we saw was that nobody can stop them. Yes, and they continue to reach the goal. Yes. In the first case, in the case of the goal, the machine can may lose, so robots can do much better, yeah? Yeah. Yeah, so that's very important. If a machine learns well, well, determination is something that doesn't lack, right? So it's very important to shape the objectives of machines especially when they interact with us. As long as it's a computer, you might always think about taking the switch off, which is not easy in general, okay? Because they might learn when you are wanting to do this and prevent this, okay? But see, this is some sort of open questions in AI, how to make interruptible machines or their way of designing algorithms which are always interruptible.  And this was one side of the thing and then the other side is exactly. The problem of correct alignment of goals, objectives, you have to specify clearly your objectives. You have to think about artificial intelligence machine, robots, next generation, not the ones that we have now, such as the genie, the genie of the tails, right? You have three desires. Then you know you have to be very careful in asking because you will get for what you ask. You know you will not get what you thought you'd be getting, okay? So in artificial intelligence it's very important shaping right rewards, correct rewards which reflect your knowledge. There are many interesting discussions in philosophy. So for instance, if you say I want to build a machine that, this is a classic example now in artificial intelligence, which builds paper clips, okay? So the objects that you use to click paper. And this machine, you just told, build the best producer of paper clips. And then you can imagine a runaway scenario in which these machines just starts confiscating all the metal from the world and building paper. And everybody will be submerged of paper clips, okay? There will be nobody else being able to build a tractor to work in the fields or cell phones, etc., because the machine is taking over. What's lacking for this machine? Common sense. And you say, okay, listen, I said, good. Very good, excellent. So as much as I can get a nice house and big building and I'm gonna be rich out of paper clips, but I didn't mean that. But that's what you asked for, okay? So this is very important in shaping objectives. Just a remark, the most sophisticated robots are performing their task according to coordinates. But humans evolved another way to perform their task. I don't know the specific way, but it's not a light on coordinates. So what I wanted to say is despite performing the same tasks, they are seeing the words differently. Yeah, that's very good. So this is another aspect, okay, which is very important, and we will discuss them talking from tomorrow. So any agent which works in the physical world, okay, it's also true for algorithms in general, but it's less obvious, but for robots it's more clear. There are two interfaces with the word. One is the actuator, okay, in how the agent does things in the word. The way that legs are built, if it's four legs, two legs, if it has a sort of way to handle things, if it's a hand or something different, this is the actuator part. But there's another part which is equally important, the sensor part. All these robots have cameras, self-driving cars have lasers. So this is the sensor part. This is an interface which receives information from the environment. And the actuator part, after processing of this, whatever that does between, brain, algorithm, whatever, then produces outcomes which are actions which impact on the world, do things. So it's equally important to have very good sensing in a way that might be peculiar to machine, different from humans, like you said, and having actuating, which might be, again, similar to what humans do. So humans and animals might be a source of inspiration, but we don't have to just keep our eyes shut. You see, the machine that was opening the door, robot opening the door, did not have a hand. That's something, a different clamp, which was very well-served in the purpose. But perhaps if it was to order two beers, that would be different, right? Okay, more difficult. The actual design of robot is right now subjected to what is a human sea of the world. We build a handle, we build having in mind maybe animal limitations of nature, a stuff like that, but what I'm thinking is couldn't be devised an algorithm for self-evolution. What I mean is, for example, a machine can, in its lifespan, can learn what is its environment, and then it could be allowed to better select the components for the next generation of machines. And so, in a certain sense, how to improve itself is like artificial selection. This is itself. Again, there are so many layers in this question that it's difficult to unravel them all. So, this idea of self-constructing machines dates back to von Neumann to the 40s. This is something that's been around. More than self-constructing, self-projecting. And then they also construct themselves, right? Or they send a project to a firm somewhere. Let me have this. Amazon, please ship me this. So, all these things have been around. And, actually, you can think about exploring. The problem with evolution is that it's slow. The big difference between all the things, all the behavior that you will see here, okay, could be achieved by a very different way of learning, which is just evolution and genetic algorithms. These are entirely different class. Because there you just do things and posteriorly evaluate.  Here, the algorithm's reinforcement learning has a totally different point of view. You experience, you improve, you have a goal, right? So, if you have some biology class, you always say, remember, evolution is not directed towards a goal. It's just variation and selection, variation and selection, okay? So, this is very different in spirit. So, in principle, it could work. On computer, it could do something. Perhaps, depending on computer power, one way of learning might be better than other, but we don't discuss this kind of selection evolution scenario, okay? I hope this is clear. If not, I can expand further. Any other comment? Hello. So, when you started those clips, and I thought the problem is about sensing and sensing the changes in the environment and re-adjusting your decisions accordingly, but you said in the first statement that it's not that. It's not adjusting your center of mass or something like that. It's more giving less control to your things. Can you explain that? Yeah, let me explain this. Let's not think about robots. Let's think about ourselves. So, who can ride a bike? So, when you learn how to ride a bike, do you exert some specific control? Do you obey some certain set of rules? Or just at some point you find a sweet spot and you're able to ride? We try not to fall. You try not to fall, right? So, that's certainly a punishment that comes in the end. But when you've fallen down, do you really know? Can you trace back what kind of actions you did that were good or not? And you said, okay, I should adjust my center of mass in that way when I was in that curve. Is that the way you learn? Is that the way to keep ourselves balanced in the center by adjusting our hands? Okay, then we must have a ride together and see how you perform. No, actually, it's very much of a shortcut with that casino brain when you learn to ride a bike.  You don't have time to process information, et cetera. So, what I want to say was more in that sense, is that it's a very complex way these kinds of robots, these new robots, sense the environment, process the information in a way that doesn't rely at all on even simple calculations like Newton's law, right? So, there's no physics knowledge there, such as there's no physics knowledge in every toddler who tries to work for the first time, right? So, it's a very practical and non-intellectual way of... But then what does it try to do? I don't know, it works. Again, I'm going to say like this, like I don't know, actually, what AlphaGo thinks when it plans, where does it want to go with this move? I have no idea. It's not looking into a table and saying, okay, it's playing the famous game between Master X and Master Y, played in 1967 in Shanghai, I don't know. It's not doing like that. It's doing just like... It's a combination of experience, collected in different ways, merged together in a way that we don't know, we don't understand. We don't have the same experience. And the same... These robots, you couldn't possibly decode all the sequence of individual actions because it's a whole. Just a second, so, the microphone moves. But you know we have something which is already called consciousness and unconsciousness. So, when we first learn to drive a car, to look, okay, if it is not automatic, when, for example, changing gear, it is one, then two, then three, for example. So, at first we care about what we are doing, but after a while, then we are learned, for example, we know what we are doing, so we do it unconsciously. I'm not sure if these two terms are still valid in the sense of machine learning or artificial intelligence, but I think his question can be somehow translated in this way that, okay, everything which is happening by machine maybe is different rather than doing us. Maybe there is no difference between consciousness and unconsciousness. Maybe we should rephrase these things and maybe we change our minds about how human we learn. Yeah, so again, these are very deep questions. I think that the line is very blurred between conscious and unconscious, machine, human, animal, but again, that's my own opinion which is just as worth as yours, okay? So, but these are definitely, I think, very, very interesting questions in general beside the fact that we are uniting here to learn how these algorithms do and what they have to do with statistical physics or et cetera, okay? Any other comment or question? Okay, if not, we go to the final clip which, again, this one is a bit longer. So, the goal of this clip is actually two-fold so I'm anticipating a little bit. First, we move away from machines. We also move back in time, so this was 70 years ago because this is the aim to show that even if these things are very recent, very new, et cetera, the ideas have been there for roughly a century, okay? And this is very useful and interesting because you have to have a historical perspective of things of old. And it will also allow us to understand better at least a very qualitative level, the level of conversation. What's the relationship between what we do in artificial intelligence now and what we have learned about animal behavior over the years and the two things talk to each other very much. So, this is the clip. Notice that it's Institute of Human Relations and these are two humans. I cannot hear the... Sorry, I can't hear the audio. It's gonna be long without the audio. From the booth. Do you have any audio coming? Ciao, non sento più audio dal video. Adesso ho fatto ripartire un video, non c'è più audio. Puoi controllare. Ah, we're trying to fix this in a second. Ah, probably that's... I know that. What do you think is the reason for the difference in their behavior? The animal on the left is hungry. The one on the right with the food in his cage is satiated. This is hungry, this is satiated. How will the difference in drive affect their... the difference in learning? We're going to use an apparatus with two identical compartments. One for the animal that is very hungry and another for the animal that is not hungry. Very hungry on the left, not hungry, satiated on the right. At the outside end of each compartment is a food delivery apparatus. This consists of a stirrup-shaped bar placed above a food dish. Pressing the bar delivers a small pellet of food into the dish immediately below. Ok? Press the bar then a small pellet of food falls into the small container. Then they take the mice and put them into their respective... We will now put the hungry and the satiated animals into the apparatus and watch for differences in learning. After being put in an unfamiliar environment both animals are active. But the hungry animal is somewhat more active. They don't know the place first time that they visit this cage. So they look around. The very hungry one is more active than the not hungry one by some measure. Ok? If you become more active. The hungry animal remains active. But as the satiated one becomes adapted to the new environment he settles down and becomes inactive. So there's no problem around. My belly is filled. Take a nap. Watch the wide variety of responses which the hungry animal makes. This is a lot of smelling and sniffing so when rats out like this they smell a lot. Mice or rat I don't actually know. So all these behavior experiments started in the 20s with work of skinners. Since each of these responses occurs without reward it is soon displaced by a new response. The behavior is variable. There's still a lot of exploration and sniffing and looking around. Apparently no food here. What responses do you think the other rat is making? The satiated rat is inactive. But even if he had hit the bar and got a pellet food would not be a reward without the drive of hunger. The hungry rat is active. He stands up near the bar but just misses it. The correct response of pressing the bar cannot be rewarded and learned until it occurs. He approaches the food device stands up near the bar presses it but since he does not see the pellet and the food cup he is not rewarded. Now he finds the pellet and is rewarded for approaching the food cup. From now on he confines more of his activity for the region of the food dish. The next interesting step just a second to clarify this. So it went up and pressed on the bar so the pellet fell but he didn't see the pellet in the box so he just moved away so there was no association between the action of pressing and the reward coming from the box. But later on he just got to the box and said oh there's food there. So in that case there was reinforcement for staying around that area but not yet for performing the correct action. Ok? We've seen this. Is it? No, it's ok. At last he hits the bar and gets an immediate reward. Has he learned will it take him as long to press the bar the next time? Although the animal still makes different responses he presses the bar much sooner the second time. The occurrence of a single reward has strengthened the tendency to make the response of pressing the bar. Notice that the rat performs the second. So the first time that he does this he makes this association. Again this is something which is peculiar to animals. Machine wouldn't learn so fast on first try. Ok? Animals, babies often displayed this single shot learning which is probably a combination of genetic abilities inherited abilities and learning. Right? So this is something that pure learning from scratch in machines doesn't happen. You have to repeat these things many, many times before establishing the association. Ok? Exactly the same response which was rewarded. Is there room for improvement? In the next trial you will see that coming up to the bar from a slightly different angle the rat makes a new response. He goes around the side of the stirrup instead of down through it. So by chance it discovers that going by the other side you can have the same thing. He still makes a few irrelevant responses. Watch him go around the side of the bar again. This response gradually wins out because it is rewarded the fastest and with the least effort. But that's true in general. If there's habituation there will become less and less interesting there's less motivation. There are two things, motivation and reward. On the next trial you'll see that the animal starts down to the food dish before he has pressed the bar hard enough to tell it. He makes several anticipatory errors which are not rewarded and regresses to his old response of diving through the stirrup. He's been pressing a couple of times but it was not just hard enough so he goes oh it doesn't work. These anticipatory errors occur for a number of trials and then are gradually eliminated. It eliminates this part because the reward was partially diluted by the fact that he had to choke himself through the ring. Ok, then the movie goes on and shows another experiment which by no means would be possible nowadays. So you might find this a little bit disturbing. So this is an experiment with punishment. Essentially there's an electric grid and there's a voltage applied. In this device we can put a mild electric shock on the grid on which the rat stands. The shock is adjusted to be annoying but not painful. Ok, so they're going to put an electric wiring at the bottom of the cage and they say we're going to modulate the voltage so that it's just annoying and not harming. So that's the experimenter that says that of course. The rat which doesn't seem to be simply annoyed and the idea is that if they press the bar now this will stop the current from flowing into the wiring so it will stop the bad sensation. It will interrupt the punishment. Shock is on, shock is off. Pressing the stirrup bar turns off the shock. You will see that it supplies enough drive to produce a radical change in the behavior of the satiated rat. He hits the bar, the shock goes off and he's rewarded. It's clean to that for his life. He hits the bar and is rewarded again. Even a satiated rat it is provided a stimulus which elicits motivation. After a few more trials he is learned to press the bar quickly as soon as the shock goes on. Ok, fine. Good enough for our sadistic show. Last session 3 minutes discussion What do you think about it? What's the connection with the other things? Does it have anything to do? Ok, I gave you some background already. 3 minutes, it's very short.