From around the globe, it's theCUBE with coverage of KubeCon and CloudNativeCon Europe 2021 virtual. Brought to you by Red Hat, the CloudNative Computing Foundation and ecosystem partners. Hello, welcome back to theCUBE's coverage of KubeCon 21, CloudNativeCon 21 virtual. I'm John Furrier, host of theCUBE. We're here with a great gas to break down one of the hottest trends going on in the industry and certainly around CloudNative as this new modern architecture is evolving so fast. Richard Hartman, director of community at Grafana Labs, we're involved with Prometheus as well. Expert and fun to have on and also is going to share a lot here. Richard, thanks for coming on, appreciate it. Thanks for having me. Yeah, we were chatting before we came on camera about the human's ability to handle all this new shift and the future of observability is what everyone has been talking about. But you know, some say, no, observability is just network management was just different scale. Okay, I can buy that, but it's got a lot more than that. It involves data, involves a new architecture, new levels of scale that CloudNative has brought to the table that everyone is agreeing on. It scales there, new capabilities, thus setting up new architectures, new expectations and new experiences are all happening. Take us through the future of observability. Yeah, so one of the things which many people find when they onboard themselves onto the CloudNative space is you can scale along different and new axis which you couldn't scale along before, which is great. Of course, it enables growth. It enables different operating models. It enables you to choose different or more modern engineering trade-offs. Like the underlying problems are still the same, but you just slice and dice your problems and compartmentalize your services differently. But the problem is it becomes more spread out and the more classic tooling tends to be built for those more classic setups and architectures. As your architecture becomes more malleable and as you can choose and pick how to grow it along with which axis a lot more directly and you have to, that limits the ability of the humans actually operating that system to understand what is truly going on. Obviously, everyone is fully all in on AI, ML and all those things, but one of the dirty secrets is you will keep needing domain-specific experts who know what they're doing and what that thing should look like, what should be working, how it should be working. But enable those people to actually understand the current state of the system and compare it as to the desired state of the system is highly non-trivial. In particular, once you have not machine lifetimes of month for years, which you had before, which came down to sometimes hours and when you go to serverless and such, sometimes even into sub seconds. So a lot of this is about enabling this higher volume of data, this higher scale of data, this higher cardinality of what you actually attach as metadata on your data and then still be able to query all this and make sense of it at scale and at speed. Because if you just toss it into a data lake and do batch analysis like half a day later, no one cares about it anymore. It needs to be life. It needs, or at least the largest part of it needs to be life. You need to be able to alert right now if something is imminently customer facing. Well, that's awesome. I mean, I totally agree this new observability. Horizontally scalable, more surface area, more axes, as you point out, changes the data equation. Obviously automation plays a big role in machine learning and AI, great grounds for that. I got to ask you just before we move on to the next topic around this is that the most people that come from the old world with the tooling and come from that old school vendor mentality or old school architecture tend to kind of throw stones at the future and say, well, the economics are all wrong and the performance metrics. So I want to ask you, so assume that we believe, we do believe you because assume that's going to happen. What is the economic picture? What's the impact that people are missing? When you look at the benefits of what this system is going to enable, the impact specifically whether it's economics, productivity, efficient code, what are some of the things that maybe the VCs or other people on the naysayer side, old school will throw stones at? What's the big upside here? So this will not be true for everyone and there will still be certain situations where it makes sense to choose different sets of trade-offs but most everyone will be moving into the cloud for convenience and speed reasons and then deliberately not saying cost reasons. The reason being usually or in the past you had simply different standard service delineations and all of the pro-serve, the consulting, your hiring pool was all aligned with this old type of service delineation which used to be a physical machine or a service or maybe even a service and you had a hot standby or something if you got like really a few years back. The same things still need to operate underlaying what you do but as we grow as an industry, more and more of this is commoditized and same as we commoditize service and storage and network, we commoditize the actual running of that machine and with serverless and such go even further. So it's not so much about this fundamentally changing how it's built, it's just that a larger or a previously thing which was part of your value at and of what you did in your core is now just off the shelf infrastructure which you just buy as much as you need it. Again, at certain scales and for certain specific use cases this will not be true for the foreseeable future but most everyone will be moving there simply because where they actually add value and the people they can hire for and who are interested in that type of problem just mean that it's a lot more, more sensible to choose this different delineation but it's not cheaper. Yeah, and the commoditization and then this intermediation is definitely happening totally agree and the complexity that's going to be abstracted away with software is Novell and it's also systematic. It's just new and there's some systems involved. So great insight there. I totally agree with you. The disruption is happening majority of almost all areas. So in all verticals and all industries. So great point. I think this is where I think everyone's so excited and some people are paranoid actually frankly but we cover that in depth on theCUBE and other segments but great point. While we get back to what you're, where you're spending your time right now you're spending a lot of time on open metrics. What is that enabling? Take us through that. So the super quick history of Prometheus cause we need that for open metrics. Prometheus was actually created in 2012 and the wire format which he used to and the exposition format which he used to transport metrics into Prometheus is stable since 2014 but there is a large problem here. It carries the Prometheus name and a lot of competing projects and a lot of competing vendors. Of course there are vendors which compete with just the project. Simply refused to take anything in which carried the Prometheus name. Of course this doesn't align with their FUD strategy which they ran back then. So together with CNCF we decided to just have a new different name for just that wire format for the underlying data model for everything which you need to make one complete exposition or a bunch of exposition towards Prometheus. So that's it at the core and that's been ongoing since 2015, 16 something but there's also changes. On the one hand there is a super careful, a super, super careful cleanup and backwards compatible cleanup of a few things which the Prometheus exposition format series year four didn't get right but also we enable new features within this. And as Prometheus chose Open Matrix as its official format we also uplift Prometheus and there in both heads obviously it's easier to get the synchronization. Exemplars stand out which is a completely new at least outside of certain large search companies, Google who use exemplars to do something different with their traces. And it was in 2017 when they told me that for them searching for traces didn't scale by labels and at that point I wanted to have both I wanted to have traces and logs also with the same label set as Prometheus has them but when they tell you searching doesn't scale they tell you you better listen. So the thing is this, you have your index where you store all your data or your value have the reference to interior database and you have these label sets and they are super efficient and quite powerful when compared to more traditional systems but they still carry a cost and that cost becomes non-trivial at scale. So instead of storing the same labels for your metrics and your logs and your traces the idea is to just store an ID for your trace which is super lightweight and it's literally just one ID so your index is super tiny and then you attach this information to your logs, to your metrics and in the meantime also to your logs so you know already that trace has certain properties because historically you have this needle and haystack problem you have endless amounts of traces and you need to figure out what are they useful are they are they do they show an interesting error state high latency some error occurring whatever if that information is already attached to your other signals that's a lot easier because you see your high latency bucket and you see a trace ID which is for that high latency bucket so going into that trace I already know it is a high latency trace for a service which has high latency it has this and that label it was run in this and that context, blah, blah, blah, blah same for logs there is an error there is an exception maybe a security breach what have you and I can jump directly into a trace and I have all this mental context and the most expensive part is the humans so enabling that human to not need to break mental train of thought to just jump directly from all the established state which they already have here in debugging just right into the trace and back and just see why that thing behave that way it's super powerful and it's also a lot cheaper to store this on the back end for your traces which in our case internally we just run at 100% sampling we do not throw data away which means you don't have the super interesting thing and oh, by the way, the trace just doesn't exist there's a good job and that's the one thing to from day one this intent to marry those three pillars more closely the other thing is by having a true lingua franca it gave that concept of Prometheus compatibility on the wire, its own name and its own distinct concept and that is something which a lot of people simply attached to so just by having that name allow the completely different conversation over the last half decade or so and to close that Okay, go ahead, finish, close it up and to close that point of course I come from the networking space and basically IETFRFCs are the currency within the networking space and how you force your vendors to support something which is why I brought open metrics into the ITF to give it an official stamp of approval in the RFC number which is currently hopefully successful so all of a sudden you can slip this into your tender and just tell your vendor X, Y, Z okay, you need to support this and that RFC and all of a sudden by contract they're bound to support Prometheus native So does the IETFRFC support that RFC yet or no, is that still coming? I, so at the last IETFRFC meaning which was virtual obviously I presented everything to the Ops AWG there was very good feedback they want to adopt it as an informational ID reason being it is most or it is a documentation of an already widely existed standard so it gets different bits and pieces in the header currently I'm waiting for a few rounds of feedback on specific wording how to make it more clear and such but it's looking good oh yes, while presenting it they actually told me that they ran the conference with Prometheus and Profano so well that's how you get things done on the old school internet that's the way it was I mean I talk to Vince and all my friends and that's the generation we grew up I'm always telling a story on a clubhouse just random that I grew up in the era we used to pirate software used to steal software back in the old days pre-open source this is how things get done so I got to ask you the impact question the deal with open metrics potentially could disrupt all those startups so how does this impact all these stars because everyone's jockeying for land grabbing the observability space is that just because there's just too many people competing for one spot or do they all have differentiation what happens to all those observability startups that got minted and funded so I think we have to split this into two answers the first one, open metrics and also Prometheus we're trying really hard to standardize what we are doing and to make this reusable as much as we possibly can simply because Prometheus itself does not have any profit motivation or anything it is just a project run by people so we gain by users using our stuff and working in the way which we think is a good way to operate so anyone who just supports all those open standards just on boards themselves onto a huge ecosystem of already installed base and we are talking millions and millions and millions of installations we don't have hard numbers but the millions and millions I am certain of and that's installations not users so that's several orders of magnitude more so that actually enables an ecosystem within which to move as to the second question it is a super hot topic so obviously the VC money starts coming in from outside I don't think that everyone will survive but that is just how it usually is there is a lot of not very differentiated offerings be they software, be they as a service be they distributions where you don't really see much value at not a lot of much anything in ways of innovation so this is more about making it easier to run or taking that pain away which obviously makes you open to attack by all the hyperscalers because they can just do this at a higher scale than you so unless you actually really innovate in that space and actually shape and lead in that space at least to some extent it will probably be relatively hard that being said yeah when you ride the big waves like this I mean you got to be on the right side of this Pat Gelsinger when he was at VM where now he's at Intel told me on theCUBE one time if you don't get it right on these waves you're driftwood right so we've seen this movie before when you start to see the standards bodies like the IETF start to look at standards you start to think there's a broader market opportunity there's a need for some standards which is good it enables more value value creation whether it's out in the open or if it's innovative from a commercialization standpoint these are good things and then you have everyone who's jockeying around from the land grab incomes of standard momentum you got to be on the right side of these things we know what we know it's going to look like if you're not on the right side of a standard then you're proprietary precisely and so that's the end game okay well I really appreciate the impact final question as the world evolves post COVID as cloud native goes mainstream the enterprises in the cloud scale are demanding more things enterprises are they want more stuff than just straight up born in the cloud startups for instance so you start to see faster more agility obviously with deploying modern apps when you start getting into enterprise grade scale you got to start thinking this is an engineering and computer science discipline coming together you got to look at the architecture what's your future vision of how the next gen programmable infrastructure looks like you mean as in actually managed those services or limited to observability observability role observability just you're in the observability speaks to the operating system of what's going on distributed computing you're looking at you got to have a good observability if you want to deploy services so you know as it evolves and this is not a fringe thing anymore this is real deal this observability is a key linchpin in the architecture so maybe to approach this from two sides one of the things which I mean I come from very much non cloud native background one of the things which tends to be overlooked in cloud native is that not everything is greenfield matter of fact legacy is the code word for makes actual money so a lot of brownfield installations which still make money and which will keep making money and all of those exist and they will not go away anytime soon and as soon as you go to industry trying to uplift themselves to industry that form all those buzzwords you get a lot more complexity in just the availability of systems than just the cloud native scale so being able to actually put all of those data types together and not just have your okay nice I have my micro-service and it's fully instrumented and if anything happens on the layer below I'm simply unable to make any effort on debugging things like for example, for me this course they are so widely adopted and able to literally and I did this myself from the diesel gen set of your data center over the network down to the office if someone is in there if your station and your pager is stepped in such to the database to the actual service which is facing your end customers all of those use the same label sets use the same metadata to actually talk about this so all of a sudden I can really drill down into my data not only from me okay I have my micro-service but my database big deal no I can actually go down as deep in my infrastructure as my infrastructure is and this is especially important for anyone who is from the more traditional enterprise because most of them will for the foreseeable future have tons and tons and tons of those installations and the ability to just marry all this data together no matter where it's coming from because you have this lingua franca and you have these widely adopted open standards I think that is one of the main drivers in the future. I think you just nailed the hybrid and surprise use case operation at scale and integration of systems so great job Richard thank you so much for coming on Richard Hartman director of community at Grafana Labs talking observability here on theCUBE I'm John Furrier your host covering KubeCon 21 CognitiveCon 21 virtual thanks for watching


Hello everyone, so let's start First of all, we are quite happy to be here at cubicone. This is our first cubicone. I'm from Yandu Fidencio I work for Intel and in part of the Qatar Containers Architectural Committee and one of the containers of some parts of the confidential containers project I'm Jens Fleiman. I'm an engineering manager at Wethat and I contribute to the Cocoa project mostly on the operator side of things Today we're going to talk a little bit about how you can consume confidential containers in a really easy way We are going to cover What is confidential containers? A very quick introduction to that We're going to talk a little a little bit about Qatar containers and this makes me think who here is familiar with Qatar containers? Raise your hand. Oh That's nice. Cool We are going to explain how we went from Qatar containers to confidential containers We're going to cover a little bit of the different flavors of confidential containers that we have show some music cases and Finish with a short demo. So confidential containers. This is an umbrella project The front door of the project is the operator. We are going to be showing the operator today, but it also The ripple also includes a bunch of other Projects we have a key broker service. We have attestation agent attestation service We have lightweight virtual firmware to start the confidential containers VMs We have rusty libraries for pulling encrypting decrypting images and we also have a place for for different flavors of confidential containers and of course Qatar container is not part of the project officially As in like hosted on the same it have a ripple, but we have a really strong relationship. We've got the containers Confidential containers project has been part of CNCF for one year now a little bit more than that. We are a sandbox project and As you can see we have like a bunch of companies contributing to this right now going through CSPs Silicon vendors software vendors and Some research institutes and we are expecting more. So what is the value proposition of the project? We really want to protect data news like we know how to protect Data in transit. We know how to protect data Storage But our focus here is how to protect data news at pod level This is important. There are projects that are doing this at noble level. We decided to Take a different approach do this at the pot level and we are leveraging these trusted execution environments We really want to simplify how people can use those teas mainly when Focusing on the cloud native across space. We want to enforce security requirements and Transparent deployment of unmodified containers. So this should be just lifting shift We are trying to make this transparent supporting multiple teas, which means that Choose your choose the flavor of the vendor that you want to to play with We would try to support that and of course we want to separate CSPs from gas applications as much as we can So the focus of the project I'm gonna skip this I'm gonna talk a little bit about the cut the containers and I will get back to this quite soon So I saw that a bunch of people here are familiar with cut the containers. That's nice You can see this picture here on the Right inside my right your left. We have traditional containers like those are Isolated via name spaces. We can have sec comp. We can have monetary access control like I said, you know, it's And we have like capabilities right each container running on its own name spaces Which is good, but if there's an attack you end up like on the host Linux kernel because this is shared So what cut the containers when it was started like several years ago? We had the idea to just come up with a micro vm and have Exactly is exactly the same things that you have with traditional containers But with an additional layer isolation layer of the micro vm So it helps to protect one or cloth to another It enhances that protection and it also protects the host Against the amalitions or interested workload So cut the containers How how it actually works like a really quick example You start your engine x pod it will go to the cubilette cubilette. We start the CRI engine CRI engine will then be responsible for starting the Sheen The sheen will create a virtual machine This virtual machine will boot up. We have like special guests That is used for cut the containers. We have this agent embedded there this agent is responsible for the managing the lifetime the life cycle of the containers and We put an image on the whole side. We share this image with the guest using VertiOS and that's pretty much what we have here So that's cut the containers and Let's go and talk a little bit on how to get from cut the containers to confidential containers The first thing here is We want to use these we want to have and take advantage of the encrypted memory by the way, this Slide has an issue if you find the issue talk to me later on. I'm gonna give you a gift but yeah, so with the the confidential containers the first thing we had to do was Take advantage of the tease you start the virtual machine now this Virtual machine is running into this encrypted memory. No one has access to that but that That's like partially good, but this does not ensure that your workload running will be secure or can actually trust Or working in an environment where you don't trust the hardware The next step that we did Was actually changing the image that is pulled to be pulled inside the guest That is a work around kind of work around that we started with this is used that for pure pods We're gonna talk about pure pods later, but this is actually used that for different flavors but this does not scale for CSP so Alibaba and Microsoft have been working on a proposal to make this Better in a way that it can actually scale for the CSPs, but yeah, the container image is protected. So CSP does not have access to that and then the last part is actually Having a way to attest that what you are running is Actually, what you are expecting So we have an attestation agent that will talk to a key broker service and only then start running their workloads We have a nice talk later today after lunch about this talk. So please attend that and we're gonna give links So with this just getting back to that previous slide We've got the containers. We really want to protect one workload from each other We want to protect the host from untrusted workloads with confidential containers We are adding one more barrier there We now do not trust the infrastructure This image summarizes a little bit what I just explained it and this is what I would like you guys to Take away of how we went from cut the containers to confidential containers Yes Yeah, thank you Fabiano. So cut our containers comes in different flavors and We can distinct them by the great of isolation that they provide or what they isolate first one is Process-based isolation that's provided by the enclave CC project. That's using the SGX technology from Intel Then there's a second one VM based isolation and that's where Kata containers comes into play Basically Using all the different TEE technologies from different hardware vendors. There's secure execution from IBM SF from AMD there's TDX from Intel and there's more to come So all of these kind of under the hood of the confidential containers project and as we said the goal is kind of to Unite them in one project and make all of them usable using the same software so users can Because can Choose what kind of isolation they require there's another flavor and that's not related to hardware technology it's kind of related to how we deploy the containers and pots and so there's a sub project and confidential containers it's called we call it pure pots and It's basically making use of the Kata remote hypervisor. So what does remote mean in this context? the Kata virtual machine that started in this case is not Launched inside though my worker node and so inside my cluster instead It's launched outside of the cluster and how do we do that? The cloud API provider tool basically talks to the cloud service providers API is to create a machine a Virtual machine and what's the connection to confidential containers here? Well, this virtual machine can be a confidential which machine using the TV technology and it's a tested and measured So you have of a base a trusted base to run container workloads on this machine Cloud API adapter has support for quite a few cloud providers We have a few listed here, but it's extendable more can be added and it's not that hard so Peer parts are really a complex topic you can do a lot of things with it And it deserves its own talk and in fact, there was a really good talk at the office three conference in February We have a link to the recording in the slides and I can highly encourage you to go and watch that to learn more just about this topic So now we talked a lot about technology Let's talk about use cases. Where do you use? Confidential container computing in general and was that also confidential containers so First adopters of this technology are Regulated industries they have to keep up with rising demands for regulation everything becomes most strict And they have to apply to those new rules and still run their workloads still on their businesses And that's where confidential computing and confidential containers can help So it's usually financial services Government and also health care few others But here we picked one example a simple one from health care So imagine a hospital uses an application. It's running in the cloud How can I be sure that the application that's running in the cloud is in a secure environment because it's that trusting patient data To this application test results personal information things like this so If the application is running in a secure environment protected by a TV and we have an Service and at a station service that basically can confirm the identity and Of this workload and the stack that it's running So we know exactly that what is running there is what we expect to be running there and we can do this by basically using at a station services remote at a station and How this works you should go to the talk in the afternoon Jeremy will explain details about how at the station works with different models of remote at a station there are So it will be I think at 2 p.m. Or 2 30 p.m. So this model can be extended to third parties We can include for example a diagnostics provider that processes medical image data and then gives back a result and We can extend the trust basically Running this application in the same kind of environment and I can use the same infrastructure to prove its identity and prove that it's running an Secure environment with encrypted memory and the exact stack that we expect to be running there So this was one There's another Example that we want to briefly mention and then imagine you're running on Machine learning workload using Apache Spark Which is a well-known open source project that basically if you run it on kubernetes It deploys a driver pot and it was executor pots and those process the data So what we can do to enable this for confidential containers is basically one simple change When you run your spark job you can specify also top pot template And you just need to add one new line for the runtime class name and that means The pots will run not the normal run C base container runtime, but using the confidential container runtime So and that's how we Change it from using normal container technology to this confidential containers That's based on Carter containers with this runtime class name So in this case it means the user data is always encrypted with a key provided by the user in storage When these pots come up driver and executor pots They start the attestation Get fetched a key if the attestation was successful. So if the Software has not been changed Started in a different environment or has been modified in some way The attestation will be successful and then the key will be released to decrypt the data That's what the parts internally can do that and will be for example provided in an FML volume The key and then the workload can decrypt the data before it starts its actual work So this is something that will actually Demo at the red head boost tomorrow at 2 p.m You can come and generally watch that So now we talked a lot Let's show a quick demo so What this demo will show is how you can deploy the confidential containers operator, which is hosted in operator hub IO and We will show how you can modify what it Deploys and how it deploys things on your cluster and then we'll just run a simple workload using what we just installed So let's get started So the prerequisites are you need a running kubernetes cluster and you have your nodes have to be ready for confidential Computing so you have to have the right hardware and has to be configured including the BIOS setup Let's take a look at the cluster It's a one-hole cluster in this case running just the default things and now we're going to Deploy the our operator version 0.5, which was just released last week Just apply this manifest to it will create the namespace and the subscription and so on install wire Well M and now we're just waiting until the Actual operator deployment is coming up So so far we have only deployed the operator. We have not triggered the actual installation of the components of the artifacts We'll do that in the next step and for that we create a custom resource It's called CC runtime. So let's check if it's actually there after the installation and yes it is Next step we have to create an instance of this custom resource and here We'll just take a look at an example It shows you can Specify a payload image that has the contents that all the artifacts binaries config files that you want to deploy There are also hooks for running a container image for pre-installed to prepare your cluster and also for post-installed to clean up things In case you have something custom So this is an example default examples very robust kind of includes all the different kind of artifacts that we have For different technologies. So this is where you can go in and customize it for your needs really and In the next step once we've shown all of this We'll actually apply this manifest and that will start the actual installation So in the next step, we're going to be doing just that apply and What happens now is the controller What is watching this custom resource and it's starting the installation process basically running demon sets the ones that we specified in the Custom resource you see the pre-installed demon set is already finished and the actual install demon set that's deploying the binaries from the payload image is running It will also create the runtime classes So here we have one for vanilla cutter containers and then others for the combination of hypervisor technology and TV technology Now we take and look at all the artifacts and stuff that was deployed to the nodes. So we have kinds of binaries QMU Cutter container components and a lot of configuration files. We also have The kernel images the initial RAM disks that we need for the virtual machines and we have a bunch of firmware and BIOS files that we also need So this is a lot, but keep in mind. This is for all the different kind of technologies That's where you come in and customize it to your needs. What technology are you using? What do you want to deploy? What do you want to run? So in the next step We'll create a simple engine export in this case. We are using the runtime class name for cutter containers This is the only change that you make to your deployments. We changed the runtime class name in your pod templates or deployments So now we're waiting until the pot is coming up and then in the final step Just going to make sure it's actually running and we can access it So this will be a now it's up. I know we're going to check If we can access it and yes, there's the page. So that means the pot is running And everything was working as we expected And that's the demo Okay, so in the demo we shown That it's easy to deploy the operator. It's basically one command Then it's another step that you have to do is create a custom resource Which you can modify to a needs but not you can also use the default one if you just want to play with it for now and then we'll show on how you can using the correct runtime class name run a simple deployment and So we just released version 0.5 Fabio mentioned sir. It's a young project But this is our biggest release so far It has a bunch of new and large features we mentioned peerpots the other very interesting ones and Basically, we're here to encourage you to actually go ahead and give this a try play with it If you are interested also join our select channel in the CNCS workspace and we have a weekly community meeting where all of you are welcome to join and Discuss your use cases discuss your needs if you want to contribute, that's also a good first step and Yeah, so please come and join the community Tell us what you expect what you need what your use cases are So as we already mentioned There's a really interesting talk today in the afternoon given by Jeremy Piotrowski from Microsoft He will go more into the low-level details of how this works starting from the hardware technology to be also deployed How adaptation is going to work and different types of Attestation all these things so highly highly encourage you to go there and watch this talk as well There have been other great talks in past cube con conferences They all talk about The purpose of confidential containers and confidential computing, but they look at it from a different angle So it's also worth watching those talks as well and I think with this we're at the end of our talk and Hopefully have some time for questions There's one question here What are the hardware requirement to use these Confidential computer hardware requirements was that a question so the question was what are the hardware requirements and basically you need a server was a CPU chip that has this technology enabled so and Intel TDX or process of AMD SCV There are different flavors of AMD SF so make And or there are the hardware platforms as well like IBM C That you have to use Just to compliment Just a compliment You can test it. You can run and develop without having access to tea For like the this demo for instance This demo for instance was recorded in the development Environment that I have so if you just want to give it a try you don't have to have a tea if you want to actually use it You have to have one of those machines and availability is coming It's not like everywhere right now and maybe to add to that as well We have a block describing exactly this from a colleague of ours that how you can try and try this out Without having the actual hardware We'll make sure to add the URL to the slides after the talk So if you're interested Just look it up in the slides and you can follow the block. It's actually a tutorial how to do it without having the hardware No more questions No more questions. Oh, that's one. I was just curious. What's the performance overhead of running an application in a Confidential container as opposed to regular containers So I'll add Fabiano add to that but basically the overhead that you have starts with Over that you have for Carter containers and so that's I let Fabiano speak to that But on top of that overhead for confidential containers, I would say does But this is the biggest overhead and what comes on top for conflict the confidential part is not that big so The overhead for using the encrypted memory that it's not that big. It's like Notable, but when you're talking about Kubernetes like it's gonna take a few seconds to shadow your pod anyways a big overhead that comes is Those technologies do not support for instance hot plug You cannot hot plug memory. You cannot plug CPU So once you start a pod That's gonna locate the memory that you need and That's a reason of overhead But like time-wise on running should not be a game a showstopper Was where I where we able to transfer your question. So the benchmarks should come From the hardware vendors right from Silicon vendors They have we don't have these as part of the talk but contact us and We can point you to the right benchmarks for depending on the tea that you are using of course so in general This the workloads that you would run on these are not things like function as a service where it Depend on minimum latency for workloads to come up and then disappear It's probably going to the first run more be like long running workloads where they start up time doesn't matter as much So I'm not really an knowledgeable in trusted execution environment But I'm wondering like see if you really don't trust the platform on you which you are running or can you know that? the API that you are accessing that and show you that you are Running like a security is not like fake. It's like a really Unforged by a CPU and really you have access.  Was that your question? Yeah, I mean you're executing your container and you are touched that your container cannot be accessed by the by the platform, right?  Oh, okay so basically There's a root of trust showing you that from the hardware level that The environment that you're running is based on this on this hardware level Certificate So when you get the attestation report, it's come it's going into the CPU basically creating this attestation report and that's based on Key provided by the hardware manufacturer and from there It's like always in security a chain of trust up to the running system Does that answer your question? Just to compliment at this point you trust the hardware vendor Right, you are buying a hardware from from some vendor. You trust that vendor what you don't trust is Everything that is using that Right. So so that's the how the vendor is providing the key you trust that and then everything that you unsaid Does someone else? Preferably in the front here Has some questions if in the back, that's okay as well Okay, so oh, okay Thank you my question would be how you manage the The fact that pods are moving from one node to another when you have encrypted enclaves memory and So the question is how do you manage that workloads move from one node to another? Basically as you move notes And you start let's say you you move to know you move the pot to another node and you recreate the virtual machine It has to go through the same process that it did on the first place did on the first note Yeah, so You mentioned that to benefit from these hardware T is you need Support from the CPU and you mentioned Intel and AMD a CV and so on Have you considered support for platforms based on arm? So actually What's up to the hardware vendors to join the project and contribute in fact? There was I think the first PR from arm the other day So that's coming In general as hardware providers Learn about the project and want to join typical workflows that they join one of the community meetings and State what their intent is and send PRs and they will usually be integrated into the project. Yeah Okay more questions Yes one No, it wasn't so much a question, but relating to the benchmarking question earlier It is something that's come up in the community so far as nobody's volunteered to help write it I think we'd like it from the perspective of the community rather than the hardware vendor So it's not really a race to the bottom or top whatever way you look at it So if anyone's interested in coming up with a way of benchmarking what we're talking about here Generically for the community to at least as a starting point allow people to try it out in their environment Then all help greatfully received And he's James. He is one of the folks who work directly on on peer pods Thank you


We're at the end of the line, pal. Are you even saying that? You guys have been with me to the end of the line, pal. What? What's up, YouTube? Welcome back to the Living Room. We are The Outtober. So guys, every since we've been on this Marvel journey, it all has seemed to lead here, man. Avengers Endgame. Honestly, babe, I'm excited. I'm nervous. I'm anxious. I'm a little emotional. Baby, are you excited to watch this movie? I'm so excited. Thank you guys so much for your support. We've grown so much with the series and we can't be more thankful. Honestly, guys, this series has been a roller coaster to say the least. There's been movies that people have not necessarily loved that I thought were fantastic. There's been a lot of twists, a lot of turns, a lot of emotional moments. We've shed some tears over here. This has honestly been one of the great journeys of our lives checking out these movies and hanging out with you guys and having you guys into our house or home to watch them and just seeing how passionate you are. You guys have shared so many stories, so many moments. So many people become really close with family, just reading these comics and going to comic book stores with their parents as kids. And not to get too deep, but a lot of parents out there passed away and left some of these for their kids. And it's just deep, guys. A lot of people are passionate about this and I'm just really excited to watch this movie, guys. So sorry to blabber so much. We're just passionate about it. I know Mrs. October has been so anxious to watch this movie. She's been rushing me all day. Hey, stay tuned to the end and we'll tell you who our favorite character was throughout the whole series. Right, yeah, absolutely. So I think there's one more movie left in this phase. No one's on the phase four. So yeah, guys, just come join the team over here. We're gonna be reacting to all kinds of cool stuff down the road, including a lot of Marvel stuff. So, you know, we're not going anywhere. And yeah, oh, it's a two-part. It's a two-parter again, guys. So the second part will be in the description. So as soon as this video is live, which is, you know, right now, you can check into the description and next one will be out. So go check that one out and we'll see you all on the other side of it. Let's go. Let's go. Nervous. Come on. You see where you're going? Mm-hmm. And let's worry about how you get there. Point it to her this way. Is he on house arrest?  Mm-hmm. Nah, back her up, Dan. That's too easy for her. Well, that's like a layup. Oh, and they're balling. Me. Yeah, ew. Catch up on my string. Let's go.  Yeah, she can probably do that with her toes. I'm glad we're starting off with Clint, though. We ain't seen him in a minute.  He has no idea. Probably. What a start. That was crazy. What a start. Boy, I don't cry. How many minutes, like, into this crap? So here's the thing, dude. Bro, that got me that tricky mess out of me because I couldn't have been like, I don't know, I forgot what this movie was. I was so happy, right? That was such a shift of emotion. Yes. He was so happy. That's why I was like, stunning. I don't know what to do about that. Yeah, that was like, because I'm kind of dumb, right? So I forgot that that happened, you know? Well, I kind of thought we were a little past that part. I didn't even think about Clint's side. Right. You don't need to do that. You're just holding the position. That's all right. I would like to try again. And you've won. Fair game. Why does Tony start dressed like that? How's he looking? It was fun. Just hang on. Hey, Ms. Putz. I don't know if you're ever going to see these. I don't even know if you're still here. Oh, God, I hope so. Today's day 21, Infections Rant's course. You love her. Oh, Nebula. Only a tiny bit sadistic. A thousand light years from the nearest 7-Eleven. And that's tough because I love 7-Eleven. I assume we'll run out tomorrow morning. Oh, no. And that'll be it. Oh, no. I probably lied down for a minute. Please, no.  I know. I'm just something's got to give, right? And I'm just waiting on it. Oh, my gosh. That is so crazy. Is it like a fireball?   Because we can't have an Avengers movie without Tony Stark. No way. I'm saying, who's this about to be? Captain Marvel. Oh, it is her. Let's go. He did it just for you. He heard and he delivered. I got so much hate. Dude, I wasn't hating on the dude's mustache, bro. I just think that like Captain America is a professional, right? Queen Shave and professional. Dang, she carried that thing back to Earth, bro. Like, what the heck? Jeez. Oh, my gosh. I didn't even notice her at the bottom. Thanks, verse. Appreciate you. That man needs some hot pot. Or some shawarma. I'm so glad Pepper made it, though, man. I mean, I'm glad everyone who made it made it, because. Oh. It's been 23 days since Thanos came to Earth. World governments are in pieces. The parts that are still working are trying to take a census. And did you see Ant-Man on there? But he's not really missing. Thanos wiped out. Oh, he's in the quantel. 50% of all living creatures. What is the word he went? Where is he now? Where? We don't know. He just opened a portal and walked through. You're Dr. Strange? Of course. Oh, he's guilty.  He thinks he failed, which, of course, he did. But you know, there's a lot of echoing around here. Honestly, until this exact second, I thought you were Bill de Barre. Space scans, satellites, and we got nothing. The thing from Animal Crossing? Did he give you any clues? Any coordinates, anything? I saw this coming a few years back. I had a vision. I didn't want to believe it. He looks so sickly. Yeah. I said, we'd lose. You said, we'll do that together, too. You weren't there. But that's what you meant, right? Were the Avengers? Not the Pre-Vangers? OK. Right? You made your point. Just sit down, OK? I got nothing for you, Cap. No trust. Liar. Oh my god. You find him. You put that on. You hide. Tony, it's fine. What in the world? I mean, it's safe to say mental. He's not doing well, huh? You guys take care of him. And I'll bring him Missouri and Elixir when I come back. Where are you going? To kill Thanos. We realize up there is more your territory, but this is our fight, too. You even know where he is? I know people who might. I can tell you what Thanos is. Thanos spent a long time trying to perfect me. Now when he worked, he talked about his great plan. I'd ask, where would we go once this plan was complete? And his answer was always the same. To the garden. That's cute. Thanos has a retirement plan. So where is he? That's a weird retirement plan, though. Sounds boring. The power surge of ridiculously cosmic proportions. No one's ever seen anything like it. Until two days ago on this planet. Thanos is there. What planet is that, though? So let's get him, use them to bring everyone back. Just like that. Yeah, just like that. I mean, we owe it to everyone who's not in this room to try. How do we know it's going to end any differently than it did before? Because before, you didn't have me. OK. Everybody in this room is about that superhero.  There are a lot of other planets in the universe. And unfortunately, they didn't have you guys. Yeah, there sure is. Or you need to get it together, bro. I like this one. That's the first thing he said. Right.  Let's go, Cap. Language. Let's go. A language, Cap. Coldest opening to an Avengers movie I've seen thus far. 100%. Let's go. I'm so nervous. There's too many stars in the room, though. Like, you know what I'm saying? Like, everyone who, like, steps on the screen sort of demands it. Who hit, man? Then I'll throw up on my ship. Rotating jump in three, two, one. Remember, is space surveillance supposed to be like this? There's your hexagon. Oh, the dang hexagons. We know that's where we at. Space, if there's hexagons, or we're in some type of, like, weird base reality. She long gone, Cap. This is going to work, Steve. I know it will, because I don't know what I'm going to do if it doesn't. No satellites, no armies, no ground defenses of any kind. Anus don't need that. It's just him. Yeah, that's what I'm saying. And that's enough. Dang, this man. Good god, look at that planet. It's beautiful.  Right, there's way too much less to defend Thanos going on in the planet section. I know we're going to, y'all are going to come for us, but like, did y'all forget that he did that part? At the end of the day, it's not Thanos' decision to decide if half the population of planets needs to die. And he's picking cumquats. Just because he's the most powerful tyrant in the universe at the time. How big do those cumquats got to be? So he just wanted to be a harvester. Yeah, he just wants to go be a hippie. Look at him. OK. Now he's seasoning his water while people are disappearing. He was beat up. Oh, Captain Marvel just ran up on him like that? Oh my god. Goodness. Oh, and the Hulk. The Iron Hulk. I'm shocked they saw him coming. I'm glad they can breathe on this planet. There you go. There's your arm. That's tough, man. You know he wants it. He loves body parts. They're not there. Where are they? Answer the question. The universe required correction.  After that, the stones serve no purpose. You murder truly. You should be grateful. Oh, turn into the Hulk. Where are the stones? Reduce the atoms. You used them two days ago. I used the stones to destroy the stones. Nearly killed me. Do you believe him? No, I bet he has one. I am. He has to be lying. My father has many things. A liar is not one of them. Kill him. Oh, thank you. Yeah, we don't need to hear him. We don't need to hear that. But there's no way he's dead, though. What did you do? Did he mess up again? He didn't make the mistake this time. Oh, they're saying that Thanos knows where the stones are, and they need him to bring everybody back. But he then decapitated him. So is he dead? Took his head off just like one of them frost giants. No problem. You know what that really made me remember? What? I'm this Asgard. Yeah. It was really nice there. I'm very pleased that was. That was nice. Five years, I tell you. Five years later? So Thanos is dead, dead and gone. What have they been doing for five years? There's probably like nobody. Hopefully forming an army of what they got. I'll run down. So I first time in five years, I didn't even know what to talk about. What did you talk about? I didn't know much. We missed the mats. Then things got quiet and he cried as they were serving the salads. What about you? Just before dessert. But I'm seeing them again tomorrow. So that's great. You did the hardest part. You took the jump. You didn't know where you were going to come down. Good job. How lucky would you have to be for a cap to be your guidance counselor? Like your AA or whatever it's called? What are the odds? You got the best one. I woke up 70 years later. Traumatic boy. Jesus. You got to move on. But I really don't think you have. You got to move on. You got to move on, man. I say it all the time. Not from you, but how could I? Not my darling. The world is in our hands. It's left to us guys. We got to do something with it. Otherwise, Thanos should have killed all of us. We'll say it, Cap. Dang, man, I just know him on the streets like that, Thanos. Yeah, everybody knows Thanos now. He's a galaxy-wide celebrity. You think he's like America's most wanted? He's the universe's most wanted. You think they have one of those who's up in all over the place? Boy, he's dead. Thanos is basically. Ling, that says Ling. Is that rat going to help him? No way. Oh, let's go. The rat did it. Good job, rat. What in the world? Oh, Paul Rudd. Let's go, Paul Rudd. I wonder what time was like in there for him. Like, was it like one second or was it like five years? Hope. Oh, my God, what's that guy's name? I don't know. I don't think I've ever seen him before. He's a judge on Masked Singer. Yeah, he's like, what is happening? Oh, he has no idea. Hey, kid! What happened here? To be honest, I feel like it's all going to work out because we have Paul Rudd. Let's go, Paul Rudd. If we have Paul Rudd, we win it all. Please. I really hope his daughter's not. I know. Was he on the L's? Oh, I thought I saw a Cassie, bro. Please, no Cassie. I think I did. Scotland. They thought he was gone, yeah. He's like, who do I tell to get me off the stone? Who's there? Please be Cassie. She grew up. Yeah, it's been five years. That's peanut? Wow. That's super sad, bro. I know. You're so big. But from her perspective, though, man, like all of her prayers have been answered, right? Right. Well, she probably just, like, accepted it because everyone vanished at that time. Hey, dude, that's two tearouts for me in this movie. I know. Are we seeing you here next month? Not likely. What? You going to get another haircut? Listen for face. The things that are happening on Earth are happening everywhere on thousands of planets. All right, all right. That's a good point. So you might not see me for a long time. So she's everywhere. This channel is always active. Anyone's making trouble where they shouldn't comes through me. I like that nuts in charge. Right, you too. Well deserved. Where are you? Mexico. Federale's found a room full of bodies. It's probably a rival game. Except it isn't. It's definitely Barton. What he's done here. I mean, the scene that he left. I got to tell you, there's a part of me that doesn't even want to find him. Will you find out where he's going next? Oh, my gosh. That was some good acting. Please. The Hawkeye fell apart. You know, I'd offered a cookie dinner, but it seemed pretty miserable already.  I'm here to see a friend. Clearly your friend is fine. You know, I saw a pot of whales when I was coming over the bridge. And the Hudson. If you're about to tell me to look on the bright side, I'm about to hit you in the head with peanut butter sandwich. You know, I keep telling everybody they should move on and grow. Some do, but not us. If I move on, who does this? Right, that's how I would feel, man, for real. They're still trying, right? Like you would almost feel guilty to accept it. Like you're like giving into it or something. This job, this family, it's always better because of it. And even though they're gone, I'm still trying to be better. I think we both need to get a life. You first. This is Scott Lang. We met a few years ago and recognized you. He's just an old message. And man, I know you don't. I know you know that. This is Frankie. We need to talk tonight. You think he's really confused? Yeah, he just needs to, like, process. Yeah. Have either of you guys ever studied quantum physics? Only to make conversation. All right, so. Except that. Right, right before Thanos, I was in a place called the quantum realm. To get in there, you have to be incredibly small. Hope, she's my, she was my, she was supposed to pull me out. And then Thanos happened and I got stuck in there. Sorry, that must have been a very long five years. Yeah, but that's just it. It wasn't. Oh, wow. It was five hours. Is that anybody's sandwich? Yeah, there's no, like, there's no, like, laws of physics in the quantum realm. There's no constants. What I'm saying is. Well, there are constants, but. Time works differently in the quantum realm. The only problem is right now, we don't have a way to navigate it. But what if we did? What if we could somehow control the chaos and we could navigate it? What if there was a way that we could enter the quantum realm at a certain point in time, but then exit the quantum realm at another point in time? Like, before Thanos. Are you talking about a time machine? No, of course not. No, not a time machine. This is more like, yeah, like a time machine. I know, it's crazy. But I can't stop thinking about it. There's got to be some. It's crazy. I get emails from a raccoon. Nothing sounds crazy anymore. So who do we talk to about this? I like the direction that they're going with it, for sure. Now, that's the thing. Scott's not the expert at that. It's Hank. Right. And you know how smart you'd have to be to understand how to move through the space time continuum through the quantum realm. So Hank's wife was only in there for 30 minutes in her life, because it was 30 years. We're going to start. Possibly. Maybe not from her perspective. From her perspective, she could have been in there for three seconds. That's what I'm saying. Time works. The quantum realms, there's not constants like that there. That's why we can't understand it. You can't observe it over and over again and understand the laws of it. I just am noticing that Tony Stark has a daughter. How did you? Really? Were you looking for her? You're so cute. You like going in the garage, huh? It's fine, actually. Mom never wears anything I buy her. That's not good if you're Tony Stark. He's like, no, no, no, no. I'm retired, boys. I got a noug, a five-year-old, it looks like. That little girl don't know, but that's trouble right there. We know what it sounds like. Is anything really possible? Quantum fluctuation messes with the Planck scale, which then triggers the Deutsch proposition. Can we agree on that? It means you're not coming home. I did. No. It's a billion-to-one cosmic fluke. And now you want to pull a, what do you call it? A time heist? Yeah, a time heist. Why didn't we think of this before? Because it's laughable. The stones are in the past. It sounds like some clock busters or time busters or something like that. Clock stoppers. Yeah. Gotta say, it has sometimes missed that giddy optimism. I believe the most likely outcome will be our collective demise. Not if we strictly follow the rules of time trappers. No talking to our past selves. No betting on sporting events. I'm going to stop you right there. Scott, your plan to save the universe is based on back to the future. Got to watch that one. Good. You have me worried there because I'd be pushing. We have to take a stand. We did stand. And yet here we are. I know you've got a lot on the line. You've got a wife, a daughter. But I lost someone very important to me. A lot of people did. And now, now we have a chance to bring her back, to bring everyone back.  That's right, Scott. I won't.  Good job. I'm saved. I wish you'd come here to ask me something else. I'm honestly happy to see you guys. I just forget it. And I'm happy for you. I really am. This is the second chance. I got my second chance right here. Dang. If you don't talk shop, you can stick a bunch. But they don't. You know, man. It's not wrong. What are we going to do? We need it. What are we going to stop? No, I want to do it right. We're going to need a really big brain. Bigger than his? Come on, I feel like I'm the only one eating here. Try some of that. I'm so confused. Did you see that bowl? That's not what I'm going to say. Oh my god. I know. It's crazy. Whatever. I'm wearing shirts now. Yeah. Five years ago, we got our asses beat. Except it was worse for me. Because I lost twice. First Hulk lost, then Banner lost. Then we all lost. No one blamed you first. I did. For years, I've been treating the Hulk like he's some kind of disease. Something to get rid of. But then I start looking at him as the cure. 18 months in a gamble. I put the brains and the bra on together. And now look at me. Best of both worlds. Excuse me, Mr. Hulk? Yes. Can we get back in? 100% little person. He's so different now. Anything. Say green. I was about to say he can't take a picture. He said say green. Look at him. Did you get that? Do you want to grab one with me? I'm Ant-Man. No.  They don't know him, man. Oh, he feels bad. Nobody does. And you wanted to take a picture with him. Stranger danger. I don't want a picture with him. I don't want a picture with him. I don't want a picture with him. They're like, we can do it.  Why are the captains saying smart Hulk? Hulk out. Right. Damn. Dad. She knows better. About what we were saying. The whole time travel do over outside of my area of expertise. He's so goofy right now. Why do you hold this off? I remember a time when that seemed pretty impossible too. Yeah, he's so zen now.  Go ahead, Hulk. What's going to break him, you know? I don't know, but that acting was crazy. How did he pretend like he didn't do that on purpose? You know, it was good if you think about it. But wiping it off the countertop. Oh, he had to look at Pops. Oh, no, he didn't look at Pops. He looked at Spidey. Upside down with the certificate. One last sim before we pack it in for the night. Processing. Factoring in spectral decomp. Model rendering. Did it work? That was like too technical for me, but I think so. No, I think it worked. Shit. Heard it out. Morgan, aw. Nope, you don't say that. Only mommy says that word. Why do you laugh?  What do you think? No, I got some on my mind. Like a juice pop? Sure was. That's extortion. That's a word. Great minds think alike. Juice pops. Exactly was on my mind. You done? No, you are. Here, wait. Aw. I'm still taking back. Tony Stark has a daughter. She's cute. Or I'll sell all your toys. He's the same. Did you hear that? What? He said, she loves me 3,000. What are you reading? That's the book on composting. What's new with composting? Interesting science. I figured it out. That's amazing and terrifying. Yeah, she doesn't want to hear that at all. Right. She wants him to stay out of it. Because they're finally at peace. They're finally happy. No, I can't help everybody. Oh, we got him. He's wrestling with his conscience right now. Self convincing. Trying to get you to stop. Something tells me I should put it in a lock box and drop it to the bottom of the lake. Good bet. But would you be able to rest? That's a good line right there. Here we go. Time travel test. Why is it saying smart hole guts killing me?  That when he has those glasses on. Right. What is it? How did he get a uniform? He's kidding. Just a bad joke. You were kidding me. I have no idea. I'm over talking about time travel here.  We're good. We're good. I'll send you back a week. Let you walk around for an hour. Then bring you back in 10 seconds. Oh my lord. Here we go. Why does he sound like he knows what he's doing, though? I don't know. I'd be so nervous. I do, Captain America. Because he just lost so much time. I'm talking too much, my bad. One. Guys, this doesn't feel right. Is that him when he's little? Can I get a little space here? You're back? I'm working on it. Oh. Baby.  Kill it. Somebody peed my pants. I don't know if it was baby me or old me. Or just me, me. Time travel. What in the? What? I see this as an absolute win. What in the heck is? They sure do have a nice test in facility, though. Whoever that is, they can stay on. They're coming in hot. This is neat for speed, right here. Shield agent, maybe? It's probably Tony. Absolutely. Tony of Iron Man over there. Why the long face? Let me guess, he turned into a baby. It's the EPR paradox. It's tricky, dangerous. Somebody could have cautioned you against it. You did? Oh, did I? Well, thank god I'm here. Regardless, I fixed it. A fully functioning time-space GPS. I just want peace.  Me too. We got a shot at getting these stones, but I got to tell you my priorities. Bring back what we lost, I hope. Yes, keep what I found, have to, at all costs. And maybe not di-tron. Sounds like a deal. Let's go, boys. He's got some Guy Fieri vibes right now. Tony Stark. Wow. I don't know, he's dressing like him. Whoa, it's the shield. Did you hear the music playing? He had it all that time. Honestly, I have to get out of the garage before Morgan takes it sledding. It's just been in his garage. Thank you, Tony. Will you keep that a little quiet? Didn't bring one for the whole team. The whole team. We're working on that right now. I know they were smacking on it. They took the packaging off the Taco Bell. Yeah, why is the spaceship playing that close to mess it with his Taco Bell? Where's Big Green? Kitchen, I think. Careful on re-entry.  Oh, god. What's up, regular size, man? Oh. Dang, I want to be around them, either. Oh, what's up with the whole man? What's the music? Did you seem to smile and hand deliver them to tacos? He's found some type of zen in his life or something. Look at him. The road to Hanna. The new Asgard. New Asgard. Hey, that's where Odin was standing. Oh, they haven't built it up yet. Look how, like, bare it is. Where is that Norway, they say? Kind of a step down from a golden palace or some magic hammers and whatnot. Hey, have a little compassion, pal, for they're probably just happy to have a home. You shouldn't have come. Hey. Velikari. She made it off that wacky planet, huh? I think I'd actually better either of the other ways. I won't see you. We only see him once a month when he comes in for the size. Is it Thor? Yeah, they got to be there to see him, right? Five years later. Something died in here. Oh, Thor! You hear about the cave? Is Thor's house? Bro, he's the God of Thunder. He can make a better house, right? He just said the Cinemax went out two weeks ago. The boy got a little chunky. Oh, his friend's there. Oh, my God, it's so good to see you. It's like when I see my friends from high school. You know my friends, Amik and Korg, right? Hey, there you go. Playing in the boys' session. Feel free to log into the Wi-Fi. I love that guy. Oh, he's back. The kid on the TV just got hit again. It's Fortnite. Newbmaster. Yeah, Newbmaster 69. Newbmaster, hey, it's Thor again. You know the God of Thunder?  He's toxic.  Thank you, Thor. Hey, let me know if he bothers you again, OK? If you're the guy who's going to drink, what are we going to be drinking? You all right? Yeah, that's fine. Why? Don't it look all right? You look like melted ice cream. So what's up? I'm just here for a hang-up. Be a chance we could fix everything. We're like the cable? Because that's been driving me bananas for weeks. Like that? Bananas? Uh-oh. Let me show you that. We don't actually say that name in here. Now, I know that guy might scare you. Why would I be scared? Didn't he cut his head off?   Stormbreaker? He was swinging Stormbreaker. He's tore up, huh?  I guess so. That's kind of weird. Oh, yeah. And Ragnarok, they were in opposite positions. I think we could bring him back. I'm fine. OK, we're fine, aren't we? Oh, good here, mate. Well, there it is, Trump. Sorry, don't care. Couldn't care less. We need you, pal. There's beer on the ship. We're kind. Tokyo. Let's go. Oh, we must be going to see Dr. Strange or something. What the guy going on over there? Who is this? It's hard to keep up with. Why do you do this? You don't do anything, do you?  Why do you do this? Who is that? These people. This is like John Wick, isn't it? I don't know who that guy is. So I don't know how to feel about him. Help me. What do you want? What I want. You can't give me. Is that about to be Clint? It better not be. This one boy don't want to psycho. Hey, that was clean. You shouldn't be here. Not if you do. Bro, how did you know it was Clint? Because his voice. Oh, man, then turned into a whole assassin.  We found something, a chance, maybe. Don't give me hope. I'm sorry, I couldn't give it to you sooner. Dang. He just had a character digression. Yeah, I didn't really see his character going that path. Either or that one. I mean, I would say I'm not really feeling this door, but y'all might come for me in the comments section again. So I'm just going to say I love it. It's funny. Well, you know what I said? I didn't like Kat when he fell apart. I'm travel soon, not bad. Easy, easy. You're being very hokey. They're PIM particles, all right? Ever since Hank PIM got snapped out of existence, this is it. Scott, calm down. Sorry. You've got enough for one round trip each. That's it. Plus two test runs. Man, that's tough, so. Oh, that was one of them, one test run. Oh. I'm not ready for this. I'll do it. Ben's got Bucky vibes on him. What's his haircut, though? First of all, that's horrible. It's Thanos. And secondly, changing the past doesn't change the future. Look, we go back. We get the stones before Thanos gets them. That's not how it works. Wait, but who told you that? Star Trek, Terminator, Quantum Leap, Wrinkle in Time, Hot Tub Time Machine, basically any movie that deals with time travel. Die Hard? No, it's not one of them. This is known. I don't know why everyone believes that. If you travel to the past, that past becomes your future. And your former present becomes the past.  Oh, gosh. Right, Clint, we're going in three, two, one. He's getting way too comfortable at that, though. I know. Oh, my gosh, is that the place where they were all in Avengers Age of Ultron? In that little getaway house? It looks like it, because of that field, right? And that barn thing. Yep, that's his house. He's got a hide, right? Is he going to see himself? That's the part I'm confused about. Oh, so they hear him. Well, no, he was there, but his time's up, so he disappeared. He was so close to getting to see his daughter again. So basically it worked. Yeah. Time heist. Now we got to figure out the when and the where. Almost everyone in this room has had an encounter with at least one of the six Infinity Stones. Why haven't?  We only have enough pin particles for one round trip each, and these stones have been in a lot of different places throughout history. Let's start with the ether. Thor, what do you know? Jane. That's what we know. Is he asleep? Is he asleep? Is his hands in his pants? No, the ether is dead. The ether, firstly, is not a stone. It's got an angry sludge sort of a thing. Someone's going to need to amend that. My grandfather many years ago had to hide the stone from the scary being. So Jane, oh there she is, with an old flame of mine, she stuck her hands inside a rock this one time, and then the ether stuck itself inside her, and she became very, very sick, and so I had to take her to house guard. Do you remember all that? Yeah. You have me too. Good time. That started the dark world. Right. Jane and I aren't even dating anymore. Why don't you come sit? I'm not done yet. The only thing that is permanent in life is impermanence. I'd like a Bloody Mary. Go the power stone for Morag. Is that a person? Morag's a planet. Will was a person. He's just so late to the party, dude. Do you want to go to space? I'll take you to space. Thanos found the soul stone on Vormir. What is Vormir? Dominion of death at the very center of celestial existence. I love the way she talks. I swear, Thanos murdered my sister. Oh yeah. It's with the guy that's not ego-eving. I feel like Hope might kind of be into Gamora though. You know what I'm saying? Maybe. That time stone guy. No, Doctor Strange. What kind of doctor was he? Wait, he lived in New York? If you pick the right year, there are three stones in New York. Oh, wow.  All right, we have a plan. Six stones, three teams, one shot. So this is crazy. So they're going to have to like time travel to go get the stones so that they can go back in time before Thanos ever done it? All of us. We lost friends. Well, him and Hope about the same size now. Be a fair fight. The Ragnarok lost a part of ourselves. Today we have a chance to take it all back.  One round trip each. No mistakes, no do-overs. Most of us are going somewhere we know. Doesn't mean we should know what to expect. Look out for each other. This is the fight of our lives. And we're going to win whatever it takes. Damn good speech, Cap. Always. Price? All right, man. Struck those keys, Jolly Green. Tractions and cage. You promised to bring that back in one piece, right? Miss Shrunkett. Do my best. I just promised to go. That was pretty lame. Say it in a minute. Oh, it'll be a minute. When they come back, it'll be a minute. In their time? Right. Yeah, when Tony Stark gets involved, it starts looking like this, y'all. They're in New York, baby. Let's go. Oh, this is the first fingers. The first fingers, yeah. Look at the hole. Where's that hole cat? Look how young they all look. I miss this. That was a good times, man. Cat needs to go get some instructions on that car. Oh, yeah. Tell them a different way this time. All right, we all have our assignments. Stay low. Keep an eye on the clock. Maybe smash a few things along the way. I think it's gratuitous, but whatever. My lord.  Yeah. When he watched himself, he was like. There she is before she passed away. I'd be careful going that way. We just had the floors waxed. Do you think the ancient one will know that they time traveled? Maybe. I'm looking for Dr. Strange. You're about five years too early. Oh, my gosh. But she knows. They gave me chills. They gave me chills, y'all. I'm afraid not. Sorry, but I wasn't asking. You don't want to do this. You're right. I don't. Yeah, I was about to say, that's what she did to Steven. Let's start over, shall we? Yes. Oh, let's go. Are we going to see? Oh, my boy. And he's in jail. Look at them. Look at them. And rocket. He's solid, too. You know he did. Here's the deal, Tubby. Extract the reality stone and get gone. Look at me split. Aren't you drunk enough already? This is mom, babe. Aw, Frigga. Who was the fancy broad? My mother. She dies today. That is today. Dang. And he can't do anything about it, right? He can't. He can't mess up the time one, because then he'll split it. No, I don't think I'm having a body to talk to. I don't think it's that. Right here. Dang. I think you're the only one who lost people. I lost the whole family I ever had.  But she's gone. And there are plenty of people who are only kind of gone. And you can help them. Aw. There was too much to ask that you brush the crumbs out of your beard.  Are you crying? No. Yes. I feel like I'm losing it. Get it together. You can do this. I can do this. So he's got to go split game right now? Yeah. Why? He can't. He right now. This is our shot. I guess last time it was the Hulk who couldn't get it together, but now it's Thor, huh? Come on, buddy. We need you. All those things. From the first, yeah. They're going to get the power stone, right? The purple, the orb. Are they going to run into Star Ward? Maybe. Depends on the year, I guess.  We're messing around. We got this. Let's get it done. Yes, sir. You guys watch each other's six. The warden, it's for Vormera laden. All they have to do is not fall out. A long way from Guru to past. OK, so we just wait around for this quill guy to show up and then he leads us to the power stone. And then they take it, right? We're not the only ones in 2014 looking for the stones. Who else is looking for these stones? The Kree, right? My father, my sister, and me. And you? Where are you right now? No! Oh, Howard. Yes, it's good to see her again. She was showing out. I didn't ask for your help. And yet, you always need it. Father wants us back on the ship. Why? He's found the infinity stone. Where? On a planet called Morag. Those things. Oh, they got to go back to Morag. So this is like the beginning days of his hunt for the stones. What's that about to be? Is that him? Conan's located the power stone. I'm dispatching you to his ship. He won't like that. It's alternative is death. Conan's obsession. Shilip. Shilip. What? Who was that? I don't know. Bring her to my ship. So this changes things. So their plans are already kind of like messed up. Because they found out. Right. They didn't account for that. Whatever just happened there. Oh, he's going to have to sneak around them. It's all the same to you. This is what happened when that scene changed. We didn't get to see the rest of this part. 2012 Black Widow. Oh, no. What's his name? Something with the R. Yeah. Oh, yeah, we don't want him to have that right. Snakes right there. Shield, but we didn't like him. Seriously, they coordinate search and rescue. On my way down to coordinate search and rescue.  All right, you're up, buddy. There's our stone. All right. Flick me. Oh, he got in there with it. Right. Right. Bro, he'd be an expensive guest. I kind of missed that whole funny on it. It's a lobby. Part of it is secure. No, he just sit on the secretary. This is that crazy elevator. Uh-huh. Change of plans. They can't run low. Run low. There you go. I just got a call from the secretary. I'm going to be running point on the scepter. We got word there may be an attempt to steal it. Sorry, Captain. You can't give me this. I'm going to have to call the director. That's OK. Trust me. Yeah, I remember he whispered that. And that senator's ear. The advantage of time travel, right? Wow, took it right out on him. Oh, unbelievable. Let's go. Y'all dumb. You really think Captain America of all people is going to do that? Right. He's like the ultimate. That's cat. Bump Hydra. Dumbelina, do you copy? I've got eyes on the prize. It is go time. Is that ax body spray? Everybody use that when you're 12. Mm-hmm. Hey, I asked you where you're going. The lunch and then as God, I'm sorry you all. He's the man about the folks behind Nick Fury. We don't like him. And I'm going to need that case. Move it, Stuart. Little things are getting dicey out here. Let's go. I'm not going to argue he's got the higher authority here.  I need the case. I know you got a little. I'm just saying. That's when he had it attached to him. Right. When does closing pull my pin? Here it goes. Bro, that's some lawsuits for y'all. Y'all better back up. Nick, you got some help. Do you see how you see it? Meet me in the alley. I'm going to grab a quick slice. Oh, he's pissed. Oh, my God, because he had to take the stairs. No. Oh, why? I have no idea if it's going to work. Treat. You're so crazy. The case. The case is where's Loki? That wasn't supposed to happen. Was it? They said one chance, one opportunity. Dang it, Loki. You found that cube. You can't be shitting me. Oh, no. He's like, who are you, pal? I have eyes on Loki. Oh, my gosh, dude. What the heck? I don't want to hurt you. I feel like the original cat or wait. I can do this all day. Yeah. You always say that. You always say that. I feel like the cat from the future should win, though, because he has more experience, right? You would think, but that one's probably primed. Right. Because he was like doing Avengers battles all the time. Decepticons. You better toss some sense in the cap, cap.  All right, good. Oh, he knows him. He knows his moan self. Yeah, he knows he's not about to be able to talk to him. Captain America just sees patriotic red, white, and blue and storms and only. He's admiring his own butt. What in the heck? I'll help you, Bruce.  I'm not sure the science really supports that. The Infinity Stones create what you experience as the flow of time. Remove one of the stones and that close splits. Now, this may benefit your reality, but my new one, not so much. Without our chief weapon against the forces of darkness, our world would be overrun. Millions will suffer. Can your science prevent all that? No, we can erase it. Because once we're done with the stones, we can return each one to its own timeline, chronologically, in that reality. It never left. Theoretically, hypothetically. Until Loki takes one. Right. In order to return the stones, you have to survive. I will. I promise. I can't risk this reality on a promise. It's the duty of the Sorcerer Supreme to protect the time stone. Why the hell did Strange give it away? What did he say? Gave it away. He gave it to Thanos. Willingly? Yes. She knows something. I have no idea. Maybe he made a mistake. She knows better than that. It wasn't a mistake. Or I did. Never mind. Dang, she knows something. What the heck? Strange is meant to be the best of us. I must have done it for a reason. I fear you might be right. Dang, that's a lot of respect for him. Yeah, a lot of respect for him and a lot of humility from her. I'm counting on you, Bruce. We all are. But I guess ultimately, she can see a soul. Mm-hmm. I heard her just get that up a serious. Y'all can remember the best names for this dude, by the way. But Squidward wins. Squidward, yeah, definitely the winner. Run Diagnostics. Show me your memory file. Sire, the file appears entangled. It was a memory, but not hers. There's another consciousness sharing her network. Yep, it's a glitch. Forget it. Impossible. This duplicate carries a time stamp from nine years in the future. Where is this other nebula? In our solar system on Morag. Search the duplicate's memories. For infinity stones. Oh, no. Terrorism. Avengers, unruly wretches. Yeah, recognize the name, though, Thanos? I don't understand. The same nebula from two different times.  I would not have put that together. And now he realizes that she's going to betray him. You know, I assume he's smarter than her, though. He's going to make her answer for things that hasn't even happened yet. What are you doing? Ah! Well, that scared the dog out of me, y'all. That's her off leaving the sneaking to your brother. What's wrong with your mind? The battle of Harroquin, when I got hit in the face with the broad sword. I didn't say it was from the future. I was raised by the first human. Oh. Yeah, he's very lucky. But his mom's costume is crazy. It looks so cool. One of the best ones in the movies. Jane Foster. Jane Foster. His head was over there. I mean, what was the point? I was too late. Oh, he can't tell his mom the whole story. You're here, aren't you? Seeking counsel from the wisest person in Asgard. A failure? Absolutely. Do you know what that makes you? Just like everyone else. It's supposed to be like everyone else, isn't it? Everyone fails to do their supposed to be Thor. The measure of a person, of a hero, is how well they succeed at being who they are. The mystery one. He just happens to be Earth's mindiest, so... Right. Or is it... What is the Earth's mindiest or the world's mindiest? I got it! Earth's mindiest. Right now. Asgard is on Earth, so... I have to tell you something. But I don't know, man. I think Holt gets himself.  Your future. You're my business. You must be mom. I got the thing. Come on, we gotta move. I wish we had more time. This was a gift. Awe.  I love you, mom. I love you. Awe. Thor has awesome parents. You're too solid. Come on, we gotta go. Three, two... Boys! The old hammer. He gets his old hammer back, babe. Really? Yes. Let's go. Because that axe-looking thing was goofy. No, they said... They said in the comments, Stormbreaker's way better than Menor or whatever. Yeah, but I like Menor because it's OG. And then Peter Quill, music. Oh, there it goes. Kicks that little thing. It does a 360. And he sings in 20s like... Watch him. Yeah, there it is. The slide. We've seen it all before. I ain't never had no term before.  That's what they hear.  Yeah. Oh, that's his... That's her brother-in-law, Loki. Oh! Dang it. He didn't get it yet though. Yeah, not yet. The tool of a thief. Not early, too. This is the part where, you know, spikes come out. What are you talking about? When you break into a place called the Temple of the Power Stone. Okay, all right. Go ahead. I'll go behind you. Can't you just snag that thing? That's it? Oh, but don't you have to be strong enough to hold it? Oh, not when it's in the... In the ball.  You see what just happened to her? Hey, gosh, she's an android. Light work. I wasn't always like this. But we work with what we got, right? There you go. Let's sync up. Three, two, one. What happened? Oh, no. Thanos. He's probably doing something to where.  They're not trying to stop something I'm going to do in our time. We're trying to undo something I've already done and I found them all. Congrats. Yeah, you were the sacrifice. It's my destiny. My father has many things. Yeah, keep replaying that. He means to see that.  That's not me. Right, that'd be tough to get prosecuted for a crime you haven't committed yet. I know. He knows. What is she going to do? New plan.