Hi, this is Josef Nibhartia, and welcome to another episode of T3M, our topic of this month. And the topic of this month is security and compliance. And we have with us once again, well, but CMO of Tigera to discuss this topic with Bill. Once again, it's great to have you on the show. Thanks, thumbnail. Yeah, again, it's a pleasure to be on the show. Pleasure is all mine. Let's start with some of the basics, which is more or less like if you look at the evolution of security from a traditional IT word, legacy word, where software was kind of sold. Somebody will buy it, install it, manage it. So security was always someone else's problem. But now in the cloud native Cloud-centric word, it is the problem of the developers. Things are moving towards developer pipeline. We talk about shift left movement. A lot of other movements are happening. So we talk about those things a lot. But what are you seeing is the reality? What is the state of security in the multi-cloud Cloud native word vis-à-vis the traditional IT word? Yeah, I think the security has fundamentally changed with Cloud and especially the Cloud native world. And everything you mentioned all the way from shift left to different aspects of the application that need to be secured in all those we see. And it all started off with as the application development and the deployment became more automated, that it was very important that security controls were introduced early in the development cycle. So we started seeing image scanning and further shift left to code scanning to make sure that you're catching these vulnerabilities before their deployment. And so we started to see that. And that was primarily because of the CI CD automation. And then we started to see Kubernetes orchestrators like Kubernetes that would automatically scale up and scale down on your workloads.  And there could be security risks there, too. The orchestrator itself was breached. And so we started to seeing security practices being implemented within the platform team responsible for that sort of infrastructure. And then finally, the workloads, of course, the security team has to continuously monitor workloads for any type of breaches. But we started to see the occurrences of the breaches was happening in many different ways. The breach could come in from the network because all these applications are these tiny microservices. They're all communicating with each other. They're all communicating outside over the internet and with other applications. So you could be attacked from anywhere. And once you're attacked, the scope of the attack can grow very rapidly as these services are communicating with each other. And so we saw that the security teams had to now look at a lot of different types of threat vectors. Where are my threats coming on from the network perspective? Is my container breached? And is there malware there? How do I protect it from there? Is my orchestrator? Is my CSED pipeline? So you see that security folks had to think about a lot of different things all at once in order to secure their application. And that was a big change. Earlier it was, once it was deployed, that's when you start to think about it only from the workload perspective. When I was listening to you, it sounds like, of course, a lot of things are moving in the right directions. But we continue to see a lot of breaches. Of course, a lot of them are social engineering. Some are, of course, bugs which were fixed, but they were never patched. And of course, API vulnerability that we saw in Books.com kind of things are there. So it does look like things have improved, but there are still a lot of areas to improvement. So when we do talk about all these movements, of course, some of these breaches are actually in the big tech companies. So we cannot even talk about smaller companies. Do you think that when we do talk about the whole movement of Ship Lab, Zero Trust, is it really being practiced? Or yes, companies do want security, but they are not fully implementing all these practices. What is the reality there? So the reality is that, I mean, if I think about a day in the life of a security person, I mean, it's become extremely demanding and complicated. And that's because, number one, because of these new kinds of architectures and applications, your attack surface is huge now. And you have, as we discussed, attacks coming because of vulnerabilities in your pipeline or in your orchestrator or communication outside or there are things inside your environment that are advanced persistent threats that are moving laterally, et cetera. So number one, there's a lot of ways you can get attacked. And historically, the tools that were used or built for the security teams, they were focused on one or two areas at a time, instead of looking at all the attack vectors holistically. And so now, on one hand, you have lots of attack vectors. You have tools that are kind of siloed. And then the third thing is that because of these attack vectors and siloed tools, you're also generating a lot of alerts and sometimes a lot of noise. So from a security person standpoint, if he or she has to look at all these attack vectors, if they have to have tools that are detecting vulnerabilities and attacks, and then they have to score and prioritize to make sure that where the imminent threats are and what needs to be addressed, it's a very complicated problem. And I think that what we are seeing is that teams are trying really hard to address this problem. So they are deploying everything we talk about, whether it's shift left, whether it's zero trust, whether it's runtime security tools, et cetera. So they're doing all that. But the question is, is that really helping? And there, I think the jury's still out because despite rolling out a number of these types of tools and these types of processes, breaches continue to happen. The security teams continue to get overburdened. The development teams continue to complain about app velocity and how security is becoming a business inhibitor and so on. So while they are doing all these things, is it all working? I think that's still a question mark. And you talked about so many points that I was going to ask or I'll be asking about that as well. But let's start with, are there any new threat vectors that you have seen in the recent time? We hear a lot about zombie APIs and a lot of other things are there where you are concerned. Hey, these are the new threats that we will also talk about this whole complicated. Of course, cloud reality is still as complicated as you talk about all the alerts come in. It becomes overwhelming. But then aside, are you seeing any new threats that should be of concern? In terms of, so what we do is, we do around threat research. We also rely on a lot of industry-specific threat research to make sure. So I think as an industry, we are seeing, I think we are seeing threats across the board from all those three areas. We are seeing threats because of a lot of use of open source software and a lot of use of public registries. And so we are seeing that those are areas that are prone very easily exploitable at these areas. So I think that's one big source of threat that we continue to see. And we continue to see issues, log4j vulnerability that we saw not too long back was, again, one of those examples. So that's number one. I think we also continue to see our threat actors becoming a lot more sophisticated. And so if you look at the MITRE group, continues to update their framework with list of tactics. And you see that those tactics are getting used in conjunction with some of the use of open source software. And that's where we see either you are somehow making your way inside the environment. You're doing privilege escalation. You're doing some defensive agent. So we're seeing a lot of that as well. So I wouldn't be able to say that there isn't a specific type of attack that has increased. I would say, in general, there are attackers that are using all these threat vectors and trying to get into your environment. How much adoption of things like zero trust approach? Of course, we talked about shiplet movement. Also, DevSecOps, that security is not one team's problem. It's the problem that has to be looked at, or mentioned wide. How much adoption are you seeing? How much cultural change are you seeing here? I mean, as far as our customers are concerned, everyone's aware of zero trust. Now, the implementation of zero trust, where and how pervasive that is, that depends on the different types of industries. We still see zero trust principles definitely at the perimeter level. We see that those are getting applied. But when it comes to environments like containers and Kubernetes where there is no fixed perimeter, and now you have every single workload considerably talking and communicating outside and communicating internally, we don't see as much usage of zero trust there yet. What we see is customers who are actually starting to realize that just by implementing zero trust at the perimeter level, but then allowing traffic inside, that's that. So for example, inside of a Kubernetes cluster, as you know that each and every microservices internally can communicate with each other without any sort of controls there. Now, a zero trust principle would advocate that even a microservice itself has to authenticate that has to use the principles of zero trust and make sure that you are enabling communication between services only when it's allowed and you're identifying or authenticating that service, et cetera, using identities. So that sort of, I would say, sophistication when it comes to implementing zero trust principles is still not there. I think we see that in terms of applications and devices. We see that getting used, but not in terms of microservices. We still see zero trust not being used as per visibly as it should be. This year, we started to see a lot of restructuring with the organizations. Of course, during COVID times, companies overhired. So now they are trimming their teams. So we are seeing a lot of layoffs happening, but we are seeing layoff across the board.  You know, absolutely. I mean, this industry is also not. I mean, we are seeing in the layer, it's not that the customers don't need security or security is, but at the same time, what we saw is that over the last few years with the funding of companies and the rapid kind of growth of a lot of companies, including a lot of security companies, that a lot of them may have hired before the demand or overhired, et cetera. And so if you look at, I think there was a publication, there was a report by a very prominent VC out of Israel who's invested in almost 10 or so biggest security companies coming out of Israel. And they mentioned that they're going to see a trimming or reduction in all of their portfolio companies. And that's what we see happening. We have seen security companies announce layoffs as well. So I don't think it's immune to what's happening. Now, let's talk about Tigera, of course, Calico is there as well. How are these solutions and projects helping customers to improve their security, despite all these budget cuts and limited resources they have today? Yeah. Yeah. So you know, at Tigera, we have a very specific point of view, right? And the point of view is that in order to secure these cloud-native applications, number one, whatever solution that you provide has to be a complete solution. In other words, it needs to look at it holistically. It needs to make sure you are covering all the attack vectors, all the way from your images, making sure your images are clean before they're deployed to making sure that the posture of your configuration and system, whether it's Kubernetes, it's robust. So you are comparing it against benchmarks. You are making sure you're doing microsegmentation, access controls. And then you have all the runtime protection, whether it's from known threats or unknown threats, whether these come from the network or containers. So number one is complete coverage. Number two, what we see is that the security teams because they are getting so stretched thin across all the different things that they have to do, the solution has to be plug-and-play. So it just has to provide these types of protection out of the box without requiring the security teams to configure rules or think about the forensics and what the incident response should be. You know, the tool itself should be able to do a lot of that. And the third thing is in our philosophy is that you should always assume breach, right? So it's not a question of if you get breaches, when you get breached and everyone is going, that's going to happen. What is your mitigation approach? And are you going to be able to deploy emergency measures to prevent that breach from becoming into a disaster? And that kind of drives what we do at Tigera. So the first thing is that we've created a CNAP that provides comprehensive protection against all security threat vectors. And that includes your build time threats, your config threats, and your runtime threats. With regards to configuration, we provide capabilities like out-of-the-box microsegmentation, egress controls. We provide capabilities like integrating with your firewall. And then when it comes to runtime threat defense, we provide out-of-the-box protection against both container-based threats and network-based threats. And these could be from known attackers or from zero-net threats, right? So that's kind of number one, comprehensive protection. The second thing we have done is we have, our environment is completely plug-and-play. So you can get started within minutes. So you go to Tigera.io, sign up to Calico Cloud, and within 15 minutes, you're up and running. You can deploy controls over your cluster. The detectors we provide are out-of-the-box. You don't need to configure anything. The protection, such as IDS-IPS or workload-centric VAP, all that is provided and enabled out-of-the-box, right? So the time to value is incredibly fast there. And the third thing we provide is that in our, we believe in defense in depth. And so we always assume breach and we provide mitigating controls. So you are able to automatically deploy compensating controls in the case of a breach and contain the scope of that breach. And that's what, you know, Tigera does. And in our approach, we strongly believe is aimed at this new class of applications that just require a different way to think about security. Before we wrap this up, the last question I have for you is that your solutions are there. Of course, we are seeing some positive trends also there. What advice do you have for companies so that they can improve their security posture because tools themselves are not going to help them. They need a lot of, you know, culture, you know, as we discussed, they need a holistic approach to our security. Yeah, I mean, I think they, that's a great question. See tools are, it's just one thing that you have in your list, you know, in your kind of bag, right? So it really starts with, from a mindset, right? You really have to have a mindset where you are first starting off with improving the security posture and trying to reduce the attack surface, right? So there's no point in spending a lot of effort on detection when half of your work can be made easy by just implementing just good practices when it comes to your CI CD pipeline, when it comes to configuring your orchestrator, when it comes to kind of isolating your workloads. And there are lots of easy wins there. I think that's number one. Number two is that, you know, you should always, I mean, it's all about defense in depth, right? So you can't go for an approach where you're gonna put 10 locks on one door.  And I think that is, again, very important, defense in depth to have multiple layers of security control so that if someone gets through to one layer, you know, you always are covered. And then I think the second thing is that, the last thing is that there needs to be an empathy between the different kinds of roles involved in their needs in order to get the security of the application robust, right? For example, the developer is under the pressure to push out applications. I mean, why the security team has to make sure that the applications that are getting rolled out have the lowest probability of getting breached, right? So I think the idea of kind of helping each other out with the right kind of insights. So for example, getting the developer teams a prioritized list of things that they should address instead of, you know, here's everything you should need to fix or having the development for the development team to make sure that they're adopting good code scanning and image scanning practices so that the number of things that are pushed into production have fewer vulnerabilities, right? These are the kinds of, I would say, processes and more collaboration that needs to happen between the two teams in order for overall, I mean, security is not just the responsibility of the security team, it's the responsibility of everyone involved. Udbak, thank you so much for taking time out today and talk about this topic. And as usual, I would love to chat with you again soon. Thank you. All right, thank you so much.


Getting started with Docs Teach, this session will focus on finding and saving primary source documents. The National Archives has over 16 billion records. These are items created by or collected by the government in the course of business. Among these records you can find paper documents, photographs, audio recordings, video recordings, posters, and so much more. Millions of these records are digitized and available on our online catalog. And then to streamline the process of finding primary sources for the classroom and to provide resources for sharing these primary sources with your students, we created docsteach.org. Primary sources on Docs Teach have been chosen by the National Archives Education team that correspond to topics we know educators are teaching in history and civics classrooms. And we're always adding more. Anyone can search for primary sources on Docs Teach. However, if you create a free Docs Teach account, you can save and organize the primary sources you find into folders. Then you can share those folders with your colleagues and with your students or plug them into teaching activities. We're going to get started today with a simple keyword search. So I'm currently on the docsteach.org homepage. I'm going to click explore primary sources. From this page, we can start browsing by historical era, starting with revolution in the new nation, up to contemporary United States 1968 to the present. But I'm going to start with a search and let's just use World War I as an example. As we can see, we have over 700 documents show up for World War I. Let's click on one to check it out. At the top, we'll get the document title. Then we'll see an image of the document. We can really zoom in and take a closer look. If the document has multiple pages, you'll be able to navigate them here. And then you'll see some background information available on this document. Now, for this particular document, a transcription is available. Not all documents have transcripts available on Docs Teach. It's an ongoing process. We're always adding more. But in the case of this one, we can see the transcription and also share that with our students. As we scroll to the bottom of this document, you'll find information on where this document came from. It's from the records of American Expeditionary Forces from World War I, the National Archives Identifier. If you click on this link, it will take you to the National Archives catalog. And here's the full citation that you can copy and paste this as well. You'll also see a note about the rights of this document. In most cases, the documents you find will be in the public domain, things created by the United States government. There are a few exceptions in our holdings. And if there is an exception, you'll find that noted here. Let's scroll back up to the top of the page and head back to our search. I want to show you a couple of ways you can narrow down your search. You can modify your search by historical era or document type. So for example, we could pull up photographs we have in our holdings related to World War I. Or we could remove that filter and focus on video recordings. Opening a video recording, you'll find a video player where you can view the video in Doc's Teach and also link back to where you can find it in the National Archives catalog. You can also refine your search by artwork and artifacts, posters, maps, audio recordings, and so on. You could also choose to do a more specific search. Let's say you're looking for World War I records related to women's roles in the war. So if I just do a search for World War I and women, make sure I clear that filter from before, I'm going to find a variety of documents that come up that start to tell us a little bit more about women's work in the war, including work in the Red Cross, petitions for women's suffrage that discuss World War I and so much more. Or you could also search for a specific document. So let's try a search for the Zimmerman telegram. So yes, we have the Zimmerman telegram. We also have the decode worksheet for the Zimmerman telegram and the telegram with the translation. So let's check out this document. Again, we can see we have multiple pages available. In some cases, you'll find all of the pages of a document available. Sometimes we'll have select pages from longer documents available on DocsTeach. We also have some options for if you want to save this document for later. If you click the star button, you can create a folder and save this document for later. You can create a new folder or simply add it to your default folder. I'll show you where you can create new folders and rename your folders in just a moment and where you'll find this document after you save it. You'll also see the option to download this document. This will download all document images into a zip file that you can then use to share with your students or use in a presentation. You can print this page or you can use the plus sign to add this document to a teaching activity. Looking at the individual pages of this document, you could also download the individual image files or add individual pages to an online teaching activity. Let's find out where we can find our documents after we save them. To access your saved documents, you will go to menu, my account, my documents. On this page, we'll find the documents that we've saved in our default folder. If you'd like to create new folders, if you scroll down to the bottom of this page, you can create a new folder. You can organize your folders any way you wish, whether it's by subject matter, class periods, whichever makes sense to you. You can also select documents from a folder and choose to remove them completely from that folder. If you want to delete a folder, you'll need to make sure that your documents are completely removed from a folder you've created and then you'll be able to delete your folder. You can also choose to share a collection of documents with your students, with your fellow educators. You can do that by clicking on the link icon next to your folder name. This will give you a link that you can copy and share and this way you can share a document set with your students. You'll also see an option to rename your folders here. The National Archives has incredible resources for teaching history and civics. It's best to get started by trying your own keyword searches. You can also search for specific pieces of legislation, Supreme Court cases. You can do a search by type of document. We have thousands of petitions for and against all sorts of topics, issues, pieces of legislation that are great for bringing in multiple points of view on an issue into a lesson. You can do more of a thematic search. Do a search for checks and balances to find documents that help illustrate that big idea from the Constitution. Another great place to get started is to check out our popular topics pages. If I click menu, popular topics, I'm going to click see all. You can find these curated collections of primary sources that you can share with your students as well as teaching activities from the National Archives. For example, if we click on amending America, this is a popular topics page we created in conjunction with an exhibit at the National Archives. You'll find collections of primary sources for teaching the idea of freedom of speech, resources for teaching the suffrage amendments. These will be located on the left side. On the right side, you'll find teaching activities that you can share with your students as well. For example, clicking on suffrage amendments will find not only examples of those amendments, but also petitions related to those amendments as they worked through Congress and went to the states. Another resource I want to point out are resources for document analysis. If we click menu, resources, document analysis, you will find PDF versions of the National Archives analyzing documents worksheets. We have two different sets of worksheets, one for novice or younger students or those learning English and one for intermediate or secondary students. We have different worksheets for the different types of primary sources your students may encounter. So for example, if we click on photograph, we'll open up a PDF that shows the four different sets of questions our worksheets walk students through meeting the document, observing its parts, trying to make sense of it and using it as historical evidence. Going back to the analyzing documents page, you can also find the same questions available as a tool on DocsTeach. This is our analyzing documents tool. I want to show you quickly how these same questions appear on DocsTeach in the teaching activity and how you can quickly create an analyzing documents activity to share with your students. So for example, here is a child labor photograph. This is the teacher page with information for you on how to facilitate the activity. Clicking start activity takes us to the URL you would share with your students to complete an activity. Students do not need a DocsTeach account to complete an activity. Now as we scroll down, we see a photograph as well as those same document analysis questions we saw on the PDF worksheets. So students would enter their responses into these fields and at the end, they would type in their name, your email address associated with your DocsTeach account, their final response and send their response for you to review in DocsTeach. Now future sessions will cover how to assign and review student work in DocsTeach, but I wanted to show how these worksheets are available in this activity tool. Let's say you want to take one of the primary sources you find and pop it into this analyzing documents activity. Well, let's go back to my account, my documents. Let's take a look at a photo I saved earlier from a World War I search and I'm going to go ahead and click the plus sign to add this act to create a new activity and put documents in it. Then to find that activity, I'll go to menu, my account, my activities. Here's the activity I've just created. We can see it's not published because it's a brand new activity I've just started. If I click edit and manage activity, I'll now be able to go through the steps of setting up this activity. I'm just going to quickly show how this works and then we have lots of additional instructions that walk you through in a step by step process on DocsTeach, but basically you'll want to choose that analyzing documents as the activity type. You'll want to do a student title and a teacher title. They can be the same. You'll also see an opportunity for you to decide how you want to be attributed, how you want to attribute yourself to this activity, and this is where you'll publish it to DocsTeach or not. Now, if you'd like students to be able to submit their responses online, you will need to publish your activity, but right now, since we're working on it, we're not going to publish it yet. Then you'll want to save early and often, and you'll see instructions on what you'll need to do to complete this activity. I'll outline it right there for you. We'll go through these tabs to go through the different steps. You can choose if you just want your document available or if you want the document and background information available. There's a setup option where you can decide if you crop the document or if you use the full image in this activity. We go to analysis questions. This is where you'll choose the level. If you want those questions for younger students or if you want the intermediate or secondary students, you'll choose the document type to make sure you pull up the correct set of questions. We'll choose photograph, click save. From here, we'll see those same questions that we saw in the example of the activity we looked at on the document analysis worksheets. You can now add additional questions, remove questions. You can customize them from this point to suit your students' needs. Then, of course, we'll save. The next steps would be filling out additional instructions for students on that student page. Previewing the activity. You could add some instructions for teachers on how to facilitate this activity. Tag the historical era, thinking skill, Bloom's taxonomy level, and grade level. This activity corresponds to, and then when you're ready, you can publish it. From there, you'll be able to share the URL, the student URL with your students. They can go through that same process of answering those questions, index, teach, and train your email address associated with their account and submitting their responses once your activity has been published. You can always find your activity on the My Activities page. If you need to take a break and not work on the entire thing in the whole time. Here it's not published yet, but we have the option to edit and manage the activity. If it was ready to go, we could click on this link to open up the activities. That's just a really quick overview of how once you find primary sources you want to share with your students, you can use the Analyzing Documents activity tool on DocsTeach to quickly share these activities with your students. Then, to review their responses, you'd be able to find them under My Account, My Students' Responses. Well, the next step is to get started. Start doing some searches. You're going to find lots of primary sources for teaching US history and civics topics. If you find something cool, let us know. You can always let us know on Twitter at DocsTeach.


Hello wonderful humans and welcome back to theCUBE. We are live from Las Vegas, Nevada this week at AWS re-invent. I am joined by analyst and 10 year re-invent veteran, John Furrier. John, pleasure to join you today. Great to see you, great event. This is 10 years, we've got great guests coming on theCUBE, three days after this, wall to wall, we'll lose our voice every year, Thursday. Can I feel the energy? Can you feel the volume already? I mean, just everyone's getting bigger, stronger in the marketplace, seeing a lot more activity, new players coming into the cloud, ones that have been around for 10 years are growing up and turning into platforms and just the growth of software in the industry is this phenomenon. Our next guest is going to be a great chat about it. I know, it's funny you mentioned marketplace, we're going to be talking marketplace in our next segment. We're bringing back a CUBE alumni. Chris Casey, welcome back to the show. How are you feeling today? Thank you for having me. Yeah, I mean, this week is the most exciting week of the year for us at AWS and it's just the fantastic energy you mentioned before to be here in Las Vegas at Reinvent and thank you very much for having me back. It's great to talk to John last year and lovely to meet you and talk to you this year. It is our pleasure. It is definitely the biggest event of the year. It's wild that Amazon would do this on the biggest online shopping day of the year as well. It goes to show about the boldness and the bravery of the team, which is very impressive. So you cover a few different things at AWS. You're talking about and across industries as well. Can you talk to me a little bit about why the software alliances and the data exchange are so important to the partner organization at AWS? Yeah, it really comes back to the importance to the AWS customer. As we've been working with customers over the past few years especially and they've been embarking on their enterprise transformation and their digital transformation moving workloads to the cloud. They've really been asking us for more and more support from the AWS ecosystem and that includes native AWS services as well as partners to really help them start to solve some of the industry specific use cases and challenges that they're facing and really incorporate those as part of the enterprise transformation journey that they're embarking on with AWS. How that translates back to the AWS marketplace and the partner organization is customers have told us they're really looking for us to have the breadth and depth of the ecosystem of partners available to them that have the intellectual property that solves very niche use cases and workloads that they're looking to migrate to the cloud. A lot of the time that furnishes itself as an independent software vendor and they have software that the customer is trying to use to solve an insurance workflow or an analytics workflow for your utility company as well as third party data that they need to feed into that software. And so my team's responsibility is helping work backwards from the customer need there and making sure that we have the partners available to them ideally in the AWS marketplace so they can go and procure those products and make them part of solutions that they're trying to build or migrate to AWS. A lot of success in marketplace over the past couple of years especially during the pandemic people were buying and procuring through the marketplace. You guys have changed some of the operational things date exchange, enterprise sellers or your sales reps can sell in there. The partners have been glowingly saying great things about how it's just raining money for them if they do it right. And some are like, well, I don't get the marketplace. So there's kind of a new game in town in the marketplace with some of the successes. What is this new momentum that's happening? Is it just people getting more comfortable? They're doing it right. How does the marketplace work effectively?  Just like our coverage, what a nice coincidence. Decades all around, happy anniversary everyone. Yeah, everyone's celebrating the 10 year birthday. But I think to your point, John, we've continued iterating on features and functionality that have made the partner experience a much more welcoming digital experience for them to go to market with AWS. So that certainly helped. And we've seen more and more customers start to adopt marketplace, especially for some of their larger applications that they're trying to transform on the cloud. And that extends into industry verticals as well as horizontal sort of business applications, whether they be ERP systems like Infor, that customers are trying to procure through the marketplace. And I think even for our partners, it's customer driven. We've heard from our customers that the streamlining the payments and procurement process is a really key benefit for them procuring by the marketplace. And also the extra governance and control and visibility they get on their third party licensing contracts is a really material benefit for them, which is helping our partners lean in to marketplace as a digital channel for them to go to market with us.  I mean, all these things are possible now, right? To some of the partners, isn't that, that's like found money for the partners. Yeah, going back to what I said before about the AWS ecosystem, we're really looking to help customers holistically with regard to that. And certainly when customers are looking to make commitments to AWS and move a large swath of workloads to AWS, we want to make sure they can benefit from that commitment, not only from native AWS services, but also third party data and software applications that they might be procuring through the marketplace. So certainly for the procurement teams, not only is there technical benefits for them on the marketplace and, you know, Forest's total economic impact study really helped quantify that for us more recently. 66% of time saving for procurement professionals, which is, when you calculate that in hours in person weeks or a year, that's a lot of time on undifferentiated heavy lifting that they can now be doing on value-added activities. It's a massive shift. Yeah, massive shift. So that in addition, you know, to some of the more contractual and commercial benefits, is really helping customers look holistically at how AWS is helping them transform with third party applications and data. I want to stick on customers for a second because in my show notes are some pretty well-known customers. And you mentioned in for a moment ago, can you tell us a little bit about what's going on with Ferrari? Sure. So in for is one of our horizontal business application partners and sellers in the AWS Marketplace and they sell ERP systems, so helping enterprises with resource planning. And Ferrari is obviously a very well-known brand and, you know, the oldest and most successful. They have heard of that. Yes, right. The most successful Formula One racing team. And Ferrari, you know, a really meaningful customer for AWS from multiple angles, whether they're using AWS to enhance their car design, as well as their fan engagement, as well as their actual end car consumer experience. But as it specifically relates to Marketplace, as part of Ferrari's technical transformation, they were looking to upgrade their ERP system. And so they went through a whole swath of vendors that they wanted to assess. And they actually chose in for as their ERP system. And one of the reasons was because in for actually have an automotive specific instance of their SaaS application. So when we're talking about really solving for some of those niche challenges for customers who operate in an industry, that was one of the key benefits. And then as an added bonus for Ferrari, being able to procure that software through the AWS Marketplace gave them all the procurement benefits that we just talked about. So it's super exciting that we're able to play, you know, a part in accelerating that digital transformation with Ferrari and also help in for, in terms of getting a really meaningful customer using their software services on AWS. Yeah, putting a new meaning to turnkey or push start. You mentioned horizontal services earlier. What is it all about there? What's new there? We're hearing, I'm expecting to see them in the keynote tomorrow. Horizontal and vertical solutions. Let's get the CEO to be the best. What's the focus there? What's this horizontal focus for you? Yeah, I think the big thing is, is really helping line of business users. So people in operations or marketing functions that our customers see the partners and the solutions that they use on a daily basis today and how they can actually help accelerate their overall enterprise transformation with those partners now on AWS. Historically, you know, those line of business users might not have cared where an application historically ran, whether it was on-prem or on AWS, but now just the depth of those transformation journeys their enterprises are on, that's really the next frontier of applications and use cases that many of our customers are saying they want to move to AWS. And what are some of those horizontal examples that you see emerging? So Salesforce is probably one of the best ones to call out there. And really the two meaningful things Salesforce have done there is a deep integration with our ML and AI services like SageMaker, so people can actually perform some of those activities without leaving the Salesforce application. And then AWS and Salesforce have worked on a unified developer experience, which really helps remove friction in terms of data flows for anyone that's trying to build on both of those services. So the partnership with horizontal business applications like Salesforce is much deeper than just to go to market. It's also on the build side to help make it much more seamless for customers as they're trying to migrate to Salesforce on AWS as an example. It's like having too many tabs open at once. Everybody wants it all in one place all at one time. And it makes sense that you're doing so much in the partner marketplace. Let's talk a little bit more about the data exchange. How is this intertwined with your vertical and horizontal efforts that the team's driving as well as with another big name example that folks know probably only because of the last few years, excuse me, with Moderna? Can you tell us a little more about that? Sure. I think when we're talking to customers about their needs when they're operating in a specific industry, but it probably goes for all customers and enterprise customers especially, when they're thinking about software, almost always that software also needs data to actually be analyzed or processed through it for really the end business outcome to be achieved. And so we're really making a conscious effort to really help our partners integrate with solutions that the AWS field teams and business development teams are talking to customers about and help tie those solutions to customer use cases rather than it being an engagement with a specific customer on a product by product basis. And certainly software and data going together is a really nice combination that many customers are looking for us to solve for and looking for us to create pairings based on other customer needs or use cases that we've historically solved for in the past. I mean with over a million customers, it's hard to imagine anyone could have more use cases to pull from when we're talking about these different instances. Right. The challenge actually is identifying which are the key ones for each of the industries and which are the ones that are going to help move the needle the most for customers in there. It's not an absence of selection in that case. Right. I can imagine that's actually the challenge. Yeah. But it's really important. And then more specifically on the data exchange, I think it goes back to one of the leadership principles that we launched last year, the two new leadership principles, success and scale bring broad responsibility. Yeah, we take that very seriously at AWS and we think about that in our actions with our native services, but also in terms of the availability of partner solutions and then ultimately the end customer outcomes that we can help achieve. And I think Moderna is a great example of that. Moderna have been using the mRNA technology and they're using it to develop a new vaccine for the RSV virus. And they're actually using the data exchange to procure and then analyze real world evidence data. And what that helps them do is identify and analyze in almost real time using data on Redshift, who are the best vaccine candidates for the trials based on geography and demographics. So it's really helping them save costs, but not only costs, really help optimize and be much more efficient in terms of how they're going about their trials from the vaccine perspective. Yeah. And more importantly, getting the analysis and the results back from those trials as fast as they possibly can. Yeah. And data exchange is great with a trend that we're going to hear on the keynote tomorrow, more data exchanging, more data being more fluid, addressable, shows those advantages that are a great example, a great call out there. Chris, I've got to get your thoughts on the ecosystem. You know, Ruba Borno is the new head of partners, APN, Amazon Partner Network, and Marketplace comes together. How you guys serve your partners is also growing and evolving. What's the biggest thing going on in the ecosystem that you see from your perspective? You can put your Amazon hat on or take your Amazon hat on, your personal hat on. What's going on? There's a real growth. I mean, seeing people getting bigger and stronger as partners, there's more learning, just more platforms developing. It's kind of the next gen wave coming. What's going on there? What's the keynote going to be like? What's this reinvent going to be for partners? Share your thoughts. Yeah, certainly. I think we're really trying to make sure that we're simplifying the partner experience as much as we possibly can to really help our partners become more profitable or the most profitable they can be with AWS. And so, certainly in Ruba's keynote on Wednesday, you're going to hear a little bit about what we've done there from a program's perspective, what we're doing there from feature and capability perspectives to help really push the digital partner experience, sorry, I should say, as much as possible. And really looking holistically at that partner experience and listening to our partners as much as we possibly can to adapt partner pathways, to ultimately simplify how they're going to market with AWS, not only on the co-sell side of things and how we interact with our field teams and actually interact with the end customer, but also on how we build and help co-build with them on AWS to make their solutions. Whether that be software, whether that be machine learning models, whether that be datasets most optimized to operate in the AWS ecosystem. So you're going to hear a lot of that in Ruba's keynote on Wednesday. There's certainly some really fantastic partner stories and partner launches that'll be featured. Also some customer outcomes that have been realized as a result of partners. So make sure you don't miss it. More action than ever before right now. It's jam packed, certainly. And throughout the week, you're going to see multiple launches and releases related to what we're doing with partners on Marketplace, but also more generally to help achieve those customer outcomes. Well said, Brian. So your hot take, what is the future of partnerships, the future of the cloud, if you want to throw it in? What are you going to be saying to us? Hopefully the next time you get to sit down with John and I here on theCUBE at ReInvent next year. Yeah, I think Adam was quoted today as saying that the partner ecosystem is going to be around in a foundation for decades. I think he's 100% right. For me, in terms of the industry verticals, the partner ecosystem we have and the availability of these niche solutions that really are solving very specific but mission critical use cases for our customers in each of the industries is super important. And it's going to be a foundation for AWS's growth strategy across all the industry segments for many years to come. So we're super excited about the opportunity ahead of us and we're ready to get after it with our partners. If you could do an Instagram reel right now, what would you say is the most important? Well, the Insta challenge, but go John. The Insta challenge, real. Chris's Insta challenge. Insta challenge here. What would be the reel if you'd say to the audience about why this year's ReInvent is so important? I think this year's ReInvent is going to give you a clear sense of the breadth and depth of partners that are available to you across the AWS ecosystem. And there's really no industry or use case that we can't solve with partners that we have available within the partner organization. Anything is possible. What a note to close on. Chris Casey, thank you so much for joining us for the second time here on theCUBE. John. He nailed the Instagram challenge. He did. Did he pass the John test? I'd say so. I'd say so. And he certainly teased us all with the content to come this week. I want to see all the keynotes here about some of those partners. You teased them in the gaming space with us earlier. It's going to be a very exciting week. Thank you, John, for your commentary. Thank you, Chris, one more time. Thanks for having me. And thank you all for tuning in here at theCUBE, where we are the leader in high tech coverage. My name is Savannah Peterson, joined by John Furrier with the CUBE team and live from Las Vegas, Nevada. AWS re-invent will be here all week. And we hope you stay tuned.


Hello, and welcome to our 2015 update. This past year marked the 25th anniversary of the Hubble Space Telescope. We're going to see caverns carved out of dust by new stars. We're going to get a look at the Vale Nebula moving. We'll see it expand. We'll see through the Eagle Nebula. We'll take a very close look at the Andromeda Galaxy. We'll see a galaxy on the edge of the local void. Also in 2015, CERN reopened the Large Hadron Collider after a two-year closure to upgrade the power to almost twice what it was when they found the Higgs boson. At these levels, it might be able to find dark matter. And Hubble discovered a supernova, predicted it, and found it due to gravitational lensing around dark matter. So with two key 2015 updates, I thought it'd be appropriate to dig deeper into just what dark matter is. So we'll conclude this update with a deep look at dark matter. But first, let's take a look at the updates from inside the Milky Way.


Hey, everyone. Thank you so much for coming to my talk today. My name is Abdul Basit, and I work as a product architect with Rakutan Symphony. I work with our customer mostly around Kubernetes networking, service mesh, multi-cluster. And today, I will be talking about one of the multi-cluster out there, which is based of EBPF. It's from a product called Cilium. So for those who are not much aware of Rakutan, Rakutan have multiple businesses. And one of the business is Rakutan Symphony. And in the Rakutan Symphony, we have multiple product we use. And one of the product BU is SimCloud. And I work for that specific BU. And we have three verticals. One is the cloud native platform, which is Kubernetes distribution optimized for high performance networking and storage use cases. And there is a special focus around zero touch deployment. We have a highest performance cloud native storage available as well that can run on any Kubernetes distribution or on any cloud. It doesn't have to be packaged together with our cloud native platform. And then we have SimCloud orchestrator, which is an orchestrator for bare metal and service automation provisioning across thousands of clusters, data centers, and servers. So yeah, let's go to the Cilium. So I believe most of you are aware of this Cilium, at least as a CNI. In a brief, Cilium is a CNCF graduated project. It offers features like CNI, load balancing, cluster mesh, security features, observability, service mesh. There are so many things. I wish I could talk more about that. But at the foundation, Cilium utilizes an EBPF, which there was an early mention of that as well in the Kipler, I believe the Kipler project, which enables somehow a Linux kernel to add enhanced features for security, visibility, and networking. So yeah, I'm just to show you the amount of features that Cilium have if I put them all together in one graph. And today we are just going to talk about this one small circuit, which is the multi-cluster networking feature of the Cilium. So in a nutshell, EBPF provide a mechanism to load a programmable hook into the Linux kernel, which makes the kernel dynamic to act on the events that happen in the kernel. For example, the program here is waiting for an exact call from the process, and then it returns the PID of that specific process line. And specifically, we saw earlier in the morning that EBPF is used to collect the utilization matrix from the servers as well, the energy utilization matrix. So the best example for EBPF is to compare it with the JavaScript, how JavaScript enable us to do or to interact with the browser, how we do the click, for example, and then it will invoke dynamically certain amount of scripts. And that's how today EBPF is powering the Linux kernel to bring many new enhanced features in the kernels that were not possible previously without doing a complete rebuild of the kernel itself. When I started working or when my first interaction with the Kubernetes when I was working in a company, usually when people start Kubernetes, I mean, I believe most of us start with a single cluster. But for us, even back then, there was a strict requirement that we have to start multi-cluster because the workload has to be physically separated from each other. And we end up something like that. Initially, I named this slide as ingress-based multi-cluster. But in my opinion, it was deceiving, so I changed it to ingress-based cross-cluster connect, give it a different name because it's not really a multi-cluster. But it is simple that how it works is that to do multi-cluster, it works the same way as today we use Kubernetes to expose our services out to the internet or the terminology that we use as a North-South traffic. There is no relationship between the cluster, completely independent, no service discovery. So if the source in cluster one want to talk to the destination in cluster two, source goes out, makes a service discovery outside the cluster, and then comes in to the second cluster via the ingress. I hope we are not using the same ingress for everything, so usually we will be having a private ingress for a cross-cluster as compared to the one that is exposed outside the internet, to the internet run. And this is usually the starting point that I see with most of our customer rights. So this is what sort of make them start thinking it's a time to look into something better, to do a much better multi-cluster topologies. And one of them was discussed earlier by Brian as well, with a very good context of what we can do with multi-cluster. So moving forward in today's talk, we'll be talking about a service mesh-based multi-cluster. So it is like creating a single logical clusters of multiple single clusters. And these clusters can be spread across multiple clouds, multiple data centers. So even if you look in the diagram, the services are global, and the endpoints are global as well. So for example, a source in cluster 1 wants to do the service discovery. It does the discovery in a cluster 1. And similarly, if a source in cluster 2 wants to do the service discovery for the app 1, which is a destination in this case, it does the service discovery within a cluster 2 as well. And the endpoints are global. And that makes us to do very, very interesting routing policies on it. Some of which I will try to explain in a bit as well. So it supports complex use cases. For example, federated identity, global routing, and multi-cloud deployment. So some of the use cases of the service mesh-based multi-cluster, we have global services across multiple cloud providers. And we can have a very good availability for those services. For example, a service can fail from one cloud to another cloud. We can have a better utilization in failovers. In fact, the better utilization use case is what I'm discussing with one of the customer at the moment. So today, the way they have done the architecture is that the whole app stack is deployed in one data center. And that is the active app. So they don't have the component or service level failover. So all the request is coming to one data center and being served from that data center. And the other data center is completely idle, doing nothing. We can do locality aware routing. That was discussed as well earlier in the brand talk ride. So when we have a global endpoint, what we can do is that we can do a smart routing ride. So if the request is originating from within a cluster one, we can have a policy that the request goes to the cluster one, to the endpoints in cluster one, or maybe cloud one. But if it is coming originating from a different cloud or different cluster, it goes to the being served from the other cluster. We can use security and global policies in a much better ways, because we know the identity of all the endpoints. So we can enforce policies. And also, we can have a much better observabilities based on that. So let's just take an example. For example, if I want to do the service mesh based multi-cluster, what do I need to do? This is, by the way, not specific to CDM cluster mesh. It is a generic that I have seen across any other service mesh base. Multi-cluster topologies as well. So at minimum, we need at least two requirements that has to be there, for example, the cross cluster service discovery and the network connectivity and load balancing ride. So if I have a source in cluster one and a destination in cluster two, if source talk to the local QBPI server, for example, and try to ask about the destination, it will not get any answer for that ride. So in that case, what we have is that we have an additional controller that sits in the cluster and it goes and talk to the QBPI of a second cluster, get the endpoints of that cluster, and then inform the source somehow. Let's not talk about the detail. That, hey, OK, the global endpoints of the second clusters are accessible. And once we have the service discovery, we need the networking part to connect the source and destination. And that's how then we are able to make the service multi-cluster work. These two requirements, at minimum, are good enough for some people. But I know for a majority of us, we need more than just cross cluster service discovery and network connectivity. So there are important add-ons that are required. For example, we need monitoring and observability across multiple clusters. We need encryption. In many cases, access control is mandatory. And we also need advanced traffic management for multi-cluster use cases. So one of the best things that Cilium cluster mesh offer is that if the previous slide, whatever requirement that I discussed, is all available within one product right. We don't really need multiple product to make it work. Cilium being a CNI, we know Kubernetes networking doesn't work without CNI. Anyway, CNI provide us the connectivity. And since Cilium cluster mesh is, Cilium is aware of multi-cluster with the cluster mesh feature. It is sort of aware of the routing across multiple clusters as well. The identity information is shared between multiple cluster. There is a service discovery and load balancing built in within a Cilium cluster mesh. And now Cilium is also adding up a lot of service mesh features as well within a product. So let's look at an architecture which is very specific to the Cilium. So if you look at a cluster one on the left and cluster two on the right, we can see that a few components. So there is an agent that runs in every node of the cluster. The job of the agent is to talk to the local Kubernetes API, discover the endpoints, network policies, and it also manages the EBPF maps on the node itself and also attach those EBPF maps to the specific sources in destination. In addition to that, we also have a cluster mesh API server. You can consider this as an agent, which is per cluster. And the job of this agent cluster mesh API server is that it is that middleman to share information from one cluster to another cluster. So for example, the agent in cluster one reads all the information, for example, deployment, identities, network policies of the cluster mesh of a second cluster. And since the cluster mesh in a second cluster is local in a second cluster, it can talk to the local API server and get all the information and then share it over to the first cluster. So because of all this information that is shared between that is available to the agent, we can see that it makes it possible for the service discovery and also network policies and the identity information that is shared that can be used to enforce. And similarly, the observability data is well-ride that is collected based on that identity sharing as well between multiple clusters. So to make cluster mesh work, there are specific requirements. So all the clusters have to be in the same data path mode. So CDM supports two types of data path mode. One is the native routed data path mode. Another one is the tunnel mode. So all the clusters either have to be in the tunnel mode or it has to be in the native mode. I believe those who are using the cloud-based deployment are most likely going to work with the native routed mode. All the nodes must be reachable. Podsiders in all cluster must be non-conflicting. That's why in the demo I'm using IPv6 in fact because I know the pain of getting dedicated podsiders for every cluster, especially if you also have to make it routed, it causes a lot of problems. I mean, not really a problem, but it's very, very difficult to achieve that, especially if you have a lot of clusters. So yeah, something that you guys can consider to opt in for IPv6. It works pretty well. So yeah, the firewall ports that are required for intercluster traffic has to be allowed. The cluster's names must be unique. There is a specific requirement for the native data path mode is that all ports must have a native connectivity between each other. So today if you're using VMs, it's pretty much similar to like that that if you look into your VPC, you should be able to see all pod IPs same as your VMs IP addresses as well. So in demo, I have two kind clusters. And there are IPv6 unique side arranges for cluster 1 and cluster 2. And for native routing, I'm using an open source FRR router. Consider this as maybe your VPC that provide you BGP capabilities to do the peering. So the reason of picking FRR is for me so that I can peer each cluster with the FRR to make the native routing work. And then I have a cluster mesh deployed in cluster 1 and cluster 2. And these cluster mesh API servers are exposed via Metal LB. And we will look into the first use case of doing the multi-cluster east-west traffic route. So for example, the sleep, I have a Hello World deployment in cluster 1, which is having a version V1. And a Hello World deployment in cluster 2 with a version V2. When I make a call from a sleep pod in cluster 1, it should be able to talk to this Hello World V1 and Hello World V2 in both clusters. Let me try to. So if I have Iliasis as K1 for cluster 1 and K2 for cluster 2, I get nodes, I believe. Oh, so much delay. So I have two clusters, and maybe we should have used. And then within, let's look into the cluster 1. We get kubesystem, everything done already in advance. You can see the cilium. You can see a cilium mesh API server. That is the cluster mesh API server. You can see the Hubble for observability. And then in the default names, we have V1 pod in cluster 1. And OK, so V2 in cluster 2. Sorry for the lag. This demo is I'm accessing over the VPN. So let's try to verify the east-west traffic. So I have a script for that. What I will do is just go to that script. It's in the app folder. And OK, so it is verify east-west OK. So we can see in the beginning some of the information. For example, just the node IP addresses for each cluster. And then to show you the pod-siders from within the local cluster that are known to every node in a cluster. So this is just from one of the node. And then it also knows about the pod-siders of the second cluster, cluster node. That's mandatory. And then we have a code from cluster 1. We can see that it can access the local service. And it does the load balancing between cluster 1 and cluster 2. So the important thing to remember here is that if I do, for example, the endpoint, we can see that hello world has only a local endpoint. So the cluster 1 by itself, QVPI of the local server is not aware of the second endpoint. It happens actually in the ABPF, right? So the request comes, and within the ABPF data path mode, this load balancing is happening. If I have time later, I'll try to show you that as well, to look into the CDM agent. And then we can get the information out about the endpoint that it is aware of. So that was the traffic flow between the cluster. I will also try to show you guys the traffic flow for the north-south traffic. So let's see what happens when the traffic is coming from the internet, right? So what we can see when the traffic is coming from the outside, in fact, let me see. I can show you guys the slides again. OK. For the north-south traffic, I have an STU ingress that I'm using for the north-south traffic. And expose the hello world service on the STU ingress. So the request comes and hit the STU ingress, and then it goes to the hello world, right? What I'm seeing here is that we can only see the version one, right? So we don't see the version two. And the reason it's happening is if I look into the STU endpoint, I can only see the local endpoint, right? So that's how it works. The STU uses a client-side load balancing. It does its own service discovery and asks the Kubernetes server for the local endpoint. And then it uses that to send the traffic. So the STU ingress is not aware. And it is a common issue. Even if you use IngenX, you will see more or less the same behavior. I will just show you the trick, how to make it work with the STU. I believe there are other mechanisms for other specific load balancers. So what I'm going to do is I will just try to tell STU to use the cluster IP instead of going directly straight to the endpoint. But I hope it works because the response is pretty slow. So I have deployed a service entry in a local cluster. And I call it a helloworld.global. And that service entry spawns to the cluster IP in a, I'm sorry, respond to the helloworld cluster IP service. And what I will do is I'll just go and edit the helloworld vS instead of going directly to the helloworld service. I will tell it to go to the helloworld global. And then let's try to verify again. Hopefully it works. No, it does work. So we can see the v2. And also this endpoint IP has changed. So OK, I'm going to get a helloworld p6. Anyway, so that's it from the demo. Thank you. If you have any questions, we still have three last minutes. Thanks.


Hmm Okay, cool seems legit Chris. I was I was standing by you on medbay to just kind of confirm and I feel like I confirmed that you're real Has been a killer or real isn't a crewmate. Yeah. Yeah. What do you see? Yeah, man, tell us about it. It's your time Thank the gospel the body was bloody. All right Yeah, just what about it? Yes, we know oh my god, this is so frustrating Okay Entrance of off the drop ship the room to the immediate right of that right in the doorway saw it right on the floor Like a big drill-looking thing over there. I saw no drill the blood was everywhere. It's all All right, so we have no information guys. I'm actually kind of Yeah, which is kind of which is kind of brilliant to be honest if Mark's not a posture I think we had the right move the last couple of games It's not a band Fuck got it right to the end right to the end gamers.  It's my birthday. It's my birthday Please don't kill me. It's my birthday. It's my birthday. I want it. It's my birthday. Please don't kill me I want it. It's my birthday All my tasks are done Now just a oh Okey-dokey, so this is all the information I have I was over in O2 Shelby and I Both went in there around the same time. I did the O2 canisters the lights went out Alana was also in there I could see her in my peripherals if you will and then the lights were still out I went out of the O2 canister thing and her body was somewhere over there the report button just showed up I don't actually know where it was Shelby while were you in O2 again weren't you there last round? I never finished the tree because I stopped it to turn the lights on before but I finished that and I left I've been in comms doing my upload I never went towards lights this time because I'm just still in the middle of the upload Okay, but I'm just in tow a calm now solid alibi Kind of maybe Mark what's up? I Was walking around the middle fearing for my life I was circling the middle structure Brian said that he went to the middle of the map, which is odd because I was circling only the middle Literally just vouched for me Brian you went top right that I would tail Brian wait this round. No this round. I just went straight, right? I don't think I got this body even I was literally about to activate the task on the springboard by the lava, so I I don't think I was anywhere near Oh You sound you sound like the the private detective The second time I played with ambers so I didn't know that more tasks for me, so I'm gonna try and catch somebody in the act I'm just going cams It's Brian It's bright. It's Brian All right, here we go gamers mark is dead and I saw Brian do it on cams was anybody over by Brian Yes, so I went to go down there with me Brian I'm gonna stop any way out of this one Okay, let me talk real quick So I was going out of O2 trying to leave or are trying to enter in O2 from that long tunnel mark and Brian We're at the door I went into O2 did my task and then Brian mysteriously comes out of that area later and is now saying oh he saw me out There Was I was vouching for you because you were the only person there besides Eddie vote Brian. I literally saw Super bizarre though Chris. Did you vote Brian? Absolutely?  Is Because Ethan never sits on cams and Sophie That's right in the reason the reason I'm on cams is that I'm completely done with my tasks This is huge.  Okay, cool good luck Goodbye I'm going back to cams dude. I'm just going back on cams. I'm probably gonna get killed right away I don't even it doesn't matter if I get killed by the way because I already finished all my tasks At this point, I'm just trying to figure out Who done did it? Oh Yes, yes, Eddie use yourself as bait All right, that's not Eddie whoops Here's the deal we have we're kind of in trouble if there's still two killers left I don't know. Yes, so there is there's not Brian 100% I saw him. Okay.  So this round in the previous round I've I've been on cams cuz I'm done So why would he put sus on on amber when he died either?  Yeah, that almost can clear her like this. Yes, just as a play like he threw sus on her to make us clear After possibly but also Somebody who's guilty would say I'm just saying that's a play I'm not saying she says cuz I haven't seen her probably actually the whole game This one is really tough because I am not really sus if anybody I do have a question for Chris the only thing that I saw that was weird And this is just the thing that I say every game you went through specimen But didn't have a task in there anyone who goes through there looks is looking for a body to kill Determination above it What tasks did you have in taking to have a nation because I stood there and I watched you and you did nothing you just did that look at I Did wires and then I had a wires in the other one. It was wires and wait I said you know around that. I don't know where it is on cams. Ethan.  That's right next to the wires. I saw Chris standing at the computer and not that was that was in comms That was me checking vitals and no one was dying. Okay, that makes sense to stand there for a while.     Okay, okay, okay true.    How fast how fast do you think you can do it? I said I said time me Okay, what are you leaving? What are you leaving? Three two one go back Discussing a minute and five seconds. That's pretty fast. That's some quick pee in dude Did you cheat you can use your bloods did urinal? That'd be great. Yes. I did use my urinal. Why is that? Why is that? I thought that was broken and it was like leaking everywhere. I Mean it was but I just turned I just like turn the Water off and on I just Because it constantly flushes yeah, so I just turn it on it'll flush. I'll pee while it's flushing them. I'll turn it off. Oh You know pretty good You're a cheater had an important question to ask what? What's your question? What did I? Yeah, you said something about being at a desk. I don't know Ever first guys, please.   I hate everyone here.   I just can't It's my birthday and they're all shaming me feeling I used hand sanitizer, bro.  It kills 99.99999% of germs The only reason that they don't say a hundred is because they don't want to get sued Is that what that task is? What? I've never had this task before I'm not going to react here because I think that people will take care of what they did They did they did indeed take care of it Whoa All right, well interesting three dead bodies mine. Oh my god. Whoa Okay, no one was a busy boy. Why'd you report Ethan? All right, the reason I self-reported was because I went up into admin and I saw Amber's body there and I want all shit self-reported Yeah, I self-reported Yeah, and so I self-reported and I found Amber's body I saw something weird, but I think it's just because he doesn't know this man very well But Brian, why were you not opening the door? You literally have to hit that little tiny button thing Also Trevor was standing next to me and I was like, why isn't he opening the door because I had an electric panel right next to it Wait Ethan, where did you go when the reactor went off? To be honest, I didn't go to reactor because I was like other people will take care of it All of my tasks are up here. I went to the room off of the cafeteria where the like Plant watering bucket is what it's like called whatever that's called the watering can yeah, thank you And then I went up and then I went up to admin Okay, was anybody else in that direction or was everybody else heading toward reactor? Well, doesn't matter Who Damn That's a win you guys Here we go, baby Time to get some kills time to murder some people time to It's about to say something very funny. I'm I'm pretending to do admin for no one right now. What a sticky situation. Oh my god Wow I Electrical on the lights they killed her after she turned on Okay, wait, so sorry what info do you have? No one was in the room. I think that they vented in possibly probably What? Or not Where was it front or back? It was at the light switch. She turned them on and then died. I Can't believe they made her do the task and then slotted her Yeah, she did one final good deed Do you guys just want to do soul read and vote someone off Was anyone in medbay possibly or security to confirm no one vented from there nope. No Okay, great Numbers are okay mark we have 55 seconds left excellent Back as much and I don't know I don't know why I'm saying. Oh, no All right, I think I saw a murder Okay, what's that? Okay, I just stumbled across a body with Chris. Yeah, so I think oh Maybe like it literally we can literally find out where everyone is Brian. You were with me Eddie Where were you just now? I was in the right side of the map. I think I ended up maybe around shield No shovel, where are you? Okay? I'm in storage, but I think it's Brian It's interesting story, so I was in weapons Mark is here Amber. Where were you? I was just trying to do card swap. Don't mind me. Okay Ethan yes, I was in the hallway in between like comms and weapons So disappointed wait Chris. I'm confused. You bro. You shall be about Brian. Yeah I saw a dark great character kill in front of me, and I'm pretty sure was he it's a new oh Okay, the other reason I said Brian was because It was going with him standing there for a very long time. I did not see Ethan at all. No, it was Ethan I think dude, okay, you can I I literally okay, but wait hold on Chris. Were you with anybody? Yeah, with Brian behind you. Yeah, wait Chris. I literally walked up to the body at the same time. Okay. Okay. Sorry Wait, so Shelby, why do you say that you think it's Always Doing topo too, but it like he wasn't doing it. He was the only one standing there And because I was literally just typing in the numbers I'm just saying you were there for a long time kind of letting it run. I wasn't saying It was here. They're not in order. That's confusing. I can believe that but then Chris said he believed me So, okay, Brian, but can you confirm that Chris? I Wait, really why I was gonna skip Wait, how come when Trevor comes in would like wait really why it's not sauce, but when I do it, it's sauce All right, I'm gonna go grab some fun dip so that I'm Alright, so I need to help out my boy Edward sissy hands Where my boy Eddie sissy's God who gave me the right to speak, you know, who gave me Let's prove that God isn't real guys if I can talk if I can have the platform that I have Kind of kind of sauce Chris I Hello, oh my god, yo What's up, so I have I have a I have a yeah, I have a Theory, okay. I found this body in storage The only person I think it could potentially be is Eddie because he was the last person I saw walking away from it I saw Brian walking in that direction beforehand. I passed Brian in that hallway before that Chris Well, he was stuck in he was stuck in electrical though Yeah, Chris and I were on opposite sides of the door when it locked in electrical Because I was I was walking that way, but I was in reactor for forever Well, and Trevor by a security, so I feel like they're good. It might either came Eddie, I think we get 50-50 this either Or it could be Chris doing his self So I think we're good Oh back you ain't you ain't even seen we were upwards of like 17 a year earlier pretty crazy I said we go for Eddie maybe or Brian I just Finished the little crystal tourney thing he did go left cuz I passed him there's a chance There's a chance that Eddie walked by Brian while he just finished a kill and then Brian went up to electrical and then got stuck in there quote-unquote We don't have to vote here We call another meeting and we Trevor here's the deal we call a meeting and we get it. I'm voting Brian Yes, I Chris were you the other one? No, you My god, that's I think it's Trevor man And she'll hear out my reasons Trevor's been trying to bribe us with candy this entire night.  You could vote me, but what if you voted Trevor think about that? Well, that's not Well, you try it Eddie you're pretty close man. Yeah, dude. Well, can I ask Ethan? Why did you say you can vote me this first?  That's it. That's it and we are scot-free, you know Doing doing doing are a good old swipe Right off the bat, you know wow That's me going just just thinking about huh, huh up. I just thought Trevor.  There's like four people there Can confirm just came off of a task. Jesus Christ Can confirm there were four people or can confirm Trevor Can confirm there is a dead body Okay, well, it's just a group of people. I think it's Trevor I'm almost positive that it's Trevor because I think the other person that was over there, which I think was Eddie Was doing the task. No, I was in Nav and Brian was just was a amber.  No, no, that's what I mean is you were doing wires and storage, right? Yeah, yeah, okay. You were doing wires and storage So you had your task up and the other person was Trevor and I saw a body fall and Trevor was right next to it And I saw it happen I feel like if Ethan Was the imposter he wouldn't be throwing accusations at two people when he thinks it's not really but also I don't want to throw if it is Ethan.   I don't know I don't think No, because because I came back up I was going towards I was going If I'm dead it's I don't trust anyone in that that trio dude dude dude, dude. All right. Here we go, baby Here we go.  Well, actually, no, he probably won't if he was smart He wouldn't because I'm I was the person accusing him. Why am I going over here because I have a task Which I only realized that I have Right now I don't want to die I don't want to die here gamers. I'm at that top of my game right now I'm at the top of my game. You know, we got almost 13,000 viewers here Everything's going great. Okay sick. Where be the body. All right. I'm reporting the body again I know that makes me look sus. It's real sus But I'm not gonna walk into admin find a body and then walk out because that would be not great That would be even worse. I'm a lost time. Yeah, so I saw I saw Shelby in I Okay, the only person I saw an admin was Chris when I was doing card swipe I went down into electrical where I have four different tasks Okay, it's a lot of detail. I was in medbay as I amber there I was just leaving and to walk down and I walked into storage So I guess I walked past admin, but I definitely didn't go in there And it was you're doing wires and admin or storage, right? Yeah, you saw me come from below I don't want Ethan accusing me again. I was doing the task, but I think that'd be a real ballsy move So I do believe that you walked in below Ethan you I mean you must have saw me come like below you anyways, right? Again shields and storage shields and storage I know I came I came where do where do the admin vents leads shields and what else is it o2? Or is there a vent in o2? I Think it's o2. Yeah, I Don't know Alana, where are you at and also Chris? Cafeteria, I just finished a toss in cafeteria and then had to go to the other side I was about to head to medbay I was an admin in o2 and I did the leaves and I could say mark was with me tossing leaves out into the space Chris is the only person that I also saw in cafeteria. So then Chris was an admin at a point Did anyone walk into admin like mid game at all? No, that was a late game when I Chris left after me.   Okay, I Think I'm too valuable to be kept alive guys. I think I'm gonna get killed. I know too much. I know way too much, you know I'm gonna be assassinated.   I came out stopping wet out of the This is my day and this is how I get this is how I be be honored by my friends, you know I should stop talking. This is too much. This is too much. I Can't believe it.  I believe you dude. I'm sorry. Thank you so much Sorry, we ever doubted you Let's go, baby, let's go don't go changing to try to please me You never let me die far That was very ballsy Imagine my surprise The cafeteria Ready to go get some food after a long day's work, and I find I just want to remind you that Anyway, captain here at bottom left Yeah, did you see anybody I saw nobody around when I found the body Mmm, I only saw Markiplier going up from I think O2 into cafeteria So I don't think he could have done a self-report plus. I don't think he's capable My god, so we could do a soul read here.  I'm always ready to cry. I just shall be what were you doing?  I have more information if you wanted Great wonderful Chris you voted quick. Are you voting voting? Bloody was right at weapons paladade was in the cafeteria when we a Lana and I were both there I went down Brian was standing by the shields bottom right after I went there Through weapons to cafeteria found the body Paladade was doing nothing that I saw why can you not be this succinct all the time So keep an eye keep an eye on Amber then Well, I mean that's the only I never saw but I don't trust for some reason Is it because he called you out for not being able to do a self report? Okay, it's not mock and I almost want to stick with you're not muted Alana. Oh, sorry guys. Hey, it's not mock though Just so everyone knows I'm running around too much. I saw show will kill and self report I really saw it happen. Oh my god It's our my word against his I don't know why you're laughing when I literally saw you kill and self report instantly Okay, hold on wait. Where was it in admin?  I literally saw you murder a man Self-report and blame an innocent person such as myself first ball. I don't know why I don't know admin anyway Shelby could have killed me. I wanted to wait my admin card because I have to talk into work. This is very interesting that you're blaming He stabbed Ryan right in the hole like entrance doorway of admin and then So the only the only thing is That's Shelby and I don't mean to call you out. I've known you for a very long time and you're your voice is a little weird right now I I can't play some what it is I mean that that makes sense room for a while that mock you were alone in a room with Shelby and I just walked in and Yeah, you guys weren't electrical together. Oh heck. Yeah, actually I only stepped in electrical I saw Shelby standing over the vent but not necessarily that was the down it might have been the download I saw top right corner. She was up there. I didn't want a chance. It went back down I came around paladad was being a little suspicious like creeping up on me, but didn't commit to anything There was another body, which was Chris was in the top left of the ship I don't know anything about Chris where he was last Chris Chris Body no wasn't the top left over there. I don't trust Trevor for a second, but Ethan does come on Mark We're good, but if shovel no Troubles tell I would be willing to trust that Think Shelby's getting played. I 100% believe that it's like I do wanna Okay, are we voting Trevor?  It's all up to me baby. No, I think you're good In the bad times Love you just the way you are Don't go changing Never let me down Hi Shelby, I want to play where there's no kill cool down Which I guess would be pointless and now she's dead Didn't think it was Shelby didn't think it was Shelby. Well, some Events um, that was right. I didn't see anything or anyone, but I did see Shelby's thick hair, but so oh You saw it this time, huh? You couldn't see mine last time Okay, wait hold on where Security so it's like right out the front of so she was going to look at cams She had what she was gonna collect evidence and now she's dead This is fascinating because bloody passed me right by bottom right like around towards the end So I was going the complete opposite direction, but far enough away that it was justifiable Halana I think you're clear definitely Paladette you were pretty pretty okay. You had opportunities to come after me. You didn't Ethan What's your justification and where were you? What's my justification? I went up into How can you clear bloody is my question Okay, I was just asking I went into electrical And then I went up into top reactor and then I was going back into cafeteria at the end of the game That would put you in the right spot to kill this person wait So why did you why did you clear amber though? Wait, wait, I'm just saying the I don't clear amber. I clear bloody. I clear bloody I don't clear amber just because she had opportunities, but didn't pursue them. I don't I haven't seen Ethan at all I haven't seen Ethan either. That is the one person. I haven't seen anywhere So you mean you haven't seen me mark. Will you saw me in storage? I Didn't see you in storage. Did you see me in store? I saw you in storage this round Here's what we do guys we vote out Ethan right now and if it's not Ethan we go and we call a meeting and it's ample I agree Tight work Just not a good idea. I think you guys should be voting My birthday


Hi everyone, Joe for jazby's casebreaks.com coming at you with 2022 tops sterling baseball two box pick your team number six Loose box. I'm sure everyone Read that was the two loose boxes right there looking pretty sharp the sterling big. Thanks to everyone here for making this happen appreciate it You're on a Wednesday the first of the month Thanks, everyone for making this happen We only had to pull four teams out for that number block Appreciate that we're five five teams six teams not a lot of teams So most of this filled up straight up. So I appreciate that as well This I believe is uploading in a separate video. You should probably rename that It's just the number block randomizer But yeah, so the results are right here in front of us and the randomizer video we did in a separate video All right, so There's everybody right there. Thank you very much everyone appreciate it Set that aside right next to me over here and let's go. Let's do it. Ah Right. Well, I don't know He's pretty sharp Our Joshua docks. He might he might come in as a guest to be interviewed by me and Then end up just taking my job by the end of the day 2022 sterling. We've got all-star rookie cup team and postseason performers Posts this is a postseason performers Yes, this is the last of the sterling. Oh, nice nine out of ten triple relic and autograph Greg Maddox Braves edition and That's gonna go to Craig and the Braves Another goal for the Rangers now tops all-star rookie cup team You're good enough to get make it to the league though Not everyone can say that. We've got a Luis Robert Portrait mode four out of 25 dual relic and on-card autograph highlighting his 436 Slugging percentage pretty good Nice white salt white socks are a number block team. So that goes to white socks for we go by that digit right there And that is for JG Justin With the number four congrats. All right another box Yeah, Jonathan when we find some we'll definitely post some Diamond icons tribute also also really great. All right now. We're we got 1970s MLB all-stars and MVP award winners Let's go back in time and we've got a triple relic and autograph Johnny bench nice Jersey Jersey piece of his lumber and his autograph that is five out of ten for the Reds Justin with the Red Legs and MVP award winners MVP award winners MVP award winners Wow Brandon guessed it spot on it is Shohei Otani Great guess Brandon one out of 25 to color dual relic and autograph Shohei Otani showtime And that's Brittany with the Angels There you go, Brittany There you go Angels looking good this season, and there you have it ladies and gentlemen I'm Joe for jazby's case breaks calm. Thanks for getting into the break. I'll see you next time for the next one