Mathematical symbols fall into three major categories. Operators, symbols that indicate an action, like plus or times or divide. Operands, what these operators act on, symbols like five or x or pi. And relational symbols, symbols that indicate a relationship between two expressions, equals greater than approximately. So let's take a look at those relational symbols. So to begin with, let's define an equivalence relation. Let R be a relational symbol for operands in some set F. We say R is an equivalence relation if, for any x, y, and z in our set, it is reflexive, so that for any x, x is related to itself. Symmetric, if x is related to y, then y is related to x. And transitive, if x is related to y and y is related to z, then x is related to z. It's important to keep in mind there are only so many symbols. And so while we define equivalence relation in terms of this symbol R, R could be any symbol we wish to use to represent a relation. The most familiar symbol is this one, and let's see if this is an equivalence relation for the elements of the set of real numbers. Definitions are the whole of mathematics. All else is commentary. Our definition of an equivalence relation can be viewed as a set of requirements for entry into a very exclusive club. And what we want to do is we want to check the requirements at the door. If a relation meets these requirements, then it gets in, and if not, it's rejected. So let's suppose x, y, and z are real numbers. And we'll check our three requirements. So first we see that equals is reflexive since x is equal to x, which means our first requirement equals is symmetric since whenever x is equal to y, y is equal to x, which means our second requirement, and finally equals is transitive since whenever x is equal to y and y is equal to z, we have x equal to z. And that meets our third requirement, which means that equals is an equivalence relation, and it can be let into the club. How about greater than or equal to? Well, again, we'll check our requirements for any x, y, and z in R. Well, greater than or equal to does satisfy reflexivity, x is greater than or equal to x, but it fails symmetry. It is not symmetric. If x is greater than or equal to y, it will not generally be true that y is greater than or equal to x. And the important thing to recognize here is that as soon as we fail any of the entrance requirements to the club, then we don't get in the club. And so as soon as we see that greater than or equal to is not symmetric, we know that it is not an equivalence relation. Again, that relation can be anything we want. So let x and y be integers, and let x be related to y if x minus y is a multiple of five. Is let's call this squiggle an equivalence relation. So again, to show that squiggle is an equivalence relation, we need to show that for any x, y, and c that are integers, x squiggle x. If x squiggle y, then y squiggle x. And if x squiggles y and y squiggles z, then x squiggles z. Now, definitions are the whole of mathematics. And remember, we want to rewrite definitions as two conditionals. And while we know our definition for equivalence relation, the other thing to recognize here is that we have a definition for squiggle. And our definition says that if x squiggle y, then x minus y is a multiple of five. And also, if x minus y is a multiple of five, then x squiggle y. So here's another useful proof strategy. You can always write down the consequence of a conditional. So we want to prove that x squiggle x. So let's write that down as our conclusion. But remember, this has to be the last line of our proof. And so everything we write has to go above this line. Definitions are the whole of mathematics. All else is commentary. If I want to conclude that x squiggle x, then I have to have that x minus x is five times something. Well, I know that x minus x is equal to zero, so I can write that as the preceding line. And I can fill in our something. x minus x is five times zero. And so I conclude that x squiggle x. Again, we can always assume the antecedent of a conditional. We want to prove that squiggle is symmetric. So suppose x squiggle y. We want to conclude that y squiggle x. Definitions are the whole of mathematics. All else is commentary. In order to conclude that y squiggle x, then y minus x must be a multiple of five. It's got to be five times something. Since we know that x squiggle y, we know that x minus y is five times something. And we might notice that we can convert x minus y into a y minus x by multiplying through by negative one. And a little algebra says that we have a minus k inside those parentheses. And so y squiggle x. And our last requirement is transitivity. So again, we can always assume the antecedent of a conditional. Suppose x squiggle y and y squiggle z. We want to conclude x squiggle z. So we can conclude x squiggle z if x minus z is five times something. Since we know x squiggle y and y squiggle z, we know that x minus y is five times something, and y minus z is five times something. Now since we want to end up with x minus z, we might notice that we can just add the two equations. And that tells us that x minus c is in fact five times something. And so x squiggle z. And now let's put our pieces together. Since squiggle is reflexive, we prove that x squiggle x. Symmetric, we prove that if x squiggle y, then y squiggle x. And transitive, we prove that if x squiggle y and y squiggle z, then x squiggle z. It follows that squiggle is an equivalence relation.


From Sunnyvale, California, in the heart of Silicon Valley, it's theCUBE! Covering Accelerator Journey to AI, brought to you by NetApp. Hi, I'm Peter Burris with theCUBE and Wikibon, and we're here at the NetApp Data Visionary Center today to talk about NetApp, NVIDIA, AI, and data. And we're being joined by two great guests, Jimmy Cues, the Vice President and General Manager of Deep Learning Systems at NVIDIA, and Octavian Tanasi is the Senior Vice President of ONTAP at NetApp. Gentlemen, welcome to theCUBE. Thanks for having me. So, Jim, I want to start with you. NVIDIA's been all over the place regarding AI right now. You've had a lot of conversations with customers. What is the state of those conversations today? Well, I mean, it really depends on the industry that the customer's in. So, AI at its core is really a horizontal technology, right? It's when we engage with a customer and their data and their vertical domain knowledge that it becomes very specialized from there. So, you're seeing a lot of acceleration where there's been a lot of data, right? So, it's not any secret that you're seeing a lot around autonomous driving vehicles and the activity going there, healthcare, right? Because when you can marry the technology of AI with the years and years and years of medical research that's going on out there, incredible things come out, right? We've seen some things around looking at cancer cells, we're looking at your retina being sort of the gateway to so many health indications. I can tell you whether you have everything from Dengue fever, to malaria, to whether you're susceptible to have hypertension. All these kind of things that we're finding that data is actually letting us to be superhuman in our knowledge about what we're trying to accomplish. Now, the exciting thing is, if you grew up like we did in the IT industry, is you're seeing it go into mainstream companies. So, you're seeing it in financial services where they for years were, the quants were very specialized and they were writing their own apps and now they figured out, hey, look, I can broaden this out. You're seeing it in cybersecurity, right? So, for years, if you wanted to check malware, what did we do? We looked up the definition of the database and said, okay, yeah, that's malware, stop it, right? But now, they're learning the characteristics of malware. They're studying the patterns of it and that's kind of what it is. Go industry by industry and tell me if there's enough data to show a pattern and AI will come in and change it. Enough data to show the pattern. Well, that kind of introduces NetApp to the equation, a company that's been especially more recently is very focused on the relationship between data and business value. Octavian, what is NetApp seeing from customers? Well, we know a little bit about data. We've been the stewards of the data in the enterprise for more than 25 years and AI comes up in every single customer conversation. They're looking to leverage AI in their digital transformation. So we see this desire to extract more value out of their data and make better decisions, faster decisions in every sector of the industry. So it's ubiquitous and we are uniquely positioned to enable customers to do their data management wherever data is being created. Whether the data is created at the edge, in the traditional data center, what we call the core or in the cloud, we enable this seamless data management via the data fabric architecture and vision. So data fabric, data management, the ability to extract that, turn it into patterns, sounds like a good partnership, Jim. Yeah, no, we say data is the new source code. We're really what AI is, we're changing the way software is written where instead of having humans going in and do the feature engineering and feature sets that would be required, you're letting data dictate and guide you on what the features are going to be of software. So right now we've got the GPU, Graphic Data Processing Revolution, you guys driving that, we've got some really advances in how data fabric works. You have come together and created a partnership. Talk a little bit about that partnership. Well, so when we started down this journey and it began really in like 2012 in the AI, right? So when Alex Kurcheski discovered how to create AlexNet, NVIDIA has been focused on how do we meet the needs of the data scientists every step of the way. So beginning, you know, started around making sure they had enough compute power to solve things that they couldn't solve before. Then we started focusing on what is the software that was required, right? So how do we get them the frameworks they need? How do we integrate that? How do we get more tuned? So they get more and more performance. Our goal has always been if we can make the data scientists more productive, we can actually help democratize AI. As it's starting to take hold and get more deployments, obviously we need the data, we need it to help them with the data ingest and then deployments are starting to scale out to the point where we need to make this easy, right? We need to take the headaches of trying to figure out what are all the configurations between our product lines but also the networking product lines as well. We have to bring that whole holistic picture and do it from there. So our goal and what we're seeing is not only we've made the data scientists more productive but if we can help the guys that have to do the equipment for him more productive as well, the data scientists, she and he can get back to doing what their real core work is. They can add value and really change a lot of the things that are going on in our lives. So fast, flexibility, simpler to use. Does that kind of capture some of the, summarize some of the strategies that NetApp has for artificial intelligence workloads? Absolutely, I think simplicity, it's one of the key attributes because the audience for some of the infrastructure that we're deploying together, it's a data scientist and he wants to adopt that solution with confidence and it has to be simple to deploy. He doesn't have to think about the infrastructure. It's also important to have a integrated approach because again, a lot of the data will be created in the future. The core or at the edge more than in the core and more in the cloud than in traditional data center. So that seamless data management across the edge to the core to the cloud is also important. And scalability is also important because customers will look to start perhaps simple with a small deployment and have that ability to seamlessly scale. Currently the performance of the solution that we just announced basically beats the competition by a 4x in terms of the performance and capability. So as we think about where we're going, this is a crucial partnership for both companies and it's part of the broader ecosystem that Nvidia is building out. How does the NetApp partnership fit into that broader ecosystem? Well, starting with our relationship and the announcement we made, it should be no secret that we engage our channel partners, right? Because they are that last mile. They are those trusted advisors and a lot of times of our customers in going in and we want them to add this to their portfolio, take it out to them and I think we've had resounding feedback so far that this is something that they can definitely take and drive out. On top of that, Nvidia is focused on, again, this new way of writing software, right? The software that leverages the data to do the things. And so we have an ecosystem that's built around our inception program which are thousands of startups. If you add to that the thousands of startups that are coming through Sand Hill and the investment community that are based around Nvidia Compute as well, all these guys are standardized in saying, hey, we need to leverage this new model. We need to go as quickly as possible and what we pull together is the ability for them to do that. So whether they want to do the data center or whether they want to go with one of our joint cloud providers and do it through their service as well. So a great partnership that's capable of creating a great horizontal platform, it's that last mile that does the specialization. Have I got that right? You have the last mile helping reach the customers who are the specialization. The customers and their data and their vertical domain expertise and what the data scientists that they have bring to it. Look, they're creating the magic. We're giving them the tools to make sure they can create that magic as easy as possible. It's great. So one of the things that Jim mentioned was industries that are able to generate significant value out of data are moving first. One of the more important industries is IT operations because you have a lot of devices generating a lot of data. How is NetApp going to use AI in your product set to drive further levels of productivity from a simplicity standpoint so customers can in fact spend more time on creating value? So interestingly enough, we've been users or practitioners of AI for quite a while. I don't know if a lot of people in the audience know we have a predictive analytics system called ActiveIQ which is an implementation of AI in the enterprise. We take data from more than 300,000 assets that we have deployed in the field, more than 70 billion data points every day and we correlate that together. We put them in a data lake. We train a cluster and we enable our customers to derive value in best practices from the data that we collect from the broader set of deployments that we have in the field. So this is something that we are sharing with our customers in terms of blueprint and we're looking to drive the ubiquity in the type of solutions that we enable customers to build on top of our joint infrastructure. Excellent. Jim McEw, NVIDIA, Octavia Ntenasi, NetApp, great partnership represented right here on theCUBE. Thanks very much for being on theCUBE today. All right, thank you for having us.


Okay. So the agenda for this part is about easy. So an overview of the Qube ecosystem, then an overview of the Azure Ertos, and the integration of the Azure Ertos on our Qube. Okay. So let's start understanding. I think you know already, but in case you don't, okay, a quick introduction. So what is the STN32 Qube software suite? Okay. It has basically a collection of tools and embedded software, and the tools are meant to guide you from the configuration of your project up to the monitoring on the field of your project. Okay. So this is the aim of our tools. And this process started in 2014 when we released our first package of the software suite. And so far, we have more than 7 billion STN32 units worldwide that are using these tools. This in order to say that we got a lot of experience over the last years in order to improve the quality and getting all the feedbacks from the field, we changed, we upgraded, and we upgrade roughly in a quarterly base the release of this software in order to improve the quality to let it to be easy to use and of course to upgrade it for the new MCU that we release every year. So starting from the Qube MX, the Qube MX is a graphical configuration tool where you can select your MCU. When you have selected the MCU, you can address all the hardware features of the MCU itself. You can configure the meaning of each pin, the behavior of each peripheral, but not only, okay? You can also touch everything that is connected to the middleware or you can install additional expansions for your project. The main idea of Qube MX is that with a few clicks and in a graphical way, you set up the configuration of your system, of your project and then you can generate the initialization code for your project. A Qube MX generates code for Qube DI, that is our EDI, and for IR, for instance, or Kyle. So it's not only meant to work in ST only, but also for additional platforms. The good idea behind the Qube MX is that when you generate a project, you can always go back to the graphical interface in order to add the modification to your code to the setup of your platform in order to adapt your platform during the development. So if you need to change any IO, if you will need to add any package, you can do it still preserving the application that you have written in the ADI.  The Qube ADI instead is our common place where the Qube MX, so the graphical configuration tool, the development tool where you can really type your code, test and debug your code, and the programmer are all together, okay? So the Qube ADI is a complete software suite that can guide you from the beginning up to the debug of your application. Of course, as I said before, you can use our ADI, or you can use our ADI, excuse me, or the ADI that you are happy to use like a yard for instance. Then we have the programmer. The programmer, of course, is needed to upload in a secure way the program on your MCU, and you can use it to program your system. Last but not least, and we have a dedicated slide at the end is the monitoring. Monitoring that is provided by the Qube Monitor is a way to monitor in a real time and non-intrusive way your application also in the field. And this is a way to have a touch on variables, memory portion of your project, of your program running on the target in a release way, not in the bug way, in a non-intrusive way, in order to monitor the functionalities and typically meant for the bug, but also for other functionalities such as triggering of algorithm or stuff like that. We will see later. Then in terms of software, we provide the software packages that are meant to support a given series, okay? So you have packages for each, the series that we provide. And then there are also expansions pack that are meant to provide additional functionalities that you could need on your application. For instance, in ePron emulation, okay? You have the expansion pack for it. So talking about the middleware in where instead, this is our offering so far since 2021, that is basically the three-year toss that is the operating system, in pair with additional middlewares, typically for FAT file system, for TCP IP stack, and for the USB library, okay? So this is what you should be a habit to see in our offering. Now let's see how the situation changes. And the main aim of the meeting today, talking about the middleware, we added or we complemented our offering thanks to the Azure RTOS. Now, Azure RTOS is not only the operating system itself that instead is the ThreadX, okay? So the Azure RTOS ThreadX is the real operating system. While when we talk about Azure RTOS, we talk not only about the operating system, okay? So the kernel of the system but also about additional packages that are in this case and what we embraced so far are the FileX for in order to manage the file system, NetX and NetX Duo for TCP IP version 4 and version 6 and also the USB X for host and device USB application, okay? So when we talk about in ST and in our offering about Azure RTOS, it means that we are referring to all these offering, okay? What are the benefits, why we did this step forward, okay? Because basically Azure RTOS is meant to provide best performances in terms of execution and in terms of footprint because this bio architecture is meant to be ready for embedded system. And this means that in terms of footprint and in terms also of content switch, it is really designed for embedded application providing very fast or very nice performances. It is a complete and consistent solution. Why? As we have seen on the slide before, Azure RTOS is not only the kernel but it also provides a lot of packages, okay? And it is also meant for different needs. And it is consistent because the API style, the documentation, the philosophy and the architecture that is behind all the packages is exactly the same. So when you have learned how to use or what is the philosophy behind an API, you can retrieve and find exactly the same philosophy and APIs that are meant for the different packages. And last but not least, this is of course not a ranking in terms of priority. And what is really important is about the certifications. We can see in a slide that is coming certification about safety and security. So what are the key features? As I said, this is an industrial grade, especially talking about the networking. So it is ready for many IoT protocols. And as we will see later, we support already a lot of additional protocols on top of the standard TCP IP networking protocol. It provides a full system for the tolerant, meant for SD, NAND, and so on, so already available. For the USB is an Austin device. And it is of course provided with many classes already available for you. And it comes from Microsoft, okay? Already pre-certified for safety and security. And here you can find the sum of the industrial and the automotive and the medical class that you can achieve, okay? So it can goes up to the C4 or class C for medical or up to SLD for automotive. Of course, we don't have SDN32 automotive so far, okay? But this is in order to provide you the feeling, okay? How these suite is mature for both safety and security. About security, instead for TLS and DTLS is up to EL4+, and talking about software, CryptoLibrary is a FIPS 140 that this is typically needs for medical application. Because operating system is very good, but when you have to debug and you have to trace what happened, it could be difficult if you don't have a right tools in order to see the progress of each tasks, the HEEPO or everything that is connected to the communication, Q, semaphore, stuff like that. Okay, so it provides a very nice tracing and debugging capability. And the guy in during the technical session will show you what this means. Last but not least, it is completely free when you work with the SDN32, okay? So basically you don't have nothing, anything to pay is something like embedded on the usage of the SDN32. Just to give you a quick information, I wanted to go about fast on this slide, but the idea, when we talk about the point that Azure TOS is meant for embedded application in terms also of footprint, you can see the kernel goes down to 2K byte of flash, in its minimal footprint. And we have a sub microsecond context which, as I said, that is able to provide a lot of performances in terms of safe and security, we just talked about that. And it also provides additional benefit versus a standard operating system that is some over the other preemption three-shoulder. So you can trigger the preemption. You can put in chain events, okay, in order to improve the capability or the speed on how you manage multiple events in a chain and it also auto scaling, okay? So, okay, something that is interesting, but we will touch later is the possibility to have some abstraction layer for free at TOS. So for whom is able to use free at TOS, you have something like a parser or an abstraction that allows you to still keep your free at TOS APIs still working on an Azure and ThreadX environment. This is for USB X, I don't wanna go, but what is important here to see is the amount of classes that are already available for you, okay, don't wanna to enter in the details here. You have these slides so you can read by yourself. This is the NetEx instead Duo, the TCP, IPv4 and v6 stack. What is important for you instead in this slide on top of this ball, because 50K byte for such a kind of stack is something that is really interesting. But what I want or where I'd like to have your attention is exactly on the additional networking layers on top of the TCP, IP, stack that are needed for any kind of networking application. So we can notice MQTT, CoIP, and everything that is absolutely common, the HCP, NAT, SNMP and so on, okay, DNS, MDNS. So these are already available for you, part of the package and mandatory for any kind of application talking about networking. There is also the FileEx in order to manage the file system. So we support all basically the standard fat, including the extended fat, and this is license free for usage on the STM32. Okay, what is the delivery model of the Azure RTOS? Okay, we have to distinguish into basically a main session. If we talk about MCU already available in our portfolio, and in MCU that are coming or very new in our portfolio, for everything that is already available in the market, that is added recently on our portfolio, what we provide are extension package, okay? So you can upload, you can get the extension package for your MCU in this case H7, F4, L4, and other, and we have a slide right after describing what are the packages available, and so you can then use Cubemix to configure everything, okay? So the main point is that you have the standard tools, you have to download the extension of the middleware and then you can work with the Cubemix and all the tools that we have talked before. What are the packages available today? Okay, basically, as you can see, this slide is talking about November, Q4, December, Q4, meaning that within this year, you will have all these MCUs supported where for which you can have the Azure RTOS extension package to use, okay? So what is really interesting in this slide is first, you can easily understand that from H7, so M7 500 MHz, you can use the Azure RTOS up to Cortex M0 plus 64 MHz. So this is really interesting because it's going to create a way to migrate your project across a very large product portfolio. And what is also interesting is that we are ready to deploy Azure RTOS also for the wireless MCUs for the sub-giga and the 2.4-giga and everything will happen within this year, okay? Next is instead about the new MCUs that we already released, U5, for instance, has been released in September and for everything that is coming, in this case, you will not need to download an extension package, but the Azure RTOS will be part of the SDK, will be part of the CUBE package for that MCU, okay? So alongside with any peripheral driver examples and so on, you will have also the Azure RTOS available in a single package. As I said before, this is our offering so far, so not only the Tredex, okay? With all the examples for the creation, synchronization, message queue and so on, we also provided the wrappers that I have said before, so wrappers for free RTOS, SCMCs, meaning that if you are a habit that you use a free RTOS or a SCMCs language, you can still leverage on these way to write your code, okay? So in order to have a very seamless migration to Azure RTOS, then talking about the USB X, we have, of course, we are talking about USB, so we have a host and device and we provide also examples for all these classes, so if you have a mass storage, you have the classes, you have, if you need a human interface, you have it and so on, okay? So those are already examples available for you. Talking about, instead of the TCP-IP, we have, again, the server and the client, we have TCP and UDP examples and we have also standard examples that you can easily use, such as a web server, MQTT client, network time protocol client and other examples already available. And instead, last, talking about FileX, you have additional examples how to easy access to your memory and the file system. Okay, we already touched these so we can skip easily these slides. Okay. The CubemX, as I said before, okay? Is meant in this case to import a package, okay? Or also to create a package. The package creator is really interesting because it allows you to create new packages that you can or you could reuse inside your company, for instance, because you have made a package that can be used across multiple projects on your system or you can also create packages to be shared with the community, why not, okay? Or also sold as a professional services. As I said, the CubemX is a graphical user configuration tool. Everything is made in a graphical way and we have also different workshop and web in a ready or coming describing how to use for different use cases, including also configuration of Bluetooth or energy, for instance, in a full graphical configuration way. And then you have the code generation. So CubemX, at the end of the process, create a code for you that you can use with your IDE or with our IDE. Cubed IDE instead is the ST, as I said, free of charge and it provides to first, as I said, include the CubemX so you can configure your platform. You have the code development, so everything needed. Cubed AI is based on Eclipse and GCC as a compiler. You can debug and programming and then you can, and this is what we are going to see today, you can fully debug your operating system, okay? So you can have full awareness about the thread, about the motex, about the queue, about what happened talking about an operating system. Last, but really not least, is the Cube Monitor. Let me spend a couple of words about the Cube Monitor. As I said, this is a non-intrusive tool. What is the main target of Cube Monitor? When you have released a software, okay, and you have, for instance, a bug that happens after days of working, okay? And it is very hard to be replicated at the desk. So typically what a technical guy do is adding a lot of tracing code in order to try to understand to trace the flow of the bug. And typically, if, for instance, we are talking about memory issues, the fact that you are adding a code is, can move, okay, or can also hide completely the bug itself. Now the Cube Monitor is, instead, is a non-intrusive, meaning that you don't need to add line of codes in your application. And the Cube Monitor is able, in a graphical way, to show variables, a portion of RAM and stuff like that, and also take action when something happened, okay? So it's a really interesting graphical way to interact with your application in order to trace variables meant for the bug or meant in order to improve the quality, for instance, of some algorithm when you have a tracing over some days of activity. Is a drag and drop, as I said, is a graphical tool, already a lot of widget ready, so you can leverage on a very nice, also, look and feel. It is based on a red node, so you can really create a complex decision flow in order to alert or to do something when there are multiple conditions happening, and really, this is super interesting, that you can use these in a remote way, meaning that you can have your board, your hardware, and software in the field, and you can use a tunnel through internet to your board to monitor what happened in your hardware. And I think this is all for myself. I think that you enjoyed this part, and now let's go directly to the technical part.


The NCAA Woman of the Year Award is given annually by the NCAA Committee on Women's Athletics. The NCAA established the Woman of the Year Award in 1991 to celebrate the achievements of women in Intercollegiate Athletics. The award is unique because it recognizes not only the athletic achievements of outstanding young women, but also their academic achievements, community service, and leadership. NCAA member institutions from all three divisions nominate their own Woman of the Year. To be eligible, these women must have competed in earned diversity letter in an NCAA-sponsored sport and must have completed eligibility in their primary sport. Nominations are submitted by institutions to their conference office, who will then select one nominee to submit to the NCAA on behalf of the conference. The NCAA Selection Committee will choose the top 10 honorees in each division and from among those 30 candidates will determine the top three in each division. The members of the NCAA Committee on Women's Athletics will vote from these to determine the finalists for the NCAA 2020 Woman of the Year. This year's winner of Stevenson's NCAA Woman of the Year Award is Katie Leffridge from Women's Volleyball. Congratulations, Katie, for being named Stevenson's NCAA Woman of the Year. You're receiving this award because you have distinguished yourself throughout your college career in the area of academic achievement, athletic excellence, service, and leadership. What is so amazing is that you did all this and accumulated a 3.9 GPA while playing two sports. That's right, for all four years, eight semesters. Honorable mention, all-American, three years in indoor, max senior scholar athlete while playing and happening both of our teams. Your kind, down-to-earth leadership, strong work ethic, dependable, and loyal spirit will be missed dearly. I can't think of anyone who deserves this award more than you do. Congratulations, Katie.


And that you acknowledge and testify that the Prophet Muhammad sallallahu alaihi wa sallam is the last and final messenger of Allah So I'll just say it in Arabic, and then that's it. You become a Muslim, inshallah. Okay. All right. So just repeat after me Rasul Allah Allah I testify I testify that there is no God that there is no God worthy of worship worthy of worship Except Allah and I testify and I testify that the Prophet Muhammad that the Prophet Muhammad Peace be upon him. Peace be upon him. It's his final is his last messenger and slave.  It's a long journey. We're all on it It's a marathon on a sprint so I'm gonna bless you for being here Thank you for being the best part of mtc. We look forward to seeing you in the new year and jazakal hafiz. I'm like


Hi, this is your host up in Bhartiya and welcome to another episode of TFR. Let's talk and today We have with us once again Brent shoulder global CTO at Suza Brent is great to have you back on the show after a long time Yeah, it's great to be back and great to talk to you again A lot has changed pandemic happened and of course the market is changing a lot of companies are looking at Cost cutting or the way we look at it becoming more cost efficient Which also mean the whole you know once again the ecosystem is changing If I ask you if you look at all these macro micro and major trends Changes that are happening in industry What are you seeing is happening when it comes to a cloud adoption digital transformation companies are definitely Trying to accelerate their transformation as much as possible and cloud native is a root of that You know, that's one of the biggest things that I see in talking with companies in while, you know There may be some macro economic headwinds Companies still need to invest to innovate Because they recognize the competitive environment and that they're in and that they need to respond to it and continue moving So it's great to see the investments that are going in in the innovation in cloud native AI and ML and edge You know, it's just an exciting time of everything going on I mean we look at loud native that things have mature everybody's talking about the next thing kubernetes But there are still a lot of companies who still are in a very early stage of their digital transformation Suza has been on for a long time you folks kind of, you know set the whole open source, you know ecosystem their Banks are there like which are like hundred years old, right? So do you still see there are companies which are in the very early phase of their digital transformation cloud native journey is still And if yes, what are some of the major challenges they face? You know, I think it's I think there's still many companies that are very early and and even some that that let's say are the Such at the beginning that you know, they're still haven't rolled out any material production solutions in the in the cloud native space, and I think the the inhibitor for many of the companies falls into two camps One is just the operational expertise, right is is they're traditionally used to and well versed in the virtual machine world and and all the infrastructure that is involved there and With you know, it's one of those of you know when your hair is on fire you focus on what you've got to do And having the time and bandwidth to do that transition is is still a and a hit a burger to some Because they need the applications to go as well, which leads to the second aspect is, you know It's it's really a new development world for companies to move into cloud native to develop in a microservices architecture to adopt That development methodology both architecturally and the CICD or DevOps delivery models and operational models I think those are some of the barriers That are in place, and I think that really sets up the trends, you know that we're seeing is And that we as an industry need to continue to do is how do we make it easier? Faster to adopt the technology To minimize the new skill sets leverage the existing skill sets that Companies have so that they can put them to use in a much quicker manner Excellent. Once again, since you brought the point of a skill set, we are also seeing, you know, a kind of Not disturbing. I think what happened during pandemic companies were over hiring They just you know wanted more talent because there was always a talent shortage in the market We cover, you know, a lot of reports through Linux Foundation and all those and now the layoff is happening Seven percent seems to be a magic number there, which means that, you know There are a lot of developers in the market, but as you also said that I mean this This gap is not going to go away anytime soon that, you know, you have to kind of also internally enhance those skill sets Once again, what kind of challenges organizations are facing when it comes to having these developer Skill sets because we are also looking a lot of cultural organizational changes. We talk about platform engineering We talk about DevOps. We talk about SREs Rules are changing whether I don't know if the actual role is changing or just the labels are changing So if you just ask you to look at it from the culture of people's perspective What are companies doing and what they can do to address this skill set challenge? Yeah, you know, you mentioned some of the turnover in the industry And I think it's, you know companies trying to address that skill set challenges is, you know, aligning their business needs With the resources that they have and making sure that they've got the investments in the right places You're talking about it, you know, are they change is the world changing or is the roles changing or is the we're just changing the names I think the role is changing Because the technology and how you work has to change, you know, are historically Much of the organizational architecture was, you know, functionally siloed And that has to fundamentally change to take advantage of the technologies, you know having, you know Here's my compute team. Here's my storage team and the network experts know there's a security team, you know down the hall And they all work independently in silos does not work in the cloud native environment You've got to bring in more of an integrated experience where they work in teams with all of the skill sets together To deliver that and that's the biggest thing that we see You know, you mentioned one of the terms and this is one that is big in my mind and I see this every day when I'm talking to customers is this notion of platform engineering And I see platform engineering and it's a very maybe generic term But how I see platform engineering in the companies that I'm talking to that are adopting cloud native It's about providing the set of services to the company to the developers across the company and the operations teams across the company That provide them a consistent experience and actually abstract away some of the nuances of the underlying technologies You know, if we are asking developers to go learn Kubernetes In addition to understanding the applications that they're trying to develop and the business problems they're trying to solve That just because it's not in the interest of most of the developers You know when I travel around the industry and talk to developer groups They want to develop code. They want to solve problems. They don't want to understand pods and service meshes and such It's you know, somebody else take care of that And that's really the role of platform engineering is abstracted out of way provide services common services for the developers And that's where the team that platform engineering teams need to work together. I'm seeing them are the successful ones are working together Across compute storage network and security to provide that set of services to their developer community Now when we are talking about you said, you know, the developers are they don't want to get involved Also technologies are changing so fast. You didn't want to just keep learning new things because there are a lot of things that they're good at They want to continue to do is one more thing that is evolving and I remember talking to Susan also back in the early days was also AI ML there. We all talk about chat GPT copilot is there. So can you also talk about that how the AI ML all these new technology can also kind of enable Platform engineering teams so as to take care a lot of mundane jobs so they can still continue to focus on the challenges Versus doing a lot of repeatable things. Does that make sense? Yeah, you know, I do see you know more of that coming into the operation space and we even take advantage of the technology in some areas and are working on some of the next Areas, you know, one of the areas that is really being maybe two areas that is really being applied to observability right Kubernetes brings in a lot of power But with that is a lot of complexity under the hood and so to really scale and optimize on a continual basis as new services come online as they need to scale up scale down etc. And you've got all these different services interacting the only way to practically optimize that on a real time basis is with AI So I think we're going to see this notion of AI ops, you know really grow as you know the Kubernetes continues to expand And microservices continue to expand because you've got to balance, you know those services against available resources And you know, both the operation side and then the let's call it the reliability side keeping things running when there's an outage occurs where where's the root cause With complex interconnected systems understanding where the problem originated is extremely complex. So again an AI ML Problem that the technology can really be brought to to help address the second area I see AI ML helping significantly in the area of operations is security Again a very complex area it's it's changing every day right it's it's not like you know I can go out and like the old days of let me just go download a vulnerability file and you know check my scan you know make sure my security scans being done You know that's not the way security works these days you know the actors are the malicious actors out there you know have new approaches every day And the patterns that they use are constantly changing so to keep up with them and detect anomalous behavior is really the key that we see security moving into You know some of those solutions that we're working on and building into our systems you know the behavioral learning you know what's normal understanding that and then being able to real time catch anomalous behavior to help prevent data loss or malicious activities that may be going on you know that I think we're going to continue to see zero trust grow as the preeminent way to protect data loss and you know AI is definitely going to contribute to the growth of that. Now let's just like put it all together wrap it up and look at it from the lens of Suza the challenges the ideas that we talked about talk a bit about how is Suza evolving from the early days of Linux player to providing a wide variety of solutions so that you know the challenges that we just talked about so that you can help your customers wherever they are in their journey. If I was to just kind of summarize some of our key focus areas one in this whole this what I now refer to as the distributed enterprise and the complexity of the platforms is is how can we help build a unified platform across that distributed enterprise at both the Linux layer which underlies you know both the infrastructure and the applications and the Kubernetes or the cloud native layer having a unified cloud native platform you know across that distributed enterprise heavy focus on those two areas of the platform level working on simplification for the developer and the operations you know the world is moving too fast and there's too much technology for everybody to be knowledgeable about everything. So how can we simplify adoption reduce risk in adopting new technologies you know we talked about you know there's still many companies that are to come on to the cloud native experience. And I think much of that is about simplifying and reducing risk in technology adoption and then finally what I would call kind of the supply chain to production security. You know it's where you're getting your software from and can you trust that the developers and their building of it you've got to have security shift left into the developer realm it's dev sec ops it's not it can't be just dev ops any longer. And then you got to carry that through to the operation side to the production side and then implement zero trust controls on top of that. So if I was to kind of summarize the the spectrum of SUSE's portfolio investments and where we're going and trying to you know really focus on the customer needs that covers that the spectrum of that. Brent thank you so much for taking time out today and once again talk about the larger trends and the role SUSE is playing today in this ecosystem. I really appreciate your insights and I would love to have you back on the show again but let's make sure that there will not huge gap like this one. Yeah and it is such an exciting time in the industry and a lot of things to talk about so look forward to our next discussion.


Thank you all just so very, very much for making the time to come today for the extremely kind remarks. Mike, Steve, it's such a thrill. And let me say also thank you to my wife, Roya, who I just couldn't do any of it without you, my darling love. And let me also thank and just say how touching it was to hear from secure and from Andrew. Hearing hearing both of you Andrew was was such a pivotal advisor for me at the very beginning of my research career and secure has just gone on to be the advisor to so many wonderful people himself. It really makes me think about what a continuity we have within this academic enterprise and how, you know, the really the best good, the greatest good that we can do is the good we do through other people. I also want to say that this is a little bit intimidating because these are such big shoes to fill stepping into this professorship that was previously held by much who is a both a fabulous colleague and a person I've long looked up to. And I'll do my best not to to mess it up much. And also let me thank the Brent family for what they've done for this university and it's an honor to have your family's name associated with with myself and I'll all again I'll try not to mess it up. So let me share my screen, they've asked me to say something remotely profound and all I'll do my best. So let me let me try to put a little bit of what I've been attempting to do through my my science in context, and try to encourage others, especially the students here to think about the world in a certain way and to think about certain problems that that badly need or help. So first I want to just direct you all to think a little bit about what the scientific enterprise involves we think really broadly about what we do as scientists. Like, there, there are really four things that we spend our time doing knowledge generation, education and tech transfer or things that we do a lot around the university. But one more thing that science does is infrastructure creation and by infrastructure, I mean that the physical and organizational structures that are foundational to the operation of a society. Now in computer science. We don't really spend that much time on infrastructure creation. There is one big piece of infrastructure that we can claim credit for the internet one of the greatest pieces of technological infrastructure that humanity has ever devised. But I would argue that we should be spending more time on this last branch of the scientific enterprise and thinking more about the ways that we build and shore up the infrastructure of our society. Now in this talk I want to focus on one kind of that infrastructure and I'm going to call this the infrastructure of democracy. These are the technologies foundational to the operation of a liberal democracy like ours. And there are two key ways I want to highlight that technology is pivotal to the operation of a modern liberal democracy. And those are the technologies that power or secure and private communication the modern day post office and the technology that powers and secures our elections themselves the way we allocate power and decide who will lead. Computerization has created potentially existential threats to both of these kinds of infrastructure through things like cyber warfare and mass surveillance disinformation. But we as computer scientists as researchers have the opportunity to help address these problems. And I'm going to point to two ways that we can do that by building new infrastructure for security, and by working to bridge science and public policy. All right, so first let me talk about work that I did to build infrastructure to encrypt the web and I mean encrypt the entire web. So in in past work I and many many other researchers have highlighted lots of different problems with the cryptography that we use to secure online communications things like the TLS protocol that underlies every HTTPS website you visit. And in in that work we found all sorts of different problems problems with random number generators problems with legacy cryptographic protocols problems that were in some cases the result of earlier attempts decades before to build our cryptography so that the government could break it for surveillance purposes. But for all of this work. The most common vulnerability in the HTTPS protocol and its deployment was, well, what do you want to guess that vulnerability was plain text. Just seven years ago, how about half of all connections from web browsers to servers were just sent completely unencrypted over internet backbones. It was just about 2%, but that exposed these connections to mass surveillance to censorship to consumer profiling by advertising companies to attackers even modifying that data to attack and harm third parties. It's hard to believe, sitting here in 2023 that as recently as that half of the web was not encrypted but why was that well deploying encryption on your website was hard. You had to realize you needed it, you needed to go through a long and complicated technical process to get it. And that process involved going to some third party company called a certificate authority to have them vouch for your identity to web browsers that visited your site. But it was a huge complicated manual process.  Well, a year later your site would start looking like this because your certificate from that certificate authority would expire. And just in time for you to have forgotten how you got it in the first place. Today, things are quite a bit different from that. And that's because, well, my collaborators and I, we realized and we knew this from day one that there was a solution to this problem and that solution was form of extreme automation. We wanted to make it so that certificates could be automatically obtained in just a few seconds with no user interaction and it no cost to sites. My collaborators at the Electronic Frontiers Foundation, Mozilla, and my students here at Michigan got together and started a process that took many more years than we thought it would to build a new kind of certificate authority that could encrypt the entire web. Doing that was not easy. This was in some ways when we eventually wrote the paper and we only got one paper out of this. And it was one of the longest gestations of any research I've ever done. But we really looked at it. We had to explain to the reviewers, well, why is this, you've already succeeded. Why is this something worthy of publication? I said, look at it as an experiment. When we started this, if we had told you that this, if we had just proposed this system in a paper, you would have laughed it out of the conference because there was no evidence it could ever work. So we had to build it and prove that it could work and use it as an experiment. But building it required, well, creating a lot of different technical artifacts, pieces of infrastructure. We had to found and fund a nonprofit that could have people there all the time to run this thing. We had to build a protocol and take it through the IETF process as an RFC so that we could have a standard and open way to acquire certificates. We had to build new infrastructure grade software for the certificate authority itself, and we had to build software for clients to help them obtain certificates through this protocol. So all of these different pieces we had to build. But the impact of that has been intensely gratifying. A few days ago, Let's Encrypt issued its four billionth certificate. And today we serve more than 363 million domains. As Mike mentioned, those include Wikipedia and the White House, but also they include NSA.gov. So sometimes I wish I had a dollar for every one of these certificates. And I'm content with thinking just perhaps that every one of those certificates has generated maybe a dollar in value for society, even if we haven't been able to capture that, just as a rough approximate measure of the good we perhaps have been able to do. And if we look at how at use of HTTPS has changed on the web since we started it's gone from about 40% in the day we launched to about 98% today. Now there have been many other contributing factors besides Let's Encrypt, but we hope we've been responsible for a part of this. Today we are the largest certificate authority in the world by far to the point that as a director I have to worry about antitrust. But I'm pleased that the, I believe, fourth largest certificate authority in the world, James can correct me if I'm wrong, is Google Trust Services, which was built and operated by my former PhD student on this project James Casten. So again, the greatest good we can do ultimately is going to come through other people. Now one thing that a lot of people don't realize about Let's Encrypt is that the gestation the real reason for encrypting the whole web was important for the direct good that it did but also was to make another one of my projects building infrastructure more likely to succeed. And that's the refraction networking project, which aims to combat global censorship by making it by essentially rewiring the internet. So that sites are more difficult to censor. And the way this works is we put boxes at ISPs in friendly countries and make it so that make it so any HTTPS connection from someone in a censored country that passes through one of these networks can be picked up by a box in the middle of the network and converted into a connection to a proxy server. This technology thanks to the ubiquitous encryption on the web is able to more easily pass under the radar of sensors. And today we're operating it at scale, and it's the client software is in the hands of millions of people in highly censored regions. Encrypt has been working on a number of new applications to and I think this give you an idea of other kinds of research of infrastructure that we can build for security. One of these projects divvy up aims to provide privacy preserving analytics as a service. Another pro semo aims to rewrite the core pieces of the core network facing pieces of the software stack and memory safe languages. And we need to build more security infrastructure and I encourage the students here to think about new problems that fit in this in this vein. Now I'd be remiss if I didn't also talk about another kind of infrastructure that I think we can be doing a lot more in this computer science community to secure. And that's the infrastructure the highly computerized infrastructure that underlies modern elections. There is two broad classes of security risks. One of them we saw in 2016 when Russia targeted in cyber attacks election infrastructure across all 50 states, which we know happened because of the investigations of the bipartisan senate intelligence committee and the special council in 2020 we saw another class of attack false claims of fraud, which were purpose which were made by the president himself, who claimed that the election result had been hacked against him in an attempt to retain power. Both real attacks and false claims that attacks happened or things that elections must be engineered to resist. That's part of what makes it such a difficult problem. I'll mention briefly, my own role in resisting some of those false claims. So right here in Michigan I don't know how many people know this but right here in Michigan and on election night 2020. We were, I think the only large jurisdiction in the country where an entire county reported actually did report the wrong winner on election night. So, Antrim County, Michigan. In its election night results report it's a very red county in upstate Michigan, and yet it reported that president that that that Joe Biden had won by thousands of votes, and this is a result that was absolutely impossible and everyone knew it from the first place. And the state very quickly corrected this and reported that it was the result of human error. But that was too late to stop there from being a lawsuit by people connected to the Trump reelection campaign, which obtained from a judge the right to do a forensic investigation of the computer systems involved in the election. And within just a couple of days came out with this incredible expert report, declaring that there had been massive fraud as a result of rigged dominion voting machines. Now, this is in just in December of 2020, even before January 6. There were calls for President Trump to do something. Now we know only in retrospect, more specifically what do something would have meant the Congressional Commission that investigated the events of January 6 turned up this draft executive order that was never issued. What would have authorized the Department of Defense to seize voting machines across the country, citing as its reason, this bogus expert report from Antrim County, Michigan. So that's what's at stake. In the in the immediate aftermath of those events, the way that Michigan responded was that our Secretary of State and Attorney General commissioned me to do an independent forensic investigation and respond to these claims. And unfortunately, it's much harder to do real science than to just make things up. It took a couple of months to do a thorough did investigation of all the digital artifacts and really determine what had happened to a high to a high standard. But I did. And what I was able to show was that the reason for the errors in Antrim County was that election officials had made a last minute change to the ballot had updated their central aggregation computers but it neglected through human error to update some of their voting machines with that new ballot design as a result in much of the county. President Biden's votes were thrown away. Biden got Trump's votes and Trump got the libertarian candidates votes, and so on down the ballot and you can reconstruct these errors exactly there's no doubt whatsoever that this is what happened. The investigation also showed that there were still some down ballot races in which other errors that the election officials had made cause the results to still be wrong, including one contest, the Central Lake Village Marijuana retailer initiative that had been failed as a tie on election night, but when they went back and re scanned the ballots to try to correct the other issue, one of them had gone missing. And so the initiative passed, but I was able to reconstruct the initial ballot and show that probably this was incorrectly decided it should have been a victory so I've been to Antrim County and visited that Marijuana retailer I mean Marijuana retailer here it is so if you ever say that you know election here someone say election glitches are never going to have consequences while you're living proof. So, um, there is no evidence whatsoever that the 2020 election was hacked, but what we do know is that election infrastructure has very serious vulnerabilities in fact it's the consensus of the National Academy's that there's no realistic mechanism to fully secure vote casting and tabulation computer systems from cyber threats. So our grand challenge is to figure out how to achieve security and public trust using inherently fallible technology. It's fallible in the sense that every single time that qualified independent experts have done a security review of a US voting machine, we've found vulnerabilities that would enable vote altering attacks. And this is for a variety of deep regulatory reasons that we just don't have a very high bar for this technology it's maybe 20 years behind the status quo and if you want recent evidence of this just last year. SZA the cyber security and infrastructure security agency the federal agency that oversees election security issued its first ever security advisory about vulnerabilities and election equipment. Based on work that I did with my former PhD student Drew Springle is now a professor at Auburn. The Georgia voting machines shown here a dominion voting machine because of course it's dominion, and found, well, just awful very serious vulnerabilities, including we could completely bypass the cryptographic authentication mechanisms and remotely execute arbitrary code from the memory card as root. So, SZA said that these vulnerabilities present risks that should be mitigated as soon as possible, but Georgia's Secretary of State recently announced that it will not patch these vulnerabilities until after the 2024 presidential election is over. Because of course it won't. It will ultimately have taken longer than the US is involvement in World War two for the state of Georgia to correct these nine CBEs. Now what's the implication of that the Georgia's machines as a professor of power from Princeton mentioned have a paper trail but we say that there is probably the worst kind of paper trail. Well that's because there's a vulnerable computers sitting between the voter and this computer print out that says how you voted. And how are voters going to notice if something is wrong how likely our voters to notice if something is wrong with that print out because the machine has been hacked. People have very different intuitions about that. And so my students and I wanted to actually try to measure this. And we did a study where we set up a mock polling place here in Ann Arbor at the public library and asked more than 200 people to come and vote on real machines we had hacked so that they change one vote on each print out. 23% of people failed to notice that cheating, and that means that in a real election. If it's a close election, enough people might fail to notice the tampering for the the result to be wrong. So this is a serious problem and one more problem I want to point out also in dominion voting machines. Another real problem is that this technology can also potentially threaten voter privacy. Last year, my students and I, along with Professor Springle, discovered a vulnerability in dominion ballot scanners because of course it was dominion. So, to protect privacy these scanners assign each ballot a random looking identifier, and that gets linked to the ballots, even if jurisdictions publish things like scans of the ballots, which because of the stop the steal from the government and other things there's now a lot of pressure for jurisdictions to have that level of transparency and publish vote by vote data. My students and I discovered that these random IDs are in fact fully predictable because they're chosen by a linear congruential generator, a method known since the 1970s to be unsuitable for use in security. With public information anyone can reverse engineer the generator and unshuffle all the ballots. So you can go from results that look like this with scan of every ballot and figure out the order they were cast. Also because of the current public pressure about election security some jurisdictions publish all day video of the polling place showing exactly who has used the scanner. So, and align the photograph of the person using the scanner with exactly what was on their ballot all day long. This also won't be patched in Georgia until after the 2024 presidential election. All right, so what do we need to do to defend these things. To find out how to achieve security and public trust using valuable technology now we could do the old fashioned approach try to keep hackers out of the systems and of course we should do that. But that's never going to be enough to prove to people that the election result was right at best will have no evidence of problems. A better approach and what my research community advocates is to provide public affirmative evidence that election results are accurate. We can do this using handmark paper ballots and risk limiting audits. So risk limiting audits, a technology introduced by Philip Stark of Berkeley who I hope my friend Philip is here on the call are a way to hand count enough paper to ensure that if the outcome that was reported by the computers is wrong then the audit has a high probability of detecting the discrepancy. The National Academies is called on all states to adopt our LAs by 2028 in all those federal and statewide contests. So how are we doing getting paper and audits. Well the map has changed considerably between 2016 and today, you see a lot more green handmarked a lot more a lot less red, but you actually don't see all that much more green. So, the paperless voting machines have finally gone away and all but one state Louisiana, but we have a lot more work to do because most of the jurisdictions that have gotten rid of them have gotten those ballot marking devices, technology similar to what Georgia uses that put a vulnerable computer between the voter and their ballot. We're even farther behind unfortunately, even though it would cost only a few 10s of millions of dollars a year to audit every federal contest. Only a small number of states routinely require audits to a high level of statistical confidence after elections, and there's no way we're going to get anywhere close to the National Academies recommendation. So if we don't have auditing or if we do have auditing but want to make sure that we detect problems before voters go to the polls. That raises one more interesting research question. So how can pre election testing do a better job of detecting attacks. And this is something I'm working on right now with my PhD student Braden Crimmins and my collaborator at UI UC Brad Sturt who just had a baby hi Brad. And we're looking at ways to make pre election testing more rigorous before every election officials run ballots through every machine that have known marks and make sure that the machine gives the right total sounds like a good idea. But what kinds of problems you can spot with this depends on how that test deck is marked. We discovered that there are actually some pretty easy to carry out categories of attacks that the test decks that states use today just aren't going to catch. But moreover, if we're very clever about how we generate the test deck. And in fact if we generate that test deck by applying an optimization algorithm and techniques from operations research called integer programming. Then we can come up with a test deck that's both short enough to be used efficiently and also can detect a much broader category of potential attacks and misconfigurations. So how many ballots would you need in one of these tests well looking at Michigan's 2020 election the 2022 elections, Michigan's existing procedure which only detects a limited set of attacks required 22 and a half ballots on average. Our technique requires only 22.8 on average and detects these different problems both within in a cross contest. We're working with the state of Michigan to deploy this technology and just this month it was used in real elections for the first time in a number of Michigan jurisdictions. So to get farther we need more science, we also need more help from policymakers and Congress has an opportunity to enact key reforms like requiring paper ballots and risk limiting audits, but so far it has yet to act. So working with our policymakers, we can make sure that these key reforms get in in implemented such that evidence based methods are deployed that can show election outcomes are correct. Not merely that there's no evidence they're fraudulent. We have to make attacks more difficult by applying security testing and best practices ensure attacks are detectable by recording every vote on a very voter verified and preferentially handmark paper ballot actually conduct risk limiting audits of all major contests and normalize nonpartisan investigation of problems of the kind that I did in Antrim County. There are abundant research opportunities in elections for any students who are looking to help and elections truly need all the help they can get, not just from not just from the political pundits and activists you see on TV but also from scientists. So I want to thank everyone who came out today for this. This work would not have been possible without my colleagues my collaborators, and especially my students. So to to past and current students. Thank you just so very very much. And thank you, everyone.


Going on everyone Sam here with Lance sports cards room in 23 bow and trap baseball jumbo 8 box case number 56 picker team style names and teams Anton H. Reds Bennett P with the Phillies Chiwei F Nationals Chris F brewers Daniel L. Royals. Thank you Daniel. Demetrius J with the Angels Duke F Marlins Edwin C White Sox fur Han a Rockies Frank P blue J's Gary a Astros Jeffrey H. Meth pirates Cardinals Jordan K with the Orioles and Mariners Joseph C with the Rays Justin K Dodgers Kevin S. Paper Base Kong X Cubs Lisa S with the Giants Mark C. D. Backs Michael M. Braves Yeah, Braves Michael B with the A's Mitch D. Red Sox Nelson P. Guardians or NW at Tigers Rangers Peter and Padres Tyler P. Yanks and Zach D with the twins So good luck here everybody Let's get after it Again, let me drop you a link to 57 really quick before we get started. What is it 12 to go? I believe 12 to go On the next one All right, here we go Bowman drop jumbo Hey, good luck everybody do it. I'll first of Hunter Holland. If you have the case of the Mondays It's a Rippa case of Bowman draft very true made on that Victor Purple to 250 Carlos Jorge for the Reds Jaden Ham Jack Weninger Just 99 and under for To 499 Brady Smith sky blue paper Got sky blue chrome Garrett Forrester Lunar Glow how you Lee Marianne Boyd and Brock Rodin first refractor Justin Crawford parada and Spencer Nivens got a glass of Dillon head and Luke Keissel first refractor Sparkle Justin Reimer That's on that Red Sox Do you know and Jacob Gonzalez first refractor, but yeah, that's a Langford first refractor Did I go pass an auto my fault on that one? I may have actually Yeah, right there Brandon winnaker good catch on that one now. You're good. Sorry about that I was gonna make sure I feel like for some reason like I felt like that they're supposed to be one in there But that's a Brandon winnaker auto so congrats on that one twins my fault It's Monday. We'll come some slack a little bit. Yeah, I Guess on that one first base auto Jack Mahoney Going through the Rockies nice one there First shown wetter and Malia winner There's a lot of times like the the run of ballman will be set up the same on how the packs come out, right? Like where the autos are so like with this one the auto will be in the last one most likely to 99 Kevin Parada so when you don't get an auto in the first stack usually it's like okay something might be wrong that is Teddy McGraw Donnie curse no strike again. Come on. I Just your presence it's a 150 Jonah Cox one of 150 Phillip Abner and hero white I'm sure you would love to have a No, I would not Sam Zavala sky blue chrome First of Chris Clark and Shrey the ray Morgan say gradient paper to 199 Charlie Soto And first refractor Otto Ethan O'Donnell for the Reds 499 congrats since he Roy and Brock Raidenberg Mods those TJ Walton and Jonathan. Yeah, three fractors True green Jayce young to 99 for the tags Devon Salt ebon and William Brigouet. That is a first at Teddy McGraw At a lunar glow first of Christian opera Carson Rock a fourth day and Bruce Lee First base auto Nolan McLean. We go to the Mets. Congrats in New York Mr. McLean the Zanzana tello drew Gilbert And Arthur Smith just doesn't look like she'd be in charge of anything fair we give Bradfield glass Jonah Cox and Ryan Clifford Eat some mustache back True dude That is a aqua wave to one at 25 Christian Campbell Red Sox First of Owen Taylor and white Sky blue paper Roger Garriott's 499 finally sold my out of his Joe Whitman and Patrick Riley took a loss Okay, sometimes you guys take a loss. All right. I'm just glad that it's gone Price Eldridge nice one there at 199 Aqualaba Congrats Giants there you go Lisa Congrats Lisa Very cool very cool. Thank you. Mr. Josh pick up the deep accent Bowman Chrome Seth Keener Zach Thornton Noble Meyer first refractor purple first Seth Keener 250 Travis Honeyman and Alex Ramirez Yeah, that's a good time the defense isn't great, but the offense is very good Like it has the potential to be stupid good Falcons offense Carlos Jorge. I Don't think winners the guy. No I think he could get the job done They didn't want to get quarterback this draft. Yeah, he might be a bridge guy Brock Rodin first base autumn Congrats on that one there Levenson and Jake Jason. Sure. Yeah seems like he's got respect in the locker room. Hi Nicky. Yeah Eleven ago in the next one everybody 11 ago some good squad still remaining as well. It's up quicks. Hey, dude, buddy What's up? What's up? Yeah teams all on sale for the next one as well guys pretty house and Kendall George first refractor Sparkle JCL and first of Sean Sullivan refractors lunar glow first is Charlie soda the twins Picard and Kate color first base auto Kate Denton That's on that Rockies Lindsay and AJ you know Noah Schuyl is really gonna have it. What's up sin is really gonna have one Said hi Pete first of Tanner Hall and Colt Emerson. That's not by sins Pokemon break last night. Nice pretty good Still with full fire actually Curse them with Donnie She's 75 Mike Bovee. I sure didn't like Bovee first your practice She'll probably be in He'll be in regular bowman though. Nice Max Clark to 99 on the green paper. That's Tigers or you go orange Sky blue chrome like your mirror Holiday and Nolan the plan first base auto camp alderman It's one there for the Marlins Charles Jones Dylan Campbell Mood ring that is Colt Emerson think possibly they might actually to be honest quicks Homer Bush. It's up Zach. How you doing, buddy? If you're doing well as well Dude, I want to get a counter of you saying that phrase Because I feel like it was so probably Lord eight of ten on the Rose Cold Lava Grats on that Orioles nice one there and it drew Hackenberg first refractor grace and hit and Jerome Watts Brown I'm all down for a phrase counter It'd be so high Vaughn Probably would be True green auto is gonna be Kemp alderman first two ninety nine congrats, uh, Marlins Manachi Tommy Troy Get everybody. We got 11 to go on the next one 11 to go teams are marked down again 11 it to go 11 it to go on number 57 Alrighty guys for Kylie up that trash for Sean. I love the Canadians class Colt Emerson Napsick and Coulson at Montgomery true blue Christian opera to 150 first Barofin and Jacob Cravey First lunar globe Andrew Walters for the Guardians Tony and Brian Acuna nice Wyatt Langford first base auto congrats Rangers There we go. Nice take it all day, man. That's awesome. Get that into a mag very nice always take Good old Wyatt Langford led better and Marcelo Meyer What's up Justin? How you doing buddy? Thank you Kevin is well taken the bears in prism Davidson Gutierrez to 499 first Cade Morris and Savak would yeah 12 out of 50 Brady still in play I haven't pulled yet again to our knowledge at least what's up? The Brady number 12 of 50 still hasn't been pulled. Oh, probably Troy to 250 on the refractor for the D-backs Cunningham and a jet will inject them that that is a Philip Abner Is Andrew muth Jason Woodward sin. I'm hoping it comes in soon like Lane got his stuff last week at some point We still haven't got a rest Purple noble Meyer for the Marlins. Why don't they're killing it dude? This one there to 250 Mahoney and a hollering. It's not technically public info Justin But we're gonna assume that it hasn't been it hasn't surfaced on social media anywhere So unless somebody Has opened it privately and has not shared it Jacob Wilson Hunter Rowan in this day and age. I don't think that would happen I need those Instagram likes Yeah, first base auto Johnny Farmella that's on that to the Royals and not Royals Mariners Marcus Brown Levi-whills Yeah, that's the only one that you could be like pretty much not guaranteed but like kind of know is still out there Because it has not surfaced Max Anderson Ariel Castro I mean as we we don't I don't think the Clark or the Lingford super autos have been pulled either from Ella To 199 for the Mariners. I know Skeens super auto is pulled we pulled droys Deanna horror head 125 for the rocks Aqualuna crater Matt Shaw fell in it so Yeah, I have to imagine most of them will be Robert M with an inception spot. Thank you, buddy That was such a long down to two to go on that is right. Yes. Yes, sir. Half of late in style is my submissions. I love it to me Vargas first of noble mire greet frack tour I Imagine most of them are gonna get graded Most most of the big ones are gonna get graded TJ Walton to 125 lunar glow and I would have low aqua lunar crater Traffitonium in alchemyris Let me read it Lunaglue, Hurston-Waldrup first Christian Campbell and Luis on her look good. Yeah, TJ Walton to 499 the Phil's Jacob Wilson first base auto congrats to the A's nice one there one of last teams taken congrats Oakland their main guy Levinson and Jason Sharia solace to 499 Glass Jacob Wilson Veccharo and Joe Redfield true green Tommy Hawk to 99 Forester first Paul Skeens sky blue chrome Farmella my team is super frackers Yes, it is Ralphie Velasquez the 71 going to Cleveland Congrats Guardians. That's nasty That is nasty man. Hell yeah, get that into a mag for sure Beautiful. Thank you, Mr. John taking the o's and bowman chrome appreciate you buddy chase Davis Appreciate you my friend spark with a 71 Mr.. Ralphie first rounder for the Gattians Come in a land of Marauders.  Well, that's good. He's a stud, dude I try will be all With right now you might be able to some decent stuff Charlie Soto 125 no Troser and Jackson William. I'm pretty cheap Sam Wyatt Crowell and Kyfer Lord I've been taking some chances outside of sports I'm what some some Star Wars some Marvel nice nice bought my first Pokemon card. I think the other day First base auto is Rockerizio Congrats on that when they're Yankees Okay, Denton Rockerizio. It's hard to buy like the 90s Pokemon stuff without like the the foils being like scratched up Yeah, I mean they're so old I Would think it's like they were in sleaze even if they're being played that like true. Yeah, you're right You'd think Levin it's a go on the next one everybody No, it's not a 112. That's pretty cool. Nick. I like that Bonacal black color Blasio their day UFC guy That's pretty sweet sweet. I don't know what name it is. Yeah One of the better one of the better UFC fighters right now Max Anderson first refractor Ariel Castro Deon Jorge at 199 first of Matt Shaw film in Celestyn Sky blue chrome Adrian Santana little look Juan Ipa Jacob Wilson first hunter Owen first Mike Bovee first purple auto nice one there to 250 congrats on that brook. It's up Joshua Marcus Brown Levi Wells Wyatt Langford glass Tayshawn Walton and Mejia This one now I said Like any of the other inserts that is a chase Davis is 75 nice one there in the yellow lunar crater for the Cardinals Salty bond Burgoy gradient paper to 199 new entry Vargas There's a first refractor Rocco Forte and Brooks Brooks lead First base auto Dylan Campbell for the Dodgers This one there doors is on a cello drew Gilbert. That's why I want the Texans to win That's why I want the Texans to win Kyle first up Jonah Cox Ryan Clifford True blues act Levenson 150 Taylor Show is gonna win.  I don't want to play the freaking AFC North in the playoffs I really don't cold Miller Joe Whitman Patrick Riley, so if you have a lose to a team Nobody I don't want to lose to anybody in the AFC North. I'd be pissed. We lost anybody in the AFC North We lost to the cheese blue Brock Vradenberg to 150 Congrats on that one Keener and Zach Gordon chiefs like whatever it's the chiefs.  I think stroud's gonna have a very tough time against the Browns defense I think stroud is gonna have a really tough time against that defense. Just he might get shredded.  Yeah, that's a team that doesn't deserve to be in the playoffs Cole Foster. Oh Steelers even less so deserve to be in the playoffs. No offense, but Jake DeLeo to 75 nice one there Mack Horvath, how you Lee? Sam I hope so I really hope I'm not like I said, I'm not confident until the Super Bowl hits F and we win that that'll be Chris Clark and Christopher Torian and Charlie Soto and Hans Montero Got 11 to go on the next one everybody. Let's get that filled 11 to go Zach Levinson to 199 the Cardinals First base auto Tommy Troy That's on that one D-max Person Waldrop, Luis Guanipa. There's Luis Angelacuni to 499 Romelo, Ethan O'Donnell and Dylan K. Studd. Yeah, I'm not as worried about I was very worried having to buy in 2019 I did not like having to buy in 2019 because I knew that we were gonna come out not swinging Jonathan Machia on the plate for the Cardinals. You're not right now Not as much now Tommy Hawke Mooneos the team is better than it was in 2019. This team is much better in 2019 Pretty much all around first of Wilson and Connolly early because I like you also have to factor in that it was Lamar's second year versus Lamar's Sixth year. Yeah, that's true. You know what I mean? Yeah a good point or fifth year Whatever the hell whatever your reason first base auto salt ebom for the Phil's congrats Philly's Brady Smith and TJ Nichols. I'm trying to like pretty sure myself that although Jalen Hurts isn't playing great He's still only 25. Yeah, yeah, yeah, he has time to get better, but Who knows if he's going to right camp Alderman and Ludwig Espinosa I can't give up face yet, but I can give I can give up faith in our coaches or coaches Yeah, they're just not look great this year. That is Lazaro Montez Baker has a nice path to super Rick Taylor and solace a good old Tampa Bay Buccaneers I mean he's got like a first round by so So that go for him That is a hero Wyatt Max Clark Carlson Reed fire the cannons Fire that the 9-0 win against the freaking Panthers yesterday Dylan Campbell to 499. That was pretty bad. That's on that Dodgers Burns and Nelson Rada. See again, at least you could think like that team's not that scary either if you're only being a Panthers 9-0. All right, we're on the last box here, but Yeah, let's get the next one sold out. We are getting there for sure. We are getting there I don't know what Stroud's prison base cards went up to Probably a decent amount again. They're probably like 70.  Jesus man, I tried to grab a blaster at a target. They did not have any. They're out Yeah, thank you. Tatsuki picking up a mixer spot again. Just mark down the rest of the teams in Bowman Draft again, everybody. They are Pricing is really good on that. Pricing is scary good on the next Bowman Draft race as well It's funny too, because you can see like that they organize like their car section and like half of it Yeah, she's like, oh, I bet that was the first one. Yep, Bryce Eldridge, Beshears and Cole Young. Yep, exactly Exactly. Farmelo class of 2023. I just went there for the Mariners. Hunter Haas, Gabriel Gonzalez. Dolphin Chief's not Peacock. That's annoying.  Like Mitchell, Andrew Walters, Christopher Torring. Restream. Yeah, true. We'll be able to get Streamy's down there. Andrew Lindsey, the 250. Or about Restream, Streamy's. Yeah Bryce Eldridge, yeah, Restream's gonna show you. Yeah What are you gonna stream again? Luke Schlager, Luke is going, I wanna come and troll you. Tomorrow. I'm not working. And I'm working tomorrow. I can't troll you tomorrow.  Maybe I'll still troll you, man. Then Thursday.  I'm not working Thursday. It's just 75 Carlos Jorge. Okay, I figure out I'm still playing Star Wars or not. Why is he finishing it here? I read the story of it, but there's still a lot of exploring. You know you have to go and Don't enter achievement, Hunter. Yeah. Go to year, it's the 499. Like halfway. Nice. Tray Morgan, the 499. Dylan Head, Camilla DX. Just like a lot of collectibles and stuff. Yeah, that's true. True, true, true, true, true, true. First base auto, Cole Miller, the ace. Kevin Sim, first refractor, Deon Jorge. First refractor, Kariko, and Roman Anthony. And first base auto, another K. Denton. Going to the Rockies. Congrats on that. Rocks, Delio, and Christian Hopper. I was thinking about doing like a challenge for the community to get up to like a certain amount of channel points to do like a grandmaster run. Like Mitchell Anderson. But that might be a headache. To do the grandmaster run. Like to be like on expert difficulty. Oh, yeah, yeah, that'd be rough. But it could be funny. Matt Corvath, the 199, probably will be. I wrote the laugh of my pain. Rios and Drew Jones. All right, quick recap here, everybody. All right, we've got a printing plate of Jonathan Allen, or Jonathan Mejia, got to be. 99 Tommy Hawk, Jase Young, Kevin Pirata, 275 is Jace Davis, Jake Delio, Carlos Jorge, Mike Bovey, to 10 Kyfer Lord. Autos, we've got Johnny Farmello, Devon Seltibon, Tommy Troy, Cole Miller, K. Denton, Dylan Campbell, Rock Regio, Jacob Wilson, Johnny Farmello, Kep Alderman, K. Denton, Brock Rodden, Nolan McLean, Jack Mahoney, Brandon Winnaker, Ethan O'Donnell, Dylan Campbell, to 255, those were to 499, to 250, Mike Bovey, Noble Meijer, to 199, Bryce Eldridge, to 150, Vraidenberg, to 99, Alderman, Wyatt Langford, base auto, and then to 71, Ralphie Velasquez. I'll do it for the break, everybody. Thanks again for the fill. Coming up next is number 57.


Hey guys, Thunder E here and welcome to my best gaming headsets for your next gen consoles. Now, if you're looking for a gaming headset to definitely pick up with your brand new Xbox Series X, S or PlayStation 5 or even your gaming PC, this is the right video for you. Now, before we go ahead and start, don't forget to hit the subscribe button and notification icon to get notified with our latest videos. All right, so the very first headset I'm going to be taking a look at is the Astro A20 Wireless. It's available for both the Xbox Series X and S as well as the PlayStation 5 and this is a wireless headset from Astro. I really like it because first of all, it's truly lightweight. It's very comfortable as you expect from Astro. Also, it retails at $119. Now, what's cool about this headset is that it works for both the Xbox and the PlayStation. Now, yes, we know they are different systems, but this has been done by using, of course, a USB type-C dongle and this one right here allows me to switch from this Xbox headset and to use it on the PlayStation. So, I can basically buy one headset and just buy the get an extra dongle and I can switch between my PlayStation 5 and my Xbox Series X. I absolutely love that about the headset. Now, this comes with 15 hours plus battery life, so roughly got around maybe about 15 or 16 depending on use case there. Now, all your controls are all on the right ear cup. There's a power button. There is, of course, some built-in EQs and you've got your game and chat volume at the bottom here. This also charges via USB type-C so that's good to see. It's a nice headset and I think a lot of gamers would like what Astro makes the cable with this especially if you're picking up both console safe. For instance, you have Series X and then you get in like the PlayStation 5 digital or you're getting the PlayStation 5 and you're getting like the Series S. You have a headset that you can use on both consoles. You just need to get that dongle right here which is really, really cool. So, the Astro 820 wireless definitely worth picking up. So, this very next headset is the Razer Kyra Pro. Now, the Kyra Pro is a brand new gaming headset from Razer for the Xbox Series X and Series S. Now, there is also a Razer Kyra which doesn't have some of the pro features. Retails for about $99. The Kyra Pro is $150. Now, this headset is really comfortable and easy to use. You can see it's rested on my head right here. What I like about this headset, of course, first off you've got, of course, Razer RGB lighting on the headset by the side of the Razer logo which is nice to have especially on a gaming console headset. Now, this connects via the Xbox wireless or Bluetooth. So, you do have the ability to connect directly to your consoles without any dongles whatsoever. And you've got Bluetooth connectivity for either laptop or PC or, of course, your mobile devices if you're playing on Xbox Game Pass. So, that's not a cool aspect of having this headset. Now, in terms of controls, you've got your chat mixer rocker on the right here cup as well as also the Xbox sync button and the Bluetooth button. On the left ear cup, you do have your mic mute, your volume rocker, and charging via USB type C. So, that is actually pretty cool to see. I definitely like the headset. I like the functionality within. I think it's something that I would be using quite a bit as well. So, right now, this is the Arctis 7P or 7X. Now, the 7P for the PlayStation 5, 7X for the Xbox Series X. Both headsets are priced at $149, really great price point, especially with the kind of sound. Now, I'm using the microphone off the headset right now, which is a clear cast mic from SteelSeries. So, you find all the headsets. You've got a ton of features that you would expect. You've got the SteelSeries sound. You've got lossless wireless audio because it transmits over 2.5 gigahertz over Wi-Fi. 24 hour battery life, which is pretty good. And it's Discord certified. So, if you're playing on PC, which you can use either the X, the 7X or the 7P, you can definitely do that. Now, in terms of controls, all the controls are on the left ear cup, the mute button, the volume rocker, your connector, and then on the right ear cup, you do have your power button and your mixer chat. Now, it does charge via micro USB, which is annoying, but it also comes with a dongle that connects directly to your PC, either USB or actually USB Type-C, which allows you to connect to things like, say, your MacBook, if you're using a MacBook in terms of using it for video conferencing calls, as well as also your mobile devices for your mobile gaming experience. So, I really like the X7X and 7P. I think this is probably the sweet spot for a lot of gamers in terms of getting some really high-end gaming headphones. So, this is the HyperX Cloud 2 Wireless. I love the original HyperX Clouds, but it's also a very comfortable headset, aluminum frame. It's got 53 millimeter drivers, 7.1 surround sound. It works well on your PC, your PlayStation 4, 5, as well as also your Nintendo Switch. So, your gaming needs are covered with this headset. It's got a USB dongle, which can, of course, attach to your console, also lining. Very simple controls. You've got your USB port on the left-hand cup, your mute button. You've got your volume rocker, and then this power button. And that's pretty much it, but it sounds really good, and it's great solid headset priced at $150. So, my last headset I have here is the Astro A10 headset. I've got the Call of Duty version, and if you're a big Call of Duty fan, this is a definitely cool headset to pick up. That is really cost-effective. You can pick up a variant for the PS5, PS4, or the Xbox use S, X, and also the Xbox One X. So, this headset will work for any of those consoles. It's got a lining cable. You've got a volume rocker right here, and the mic is a flip-up mic. So, of course, you flip it up, it mutes the microphone. Very comfortable headset to use, plugs in directly to your controller. So, you have direct access right there, and, of course, you can do your chat mixers on your console, especially on the Xbox, UeSX, which, of course, you can do that quite clearly. I like it for its simplicity and ease of use. This is something that you can just wrap up with you on the go. It does have cable splitters if you're a PC user as well. So, if you want to use this on your PC gameplay, you can definitely do that as well. Solid headset, I think altogether cost-effective, very lightweight, and easy to use. There's a solid list of headsets altogether. I think you will find something that fits what you need, be it your brand new gaming consoles, the Series X or the PlayStation 5, or if you just built a brand new PC, I think any of these headsets will work quite well for you for those needs. So, if you have any questions or any comments, guys, let me know. Don't forget to like, share, subscribe, and always enjoy your entertainment.


Putin's Daughters Foundation buys share in Russia's largest drone manufacturer. The National Intellectual Development Foundation, better known as InnoPractica, which is headed by Russian President Vladimir Putin's daughter, Katarina Tikonova, has become a co-owner of the largest Russian UAV manufacturer. The Moscow Times media outlet reported this. The publication reported that the National Intellectual Development Foundation bought a 10% stake in the GeoScan group of companies which manufactures civil aircraft, drones and software for photo-grammetric data processing. As of now, Alexei Semyonov, head of GeoScan, owns 87.5% of the company, another 2.5% is controlled by the GeoScan CEO Alexei Yuretsky. Ukraine imposed sanctions against GeoScan in early July 2023 due to the statement of Andrey Nazarov, Prime Minister of the Republic of Bashkortostan, that drones for the war in Ukraine will be created at the GeoScan-UFA facilities. GeoScan-UFA were part of the GeoScan group of companies until July 2022, but Semyonov sold 40% of the company to Vena Mirzayanov, CEO of Ural Trading, who owned the remaining 60%. The Ural Trading Company belongs to the unknown 67-year-old Khalid Zaripov. The company is engaged in numerous activities from real estate appraisal to beer and meat trade. However, drone production is not listed in its profile.