So, in a number of previous videos, I showed you how to use the developers console, developers tools to get HAR content, that's HTTP archive resources, I believe is what that stands for. For example, here in Brave Browser or any Chrome browser, but really any modern browser, you can open up the developers console, usually by hitting F12 or some other key, and you can navigate to network, and then you'd want to refresh the page to make sure everything is loaded down here, and you get a list of everything that has loaded on that page. Every font, every script, every image, audio file, video file, unless they've gone through measures to try to hide that from you, in which case you might have to do a little more digging, but you can right click this and you can say, well you can say save all as HAR with content, which gives you all the images and sounds and videos all embedded in one file, but you can also go copy as HAR, which you can then take, and I'll just paste in the shell here, gives you some JSON format output that basically is just every file that loads on that page, the URL for it, and information on it, so you can dig through that and scrape this web page a little bit better. Go ahead and clear that, but let me do that, but without using our browser, we're going to use our shell, and we're going to use a program called PhantomJS, so on a Debian-based system I'm using absolute, I'm going to search for PhantomJS, and as you can see, I already have it installed, if you don't have it installed, PseudoAppt install PhantomJS, and you'd be able to install it on most Debian-based systems, as long as it's in your repositories, as you can see it's a monolithic, headless, webkit-based browser with JavaScript APIs, so basically you can write JavaScript code and run it right in the shell here to scrape information from websites, and if you go to the project page, it's up on GitHub, they have a lot of good examples, and this one's called Netlog, and what this does, basically you give it a URL and it's going to give you that HRA information, so what are we going to rip down this time? Well recently, if we go back to my Films like Chris website here, you can see I did a video on live streaming Facebook videos using MPV or VLC, which is very simple to do, and I used that developer's console to get the video we need, but someone recently asked me on that video, how do you download streaming video? Well, I haven't really looked into downloading the streaming video, but I've looked into downloading videos from Facebook, and most of the live streams, once they're done live streaming, they're available to view, and you can use this technique to download them, so it's kind of sort of answering the question. So, yeah, let's move forward. Oh, also, normally I would use something like this, I would use YouTube DL, which is a great program, which you should install, if you haven't, and it's great for downloading not only YouTube videos, but it will download videos from a lot of different websites, and in the past, I'm pretty sure it worked with Facebook, but I haven't been able to get it to work lately, but they're constantly updating it, so if Facebook changes something, they'll probably have an update soon that, well, I do that, but we're going to do it without YouTube DL, we're going to do it ourselves. So, I uploaded a video to Facebook just for this. It was just a one minute, 30 seconds, me talking about how I'm going to make this video, I need an example video. Once I go to here, I'm going to grab this URL, which is usually Facebook.com, some sort of number, or usually, sometimes it's a name like it could be filmed by Chris, since that's my page, didn't put it there, video, and then an ID for that video. So, I'm going to take that, and actually, before we even take that, we need to get this sample code from the GitHub page. So, I'm going to take that, and I'm going to just download it. So, there it is.  You can look at it. It's very, very simple, very self-explanatory here. Anytime it's saying console, that's basically printing to our shell here, but you can see here, it's going to check to make sure you gave it an argument. If you didn't, it's going to print usage message, and then exit. And then, if you do give it an argument, it should be the address to a web page. And then, it will just basically spit out all that HRA content as JSON until it's done, and then it will exit. Okay? So, now that we have that, to run it, we're going to just type phantom.js, which, again, I just installed the name of the script. And if you run that again, it will ask us to give it an argument of a URL. So, let's go ahead and do that, and I'll put it in quotations here. I will take this Facebook page that links to this video, and I'll put it in there. And again, it will dump out the HRA for that page. Now, we can go through the look, but we can see right here, the very last thing to load is an MP4, which may very well be our video.  But if I take that, I can say copy that address, and I'll use MPV as an example. I can do that, and yeah, it is that video. If that was not the proper link, something you could do is again, dump that information, you can use jq to scrape through it, but I'm just going to grep for dot mp4. And you can see that I should get, you know, a number of lists here, and we can, you know, crop that down a little bit more, we can say cut dash, with the delimiter of quotation mark dash field four, and then I'll grep for lines that have HTTPS, and that should narrow it down quite a bit, giving us just some URLs, and I can sort unique that, and then I can loop through those till I get the right one. But again, when we ran that without any of that, we were very lucky in this particular case, the very last output is the actual video that we're looking for. Again, if I take that, and I copy the URL MPV. And that is a link to the actual MPV. So now you can use use W get or curl, put in that URL, and we'll give it a name dash, oh, and if it's W get, it's capital, oh, if it's curl, it's lowercase, oh, let's say, me dot MPV, because it's a video of me, or sorry, MP4. And you can see it's downloading it, or it can show you right here that it's a video MP4, you can see the size, we can look at it here, we can file it to make sure that it says that it's an MP4. And of course, we can now play that file or do whatever we want with it. So that's it. That was just a quick look at this. Again, I'll put a link to the in the description of this video to this example code from the phantom.js project, it's called netlog.js. Very short, very simple to understand. And you can give it the, you know, any page I can take this. And again, I can say phantom.js, our script, I can give it not that just faster phantom.js, netlog. And you're going to want to put this in quotations because URLs can tend to have special characters in them that will mess things up. But there you can see all the the HRA data from my website, which is a lot of YouTube thumbnails, because it is loading that page and actually running the JavaScript on it, unlike just using like Wget or curl, which isn't going to allow the JavaScript on that page to run. Again, my website, if you have notices, very easy to use in the shell. Again, if you just click shell, it gives you directions on how to use my website from the shell using M3, WM3, Wget, curl. If you try to go straight to my site with one of those, it will actually bring up these directions for you. But that's because I'm kind and design my websites properly for users like you. So yeah, check that out. Link in the description. And as always, I hope you have a great day and I hope that someone answered the question of how download videos from Facebook. That way you don't have to go to one of these third party sites because there are websites out there you can go to and they'll download the video for you in a pinch. But you should be able to do it yourself. And again, I'm very, very surprised. Again, if I go back here, take this in the past, I should be able to say YouTube DL. And I did check I am at the current YouTube DL version that just came out a couple days ago. But I'm getting an error here. I haven't looked much into it. It seems like it's an SSL error of some sort. But I'm not even worried about that because I can do it myself without YouTube DL in this particular case. So again, Filmsbychrist.com is my website. There you can search through all my videos, software and scripts I've written. You can also support me through PayPal or through patreon.com. And if you go to patreon.com forward slash metal X 1000, you can support me there monthly. And I would appreciate that if you can. I hope you're staying safe. Hope you're staying healthy. And as always, I hope that you have a great day.


Great. Well, thank you everyone for joining. I know we're still going to have people joining, but given that we only have a 30 minutes today, I'm going to go ahead and kick things off. Thank you for joining us. This is our second in Berkman Klein Center series on accountable technical oversight of generative AI. I'm Sue Hendrickson. I'm the executive director at the Berkman Klein Center. Last week we started this series with BKC responsible AI fellow Dr. Ramon Choudhury and Riva Thortz from NIST on the landscape of generative AI harms. And today we're going to focus on a new tension on balancing security and transparency in the quest for accountability and open research regarding generative AI. Legislative efforts such as the DSA are providing new regulatory routes for increased transparency and access, yet how best to accomplish that in the rapidly evolving landscape of generative AI is not yet resolved. Today we're looking to tease out what constitutes meaningful transparency and wrestle both with with the security risks that may come from sharing training data or code and the societal and other risks that may come from not sharing. I have with me today for this discussion and fireside chat I'm thrilled to have Bruce Schneier, internationally renowned security technologist also known as a security guru. Bruce is also, I'm pleased to say a long tried affiliate and long term fellow at the Berkman Klein Center, a lecture at the Harvard Kennedy School and a best selling author of 14 books and literally hundreds of articles essays and academic papers. The digital newsletter the Cryptogram and blog Schneier on security are read by over 250,000 people. He's a thought leader that I and many others consult with to understand the nuances and challenges of the digital security landscape. Welcome Bruce. Thanks for joining. Time is short. So we're going to dive right into questions on this. So for our virtual audience. Please add your questions into the chat box we're hoping to make this an iterative discussion and we'll try to read in your questions into the discussion as we're going through. Okay, Bruce, starting us off here. I'm looking forward to thinking about the lessons that we can learn from the security landscape as we tackle generative AI. How did we consider the trade offs and even if there are trade offs between transparency and security in releasing how should companies think about this and releasing their models and underlying training information. So it's interesting, I tend not to like the trade off metaphor, my transparency is something you trade off with security transparency is one of the ways to get security. So these are all going to be security versus security discussions. So we have a security versus another type of security in the, in the software space we have been dealing with transparency issues, really since the beginning transparency isn't a goal. It is a method of achieving a goal you might want to know that the algorithm is fair you might want to know that software is secure and you might want to know it's something about the systems you're using. So one of the ways to get that is via transparency. It's the open source movement was built on this notion that if the software is public, many eyes can look at it and vulnerabilities bugs are found and your software is more reliable more secure. I'll argue whether that's true or not, but that is the, the conceit. Yeah, there are other times when transparency might be a competitive problem, my Google is going to say, you know, we don't want to release how our search algorithms work. Even though that is transparency, then people will be able to gain them. And if you know how it works you'll be able to optimize your page to rise in the rankings, and that would be an insecurity. So there, there are ways that transparency affects security both good and bad. And the question is always, what are we trying to optimize for whose interests are we serving, and what are the ways ways to get that. Think about again open source transparency doesn't give you security. I mean, the Linux is more secure because it's transparent. Doesn't make sense Linux is secure because people are looking at it. And so there's a lot of open source software that is public but it's obscure, and no one looks at it. So you don't get the benefit of the analysis so the value is analysis then how do you get it. Right, so I mean that's actually a great topic because you know many of us saw the leaked memo by senior engineer at Google around no mode and this trend we're seeing right now in generative AI towards the smaller cheaper versions of kind of best in class models is, you know, clear with the proliferation of these open source ones from hugging faces alternative to chat GPT to alpaca from Sanford Dolly stable stable the Kuna and others. How you know I like the way you frame that, and you know I agree with you on that that transparency isn't the goal, it's a method of it. Right in the context of the open source models that are being released and widely tested, are they posing security risks are their things. How should we tackle those differently. As we look at these proliferation of open source models. There are security risks of giving everyone that powerful technology. I mean we think about what's happening with chat GPT, and there'll be ways people use prompt injection to get to do things that company didn't want and they put in controls. So it couldn't, as you get these models in the hands of everybody, a very international. Obvious community, you're not going to be able to put in those controls, and if you have an art model you can tell it like do not create fake IDs. And as long as a big company's running it, you'll be able to do that. Once that guard starts being diffused, you lose the ability to do that. So we're going to have models that will be racist and hateful, just because those controls won't be there. This isn't about transparency this is really about how the technology diffuses. I think there's a kind of enormous value in having this democratization I think we're seeing going to see a lot more innovation. A lot more, a lot more new ideas, a lot more ways these things will work and then they're not going to get a control of these massive for profit monopolies is a good thing, but it also has, has issues. This isn't a transparency problem and transparency to think about what we might want an AI is doing a thing it is making a decision, and we want to know why. But I say I want this modeling transparent it's kind of I want to know why it makes decisions makes there's a bunch of ways I can learn that. Maybe I can learn that by seeing the insights, but maybe I can't maybe that's going to tell me anything. Maybe I can learn it by being able to audit the model. Am I allowed to query the model a million times and learn what its contours are right it's making going to make this up hiring decisions. I want to query it with counterfactuals, submit the same resume with different parameters, tweaked maybe racial ethnic you know the kind of things we might be concerned about, and see what the differences. These are forms of transparency that aren't releasing the details of the thing, but it might give us the information we want. So again is you know what is our goal, releasing the full details of the AI model might be beneficial and might not. A lot of these things are irre, irre, non reduction of all in their complexity, so that seeing all the parameters doesn't tell us anything the ability to actually interact with it does. I mean that seems to be one of the real challenges here is figuring out kind of what actually would provide that kind of meaningful transparency that people are looking for in this context, as to whether you know as you said kind of will releasing it actually accomplish what the goals are of kind of providing transparency, and are there ways to to achieve those goals through that release like what what techniques would actually let you do that from these models. People like Kathy O'Neill talked a lot about the ability to algorithm audits. And I think there that's real important Susan Benish talks about the same thing you know, these these systems whether they're, you know, AI or not are making these enormously important decisions, and we have no ability to to audit them to to understand what they're doing. In a sense I don't care why if an algorithm is racist I don't care why I just want it not to be racist. So then I'll think about human systems. If a human system of humans is racist, in a sense I don't know care why I can't open the people's brains and look at the parameters and understand how they made their decisions. You know, we as society want them to make more fair decisions by whatever that means. I'm, you know, I worry a lot that transparency is is not going to give us what we want to sort of chasing the wrong tactic for the goal. I do like open source. I do like I'm glad they're open source models. But I don't think we're going to get what we want by forcing, and our companies like Google or open AI to open up their models, so we can evaluate them because that's not how we're going to evaluate them. We're going to need access to them. We need to understand that maybe we're going to need some access to their training data. There are a lot of other reasons besides security, I mean it's no if they're violating copyright or anybody else's rights, or like, you know, or unduly taking the labor of millions of people and not compensating it. So we have a lot going on here. Great. I mean, do you see any of those as particularly security related risks, or is it the broader collection of risks that we worry about when we're kind of seeking seeking this and you, you teed up perfectly our next our next session on this which will be related to audits and accountability mechanisms in its context because I agree with you fully that that is one of the things that we need to figure out you know how we're how we're managing here with respect to it. I mean, the security risks kind of look like this and this is this will be the anti open source argument. If we give people the source code, the bad guys will be able to comb through it and find vulnerabilities and exploit them. Yeah, that is what Microsoft will say we will we're not going to release our source card. Are you crazy. The bad guys will will figure out exploits. Now, that that is a thing we know from decades of security that that isn't a real worry. Then in fact there are more good guys and bad guys and the good guys find things and we fix them. So generally is a good thing to make your code public and for security and not a bad thing. So far these instances I like Google, like Google search algorithm, where you don't want people gaining it where you have an algorithm, I'm going to make this up for admission into college. And we make it public. Now every high schooler knows like the exact GPA and the exact type of extra activities, kind of making this up, the exact ways to gain the algorithm, and we don't want that. And we've heard increased calls from kind of some of the large language model providers to to hold back from the kind of openness that's been provided on these security grounds which is one of the reasons that we kind of wanted to tease this out some and think about whether that's whether that's real in attention with the open source community or whether that's I mean that's always been attention. I mean that that's Microsoft versus Linux that I mean that's the exact tension we can do both things we don't have to choose one or the other. We can do both different companies will make different decisions. And I think that's okay. China isn't necessarily more secure than the other the risks for one, aren't necessarily the risks for the other, and Microsoft keeps their source code proprietary, but we know pretty well that countries like China have gone and stolen pieces of it. So, right, are we getting the value of that closed down, you know, right. And the benefit of open source is that we in the community get to get to look at it and play with it. Now, what you said earlier there are open source models out there. And there are several and the innovation has been phenomenal. Yeah. And we're learning a lot that you don't need months of computation that these smaller nimbler we're going to update them every day they run on a high end laptop. I think that's going to be the future. And it sounds pretty good. But yes, I mean there are security worries. There are security worries in, you know, the the authentication of voice authentication now will no longer works video authentication now no longer works. Right. Yeah, the, you have to send Facebook a scan of your driver's license who thought that was a good idea. Well, now it's going to be a terrible idea. Yeah, all of these sort of security measures that kind of just barely worked now won't. I'm sure JP chat GBT can guess the answer to your secret questions. Yeah. But these are always been like my identity the authentication it's all out there now what do we do is there is there a solution to pull back any of this kind of, you know, security in a world where we're not going to be able to have this kind of authentication. We have to rely on other things. And so you know if you think about your phone right when you call me. I recognize you because of your voice voice and shared history that they know we're going to talk about things that that you know we know that we know each other. caller ID also exists but it's kind of it's not secure doesn't work very well. But if I can't trust your voice maybe have to rely more on caller ID, which means maybe quality needs to be more robust. Things like the phone company needs to do more to prevent sim swapping, because now the other mechanisms are failing. So I think that's going to be a rejiggering of security. I'm just trying to think about this. Yeah, we've been using these informal methods and because they worked most of the time, and they work pretty well. And then we might have to make some different decisions, given the ease of which you can fake data at a distance. So voice or video or photographs of documents, so all of those things no longer work. They kind of never worked, but they'll work, they worked okay, right now they're really not going to work. There are going to be some, some, some bumps. And I think sim swapping is a good example of this so this is a this is a problem where you would when you when a hacker calls your phone company and convinces them to switch your phone number onto their phone. And it's actually surprisingly easy to do. And the reason it's easy is because the phone companies are not optimizing security, they're optimizing for I lost my phone, and I bought a new one, and I need to move by account. They're optimizing for ease of use and customer service. Yep. And that that makes the attack possible. Right, you're making me realize that we're going to need quite a bit of security innovation around these around these issues in order to kind of tackle some of the authentication challenges and even worse business innovation which is even harder. I mean, businesses like to be easy. They don't like security. I don't think this is we need a new tech, we're going to need phone companies to say hey you know we need to make caller ID actually good and not accept crappy caller ID. We might have to do authentication from the phone to the tower, which we never did because we never wanted to and didn't have to. So it's going to be the processes. I mean, in this space I'm a big fan of regulation I think the market actually won't solve this very well. But a lot of our assumptions are changing. And that's what's going on. And then what do we do to get that I think transparency is going to be part of that. There's a lot of other parts of making security work in this new era, when things that we thought were harder turned out to be easier. Yeah. Well it's interesting when you say kind of a fan of regulation I want to turn to one of the questions that we received because it's a good link to it. A question from Adam Holland. If we imagine some sort of mandatory transparency in the mode of the DSA is soon to come database. It's not clear what that would actually look like practically. One different seems to be that in the case of the DSA we have safety and parties making requests regarding content in the case of generated AI we have what there's a huge difference between looking under the hood and seeing what material is or is not in a library's connection so to speak. How do we, how do we think about this how do we, how do we think about whether that kind of mandatory transparency is going to be able to accomplish the goals that we're looking for, and in the generative AI context. I mean I think that's a really good way of framing it. And in a lot of cases, it doesn't so I'm going to demand transparency do I want to see the model. I want to see the training set, like the data that goes into it. Do I, if it iterates do I have to see each version. And I don't know I mean I don't think it gets us what we want. But what I want is I want to know why the model did the thing it did. And really how can I stop doing the fat thing next time, whether it's making a mistake, or acting in in some biased manner that that that either illegal or or unethical we just don't want. Yeah, or it makes a decision that affects me that's important. And I want to know why. Why did it deny me this benefit this loan why did, why did it just make this discrimination. You know put me in one pile versus another. Right so kind of knowledge. Yeah, I mean the transparency I want is, you know submit my, my stuff. 10 times with 10 different parameters changed and tell me when I get different results. And then that's what I kind of mean by an explanation there. Why it did the thing. Exactly why the decisions and stuff are being made. One, one thing that's been kind of you know teed up is the idea of you know benchmarks for acceptable levels of security risks and what that you know might look like in this space. Can you just speak to that for a bit as to whether there's actually a kind of benchmarking process that could go on here with respect to that and then I mean I guess we get to the question of kind of, you know how would we think about what was an acceptable security risk and who would decide that. Yeah, that's really hard to do without knowing how it's going to be used. See the AI doesn't exist in a vacuum it's doing a thing. And you know in a chat box and gauging and it's generating human text in some decision making system making a decision, or it's or it's affecting the world in direct physical manner. I don't think you can have security benchmarks without knowing what it's doing I mean what would it look like you give it an AI system that that does that is there. Without without knowing what it does I don't I don't see it I don't see even how to begin to have a security benchmark is going to be some level of risk what's what's what's the risk that this will make a bad this is like a driverless car like what's the risk, it will accelerate instead of break. And so that we can talk about. We can, as soon as we instantiate it in that type of decision, we can develop a security benchmarks for what that means, which now now is really safety so. Yeah, exactly safety, yeah, but but you know safety to me my differences that safety is against the environment. Safety is road conditions and day versus night and traffic and you know people walking around security is an adversarial environment security is the stickers you put on stop signs to make the AI I think it says 55 miles an hour speed limit. It's a very different way of, of looking at the AI and adversarial way does it survive a malicious intelligent adaptive adversary versus doesn't survive all sorts of random weather conditions. It's an important it's a really really important distinction and stuff. I want to add in we got an interesting question from Jonathan Horitz for you that I'd like to tee up which is, is there anything qualitatively different for LLMs and previous statistical models in that we had a good well understood at least by people with mathematical background theory that explained what the old models did and why, whereas LLMs, we don't have such a theory, no human really understands why they work as well as they do. Is this maybe why you talk more about getting Oracle access to a model than just seeing the source code. I think that's part of it and this is where they're approaching humans right we have no way to understand why they do what they do and we know there's some psychology human explanations are basically justifications they're not explanations they are. They're generated after the fact after people make a decision. So we're getting to these models that are that are so opaque that irreproducible that like see why did make the decision here the two billion parameters that's why that's not a useful answer and explanations are very much a human shortcut. They really represent the way we humans make decisions, not how these LLMs make make decisions. So I don't think we can, we can usefully, you know, open up the insides and see what they've done just like we can usually open up human brains. So now we are stuck to the bad word, we have to use what we can what we can see. Like, what is the output as we're looking at the, you know, the, the, the class, the incoming class of a certain university, and we see, you know, we see a racial bias. And we say, look, I don't care how that happened, you can't have that. Did you use people to use an AI to use a mix we don't actually care. Right. And I think in that case we, we have the tools already to to go after that kind of bias, you know, their places where that is already illegal and it probably should be more. Right, and we thanks to also a Karsha surrender for another question, if not through mandatory transparency which it sounds like we're moving away from is the responsibility to reduce these risks then left to the developers of these models. So what incentive to do so if it slows down improving the capabilities of these models. Well, this is a regulation. Yeah, right. I mean, that's where we are because right the incentive of the companies is to make a lot of money, not to be fair not to be just not to be equitable, not to do any of those things. And if we expect, you know, whatever, you know, pajamas not to catch on fire, Jimmy sweet companies not the higher five year olds to climb them, whatever, all these things we have to pass laws. So yes it's going to be incumbent on the companies to make sure these models are fair and it's come with on government to force the companies to make sure these models are fair. Then it's a comment on government to check to make sure the companies have actually done what they said they do. They never lie in the market for this because the market is not set up to do this. Right. We, this is, I mean, but I think this is larger than AI. I always think of the market as a game playing on a field that government defines, like we define what is the viable playing field in which competition happens. We have lots of laws that talk about and whether they are safety laws or child labor laws or fair practice laws or truth and advertising laws, all of these laws determine how companies can operate, and these have to be more of them. We have no other way of doing that. So that's, you know, I think one of the challenges that we're wrestling with is to try to figure out, you know, both how we can do that on a global basis with respect to it we're seeing a proliferation of regulation right now in, in different spaces figuring out how to harmonize that and then how, how we can actually make that kind of regulation effective given the kinds of challenges that we were talking about beforehand. And so I think it's an interesting, interesting dynamic at play that because of the way so I mean, not an AI and computer security. California has an Internet of Things security law. It's not that great but one of the things that it mandates is no default passwords. So if you sell an IoT anything in California right now, you can have a default password. I guarantee you that no company has two thermostats one for California, one for the rest of the country. Right they fix the default password and sell it everywhere.  So you look at Europe. You look at their new AI law. Right, they're driving a lot of the stuff they're going to require is going to benefit the whole world. Even though the United States is really dysfunctional is not going to pass anything here. Yeah, right. The EU, who I think of as the regulatory superpower on the planet will do things that benefit us. So I'm okay with the regulations not harmonized. I'm okay with different regulations different jurisdictions. I'm almost at time so I just want to ask one, one quick kind of question for you on, thanks to David Harris, do you think it was responsible of meta to release llama to research to researchers with such a seemingly low barrier to entry that it then leaked. Interesting question I'm glad they did. And I think the fact that it leaked. I mean, we've learned an enormous amount from basically the community. The companies never understand open source. They're always blindsided by it has been true for decades. I think it's good. I think the democratization is really valuable. I think getting it in the hands of people who don't have a profit motive is phenomenal. I don't think it's irresponsible that they, they didn't. So I guess I do think it's responsible. I'm glad they did. I think we in the world are benefiting enormously from it. And now it's done me, you can't, you can't put it back in the box. The innovation has been incredible and other open source models are coming. So I guess even if, even if they decided not to, it would just be a few months delay before some of these other ones are coming online you listed a few of them in the beginning. A lot of them are based on Lama, and some of them aren't I guess all the ones that are other was alpaca and I guess when I go is the next one. Yeah. Well, Bruce, thank you very much for joining we are at time so I need to cut this off I could continue to talk about this with you for hours and you know it goes back for me on this of trying to figure out how we deal with the you know some of these communication and security challenges in this world now where it's going to be much more where we can't put the genie back in the bottle but but just for everybody else who's listening please join us next week for our third workshop on enabling Bruce teetered up a little bit on audits and others but enabling meaningful technical oversight of generative AI will have speaking Dr. Ramon Chowdhury tech journalist Julia Angwin and crowd tangle co-founder Brandon Silverman. Yeah, we're looking forward to it and thank you again for joining and Bruce thank you for your words today. Thanks all.


Johnny dollar that McCracken Johnny A blonde in a bikini just melted past my poolside window. Goodbye now Johnny this job just a few miles north of where you are. It'll take maybe a day to clear it up Yeah, you said that last Christmas Pat and I got trapped in a blizzard this season. I soak in the sun happy new year John boy, we have a bonus list in this office. Your name could be on it Near where I am It's a ghost town in Calico no prospect. I thought all prospect has never died You want to change the beneficiary in a $50,000 policy, but I like our agent gene Craig in Barstow Who's the new beneficiary? Carmen cringles Carmen exciting adventures of the man with the action-pact Expensive cost America's fabulous freelance insurance investigator. It's truly Johnny dollar And now act one of yours truly Johnny dollars Submitted by special investigator Johnny dollar to the Home Office Universal Adjustment Bureau Hartford, Connecticut Following is an account of expenses incurred during my investigation of the Carmen cringle matter Expense account item one a dollar forty telegrams a gene Craig and Barstow telling him where and when to meet me Item two fifty dollars even a well stoner for his charter plane to the ghost town of Calico The guidebook says there's something about desert country that's good for the soul and in spite of the air bumps I got a panoramic view of the great Mojave that took my breath away Sun-setting rays hit the weird mineral straighter to the Calico range and turned them into a patchwork of beauty Night comes quickly in this country, and I turned to well when a Christmas tree cluster of blinking lights appeared under our wings By way of answer he put the plane into a glide and set us down on the smooth There's a dry lake bed It could be plenty of company The moon was up enough to make out shadows and silhouetted in a circle around me was a strange collection of figures One of the pack moved toward me And for a crazy second. I thought I bumped into Santa Claus's reindeer Then a car without lights came rushing at me the headlights slammed on and I got a glimpse of a donkey herd scattering into the night Toward me slow with your hand high I've learned never to argue with a Winchester 94 so I followed orders I spotted the weaving headlamps of another car approaching and prayed it was the agent gene Craig Close enough, sonny. I can pop the wrapping off a side wind at 60 yards Don't you make no sudden move? It was maybe 60 with gray sideburns and a frosty goatee a marshal Fred And with leather jacket All right now mr. I'm supposed to meet him earlier. I'm sorry mr. Dollar. I'm gene Craig I couldn't get here until I drove Doc Spangler up to Chris.  Oh except Carmen now.  Well, I'm frozen facsimile Come on. I'll drive you to Calico. You tell Chris that I'll have his Carmen back in the corral before the moon full and Gene tell the old sourdough to stay alive. Would you we need him around here? Sorry about mistaking you mr. Dollar She was strictly business and filming in fast on the old prospector with the odd name and his desire to change the beneficiary of his college Everybody calls him Chris because every year he loads up his birds with toys and presents for the miners and their families back in the hills The kids really think he is Santa Claus I'm afraid it won't be a very merry one for them this year What makes everyone so sure Chris Kringle is giving up the ghost?  Oh, what's with this Scrooge character the nephew? Ned Kringle seems all right. It's the man with him. Willi D'Agostino He does the talking for Ned. You think he was going to inherit the money? Well, maybe he's expecting to you know, you're making a good case for Carmen Hannah Burrell be a beneficiary Johnny Chris can leave it to a three-minute sooner if he wants providing a trusted setup Could the people of Calico be that trust if they promise to take care of Carmen? Yeah, I guess so why? That's the way Chris wants it That way there'll always be a Christmas in Calico What happens when Carmen goes to donkey heaven or is it burrows that never die? They'll always be burrows in Calico Johnny And one of them Could always be named Carmen Johnny dollar in a moment black two of yours truly Johnny dollar and the Carmen Kringle matter Which is silver city in the west? It was unbelievable Like seeing a page from the past Walder Knott same creator of Knott's Berry farm and western historians Had bought the old ghost town's battered remnants and restored it to the way it must have appeared in the wild and fevered days of the silver load I could make out signs nailed a weathered baton board the total of a flourishing and colorful past Joe Saloon the last chance Hyena house hotel Lane's mercantile the calico prints high on a hill at the edge of town People were gathered at the entrance to a cave that was illuminated by hundreds of miners lamps And who gets you Almost like a list planned Never hurting for the Christmas Eve pageant Maybe you can spend Christmas Eve with us Johnny. You don't have other plans I have a day with a steam heated swimming pool Come on, let's meet the old man Expensive count item three a hundred bucks for a quarter perfume or a mixed scarf anything to wipe the hurt look off of gene craig's face She led me up the steps to the rickety porch if chris kringle's wooden shack A tall figure carrying a black bag stepped tortoise out of the shadow I'm glad to see you. Will you drive me back to town? Why certainly doc. Oh, this is mr. Dollar. Hi son. Hi Chris, is he still all right? I couldn't say he'd been sitting out here waiting for you You haven't seen the patient the medical man owes a duty and all that but I'm too old to talk back to a gun They wouldn't let you in tired of it. Well, I'm not a medical man.  Willie dagastino, this is johnny dollar. He's from the insurance company to see about changing the policy What is it woolly? Who are you talking to relax? We're gonna let him give us some tourist directions back to bar stuff There'll be no policy changing at this late date, mister Ned kringle is very bereaved at the imminence of his uncle's demise Just family admitted at this sad hour so most your long folks. I'll leave the young man was great Your foot is in the door, mister.  I shoved genie aside and that was a mistake Because a million christmas tree lights blazed up in my skull Then slowly the tree lights faded away and I saw genie fussing over me and looking worried A young nice-looking fellow was seated next to a marvel town table Dagastino leaned against the stone fireplace and dangled his gun smiling like he had a stacked deck He's all right doc the nasty cuts but no fracture. I know how to pull my punches doc the old man How is he no better? No worse just lying up there staring at the ceiling. I want to see chris I have a right to net. I'm an old friend Wouldn't it be okay if gene just won't let him die in place. He's fast-carried whole season.  Sharing blood money with a hoodlum Your uncle paid for that policy with a pick in the shovel It took a lot of years a lot of sweat And he's had your name on that policy ever since you were born Oh, man kringle never saw a paid dirt in his life Nadia give him money to live on paid the premiums and his policy Chris was always tapping the kid claiming he had a new fire. He was going to mine a million Will he shut up? No man's dying. Tell him, Ned.  I know he's been waiting a long time for this me Willie de Agostino that's who Is that true, Ned? Yeah I thought my uncle would make a strike someday. I I honestly thought he'd strike it rich I know he tried He did strike it rich Ned When he dies every man woman and child in this town will mourn him He'll live in their hearts What will people remember about you? Mr. de Agostino?  I love you. So let glad to hear that Well, how's y'all chris is uh doc and tell the old buzzard that I got his carmen back in the corral jingle bells and all Nice work What's holding you, mr. Let's go Ned. Let the squares have a round I must stay here willy. I want to be here when chris. Hey, that's a good idea That way no fool around with the world. I smart kid that Ned see you at the funeral, huh? You were wonderful marshal You too, johnny. Oh, yes, sure. I take a nice sock on the head You folks better come up to chris wants to say something I forget on this the corral come on de Agostino must have had another gun in his car One of the bullets that found the marky intended woolly boy wasn't taking any chances that carmen crangle would inherit $50,000 We found the burrow lying on their side quite dead Jingle bells and all There's truly johnny dollar in a moment.  It would kill him for sure. He'll have to know the truth gene You'll have to decide about the world. Yeah, truth is always the best And easy this time easy, huh? Yeah, I'll just take these bells often miss poor little feller And I'll put them where they belong Carmen what carmen mozi over here now Well, you pull the switch You put these bells on another book I didn't trust that cheesy character and I was right and nice girl carmen Now now you folks going up and see old chris.  Yes, sir. That's the way it's going to be But I was wrong The roly-poly little old man in the forepost of bed with his white whiskers resting on the quilt changed his mind again Even after hearing about how the marshall saved carmen I I wasn't going to scratch meds mean off of that insurance, mr. Dollar I tried to shake that de Agostino Figuring he'd take his hooks off of med if he thought my carmen was going to get the money Oh, I was scared for a while. I just might have to up and died Square man of his gamblin debt. Oh, yeah I'm sorry chris. I'll work my fingers raw paying every cent. I owe, but I'll pay him back with interest I want you around Yeah, chris Lift the lid on that foot lock and fetch me one of them bags in there They're pretty heavy, but you look strong Oh, they're sure heavy enough to get out of the stuff with silver It's better than silver over it over it up there. Yeah Recognize that man, maybe you'd better have a good sleep chris is here plain old ground It's uranium Uh, uh the last batch assay that nine hundred dollars a ton and I got a mountain of it staked out in both our names Oh If you and genie check with a barstow bank, you'll find that they have extended credit on the strength of that assay You reckon you can spend two days Buying enough presents so as we won't Disappoint the folks here about Spencer count item four sixty eight dollars even telephone calls to five principal cities where I thought willy degustino might be remembered The police department had a long list of reasons why they remembered willy That was my christmas present to them Expense account item five another fifty truck rental to haul the presents we bought for ned to give away come christmas morning Then it was christmas eve We seven the cringles fortune watched the procession up to the maggie mine The flickering lights from the miners lamps reflecting on the faces of the happy children Whole chris was bundled up in blankets his little eyes twinkling Shuckling to himself like he knew all the answers to the universe Jean was there too Isn't it shiny Kind of nice Marshal ed nola was one of the wise men in the procession. I recognized the sideburns And doc spangler couldn't hide his height. Oh, he wore an awful beard Neb cringle led the borough that carried the blessed mother Yeah, you guessed it The borough was common cringles expense account total including return to prom springs and incidentals $229 and 75 cents But forget it platt. This is the best holiday I ever had And I was only cold at the start From all of us to all of you May this be your very merriest christmas yours truly


So let's look at a simple hydrocarbon. Let's say that I have liquid cyclohexane, very simple and common solvent. Here it's just pure liquid cyclohexane, number of molecules per liter, and here is cyclohexane where I've tried to solute it in water. Very low solubility. If I take those two numbers and plug that into the equation from the last concept, I will get that the delta G of moving from liquid to the aqueous phase is roughly plus 7 kcal. In our scale that's a large number and it's large because we are comparing it to RT in the denominator or KT if you're a physicist. KT is roughly 0.6 kcal per mole at room temperature. 6 divided by 0.6 is roughly 10 or minus 10 in this case and that's e raised to the minus 10 is going to be the relation between these two concentrations and that's why this number is very low. So that was plain and simple. Fun. But I would like to get slightly more things here. Wouldn't it be great if, in addition to delta G, I could also get my delta H and delta S so that I can study the entropy specifically. It turns out that I can. But I'm going to need to use some of my equations. In the last lecture we spent a lot of time on F equals E minus TS. I need a new pen there. F equals E minus TS. There was also another equation I used to define the thermodynamic definition of temperature. Do you remember what that one was? That was that the temperature was the derivative of the energy with respect to the entropy. But as I mentioned, today is a chemistry day. So we're going to replace that. We're going to say G equals not E but H minus TS. And then you're going to need to believe me that this will just translate in an analog fashion or better yet. Maybe prove it. That would be DG, yes. We're going to use that equation in a second. In principle you could think, can't I just use that equation? There's a T here. What if I take the derivative with respect to T? That would be minus S. Well, you don't know what the temperature dependence of H is yet, at least. So I'm going to use the same approach as I did in the last lecture and study these so-called differentials. So let's look at the very small change in G here and see what happens. So I should be able to write DG equals DH minus DTS minus SDT. And now things start to look very nice because if I take this definition of temperature up here, it literally, oh sorry, so DG there, bad Eric, it should be H because E there corresponds to H there. I found that before. This number literally says that DH equals TDS, right? But if DH equals TDS, that means that this term should vanish. And now I can divide these side by minus DT and then get that S, the entropy, equals minus DG DT. And that in particular means if I now do exactly the same experiment, calculate the concentrations, but I repeat that at say three different temperatures and take the numerical derivative, the slope of that line, that means that I can get the entropy from the slope of the line. I already had G, I got the entropy from the temperature dependence, I obviously know what temperature I made, did they experiment that, that means that I can solve for H. So then we can get all these components. Let's try to draw that in a small scheme between all the possible different phases this can exist in and see if we can learn something from it.


Hi everyone, Joe for jaspyscasebreaks.com coming at you with another one another jaspys big hit express multi-sport series 5 case Coming at you. This is case sweet 16 Random team break. I think everyone knows About all the potential that could be in here high risk high reward Lot of fun stuff. We've got a rules page on jaspyscasebreaks.com. Make sure you review that Before you get into the brakes. All right big. Thanks all of these lovely people right here for getting into the action Thank you. I appreciate you. Here are the teams right here It's all in one page there. They're there all the teams and the combos right there That's also on the rules page the full list of combos one team. We did forget with the brewers I think there's still another brewers hit or two. I'm maybe more, but I know there's at least one that's still left So we'll randomize that to one person in the break All right, so I got those teams there and I need the list of cases So let's grab all those. So this is break 16. So we should have 15 Yeah, and we'll use the same dice roll for all three lists, which is gonna be 6 4 and a 2 we'll do your names and teams first 1 2 3 4 5 and 6 All right, we got Brett down to Matt after six and six times for the teams one two three Four and six in final time after six. We've got the Rangers group down to the Bengals group Brett with that group right there. I'm not gonna read off all these I got to save my voice for all the train whistles Donnie with that group Roger Eastwood Brett Tanner BJ Dale Alex Matt Kang Dan Ryan Zach Berry BJ Matt Kang Chen BJ Lee Ziao Chen Kurt Burns to that group right there I'm gonna alphabetize by your first names in just a second Oliver Tanner AJ Jake John Stephen K Brad Angel and Matt Medlin. All right, so let's bring all this on One page here. Let's sort by your first name. So you'll see on hell's no AJ's name on top there And then you can kind of scan your teams again this time you've got people about multiple spots Now you're grouped together. So keep track of your teams trades are allowed But remember if you want to trade you got to trade one entire block for another entire block of teams All right, so there you have it Now what else were you doing here? Let's uh, oh Let's randomize. Let's find out which case we're gonna do. So once again same dice roll six times one two three four five and Six after six times. It's gonna be case four Let me go grab that case. So you can see on the top camera right there. It'll say case four Any trades did you buy two spots in 16? I wasn't over on spot or under on spots Wait, what happened here? I Hmm Alright, I'm gonna pause the video folks. We're gonna figure out what happened here when we come back Let's also see if there's any trades and we'll have the brakes to ground All right, welcome back folks. So there was a deal between Brett and Matt So Matt is out of the Red Sox spot and into that Rangers Titans Yankee spot These trees these trades always scare me, but they decided to take the risk Brett is out of that group and now with the Red Sox Sacramento Kings group right there We'll put teas next to there for trade. So, you know who draws first blood in the trade Okay, once again, we're doing case number four So let's flip back to this screen There's case number four right there and the sticker in the top left. I know it's a little blurry, but that's a four All right. Good luck and thank you everyone for getting into the action I'm sure the next one's gonna sell out fairly quickly. So If I'm you get into it Before that next one is gone This is break 16. So break 17. All right Be sure to follow us on on social media at Jasper's breaks Instagram at Jasper's breaks on Twitter First one Good luck It's gonna be It's gonna be gold strike autograph one-of-one Warren moon Wow It's got an excellent autograph to obviously Euler stuff Houston Euler stuff goes to the Tennessee Titans. So who has Hashtag tighten up. Wow. That's Matt Medlin with the Rangers Titans Yankees group. He draws first blood in the trade Oh, and a one-of-one. That's a train whistle Matt All aboard the big hit express I don't know why people continue to trade I Trade at your own risk ladies and gentlemen All right. Oh, this is Brett. Well, listen a little stuff five boxes left. Let's see if we can make it up for you Hopefully this trade can even out. All right. I see a graded card It's a gem mint now gem in 10 that is PSA 10 gem mint and it's Marvin Bagley the third Sacramento Kings. It does even out Brett Rogers has the Red Sox Sacramento Kings grew Huh, that's I don't think I've ever seen it work out like that 2018 Marvin Bagley the third sensational signatures graded trades working out Yes, we are still doing personals Dave Instagram live right there on that channel right there at jaspy's breaks Teddy might be on a break.  All right, another graded card It's fernando tees jr PSA 10 2019 tops chrome baseball 90 out of 2 99 Who's got the friars? bj jordan with the bills jags and padres combo Very nice All right. Well, it should be back on soon. Do we we let the hosts uh take breaks and eat food They're not robots.  Dave wants you live right now. Okay next one Grade of the 10 10 Not a black label because the centering's a nine five, but it's a 10 10 Wow Look at that. John Elway from upper deck black silver ink autograph Just a couple off the jersey number wow Edges corners surface all a 10 Centering's a nine five for a pristine 10 And of course John Elway Elway's autograph a 10 In his college, obviously this goes to the Denver Broncos Wow Who's got the Broncos in this one my rivals? I'm a Raiders guy But I can I can respect I can respect the John Elway That's Alex Valisacos with the A's Broncos combo Thicker card sock here too case is much heavier Wow Next one Good luck. I think it's another one-of-one It's a plate an on-plate autograph From contenders draft picks It's Jared Culver And his Texas tech gear that goes to the Timberwolves A top 10 pick could have a lot of upside T Wolves Who has the train whistle there BJ Jordan with a second hit BJ all aboard the big hit express And the final one good luck. What do we got here kind of peek on the back? It's an autograph We've got some red here. What is that? Oh, it's a tops archives sticker and it's a one-of-one Cal Ripken jr One-of-one Cal Ripken jr autograph for the O's Star power autograph That is really nice Orioles That goes to that goes to Zachary again. Didn't he try to trade the Mavs in the Orioles? again Wow Tried to trade Couldn't trade mojo again Nobody wanted him Everyone's like, eh, you have the Mavs and oh Zach. We'll let you have the one-of-one All aboard. There you go ladies and gentlemen There you have it. That's it. I'm Joe for jashbycasebreaks.com Thanks for watching. Thanks for breaking with us more in the store. Check it out And we'll see you next time for the next one. Bye. Bye