What's going on everybody? Got Kyle and Shawn here with Layton Sports Guards. We're ripping this one's 2023 Chrome Update Hobby and Bowman Chrome Baseball Six Box Mixer number one. Did a randomize before the break. I'll show you guys results again real quick. Had Kyle H with the Mariners, down to Jason H with the Rangers. Alrighty, good luck on this one guys. We'll start with the Bowman. Start with the Bowman. Good luck everybody. Let's do two jumbo cases next. Top's Chrome Update. Yeah, I feel that Paul. It's kind of what I was saying, like Sundays there's just too much going on. I don't know what to go with. Yeah, just the bills and bucks left in certified. Thank you guys. Very nice. Iconic Bobby Witt, Jason Cheerio. Vapor is going to be Rainer RES. Nice one there on the Fuchsia Vapor. 2199. There you go. Giants. Nice Rainer. That's those vapors. First Otto is Mike Coyotto for the Guardians. First Bowman Base Otto. Gennaro Miller, Marcello. Say Purple Shimmer, Adon Sanchez to 2199. Or sorry, 250. Adon Sanchez for the Cubs. There's a Sebastian Walcott. Pajes, they're Celestine on the first. I don't think I pulled any yet, Victor. Still waiting. There's a Bobby Witt. Nice one there on the Team USA for WBC to 75 on the Blue. Nice one there. Royals. See if you're Isaac or Nemo. I'm at zero right now, Victor. You're right. I need to turn it up. Connick Soto. I know Gabe Hughes on the Invicta. I'm making me aren't at the last two nights, man. It's making me aren't it. Came to the league. Spencer Jones. There you go, Jay. Use cars salesman. There we go. That's all you got. Iconic Corbin Carroll. And green is Paul Goldy to 99. Yuri Perez, Jordan Lawler. Well, welcome. Thank you for buying. Thanks for buying those pictures. I'm sure you didn't, but thank you anyway. Welcome, Jay. There's a prospect process. There's an Ethan Salas. Box two. Box two. You can do it, Victor. We can do it. I know we can. We'll get it going. All right, guys. So this one's three Bowman chrome and three tops chrome. Yeah, I would uh probably get a get a few car sold. Yeah. Well done a lot out there. We got some, uh, some sandhill cranes. Yeah, that's about it. Iconic Paraza for the Yankees holiday and Lantigua. Yep. Speckle 299 is Gennaro Miller for the Marlins, Roman Anthony, Luis Torres, Jackson Merrill, Elijah Green. He really got us. I really got us. Iconica Alonso. There's a Camilo DS. One is the 199 future shimmer first for the Astros. I sell new cars, bro. Yeah. Luis on Helicunia, Guerrero and Dunno. It looks kind of good. There's a Alfredo Dunno on the, uh, aqua. Now when it's the 125 aqua vapor, that's for the Reds. Elly and Soto. Nice one there. Termar Johnson on the Ascensions, short print there for the Pirates. Let's see these two often. Ramirez. Jackson Churio, it came to the leak. Parada. Yeah, it's all he had, man. Vecaro. It's all he had. He came in and he was like, yeah, got him, man. Got him. Hey, that's fair, Brandon. I don't blame you, man. That's probably a good decision. Jason Churio to 499. That's probably a good decision, my man. Maiega and Drew Jones. I don't know, Brandon. Let me just go on Eepa on the first. Sean actually might be, uh, say another way. Sean might be going the other way with it. Process, Termar and Javier Rivas. Alrighty, guys. Box three of Bowman Chrome. Box three. Yeah, I know my boy's got my back, bro. I ain't worried. Let's go, everybody. Bowman Chrome. Box three. Y'all know what this stash can do. Box three. I'm investing in the future. That's fair. Oh, I remember that from last night. Yeah. Got the bot out. My boy got the bot out tonight. I remember the drip bot, man. I had five million drips. I was like, what the heck's going on? Dude, everybody else has 25. I've got five million killing it tonight. Rojas Spencer Jones. Better than forgiveness. There we go. Oh, man. That's what I'm talking about. Afraid of Dunno. I lived by that quote. Oh, I thought he was back. I was like, no way. No, they're just re-showing it, of course. Aaron Judge. Osaria, Welbin, Franciska on the first. Thank you, Ray, by the spot. Bowman Chrome, you. Joey Ortiz, the 499 rookie. Ellion Soto. Let's go, Jess. Oh, Orange. Come on. It is Brennan Malone on the Orange Shimmer first auto to 25. Here we go, Ace. Nice one there. Third base prospect for the Ace on the Orange Shimmer. Odell. Odell. Shimmer, Drew Jones. Gutierrez, Jorge.  Jackson Merrill. There's Maella on the first. Too much mustard. Yeah, Odell's probably lost his step, so you thought he was throwing his A or something. Greenson 99. This one is Glabor Torres going to the Yankees out of Venezuela on the WBC. I believe you guys would, Jess. I believe you guys would. Luis Guanipa first. It's going to be a fun one, man. I know it's, it is not cheap. It's definitely the ultra high-end Almanac, but it is going to be fun. Iconic Casas. Oh, and Murphy and Victor. Chivilly. It came to the league of all the anniversaries the best time to ask for goodness. I just read that. I don't know about that. It is. I don't know about that. Trust me. Save it up all year. Just trust me on that one. There's a first Christian Serda for the D-backs, first Otto. And last pack out of the Bowman U. Are they Bowman, uh, Bowman Crone? Son, or us. Order coming for Bowman U. There is Trey Turner for the Phillies to 75 on the WBC. Two blue team USA ones. I like that. Love those WBC inserts. All righty, guys. Done with the Bowman. Now we're on to, on to Top's Chrome update. Get three boxes of this going now. Luck, guys. We'll get all the cards out. We'll start going through them. Come on, redemption. Come on, redemption. We are due. That box had autos. That orange auto and a Serda auto. Didn't it? Really? Three autos? Yeah, right now. Two per box. That's two per box, right? That whole box didn't have an auto. I really missed that. Hopefully we can get some better pools here at MQ. Keep it going. Right, guys. Good luck on the first update. Prism rookie Luis Medina got a Jordan Walker rookie. Refractor George Kirby. Refractor rookie's Brandon Fott. There's a blue Robbie Grossman on the Lava Lamp to 125 or 175 on this one. Lava Lamp Grossman. A prism of Nick Ahmed. Prism rookie Mason Miller and Jeter Downs. There's a Brett Phillips Refractor. Prism is Christian Vasquez. A gold coming. There's Alexis Diaz on the Refractor. Prism rookie Cole Regans. And gold is Joey Wendell on the gold mini diamond to 50. That one's going to the Marlins. Oh, really, MQ? Which Jordan Walker was it? Mini diamond to 50. Action stars is Riley Green. Prism rookie of Brett Hedrick. Jaymer got a Levi Stout rookie refractor. Gotcha. All right, guys. We're going to add a box of Bowman Chrome Choice. We'll get three autos out of that. So we'll even out our autos there. We were short three of them actually in that three boxer. So we'll add a Bowman Chrome Choice, get three autos, even it out. So White Sox rookie. Don't want you guys to be short on those. So we'll get those out. Zach Gallin on the Refractor All-Star Game. There's a Tommy Pham. Ryan Mountcastle, Tatis and Jake Bird. So after I finish these two boxes, guys, I'm going to go grab a box of choice and we'll finish the break with that. There's a Riley Green on the insert. J.D. Martinez on the All-Star. Winker Refractor. There's an Adley Rushman on the Action Stars rookie. And Blue Auto is Casey Schmidt to 150. Nice one there. Ray Wave for the Giants. Kyle Lewis and Shay Langlars. Oh, one of those. Okay, I got you. How to do in the grading. How do we do? You should do Barry grabbing the Colton Origins. Ray grabbing a couple teams. Update and Bowman Chrome. You appreciate you guys. You got a 10. Let's go. That is what we're looking for, my man. Congrats. I like it, man. I think Jordan's going to have a good year next year too, man. Kid can hit. Kid can definitely hit. In the humidor. They are a little sticky, man. They are a little sticky. Congrats on that, man. Always take a 10. Thank you, Joseph M. Grabbing a Bill's Spot in Certified. Thank you, Joseph. Let's get it warmed. I got you, Tim. I got you, my man. We'll get that going right after this. Again, guys, since this, that was Bowman Chrome. We're short of a few autos. I'm going to add a Bowman Chrome Choice Box. I'm going to go grab that after. We'll get three more autos added to the break here. Eight to go in the second certified. First one is sold out. Thank you, guys. We've got Origins brand team, or Picker teams tonight. Just a couple left in NT football, and then Leap Hockey. Leap Hockey to end the night. Going to be a fun one there. Not a lot of space for personals, guys. Not going to be a lot at all tonight. We'll get some personals going on Fanatics live tomorrow, and I believe Site Orders will go tomorrow night with Force as well. Fracter Mike Trout from the All-Star Game. Riley Green on the Refractor. There's a Green in 99. Tommy Lestella. Tommy Lestella, Mariners. Action Stars Judge. Got a Prism Gus Varland. Nick Martinez Refractor. Grayrod on the Rookie Insert. And Jason Delay. Refractor is Josh Young from the All-Star Game. Refractor Devin Williams. Action Stars Bo Bischette. Jordan Walker Rookie for the Cards. Otto is going to be Royce Lewis for the Twins on the Veteran Auto. This one there. This guy's a beast when he's healthy. Royce Lewis for the Twins. Refractor Vulpe. Sean Bouchard on the Prism. There's a Corbin Carroll, D-Back Censor. Alexis Diaz All-Star Game. Randy Vasquez on the Refractor Rookie. There's Chris Morrell. That one's going to be a negative rookie. Chris Morrell, debut for the Cubs. Kinley Jansen Prism. There's a Blake Perkins to 199. That'll be Aqua Rookie for the Brewers. Yeah, that's tough on the Ken Griffey Rookies. I know certain of the Ken Griffey Rookies have a really, really high pop count. A lot have been graded. I'm going to have to see what they're going for really and see if it's worth it. There's a JD Martinez Refractor. If the corners are kind of frayed, probably wouldn't get the highest grade, so probably not going to be worth it, honestly. Future Stars Beatty. There's a Vaughn Grissom Refractor and Prism on the Back, Adam Duvall. Duvall. Red Sox. And last one here, guys. Top's Chrome Update. Again, we'll do a boom and chrome choice after this. I'll grab it. We'll add it to the break for those couple misanautos. What do you guys think? I don't hate it. I don't hate it. I'm going to get some futures in if that's a... You believe in that? I don't believe it. I'm going to get some futures in. Mark Angers with a Gus Touchdown. I might have... I might put four and a half receptions with a touchdown. I can't remember. I never remember, honestly. Oh, neither. Yesterday, I thought I hit one, and I was like... I was flipping on like... It was one thing and one other, and then one and another. I thought they were all in one, and I was like, oh, this is doing really good. Some Pop Sentry, Steve. Have you seen the Deccadence Man? That stuff is fun. I only got to open one box of that so far, but that is right up my alley, man. The Deccadence Pop Sentry. We had a triple... Was it Meek Mill, Rick Ross, and a little Baby Auto. It's pretty sick. It's going to be James Harden on that one, and it's good to go. Oh, it's Mark Andrews. Yeah. Not surprised. Not surprised. Wow. Say Rangers on the rookie. I know, man. There's a Austin Hayes All-Star Game Refractor. You haven't seen that yet, Steve? Look it up right now. Right now, Leaf's Pop Sentry Deccadence. It's like a high-end Pop Sentry. Caprillion. Nick Martinez on the prism. Got Mike Trout on the insert. Future Stars. Brett Beatty. Lamar's hurt. Ronald Acunha. Lamar's hurt now? Yep. Good lord. That's not good for the Ravens. Brett Wisely on the rookie refractor. Gunner Henderson. Negative. Nice one there. Oh, negative rookie. There's a Prism Greyrod rookie. Otto is going to be Chucky Robinson 499 for the Reds on the refractor rookie Otto. Arias Refractor and Jake Byrd Refractor rookie. There's an All-Star Game Josh Young. Who's their backup? I don't even... Snoop Huntley? I think Tyler Huntley last year? No, he's not hurt like that. Action Star Jordan. I'll be staying. No, he's just going to be out. There's a Volpe Titans. Come on, Sean.  Get back out there. Four more catches and we're going to let you sit down. Yeah, I'll take a look, Tom. Let me see. Let me see. It's very possible. Very possible. It's Tomas. One second here, guys. Make sure you're the only Thomas. If it's the only Thomas, then I did do that by accident. Yep, it is Thomas V. Sorry about that, sir. It is you, Tom. Sorry about that. You are Thomas L on the sheet. Sorry about that, sir. So that is you, Thomas L. There's a Von Grissom on the prism. Prism Grissom. Say a Refractor All-Star Game Mike Trout. Of course, sir. Thank you. Thank you. Sorry again. A little speedy on type and missed it there. Hubey Harris. Hoby Harris. And this one's Jose Caballeros to 250 rookie for the Mariners. And guys, I'm going to grab a box right after this. I'm going to grab a Bowman Chrome choice. We'll get going after this. Tyler Anderson. Peter Starr's Torkelson. And on the back is Altuve for the Astros. Alrighty, guys. Let me run to the back. We were short a couple autos in Bowman Chrome, so I'm going to grab a choice. Get us up to six autos. I'll be right back. Mixing is totin' it. Let's go, Bangles. This guy did not want to go in tonight. He's all bundled up. Alrighty, guys. This will be our last box of the break. Add a Bowman Chrome choice here. Pray for Sam's TV. That is true. Alrighty, guys. Get through more autos. Come on, bonus autos. First up, we have a Yanniel LaBoye. First auto for the A's. Yanniel LaBoye. Got a Gordon Graceffo. First Bowman base auto for the Cardinals. Remind you of City Inn, really. I feel that. It's got the, uh, they're all, um, like, uh, I don't want to say this frame. They're all frame cards. It's kind of sick. Gordon Graceffo. And on the back is for the Marlins of 499. Gonna be Torn Montgomery on the Refractor Auto 499. No, I feel you, Steve. I feel you. Alrighty, guys. So that'll do it for the, um, Topps Chrome hobby. And, um, Bowman Chrome six box mixer. Do a quick hit recap and we will get it going. Next one is gonna be Full Case Jumbo. 299, Gennaro Miller. 250, Sanchez 199, Arias Diaz. To 250, Caballero. Had to 175, Robbie Grossman. Excuse me. To 125 is Alfredo Duno. To 125, Blake Perkins. 75, Witt and Turner. To 150, Otto Casey Schmidt. To 99, Paul Goldschmidt. LaStella 99, Glaiber. And to 50 was Joey Wendell. Had base auto, Gordon Graceffo. Yanniel LaBoye. We had, um, Chucky Robinson to 499. Rookie for the Reds. Base auto, Royce Lewis. Christian Serta. Coyado. 499, Torn Montgomery. And to 25 was Brennan Malone. On the Orange Wave. First Bowman auto eights. Alrighty there, guys. That'll do it. Get on. Moving to the Full Case. Next.


Ha! 15th annual Project Rossum! The Project Rossum is a teenager! Beans! Beans is a bad perk. That's not a good idea. Wait, wait, perk idea. Cosmic Beans. That is a good idea. But is not legs. Oh! What's happening? I brought visual aids. We've got Dr. But here. I have the citation. Do you do it 2G's like the hosiery? No, no! Nope, you got it now. You got 2G's. But is legs. I think butt is the top. I think butt is the thing that happens above the legs. Butt is the thing that happens above the legs. Sounds like a rip off of hope is the thing with feathers. We don't know what's at the bottom of the ocean.  Those are the two last mysteries. From a medical standpoint, butt is definitely legs. Anatomically butt is legs. As you know, John, PIH is all about social contact. So, I think if you think about social context, it's very different than scientific content. I love that and I love the way that you're threatening the needle. It's beautiful. I am at the 23rd Street Chipotle and there's someone that I'd like you to meet. He's wearing armor. He's warm to the touch and he stands 9 maybe 10 feet. I think that he's remarkable. Oh yeah! Oh yeah! We're good. Everything's great, guys. It's working, everyone! Have you ever seen a Floridian thought? I wish it was more like a word. We've stopped out to save the rap game yet. For some reason. To save the rap game? To save the rap game, Hank Green. R-A-P. Oh! It's been a big time. John, me and all the rap people. It's gotten harder.  Like 12 people in this elevator start chanting Snack Man! Snack Man! Trust me, it's on fire. You look like an element from it. This time of year, I am Captain Awesome. So anyway, I've got Sharpie all over my face. Are you saying we might currently be witnessing a great sex? Yes.  Stop! My goggles are fogged. My throat is in pain. We want to not drink the milk. No, we've come this far. Oh no! Hank! We kept thinking they're going to learn about fly genitalia. One million three hundred and three thousand at four hundred and sixty dollars total raised to John's six hundred and fifteen thousand dollars raised through the Indiegogo. That's wild.  That was my happy dance, but most of it was off-screen. Most of the happy dance was off-screen. It was my happy dance. Thank you again to everybody who made this P-for-A-Happen and everybody who's been with us for the last forty-eight hours. We will see you next year. Hey, I'll see you on Friday. And everybody won the end.


Not every day. Not many. How many of you have used it quite a bit and feel comfortable using it? That's less than four. Alright, so TensorFlow is basically a tool for building computational graphs. Everyone sort of talks about it as this deep learning tool, and it is that, but it actually can do a lot more than just pure deep learning. You can do lots of different things with TensorFlow. And one of the things that I'm going to try to do is show you some of the things in relation to that. The other thing that makes it so special is it allows you to take this graph and distribute it over many CPUs or GPUs. So it allows you to basically deal with extremely large data sets and train them over 64 GPUs, 128 GPUs. Now, pure TensorFlow has been a very low level library. Alright, so we'll talk about later on about some of the announcements that have happened today. And some of the things that are sort of changing. But pure TensorFlow is a very low level library, and on top of that I've built a lot of other libraries that many of you have used, things like Keras, TF Learn, TF Slim. There's quite a number of them now. The other thing is TensorFlow by far is by far becoming the standard deep learning library out there. When you look at the number of stars, the number of commits, everything on GitHub in relation to this, you look at news articles, you look at tutorials, everything is sort of going towards TensorFlow. And I think especially after 1.0, which was just released overnight, it's going to accelerate even more. So I talked about pure TensorFlow versus high level abstraction APIs. You always have the most amount of control when you're using pure TensorFlow. While things like Keras and stuff are really fantastic to do, they're limited in that you can only basically build things that they have already abstracted to build. It's much harder to basically drop down into pure TensorFlow. That's one of the things that's going to change. We'll talk about that later on. The other thing with the pure TensorFlow API is that it's a lot more work than Keras and TF Learn. But I think one of the big things about it is it allows you to actually understand more about what's going on in your network, and then you can get a much better sense of how the people actually would work. And one of the things that I know for myself, when I speak to a lot of other people, when you use Keras or something like that, it's great. In a few lines, you can write a network, but then most people don't understand actually what that network is doing. They see that this is a certain type of layer, okay, but what does that mean? And what does that actually mean mathematically? With TensorFlow, a lot of what you're going to be doing are the actual mathematical operations. Okay, and then the other thing I think is probably one of the biggest advantages of working into pure TensorFlow is you've got access to TensorFlow which allows you to basically do everything from look at your graph to look at the training rates for different things throughout it. So the big concept of TensorFlow, there are four main concepts that you need to understand. The first is the graph. The second are the operations that you run on the graph. The third are sessions that basically run your graph for you, and the fourth is TensorFlow.  So one of the biggest things is that the graph, everything has to be built on a graph before you can execute, and you'll see when I go to the code in a minute what this actually sort of means. But unlike in a normal sort of code, you don't just write a piece of code and then you can just put it into a print statement or print down the mathematical operation. The other thing is the graph can actually be built because we can write out graphs in different languages, quite a number of languages now. Just overnight we've also added Java as an experimental language, they've added Go. There are quite a number of graphs that, sorry, quite a number of languages you can write your graph in. But generally what happens is all of these languages then get converted down and compiled to C++. And this is one of the things that allows TensorFlow to be so fast is that it can compile it in such a way that then those equations and operations can be distributed very easily. There's a new thing called XLA, which we'll talk about later on. It was announced overnight. We're just going to basically take this to even a higher, to sort of a better level of where TensorFlow will actually be able to sort of edit and optimize your graph for you as it's compiled again. So the operations, operations are what's performed on the graph. This relates for everything from standard math operations to common deep learning formulas and tools. This gives you sort of that high level of granularity in your model to really get down and see exactly what's doing and be able to change something and see does it do something. This is really important, this is one of the reasons why TensorFlow is so favored by researchers. It's because if you're trying to come up with something new you can't just use pre-made layers that other people have already made for you. Sessions, sessions get executed on the graph. Nothing is right until you're in it to initialize and run a session. And finally the TensorFlow gives you a visual representation of our model, gives us stats about our training variables like loss, accuracy, etc. And TensorFlow soon is going to actually have debugging inside. Okay, I will come back to that. Let's jump into some code. So how do you know Python? Oh, wow, that's fantastic. So many people. Alright, so I'm guessing everyone knows Jupyter Notebooks. I don't need to explain what Jupyter Notebooks are. Right? Yes? Okay. So basically I've got a notebook here and I'm going to go through a very simple network that I've built and explain it. And first I'm going to also explain some of the things about the graph and some of the things about the operations and stuff. So the first thing we need to do is we actually need to set up our graph. So one of the best ways to do this is to reset the default graph. This allows us to basically clear anything that was on the graph beforehand and get a sort of like a brand new default graph. We then basically can set up a session if we want. So what I'm going to do is start off with a very simple sort of neuron thing. Just very simple math equations. You can see here we've got two inputs. Three, four. We've got the node C that's doing a simple addition. We've got D doing a multiplication and we're also doing multiplication. So let's look at how we write that in TensorFlow. So I'm going to start off with some constants. We're basically going to just define them and this is how we define things in TensorFlow. We basically even though these are very similar to NumPy NumPy numbers and things like that, TensorFlow has its own set of everything and you're best to use TensorFlow's own ones. Otherwise when you actually run a model it has to copy them from NumPy and actually then turn them into TensorFlow so it actually slows down the process of running the model. So here I've got basically Okay, so here I've done my assignments, right? I've basically put the input A, input B, I've got an addition happening here, I've got a multiply and I've got another multiply. Now if I print out C, what do you think we should see? So if we were using just normal Python numbers or something like that, like ints or floats or anything, we'd actually see the result of the equation. But we don't here. It basically just returns a tensor because what we've done is we've actually assigned these to our graph but we haven't actually run the graph at all. So actually if we come down here we can actually see what's on that graph and we can see that these are what we've already put on the graph. And if we want we can actually start to look at some of those. So let's look at the A multiply B. So this is basically look at the load definition. We can see that it's basically a model op. We can see the two inputs that are coming into it. We can see that it's a flow. We don't actually see the value though because there's no value assigned to it yet. If we want to actually see something we need to run it in a session. This is the print statement wrapping a session run command. And now we can see the number that's assigned to that. And then now we can actually do two things here. Run E, which is basically our last thing. It's very important to understand that when you, let's say we were running this node TensorFlow knows that to run this node it needs to run all the other nodes that connect to it. It takes care of all of that for us. So now we run that node. At the same time I've also set up a summary writer to basically send the graph to TensorFlow. So if I come over here there's that graph. And if you see if we click on these things we can actually see what they are. We can see what each operation does. Okay so moving along. Does everyone know what a tensor is? Okay but the fact that people haven't put up their hands I'm guessing not everyone. So the best way to think about a tensor or a way I like to think of it is either a multi-dimensional array or a multi-dimensional matrix. An in-dimensional matrix. So I put a couple of pictures of one so that you can start to sort of think about it. This is kind of like a normal array that we would think about in code. Then we've got a 2D tensor, a 3D tensor, a 4D tensor, a 5D tensor, a 6D tensor. Very quickly representing these things in a way that humans can sort of think about them just goes out the window. And you'll see that often you will have very high dimension tensors going on being passed around. So doing the little math stuff that we did before is not a big deal at all. But now let's sort of start to work with a matrix. So we're going to basically make a matrix. Again I've reset the default graph. I've basically started a session. Okay so in Jupyter Notebook's exclamation mark means just a command line. So I'm basically just removing the previous tensor board files there. And what I've done here now, I've got to stop the tensor board. Okay so when you're running tensor board you need to obviously stop it. So now I'm setting up two matrices. And basically we're just doing very simple ones and I'm going to multiply them together. So if I want to get the shape of one of them, how many people know NumPy? NumPy really well. Okay quite a few of you. So in NumPy we basically just say dot get shape. Intensively we have to say dot get shape. And we can see the dimensionality over there. Okay let's run it. So yeah I'm just sort of printing these out so you can actually see what's inside them. And then there's the matrix being calculated. And we'll go back to tensor board and have a look at it. And the reason I want to show you this even though it doesn't look that amazing is that I want you to understand that even though you see just sort of one little note there one little thing going on there, that's actually a matrix with lots of numbers. And it could be like 10,000 by 10,000 numbers. So when you see things represented on the tensor board you need to sort of like often highlight them, click on them, see what they're doing, get a sense of what's actually going on. Okay let's go ahead and build a network. So I'm going to build a very simple MNIST network. Does everyone know what MNIST is?  So the stock standard boring thing that everyone uses. We're going to build a very simple MNIST network. Let me just bring in my train test. So basically MNIST is 65,000 images. So yeah we've got 60,000. 60,000 images, we're basically taking 50,000 for our training and 10,000 for our testing. So going back to sort of like the tensor thing it's good to think about images and what does that tensor look like for an image?  So I made a little picture here to show you. So we've got 28 by 28 and then we're going depth for the number of pictures that we've got. Now if this was say an inception network or something else that was dealing with photos, each one of these would generally have three layers. We'd have an RGB. So if this was actually in colour we would have 28 by 28 by 3 and then depth for number of images. Now actually what we're doing with the MNIST tonight is we're not going to do anything sort of CNN or convolutional so we're actually just flattening the tensor to make it a vector which is basically 784 numbers. And that's basically just done by taking the top row of pixels, taking the next row of pixels and just sticking it on until we get to the end. We can still use numB or something like that to basically represent them so here you can see I'm printing out sort of the numbers and we can see what the labels are. Okay. Now what I want to do is building a batching system because we can't just put 50,000 images in each tensor flow. It's not going to be a good way of doing it. Especially if we had actually probably 50,000 we might be able to but let's say we had like 500 million pixels going in or 500 million images going in. So we need a batching system. So the batching system here is actually from TensorFlow's MNIST. TensorFlow actually uses MNIST as one of their sort of tutorial things so it's actually part of their library and they've actually made a batching system for it. So basically all I have to do is call this and give me a batch of X, a batch of Y. So the X is the tensors with 784 vectors and the Y is just the labels. So the Y is basically just going to be a one hot encoded 10 vector. So basically for the numbers, 0, 1, 2, 3, 4, right up to 9. Can I make a pickup? Alright, so here's a rough diagram of what we're going to build. So we're going to have 784 inputs going into a hidden layer of 384, going into another hidden layer of 100, going to an output of 10. Any questions about that? Do people understand what's actually going on there? I think that's pretty self-explanatory. So we're going to sort of have our 380 inputs. I'm not trying to train the network for any sort of massive accuracy or anything like that, I'm just trying to keep it really quick. Good question, very good question. So the real answer is voodoo. You get a sense. The more networks you build, the more you can get a sense. I made a mistake is why it's 384. For some reason I kept thinking of number 768 in my brain. So I halved that and I was basically going for half whatever it started out at. Here's what you want.  You don't want too few because then the network won't be able to generalize and learn. So you will learn that over time you'll get a sort of sense of like, okay, and there are some formulas out there but I wouldn't say that any of the formulas are sort of guaranteed to work all the time every time. It also depends a lot on what you're doing. Here we're doing a very simple multi-layer perceptron. If we're doing convolutions it would be very different. Okay, yes, exactly. So the last one is basically where we're going to compare against the labels. So we're basically, what we're doing is we're crunching all the numbers through here. All these are coming into one node here. They go all out. Eventually you've got 100 nodes going into 10. Sorry? In some ways, for something like MNIST half the pixels are not relevant. Really the network can learn on, there are certain pixels in something like MNIST that tell it whether it's a number or not. For example, a good example would be the center pixel. If you think of the 3 or 4 pixels around the center, if they're black we know that there's a very high probability it's not going to be a zero. So there are certain pixels that are actually sort of more valuable than other pixels. But this is one of the cool things about deep learning. We don't sit there and try and work out features. We just check it in and we let the network itself work out what the features are going to be important to it. If we had a convolutional network, we'd actually take the filters and start looking at them and seeing which areas of the images respond the most. You'll see lots of diagrams to do that sort of thing online. We're crunching through so we've got to take out ports. So we're going to basically output 10 separate numbers and whatever is going to be the highest number there we're going to say that's the probability of being the one that we want. So let's look at how we do that in code. We've got learning rate, training epochs, batch size, just place them as just for showing. That's not a big deal. And then we have certain things for saving the model and then here we've actually got what our model is. So I talked about this before. We've got 784 for the first player for our inputs. We've got 384 and 110. We're basically getting a new graph so that we can actually see the graph once we've been done. And the other thing I'm doing here is actually defining the inputs. So inputs we define as placeholders. So anything intensive for a placeholder means that you can basically substitute values in and out of it very easily. So you'll use placeholders all the ways for things like inputs. You'll also use them for things like learning rate if you were going to have a decaying learning rate that you wanted to change with each batch or with each epoch or something like that. You would then make your learning rate a placeholder. A very good question. An epoch is one run through the entire training set. So we're doing it in batches of 100 but we're going to get through 50,000 images. So one epoch is one run through. So I'm doing 4 epochs here. I'm not going to get a very high accuracy score because 4 is not exactly... often you'll see people training like 1,000 epochs for certain days. It's 200,000, right? 4 times 50,000. A good question. Very good question. Because I remember when I first learned that too I also learned for a long time. So I've set up the inputs. Now we're at our network. So this is sort of like all the juicing part. I'm defining this as a method. We're going to basically pass in our training set. It's going to be X into here. Now there are some bits. I'm going to explain different bits at a different time. So let's look first at actually the hidden layer operations. So the hidden layer operations that we're going to do are in addition, right? And we're going to do a matrix multiplication before we do that addition. So we're actually going to use weights and biases. So does everyone understand what weights are? So basically weights are things that... is what the network is actually going to change to blur. So it can't change the input, right? If it changes the input we're changing the pixel. It can't change that. So the thing... we actually can if we want to. One of the things that we played around with a lot was adversarial images. I've had a lot of things with adversarial images where instead of training the network you train the images. So you can make an image that looks perfectly right to a human as a Mercedes-Benz or something and they put it in inception network and it says, oh it's a nice big Persian cat. And what's going on there is you're making very small changes to the pixels. But we're not doing that here, right? We're basically making small changes to the weights and to the biases. So up here I actually set up the weights of the biases for this first layer. So I just changed this before we started. So what I've got here is what we call a truncated normal. So this is basically just a random number. With this very small standard deviation. And if it picks the random number outside of that deviation it basically drops it and picks one again. So we're doing that because we don't want, for example, all of our weights. We want to try to keep our weights as close together as possible to get an efficient and good generalizing network. If we had all our weights between say negative one and one and then we've got two or three weights that are three or four hundred that could cause a lot of problems inside the network. Now I may just train out but there isn't always guaranteed that it will. So in this way we're basically dropping anything that's outside the standard deviation that we set. So I've got my weights there. I've got the bias. So we've got basically matrix multiplication which is multiplying the x by the weights. So how many weights are there for each thing? Same size as whatever we're feeding in, right? So yeah. So seven hundred eighty four weights for each of these things. Okay so we basically multiply those. We then add that to the bias. And then we basically put it through what's called an activation function. So an activation function is basically making sure that what we're doing here is not just a linear function. And the activation function that we're using is called Brelu or rectified linear unit. And I didn't have a picture. So Brelu is very simple to think about. It's just basically anything under zero doesn't go through. It just passes through zero. Anything above zero it passes through whatever the value was. So other activations that used to be very popular, things like sigmoid, softmax, tan, still for certain networks. But generally nowadays most people are going to use a Relu for most things. Just because it seems to be one of the best ways of training a network. Okay so we've gone through the weights and bias. We've gone through the two operations for our first hidden layer. We've now got a 10 support. I will come back to what this is actually going to be. And so when you see these scopes I'm actually scoping it. Not in a traditional sense for scope as in a programming sense. This is for 10 support. So we're basically saying that all the things in this belong to hidden layer one. So that when it draws the pictures nice later on it will draw it nice and neatly. Okay so hidden layer two is basically the same as hidden layer one. We've got our weights, we've got our bias, we've got our addition matrix multiplication and we've got a Relu activation going out. And then we've got our last output layer which again is very similar. We've got our weights and we've got our logits layer. So the logits layer is going to output and this is what we're going to use to then check our loss for our error function to see like okay what how close are we, what are we getting right, what are we getting wrong. And basically this is what gets returned out of the function. So let's just run that. Okay so then we basically assign that method okay now we're into our optimization functions. So the loss that we're going to be using here is cross entropy loss. I'm not going to explain it. If you can just do many searches for it there's lots of information about how it works. But there's lots of different types of losses that we could use. For depending on what type of network you're building and what it is that we're trying to predict etc. we might use different losses. So basically anyway we're basically assigning the loss here and then we've got our optimization function. So a lot of people probably a lot of you have heard of gradient descent how many of you have heard of this? It's a very popular one. Another one we're using is the one I'm actually using is Adam but I put gradient descent there so you can use that as well. How many people know Adam? Adam is not as well known but it's probably a lot more effective nowadays. Again these are pretty complicated equations. So TensorFlow is handling this for us. Now here's the key thing though is that our optimization function is using it our learning rate that we set earlier on and it's using that to minimize the loss from the loss function. And what you don't see here and what can be very confusing about TensorFlow at the start is what is it actually doing then to make that loss? What it's actually doing is tweaking all those weights and biases. So it can work out what are the weights, one of the biases and it can then alter those and start tweaking them. Okay, then I've basically just got another thing for TensorFlow where we're going to measure the accuracy so I've just set that up. But that's actually not part of our variable per se. I could actually take that out, we don't need that. I've also initialized the variables or I've actually set up an initializer to initialize the variables. They will only get initialized when they actually get run on the graph. I've got a saver so that we can basically save the model and then I've got our things related to our TensorFlow. We're basically going to make a file writer so that we can write things to the actual disk and then we can look at those on TensorFlow. What we're going to do is measure some scalars. We're going to measure one for accuracy, one for loss. And then we've got a summary op. So basically what a summary op does is it merges all your summaries so that it can just run the equation at once. I'll explain that a little bit more in a bit. So now I'll get what is built. Our graph is built. Now we're actually at the point where we're going to actually train the graph. So let's look at what's going on here. We basically open a session. We run the session in it so everything gets initialized. We then start our training cycle. So this is just very simply for each epoch that we set, we've already set the number of epochs we're basically just going to go through and we're going to run all the batches. So our follow up here is basically just going through and running batches. So you can see each time it gets a batch of x and y it then, the way it gets those, what it does is it puts those in what's called a free dictionary. And the free dictionary is basically what gets entered into TensorFlow for all its operations. So what we're doing here is we're basically working the summary up. We might talk about that before. So that as we're going around each batch, it's not only just calculating training the network, it's also calculating our loss and our accuracy and storing that to TensorFlow. So we can see that a little later on. Yeah, and then we're basically going to print out and see how it goes. And at the end of that, we've got our same, we're going to save our model. So for saving the model, all you have to do is this.  And you can use things like the saver and stuff like that. So okay, our first epoch is done. Let's see how we're going to go. We're running all of four epochs. Okay, so basically it's sort of saying open up the session and with this session open we're going to run all these things and then you can automatically close it by yourself later on. If we wanted to, we could actually do a session close as well. Does that explain it? I was curious about the width. Okay, so this one is different from the ones I'm using up here. The ones I'm using up here is basically saying with the scope of accuracy for TensorFlow, I want you to perform these equations and store them under that scope. Right? You can define whatever you want. Yes. That's one of the cool things about TensorFlow is you can actually then put your own functions into different things. So if you think that you've got a better activation function then you know. Okay, so yes, you do have to do a lot of work to do it. It's easy to do but you can't actually do it. You can define all your own Python functions to do certain things. I'm not going to go into how to do that. But you can. Just go and do a search on the API for using Python functions for different things. You can actually then contribute it to the actual project. So there is actually a tf.contrib where people have put in different ways to calculate certain things. You can define... This is the whole point about TensorFlow is because it's basically just one big mathematical graph, you can cut and change whatever you want. Now doing it for the optimizer is not going to be easy because you're going to then have to think of how it handles the back propagation. You're going to have to go through and check and make sure that your function handles all those things the way the TensorFlow expects them to be handled. But it's something that you can do. Okay, we finished our training. We've got let's see how do we go against the test set. So now what we're doing is we're basically just running the model again. I'm loading the saved model that we just saved before and I'm bringing it in and we're going to use it to predict against the test set. So he hasn't seen the test set yet. It's just seeing the training set. Okay, we've got 97.5% accuracy. Which is okay but not that amazing for MNIST. That said, consider we only had four epochs for these small network. It's not bad. Let's jump into some more interesting stuff. The thing is now as we've gone through there we've been adding a lot of things to the TensorFlow. And this is where TensorFlow can really shine. So let's look at our graph. We're going to graph them what we had before. So there are a few things here that we The training is basically we can just take that off and put it on the side for the moment. And this is where you'll see what basically is sort of the model that I put out there. We basically got our inputs. So let's look at what we're doing with our inputs. In our inputs we basically have got the x input which are all our pixels and we've got the labels. We look at our key layer. We can see. Okay, we basically have got our h1. Sorry, we've basically got our weights and our biases. And we've got them the math that's been done there. We can even look at how we're calculating the cross entropy. There's a bit more to that than say some of the other ones. Now this is a really simple model. So anything we've got in here, if we wanted to inspect it we can basically just click on it and we can see what's over here. And it will seem that when you've got a very simple model that okay well it's not a big deal to go to see it like this. But when you've got a much more complicated model it is a very big deal. Because we can do things like general trace inputs. Now whatever I've got clicked I see what goes into it but not what comes out of it. So if I'm worried that okay it should be something going in here but why is it doesn't seem to be working? Very quickly I can isolate and see okay it's not actually feeding what I thought it was feeding in there. Let's say we didn't have the inlayer 1 connected to the inlayer 2 or something like that. We'd be able to see that very quickly here. Okay we can also look over here and look at our training. Which doesn't look that good. One second. It's actually saving to a it's you're basically logging out to a directory and saving to that directory. I've actually set up you know I was actually saving to a sub directory. So now we can basically see our accuracy going up as it trained and we can see our loss going down. And we can get a very sense now you know okay and this is kind of standard right what we've got here in this network. But often you will see there'll be like a big spike or you know where something maybe the learning stopped at a certain point. Maybe your learning rate was too high and the learning plateaued. You would be able to see that very clearly here. The other thing that we can do too is because we set up those histograms we can actually go and see what's happening with our weights and our biases over time. So we can look and see sort of in a 3D way or we can go so we can see you know what's actually happening here with training our model.  So the biases are actually pretty good. You can see that there's nothing radically too low, there's nothing radically too high, they're all in a very nice band. And that also explains why the model trained well and trained pretty quickly. Our weights also recently in group places. There's nothing out of the ordinary in this model. But if there was you would be able to see that very quickly. So TensorFlow is one of the key things that you need to sort of learn to set up. So you can constantly come back and benchmark your stuff and go back and look at it through different things. Yeah we could put something like that in if we wanted to yes. If we reached a certain level then it would just stop. So we basically code that into our training section. Another thing that we will use a lot is like a decaying learning rate. So that's one of the things too. Let's see if we can predict an image. We got that one image that we picked we got wrong. So it's predicted a six and it's actually supposed to be a five. Okay it's zero. You can see that it's predicting most the images right. Okay so let's just go through TensorFlow and some of that code that I didn't explain before is that to make TensorFlow work you need to basically set up your graph right otherwise it will just look like a whole mess all over the place. So the key things that you need to be able to reset your graph, your default graph and you notice that each example I've gone through I've reset the graph to basically get rid of the old whatever was there and start again. You need to have a file writer. What the file writer does basically it logs everything to disk so that we can look it up later on. If you want to display something that's like a scalar or something like that you need a summary scalar, summary histogram you merge them and then when you're in training you actually write those you write to your file writer and that basically then saves it. This is the command line I think. We're basically running TensorFlow on this directory and we're then using in Jupyter exclamation mics for command lines. If I wanted to let's say I've let's say we want to just quickly do something else. We do a two epoch run but we're going to do a really really low training rank so what would you expect to happen? Is it going to learn well or not? We'd expect that a company is not going to learn to learn well. Let's just see what we've got for that one. Not very good accuracy. Basically double rank. Let me just run through a different one with a much higher than you may. Again we're just going to do two epochs and what I'm going to do this time is rather than just show if it's going to work it's going to work sometimes and not work sometimes if rather than just show the stats for one model we're going to look at multiple models to compare them. We've got 74% on that second model. We're running TensorFlow again so you can see now this is model 8 and this is model 9. They're very very different. And we can see that I'm pretty sure the model 8 was the one that did no learning at all. But here you'll be able to start spotting things. And you should be able to see I think it actually might be a part of one for another at the moment or it could actually be more likely my code because I've got to change these as it goes through different things. What I was changing basically is instead of us outputting to just the log simple graph who are making another folder and then when we basically just open this top folder instead of the lower folder we can see all the models that are in there. I've got another model but you can maybe go through this one yourself. It's a model for sentiment analysis. It's using almost the exact same model but doing sentiment analysis. Anyway I will put that up on GitHub and you can go through it. Because we're only showing the phone. I will take questions at the end. If everyone is cool with that, I might come up.


One of the suggestions I'm making, the basic problem that I see within the system, we're whelming concentration on making money. Everything that we do in the business world is focused on making money. In order to a new world to emerge, we need a new structure, new conceptual framework so that we can get it done. Social business is about solution of the problems and it runs as a business, but the profit stays with the company. No dividend. So it's a non-loss, non-dividend company. To solve social problems. And how is the social business different than these things? How is it different from a well-run NGO? Well, NGO by definition is not for profit enterprise. When we talk about social enterprise, it's enterprise which also makes money, dividends and so on. But we are trying to position a different piece of concept that this is totally 100 percent focused on solving problems. And all profits go back to the business. Because we create or as an investor, as a producer, promoter, I create this to solve problems, not for making money. I can have a profit-making company somewhere else, but this is a company to solve problems. We want to create an economy where there will be no unemployment at all. The word unemployment will be unknown. Every business can create business to reduce unemployment. Not for making money by doing that, but simply saying that we want to create this company to employ 20 people. Give us some personal stories about social businesses that you feel are working that you've been involved with or that you see around the world. Shoes are a problem because many health problems come to the body through the skin of the feet because you go barefoot. So we have a joint venture with Adidas. And the mission is nobody in the world should go without shoes. The CEO of Adidas asked me how cheap should it be in order to be affordable to the poorest person. So I said maybe under one euro. He was shocked. Adidas shoes under one euro. He said, why not? You have the technology, you have the ability. If you put your mind into it, it will be done. They worked for two years to produce that shoe. Now that shoe is produced. It's under one euro. It's being sold. One company that became very well known because of the social business that we did with them is Danone. We created a company and now we are producing that yogurt. And it's focused on malnutrition. Make it very cheap, make it very delicious so that all children can eat it.  And this is a partnership that's between them and them. This is a partnership, it's a business. Absolutely, it's a business. Only thing we have done, we will never take any dividend out of this company because it's a problem solving company. Emerging the world 25 years today, it will be totally different. When we try to project ourselves in future, we wrote science fiction, how to go to the satellite, who had to make satellites and so on. Today we need to write social science fictions. What kind of society we are in. We're not thinking about that. We said there's a kind of invisible hand we'll take care of it, you're wrong. We take care of ourselves, not the invisible hand. We decide where we want to go. We design how we want to live and we'll make it happen.


Hi everybody, I'm Hugh Russo from 94-3 The Point and I am so proud to be hosting once again for the third year in a row Hack and Sack Meridian Health's Women Rock event here in beautiful Asbury Park at Convention Hall and the Paramount Theatre. It's Sunday, October 14th.  The day kicks off at noon with interactive exercise and dance demos, cooking segments, spa services, art projects, career development, volunteer organizations and more activities that align with the five pillars of integrative health. We'll even have a man cave if your guide decides to tag along. We'll host inspiring speakers throughout the day in the Paramount Theatre. Stay tuned in the upcoming weeks as we begin to announce the lineup. You can register for this free event by visiting hackandsackmeridianhealth.org slash womenrock. I'll see you on October 14th.


Hello everybody welcome back to another AI video and this one Canva has come to chat GPT that's basically the bottom line and it has done a great job this is not a rushed plugin this plugin does the trick let me show you first off how to install it and then I'm going to show you how to use it should take only a few seconds so I'm going to go ahead and I'm going to click on the little button and then I'm going to go to the plugin store I'm going to go to install I'm going to uninstall it all right cool starting from scratch to get going it says plugins no plugins enabled or if you have plugins either way click on that little down arrow right there it'll take you to the plugin store in the search bar just type in canva and presto now you'll see canva install install it that's literally all there is to it now the next step and this is an optional step but I like to do this is I just type in how do I use oops use this plugin the reason why I do that is because every plugin no matter what it is it's going to tell you here's what the plugin does here's what I need or what the plugin needs and then go from there so here we go tell me what you need describe the type of design you're looking to create template suggestions it's going to select a template that it thinks relevant and then you can go in and edit it which is where the fun part is and you'll see here I've got one here this is a graphic that I had it design and I haven't touched anything yet it built this from scratch with just one prompt and then here is even a video that it designed look at that I mean it's got some you know lorem ipsum in there it's got some default text I'll delete those or I'll close those out but here we go so I'm going to say create a youtube video for a real estate company yeah a real estate company yeah something like that I don't know I'm just going to go ahead and click on this you can be more specific of course here we go create a youtube video for a real estate company using canva there we go I clicked on the little down arrow so it'll show you exactly what it's going to do but anyway you don't need to do that but there we go so now here we go it's going to create five I believe it's always five look at that find your dream house that's a cool video that's a cool looking video this one looks pretty good the third one the first one the first one looks kind of like a music so maybe it's not perfect and it's got some music and then this one is find the home of your dreams which is very corporate okay so let's go with the second one let's you can of course click on the view template so right here on the second one I'm going to click on that it's going to open up canva and assuming you have a canva account you're going to go ahead and see this and I'm going to hit the play button bottom left look at that look at that that's amazing I haven't touched anything I just said create this and it did it for me now you can go in here and override it so it says get one of our best units but if you were in albuquerque you could say get one of our best units in albuquerque just go in and override it this works the same for all types of posts so if it's a social media post a social media video a graphic all of this works inside canva inside chat gpt this is amazing thanks for watching