So just make sure that you're not over buying either because you know, there's nothing worse than over buying You don't know what to do, but you know me and a couple of days time I suppose it's important to go through the process and work out exactly what you have because there's no point in going out and buying You know jars of cloves and bay leaves when you realize actually they're they're in there Although there's there's a number of things that you can do before the big day and you know Whether that involves buying in the ingredients now and and doing it or wait until it's a bit closer It likes I'm just thinking about something as simple as cranberry sauce Which can be made now and then you have it you have a see yeah, absolutely You can now you can make your cranberry sauce like couple days before you know I mean they can have all that kind of in the little glass jars.  You know me. Yeah, and so once you get them kind of rid of the way And basically like the turkey, you know some people kind of Either a harsh kind of story that people kind of cook at the night before as well and like it easier the next day But like if it's not too big like I cook at all I cook mine On the day, you know, so I spent maybe three hours on cooking in the oven And also like make sure that you buy a turkey that kind of fits the oven as well I also like people kind of buy too big of a turkey and that doesn't fit in their oven You know and that you'll end up have them to break it down and you know, that's a lot of work down as well You know, so yeah, just make sure you get a turkey that you can fit in the oven You know, so There's there's so many options anymore because you can have bone and rolled or you can have breast only or there's even There's even like a turkey in a bag now with a pop-up Timer. Oh, yeah. I like I like using that. Yeah, I used that one year and that's actually very good. Yeah. Yeah and it keeps all the moisture inside inside The roast as well like and you have a load of You know stock at the bottom and juices that you can baste the turkey back over again You know and keep it nice and moist and you know juicy as well So there's nothing worse than the dry turkey that's overcooked. You see I I actually don't mind a dry turkey That's overcooked, but most people probably no no no I'm odd like that But most people probably would oh that's dried out and that's tasteless So how do we how do we keep it moist and and yet? I just just cook it just right don't over cook it Yeah, so look, um, I was sent there a meat barometer the last day There are really handy things to have and just make sure that um, you stick that in if you do have one Make sure you stick it into the middle the center of the joint And you roast it, you know, I mean or even the ones that you test I know there's ones that you roast and there's a pop-up one there as well tells you that it's ready Um, but there's ones that uh, you take it out and you stick it in afterwards Just make sure it's over about 70, you know 68 to 70 degrees like and that is cooked like you know, I mean don't want to kind of too much like the 80 degrees Because that's going to become kind of dry, you know, I mean So once you're hitting around the 68 to 70 degrees, you're good, you know, and then you kind of Meet and make sure you get to the core of it as well the center And when you're doing the temperature the thickest part Yeah, the thickest part absolutely And how that's that's cooking it through. How do we how do we manage to keep it moist? Some people basted a couple of times others I've even heard Well, I heard one chef on chatting in the last week about Turning it upside down to start with so as the juices run down into the breasts. Is that something you say? Ah, there's loads of uh, there's loads of um, kind of like house tails and stuff like that The way I do it is like I kind of roast it off nice and slow So I don't turn it up too high because it's a big joint, you know, I mean So basically like, um, I put it on maybe 165 to 107 degrees and I kind of roasts continuously all the way through and I kind of keep basting the juices And from the bottom up, you know, I mean so basically kind of spoon every 45 minutes or every half an hour Just kind of if there's juices there maybe at the the last kind of 45 minutes Just keep basting this every couple of 10 minutes 15 minutes And that'll give a lovely flavor because all the flavors into the juices that's kind of comes out of the turkey on the Rosentree as well And she probably make that make out into the gravy afterwards as well. You can throw that into your gravy which Intensifies the flavor again, you know, but I see here people that you can cover it with the streaky bacon as well That's the kind of nice kind of way to kind of protect them from roasting, you know Roasting it too harsh as well. I can drown the fillets out, you know, so yeah Yeah, and especially I suppose the upper parts and the the edges of the legs if there's a bacon over them It helps them from browning too much Exactly.  You're making me hungry now There's one of it, one of it the ham any any any tips or ideas? Would you cook the ham on the day or would you cook the night before? Yeah, I cook the ham on the day. So Well, there's four in my house two kids and ourselves like but I know some people are probably bigger kind of, you know, but make sure you get a pot The the water kind of covers the Ham as well, like, you know, I mean and if you think the ham is kind of salty Just so good the night before and maybe drain the water away like, you know the next day and use fresh water to kind of Oil it up again and if you put it a nice ham kind of like some cloves in there and a piece of onion and some Day leaves and I love throwing in the celery in there as well Does it kind of give a bit of freshness, you know, I mean like and You just boil that up like very slowly and just let it simmer on the boil like and it depends on the size really like in You know, you don't want to dry it out kind of too much like what you want to kind of cook through as well But you wouldn't need to cook the ham on the day before if you're gonna have enough time Like just give yourself with three hours like depend on the size, you know, I mean So I love making everything fresh on the day Like I know people kind of cook it the day before and then they they re reheat the slice the ham and then they kind of Put it on the trace rose and trace and they kind of reheat it, you know Yeah, that's that's you know, I was a big family. Absolutely But if you have family for you close the time three hours to cook a Christmas dinner, you know And it is all about the time because I suppose it's important to start start these things early Like the turkey in the ham the two big ticket items on the day and have them have them Cooking early so as you leave space in for things like, you know, your your roast potatoes and vegetables or Anything stuffing or whatever you're doing in the oven and it means that when when the turkey is out and resting that you can put those things in Yeah Yeah, but you know, the main thing is like all the sites.  What can the slow cooker or active fry be used for? It's my first time in charge of dinner and I'm very nervous I'm not sure they will be the answer on christmas day. Would they? Slow cooker and active fry. Yeah, I don't have an active fry myself now, but um I'm sure you can do some roast potatoes in them if you want, you know me and The slow cooker. I'm not sure the slow cooker You can maybe do your gravy or maybe you can do your stuffing in there as well You know have your stuffing and kind of keep it warm in there have a ready Or if you're kind of doing like a maybe cauliflower morning or you know broccoli morning something like that, you know, they might Be nice in there as well. They keep they'll be really good for keeping stuff warm, you know, I mean so Maybe you can do some sprouts in there as well like we've put our lard on to bacon They're kind of keep nicely warm in there as well, you know, but they kind of keep it kind of nicely turned over to Um Yeah, yeah, it's all it's all the different elements It's all the side dishes really that can I think can just really complicate that's going to take a lot of time Yeah, yeah, so It's important. I know we all like to have all the elements of a christmas dinner We think it you know, that'll make the perfect christmas dinner, but keeping it as simple as you possibly can is hard to be too Yeah, it is. Yeah, look at to keep it very simple like I we very simply I love brussel sprouts I love roast potatoes and I love bit of mashed potatoes. I know some people like croquettes as well And you know, you could you could stretch out to all the sides, you know, I mean cauliflower morning broccoli You know a bit of ham and nibbles and top of them just loads, you know, I mean, but um Don't don't have too much pick a few so you can focus on doing doing a really good couple couple ones instead of having the Um a load of them like that's kind of you're rushed in it, you know, I mean The um the sauce is the night before kind of get them at the start That's a really good kind of time saver as well.  Do you like parsley sauce? Uh, no, happy enough with the gravy over the over the turkey and ham Um, normally if I was having ham separate on any other occasion, the would it would be parsley sauce But just on christmas day Yeah, I I I like spoiling myself like I like a bit taste of everything you see. So, yeah It's quite nice. Yeah, I like kind of white sauce and the brown sauce You're not afraid of the elements The more no no, but that's it's only one day, you know, and you want to like, you know Get a nice kind of dinner out of it, but keep it simple So simplicity is the key and also like um and just don't buy over buy too much as well and plan it out Clowning as the huge thing in this world, you know, so yeah, we mentioned cranberry sauce earlier and A texture says it's cranberry sauce hard to make from scratch My go-to jar one doesn't taste the same thinking of trying it a few days in advance, of course So it is very simple to make and it is there's no comparison between A shop one or a homemade one No, if you like if you get nice you can get a nice bag of cranberries and you know just throw them The pot there with sugar as well like, you know, I mean and I just let that cook down into a jam and I can it's beautiful You know, I mean, so it's so simple as well. Maybe whatever orange juice if you like and Yeah, if you kind of orange peel as well if you want an orange zest as well You know, so the zest of orange before you kind of squeeze the juices in as well They're lovely to go in there too like, you know, and that kind of gives a lovely spring as well Like, you know at the sauce. Yeah, and it will you know your homemade cranberry sauce could make the difference So if there's one takeaway and then that is make your own cranberry sauce this year Easy done and easy stored and easy kept Well, listen you absolutely you you have a great christmas and by the sound of things you're definitely not going to be stressing out squanjay No, I normally have a barbecue. So it's the next day. So I'll stick a I'll stick a ham in the barbecue John, you know, so um But uh, yeah, so Whatever you have you enjoy yourself and happy christmas to yourself as well and everyone in the station Same to you same to you. Thanks a million for for chatting with us I'm tasting million bright notes a blast of seasonal spirit a hint of crisp winter morning a bouquet of candy canes A cherry red nose of reindeer a body of christmas pudding Go full-on festive with rustic reds and wonderful whites from just 8 euro all part of centrist christmas wine sale Enjoy a call sensibly. Hello there christmas is the perfect time for saying. Thank you And what better way than to give a harvies point gift card available from the hotel on 07497 to double two zero eight or from harvies point dot com It's the gift that keeps on giving all year round a harvies point gift card Hey can double and bay prawn chowder grill tracks with pac-choy


Good morning cyber traders. Happy Thanksgiving on this eve of November 21st. How's everybody doing? Good to see you all. All right. Good to see you Lawrence Mike. Look at that Mariano Mary good. Good Donna grand everyone Well, I'm pretty surprised a lot of you showed up today Very very impressed looks like a lot of us can't get okay not get enough of it after seeing what happened with the market yesterday Holy cow, right? Had a nice little crash in the market, but I think we're gonna make a little bit of comeback today So I guess, you know, you know, it's great about more than anything coming in trading a day like today Is that you get the experience of what to expect of? You know what it's like to trade on certain holidays what to you know from the experience You know been doing it for so so long and for some of you now We're starting to come here year after year and some of you are new beginners and don't understand what's going on you got to know when to Put good money On good times and bad times So that's where that all comes about. So you got to be a little careful when it comes to that So let's let's go out there and see what's happening in the market. First of all, we know the doubt took a big hit yesterday Let me tell you I was getting phone calls from people might want to hear a funny story my wife went to get her hair done yesterday and Her hairdresser, which by the way, I told you it's a while ago these hairdressers to make a lot of money So he's like freaking out that he owned basically the worst stocks of them all he owned Amazon he owned Facebook he owned NVIDIA he owned what else did he own basically the worst of the worst, right?  I think you make money. I'm like, yeah, okay No problem. Yeah, how was I? Haven't looked at in a long time, but did you see Netflix? Holy cow NFL X. Let me bring that up here Netflix at a high about 420 look where it ended up set to 50 I mean at a hell of a run since 2016 Literally up about 300 points. But you know what? You know But the funny part is when you talk to everybody What happens a PCG it has a good one card But what's funny is that when you talk to them everybody's a little bit more depressed about they all they still made money I mean don't get me wrong. Everyone still made money, but they were they were counting their chickens before they hatched So instead of having a dozen eggs, you know They only got about three eggs. All right, so but they didn't lose all the eggs But they still got something they didn't realize they're gonna have that do that well But it just listen, that's what everything's all about and one thing I always tell everybody is that if the problem Why people have issues of not controlling profits and this is one of my flaws that I am a very hardcore day trader and The problem with being a day trader you are too conservative.  You don't you like enjoying life You don't want to you know and you and people will realize it until now like now They start realizing I'm man, man I mean I should be a day trader But I'm bringing that up because now people are starting to realize that swing traders did do a lot better than day traders but When they start getting to markets like what's happening recently They're flipping out and they're like man I wish I should have been a day trader because remember if to be a good swing trader and to be a good options trader You have to be a good day trader first Ken says Could be worse. Hey, you know what Ken? It's still not over. Remember you do it for the rest of your life So people don't realize how worse it can get so true. I love day trading for Mary Beth Wayne says cash is great position to be in when smoke clears and that that is true. That is true and What was it? What was this funny saying I heard this morning? People say oh, that's what I was saying. So when is everybody gonna when is everybody gonna get back into the market? I said when this you know probably when the people and there's an old saying of that When they find out the sharks the shark is dead people will go back in the water So I don't know if the shark is dead yet. So you're a joyous fan You know, that's we got to focus on but as day traders We're the we're the snipers out there So we'll see you and get a good sense of if it's getting over or not But we need consistency, but yes cash is king and I told you that but even you might get a little bump today in The market, you know and seeing that, you know, it's up a little bit today It's got to be like this for about two weeks Consistently holding flat very strong and that's what we want now Let's talk about what happened yesterday because some of you guys did prove do pretty well We did add a couple of stocks that did move by the way today just a couple of quick announcements We did have the workshop going on today Josh is gonna do it on Monday, you know listen We were talking about shorts. We you know remember being a being a trader here You get work when you get workshops and that's where you'd be spending and should be focusing most of your time But we'll do it on Monday because I think it's gonna be a really bad market I'm thinking I can see too much and also 12 o'clock today. I'm gonna be doing an open house again We do it every week.  Well, uh, well, listen, we'll have it up. You're gonna get an email You know what? You know, it's right on the website.  I think it's on a website It should be on a website co let me just bring that up and Yeah, this should be a pop-up banner that will come up in a few seconds Yeah, by the way, I hope you guys been enjoying the new website The new CTO website we changed the whole thing and Another big thing that I want to share from with all of you two guys is that we are in the process of rebuilding The whole portal page. So for everybody here, we would like your feedback, you know, I know we got a lot of Compliments and complaints about it, but oh there it is. There's the browser deal Black Friday deal So it comes up like after like 15 seconds. So if everybody here that wants to help us out We're gonna redo the whole portal page. We're gonna make it so much easier and friendly We already got a couple layouts if you guys want to help us vote on it. Your feedback is always appreciative All right, so let's get back to see what's happening As of yesterday, it was a couple of nice little stocks that did make some big moves I mean NVDA you got I mean NVIDIA, you know, we're not a fan of that But you know because it's expensive, but that had a great rally yesterday went from 30 4 to 54 I mean AMD all every single one of them going down the list as much as the market got crushed These stocks got crushed like really bad, but they did come back Micron all in the same industry. We talked about them all yesterday. They're all in the same market The problem that you see now is they're basically hovering at the highs of yesterday yesterday Everything did exactly like the cyber clock tells you they made all their big runs from 9 30 to 11 And they backed off they was pretty much over. I was pretty much done by like 10 o'clock in the morning and Then now that basically hovering right around there A lot of people made money there. I need to go through the list, but but overall oh square, too I know I mean they all they all did it square, too You know down to 56 when that's 63 now, you know, I'm not a fan of any of these stocks You know in a way of this is like second protocol first protocol that we always focus on is What's in a big percentage gainers and losers and follow the money, you know But when you get markets like yesterday, you know, which by the way, it doesn't happen every day You know if the market would trade like like what it did yesterday Let me tell you something guys we will kill it, you know And I think CT will get so much attention because people always panicking, you know, then with so much Volatility but at the end of the day that doesn't happen. It happens. Maybe Once every few weeks. Well, it's been happened just recently a little bit more than usual due to the Fed rates But I know what one did some of you guys just mentioned earlier, but we'll see what happens to Fed rate next month So hopefully they'll they'll you know tone it down a little bit, but a couple of stocks We're gonna go through I know some of you guys already talking about it But the ABI was one of them this morning on the watch list that we did have let me fix my time frame in here But this one was one of the stocks I did find this morning I thought there's probably only one that's really probably moving that I was a fan of it's not up a lot I mean if you came here around 830 should have got in around 340 345 So you're doing pretty good I like this stock a lot because it was a hundred dollar stock a long time ago Some of you remember that we did trade it here and let me just fix this time frame in here But some of you remember back in July this stock went from 2 to 14 So we know the stock is a lot of fun. So this could be a sleeper for the day Remember we only need one and and some of you are new traders and you say hey Falstah What the hell is that one share mean, you know, let me just tell you what one share means One share means if you're if you're not going to trade it and you're gonna sit there and watch it by one share Just to say you're in it and if you lose money, don't worry It's not a lot if you make money You can you could just have fun and say, you know, it's like a video game It cost me a dollar to play the game, but you gotta be you gotta learn how to trade So, you know, if you feel like you're chasing whatever, you know Just get into position. Enjoy the glory, you know And just look at that as a the fee to play to play a video game, you know, let's call it that But this one so far is probably our favorite one our best one's doing well I thought something was gonna happen. I said that early this morning. I says, you know what? We're not finding any it's not looking like a really good pre-market. We might have to find something wait for the market opens up But so far we got a pretty good couple of AMD another one So we got the NB EV AB IL AMD is making a little bit of a move. It's got some good pre-market trading I don't know if this one's still moving QD. This one gapped up pretty nicely right now 10% Kind of flat though. Look at that The only thing I like the only reason why I brought this up earlier is because it was a $17 stock stock got crushed Look like it's up a little bit It's testing highs and I know some of you also trade the any in pre-market to any's doing pretty well at 830 Small as a $6 stock 680 that one did pretty well. So That's all looking good. Anyway, that's about it. I don't really see that much out there. We got Five stocks now listen. It is it is a Thanksgiving Eve So if everyone United States, you know what that is a lot of people in Canada and Out of this, you know all over the world that are logged in here Probably don't know what that is for us, but it's one of the probably the biggest holiday Bigger than a holiday in the United States because everyone Celebrates it. It's the biggest travel day of the year. So, you know, the markets closed tomorrow Friday, we're gonna be closed tomorrow and it's so funny. I always get people freak out They think like you went out of business or something like nobody's answering the phone. Listen, we'll close tomorrow's Thanksgiving. Enjoy your day Friday will be here. It's a half a day, which I personally say it's probably one of the best half days out of the whole year to trade So definitely be there You know, if you can but as a daylight today, I'll be really cautious you might get a good rally I would poke my head in the afternoon and see what happens, but don't be too much of a cowboy today Just be very very conservative. I don't think it's gonna be, you know If you if you hit big and you make well, just take the money and run just take the money and run I know some of you did pretty well Ken. You're already up about 25 cents on 2,000 shares All right, that's good. Just give him a round of applause Then did pretty well too. Dad, you made a what you made a what 35 cents on the any? All right. There we go. Good Good job. So stocks have good deals on Black Fridays. They sure do. That's why that's why Black Friday is a good day to trade Maybe about 20 cents on the ABIL. There you go. You made a little more than me on that I only made about 18 cents, Ben So all right, so there's our watch list guys So don't forget got Black Friday. Don't great packages for you guys every year We post them regarding about coaching and being subscribers to the cyber group room We also remember we're moving the workshop for today to Monday, and I'm gonna be doing a 12 p.m Open house and try to you know try to recruit some more traders So hopefully everybody wants to be there just go out there and support us and like I said What else we got to do at 12 o'clock unless you want to go out do some shopping. All right in the meantime guys Good luck. Happy trading and if I don't see you going to this afternoon have a happy and healthy Thanksgiving to you and your family be back on Friday


What's going on everyone? Sam here with Layton Sports Cards and we are doing 2021 Bowman Baseball Sapphire Edition 5 box break number 22 random teams. Here is the results again with the random. As always you can find these results on the website as well as the link in chat. Let's go ahead and get started. So we got Topscrone Black breaking right after this. Thank you again Sean. Sean just dropped the link in the chat. It is 14 to go. Definitely a very good product. So really excited to rip some Topscrone Black. You get one in case card. One in case autographs per box I should say. Empty. And yeah so we're just going to need some love on that. Appreciate it again everyone. Alright Taylor Tramiel, Dylan Bingler. Got Shane Boz. Lange leaders no firsts in that one. Pete Detmerz. Taran Colten Welker on the back there. So looking for a couple colored cards per box which is pretty cool. Got Leeover Poguero. Got a green here. Not a first. It is Braist and Stop. That is 51 out of 125 for the fills. There you go Phillies. With the Braist and Stop. As well as a Mick Able first on the back. So it's Poguero, Patrick Bailey, Mick Able. Nice ones there. Next pack. Jackson Coarch. Kierstad. Kevin Alcantara on the first. There you go Yankees. Yankee Legend. Kevin Alcantara. Herbie. Woods Richardson got Ed Howard. Mauricio. Got to autograph. It's Jose Tena for the Guardians. There you go Matthew G. Nice autograph there. Jose Tena. Heck yeah. There we go. We'll take that. And Trent DeVoe is your first on the back as well. Angels. There you go Angels. Guys we've got a red. You're going to pull from the back here. Jose Tena and Riley Greene. Got Matt Manning on the front. It is not a first but it is Jaren Duran. Seven out of fifteen on the red. There you go Red Sox. Nice color match. Zach T. Congrats on that on the red JD Zach. Very nice. We got Matt Manning. Gonna go ahead and tweet out. We've got Topschrom Black. Thirteen to go guys. Thirteen spots to go on Topschrom Black breaks next.  So nice hit on that one honestly. We'll take that all day long for sure. Rich freaking out over the Jaren Duran. There you go. Good luck on this one everybody. Isaiah Greene got first to Baron Sabato. There you go. Grats on that one twins. One of the guys you're looking for. Jose Salas Blake Watson. Color match Duran. Exactly. Red Sox happy with that one. There's another Jaren Duran. Mackenzie Gore. Jeraldo Perdomo on the back there. Got a Green in this one. Jeremy Pena, Jared Kalanick. We've got Ozalacy. One of the guys on the cover. That is 72 out of 125. Congrats Royals. Nice hit there for your Royals. Adam P. Take that for sure. Tyler Soderstrom on the back. Couple of nice cards in that pack. What's up Joshua? How you doing buddy? Got Jeter Downs. Logan Davidson. Daniel Lynch. Andrew Douthwist. Jackson Rutledge. Got no firsts in that one. Gunner Henderson. Bleday. Brett Beatty. Got Jeremy De La Rosa on the first for the Nationals. There you go Nats. Always nice to pull a little first action. Jordan Groeschans. Forest Whitley. First of Austin Martin. There you go Blue Jays. Probably the best guy you're looking for. Tim W. There you go on the Austin Martin first. Heck yeah. Take that one. What did you pull Joshua? Got James Beard. Got first autograph is Aaron Sabato. There you go twins. Congrats on that one. Who's got Minnesota? William Oh. Heck yeah. Nice Sabato autograph. Very nice. And a first of Ivan Johnson on the back. There we go. Next box. Random Angels Trout Otani. Geez man. That's crazy Joshua. Joshua got the Trout Otani book number 10 out of what was that? Museum. Alright here we go. Next pack. Do you mind dropping the link for Top Scrone again? Thank you. Thank you. Zach Veen. First of Ismael Mina. Tier one. Tier one. Groeschans. Nolan Jones. Got Brennan Davis. There you go on the Sepia to 99. And Ozalacey on the back as well. Thirteen spots to go. Top Scrone Black. Black breaks next. Gunner Henderson. Bleday. Brett Beatty. First of Nick Matone. Angels. There you go. Thirteen to go. Again looking for a lot of really cool stuff out of there. Jackson Rutledge. Nick Ladolo. Ryan Belade. Got Jeter Downs. Logan Davidson. Got Otto. Is Michael McAvney. For the Cubs. There you go Cubs. That is Judson C. With the Cubs. Heck yeah. And first is Alexander Ramirez for the Angels. Got Jeremy Peña. Jared Kalanek. Royce Lewis. Edward Cabrera. On your base. No firsts there. Got another Jaren Durand. Mackenzie Gore. Beater. Luciano. Isaiah Green. Aaron Sabato first again. Jose Salas. Corbin Carroll. There you go guys. Gonna again refresh spots really quick. Give me one second. Thirteen to go. Gonna drop this on Facebook. Kroben ever wants to load. All right. Thirteen to go on the next break. Gotta show that some love if we want to stay on time here. D.L. Hall. Nick York. Tyler Soderstrom. Seth Beer. This is Waldo Parraza. Very nice. You got called up recently for the inks. A little skidding. Yeah I guess so. Eddie Diaz first. There you go Rockies. I thought you were like 15 and a half and then I was down to like three or so. Three. Got a Green in this one. Got Green. Vidal Bruhan. Five out of 125. There you go. Raise. Nice hit for you there. Raise. Take that one. The Vidal. Been up and down this year. Drew Waters on the back there. The Hendy. The Josh Young on the back there. Had his first career home run a few days ago. Called up for the Rangers. Groshan's. Gunner Henderson. Couple of guys that have been getting called up here which is cool. J.J. Bladette. Brett Beatty. Got Otto is Brian Boilvis. There you go. Athletics. Oakland Athletics on the Brian Boilvis Otto. Congrats on that one. Marco Luciano. And last pack of box four and we'll finish off with box five. Got Jackson Brutledge. First up Gaby Arias. There's O'Neal Cruz on the back as well. Pirates. Here we go. Christian Robinson. Libertor. Walton. Nueva. Go ahead and drop you guys the link for Top Scrone Black again. 12 to go on that now. Thank you guys. Hope you got it. Sean just dropped that in chat. Again 12 to go. Breaks right after this. Looking for some good stuff from last year. Yeah. Alec Bombados. Ichiro's in there. Jake Vogel. Sepia. Josh Jong. There you go. Rangers. Congrats on that one. That's awesome. One of the hottest young guys in the MLB right now. Drew Waters on the back. Thank you so much. Tyler Freeman. Blasovic. Josh Jong again. Vaughn. Jordan Westberg. Nicky York. Got Otto. Luis Santana. There you go. Astros. Nice hit for you Astros. Grats on the Luis Santana. Very nice. Luciano on the back as well. Giants. Three packs to go on the break. See if we can pull some nice color maybe as well. The Paraza. J-Rod. Arias. O'Neill Cruz. Daniel Espinot. Eddie Diaz first. Garrett Mitchell. Zach Veen. Last pack. Good luck here everyone. Hien-El Choi first. James Beard and first of Ismael Mina for the Padres. Going to do a quick recap of the color and some autos here. Had Green Vidal Bruhan for the race. That is five out of 125. Ozalacey 72 out of 125. Royals. Bryson Stopp 51 out of 125. Green Phillies. Had Jose Tana. First Auto Guardians. Aaron Sabato. First Auto for the Twins. Michael McAvney. First Auto for the Cubs. Brian Boelves. First Auto for the A's. Luis Santana. First Auto for the Astros. Josh Jung on the Sepia to 99. Rangers. That's 38 out of 99. And Red Jaron Duran. Seven out of 15. There you go. Red Sox. Really nice color match hit there for you Sox. That'll do it for the break everyone. Thanks again. Next up we got Top Scrone Black. Gotta fill it and we will get started. Appreciate it again everyone.


Hello and welcome to the session. In this session, we will discuss a question which says that if A and B belong to the set containing the elements 1, 2, 3, 4 and 5, then which of the following are functions in the given sets? First part is, F1 is a set containing the order pair AB such that A is equal to B minus 1 and second part is, F2 is a set containing the order pair AB such that A plus B is equal to 6. Now the first part in the solution of this question, we should know a result and that is string for a function. Now we can test whether a given relation is a function or not by applying the following tests. We have to examine whether the first set that is the domain and secondly we have to examine that the first members to use up, that means the elements 1, 2 and 3 of our group pairs that is 1, 2 and 3 are different. Therefore it is qualifying both these tests. Now in any case when the domain is not fully used up or the first members of all the ordered pairs are not different, then in that case the relation is not a function. Now this result will work out as a key idea to this question. And now we will start with the solution. We are given this and we will start with the first. Now for the first part given the order pair AB such that A is equal to B minus 1. B belongs to the set containing the elements 1, 2, 3, 4 and 5. We will express F1 as a set of ordered pairs B belongs to the set containing these elements. Now for A is equal to 1, A is equal to B minus 1 as it is given in the condition. Therefore A is equal to 1 minus 1 which is equal to 0. So the required ordered pair AB will be equal to 0, 1. But it is also given that the set containing these elements. But here A is equal to 0 which is not the element of the set. Therefore we will not consider this ordered pair equal to B minus 1 which is equal to 2 minus 1 which is 1. Therefore the ordered pair AB will be equal to 1, 2. Equal to B minus 1 which is equal to 3 minus 1 which is 2. Therefore the required ordered pair AB will be equal to 0, 3. Now for B is equal to 4, A is equal to B minus 1 which is equal to 3. Therefore the required ordered pair AB is equal to 3, 4. And lastly for B is equal to B minus 1 which is equal to 5 minus 1 which is 4. Therefore the required ordered pair AB is F1 is equal to set containing the ordered pairs 1, 2, 2, 3. Now F1 is a relation from the set to the set itself. So now we will draw an arrow diagram for this relation. Now F is that is the relation F1 from to the set itself. The first ordered pair is 1, 2 that means 1 is connected with 2. Second ordered pair is the third ordered pair is 3 and the last is 4, 5. Now using the results which are given on the key idea. Now in this case this is the domain and the domain are connected except this element. Therefore we can say that the domain is not is left associated that means the domain is not fully used up. Therefore the relation F1 is not a function. Now let us discuss the second part of the ordered ordered pair AB such that it is equal to 6. It is given that AB belong to the set containing the elements 1, 2, 3, 4 and 5 ordered pairs by using this condition. And also we will choose AB from this set. Then F2 is equal to the set containing the ordered pairs 1 as A is 1, B is 5 plus B that is 1 plus 5 is equal to. Now let us draw the pair we will do. Now here also A plus B is equal to 6 that means 2 plus 4 is equal to 6. Similarly there will be 3, 3. Then the next will be 4, 2. Then the next will be 5, 1. So in every other pair is equal to 6 itself. So now we will draw an L diagram for this relation. Now this relation is from this set to this set. In this relation the first ordered pair is 1, 5. That means 1 the next ordered pair is 3, 3. Now here it is containing the elements 1, 2, 3, 4 and 5. That means the domain is fully used up. The domain used up is the solution of the given question. And that's all for the session. Hope you all have enjoyed the session.


Good to go Okay, welcome everybody welcome this morning We're going to present you about how we decided to Architecture the control plane of our open stack installations We took a little bit different approach than what most of the bigger referential architectures are showing Nevertheless, it's it's quite similar to a few of the other control planes that you might have seen already being presented At this summit. So my name is Marcel Harry. I work for Swisscom. That's another picture of me, but It's familiar to me I'm leading the architecture of Swisscom's elastic stack. This is our stack based on open stack and Our platform as a service solution, which is based on Cloud Foundry. I'm a member of Cloud Foundry's technical advisory board Swisscom is also part of Cloud Foundry foundation. I have a Background in automating all the things like various automation tools and Linux system engineering So I am Alberto Garcia. I work for RECHA as cloud architect I joined RECHA kind of one year and a half ago But I've been working with emerging technologies for the last five years and in a previous life I was a network engineer so I have a good background on the work stuff as well Yeah, and Alberto was on the side with us and that's how it So everything started If we look a little bit about Why did we have To build our open stack and then also reason a little bit about the motivation behind our decisions Is maybe let's have a first look at the use cases One of the very early drivers was deploying Cloud Foundry on top of open stack Cloud Foundry is a very Distributed system really built to run in a cloud native fashion and it provides a platform to run cloud native applications So there is one offering that we have on developer Swisscom.com. It's our public platform as a service offering. Everybody can go there sign up and Start pushing applications however, we're also using this platform to develop new services on top one of the services that was then start started being built and which was also a huge driver in the requirements behind the platform that we build is the product my cloud it's It's a cloud storage solution being provided to all our residential customers as part of their plans and It provides you with official marketing term infinite storage so If we look a little bit of how Swisscom Looks at IT and how we would like to produce it. It's We think You should we believe very strongly in a for our CICD approach. So Meaning that we automate a lot of the things Or let's say all the things We also have multiple stages where we then test The new releases that come out either whether it's new software releases, but also new automation releases This gives us a way to a have rapid release cycles So we can iterate quickly on new features and box fixing box and But it also gives us like Really confidence in what we're pushing because things are going to be tested up front and One one of the things is where we see cloud foundry and open stack be within our IT environment It's it we really see it as the platform to build the next generation workload At Swisscom so it's the platform for cloud native applications highly automated microservice like architecture and So when when we with that in mind, that's also how we looked at When deploying open stack so What we do we usually see in the open start deployment. We see a Monolithic controller cluster with all the control play running on top of a pacemaker cluster fixed number of Bermetal nodes But we were aiming for something different something closer that we that we we see in Cloud our workloads something agile something dynamic a platform that can be plugged into the CI CD pipeline Something that we can operate with modern Operation Methodologies, but we ask ourselves we we don't see this usually in production environments Is it possible? Is it doable? It's open stuff prepared for that. Is there a model prepared for that? So let's go through the analysis with it To figure it out. So the open stack contemplate open stack is a fully distributed system It keeps services as the couple as possible So you think about it how open stack services integrate with each other if they use the RPC Which is the message through the message bars. Did you say vehicles? They use the database? These are well-known mechanisms to the couple modern applications. So Yeah, it allows dynamic topologies So if you think what you it does not matter if you have one API 100 API's the communication is through it through a lot Balances so you're pointing a VIP so it does not matter and the coordination of the non API Components is drawn is done through the RPC through RPC calls another RPC cast So you can have multiple components one single one. It does not matter. So Yeah, control plane services can virtualize so you think about it. It does not demand Kind of How to phrase it it does not demand huge resources So you can deploy as in the API with just one virtual CPU and two hicks of memory You you don't have it's open source You don't have this kind of direct binding with licensing between the service and the and the server where you are great So it's a good candidate to be to be virtualized And you have dedicated projects to automate the deployment of the other services So that means that the open stack control plane can be managed as a code and you can pluck it You can pluck it into the CICD. So given that Open stack has been developed following the modern application methodologies. So if this is exactly what we were looking for So, yeah, so they change model All of you know the pacemaker h-model is the one that is documented in in the open stack high availability guy Is it consists of usually a three? Bermet are no pacemaker cluster with all the control plane services running on on top It's something that it has been proven in Prolation You know that it works, but we found some limitations that we did we didn't want to include in our architecture So this deployment has all the services in the same cluster So you cannot scale it as it is you have rabbit and Q you have Galera you have MongoDB those services do replication So if you put more more more more more servers, you will have more more more more replication overhead and less performance so if you have if you have all the services running so you have dozens dozens of services running on the same note There the resource requirements get higher. Isn't it? so if you translate these requirements to Virtual hardware requirements, you will end up in huge Virtual machines that are not good for virtual environments because they are harder to operate You don't want to have a virtual machine that has the same number of virtual CPUs on your than your hypervisor. Isn't it so? Life cycle of a metal is a is it low So you can it's not a good model to have in a virtual environment So you have to to move to where metal and some companies need months to have Hardware ready for consumption. So it's not something if you tomorrow need to need to scale one controller node You won't get a new hardware rack connected to the network and so on in hours This is not going to happen. So the CI CD is more complex You had to deal with pacemaker concepts when you are interrating in you in in individual components You have to care about the constraints I cannot I cannot restore Kiston service because I have some constraints And I'm going to restart also seen there and going to restart also Nova. So it's something that can be automated but it's a bit harder that if you don't use pacemaker and The whole point clustering software is a stateful. This is the whole point The cluster software is taking care about the status of the members of the cluster Taking care of the status of the services that are running on the cluster We were aiming for something more established something that follows these mother principles and It binds to the control plane. Okay, if you deploy it in bare metal, it's clear that is that early It has a direct the dependency with the with underlying infrastructure But even if you deploy it in a virtual machine, you have these stony resources To the to restart the nodes in case of failure that requires that you configure a user a password in the virtual environment Direct access to the API of the virtual environment So you you have this direct binding you you cannot port this application to other virtual environment without changing configuration and so on So yeah, not the best h.a. Model for what we were aiming for so we look for another options And looking for for alternatives we found the so-called h.a. Proxy keep a lady model our colleague have a penia that is Engineer at the at record has documented this architecture in this link that you can see there this gtap Document is it based on the belief, but that you don't need a Clustering software taking care of the opposite services. So it's a pacemaker free architecture Thanks to that you can distribute the components because you don't you don't have this glue that is okay That is a cluster you don't have this glue. You don't have to yet you are not Kind of orchestrating the startup of the services based on constraints So you can just split out the control plane in different in different smaller roles And as you can split the control plane in the smaller roles Virtualization makes more sense because you can create a small roles with a small hardware resources requirement that can fit well in any virtual environment and of course It does not bind application to infrastructure because you can virtualize it and you don't have any interaction between the application layer and the underlying hardware So is it doable so we we looked at it and tried to design it a little bit So what we aimed for was a distributed and virtualized control plane Meaning that we can pull the pieces apart as Alberto explained into individual components We wanted to look at the individual components as Horizontal scalable services wherever possible. We will come back to that later As well as so the foundation of that to iterate quickly is definitely a virtualized control plane because there we can iterate way faster and It was kind of clear that we wanted to isolate shared state meaning My sequel database within a Galera cluster and rapid MQ on their own So Double HA we leveraged the the virtual HAA the virtual machine HAA capabilities of the virtual infrastructure So if a hypervisor where your virtual machine is running goes down the virtual machine gets Automatically migrated to a healthy hypervisor. So hardware failures Handled and also we configure an infinity rule So we ensure that the same that virtual machines that belong to the same role don't run on the same hypervisor So it's what hypervisor goes down. You don't you don't lose a complete service and the Application level HAA is something that looks familiar for everyone because it's more or less the same principle of pacemaker But without pacemaker. So what we don't have here is that if a service goes down The service will be down till something goes there and start at the service. It can be an operator. It can be a automated Automated code or whatever. So for the web-based services API is the dashboard We use HAProxy HAProxy distributes the loads and plus Thus monitoring to the back ends. So if a back end stop responding to the monitors, it just dropped down the server from the back end We use keep a like the because we don't have a clustering software that handles the virtual IPs. So we need something to to provide H8 to the virtual IP. So we use keep a like the keep a like this is based on VRRP This is a well-known network protocol to to provide H8 to virtual IPs And it also monitors HAProxy So so if HAProxy is stopped keep a like the stop sending the multicast VRRP messages. So this note won't be eligible to be to be the master of the VIP Galera cluster for my SQL Galera cluster is a is an active active synchronous cluster But all we know that we cannot configure it in active active because some open-stab projects do Telephone at the square is this case blocks in the database So we have to configure it in active standby using HAProxy in the middle for MongoDB and Quick and easy replica set for rabbit in queue the native rabbit in queue clustering With a replicated queues for redis in the pacemaker Model redis is handled by by pacemaker, but we don't have pacemaker So we are using sent in it if you look at the you know common HAA configuration of of redis sent in It's always there. So full of information Upstream and the non-AP components is a will say as I said we believe this model is Based on the belief that you don't need to provide a chain to the open stack services So they coordinate themselves with RPC and the state in the database so if we Then look at the in middle components in the overall open stack we can actually like yeah Differentiate between the main two things the control plane and and the computer resources for the computer resources We went with a hyperconverge approach We we have hardware that Has quite a lot of disk and as well as memory on a high density factor form also the compute notes or actually on every note we have 10 gig cards with Where we do bonding for the network H8 to to the different switches in general within our data center we go with a layer 3 spine leaf design meaning that We terminate layer 2 at the top of the rack and then everything else is routed over the spine and the leaf switches The compute note they they are hyperconverged, but they also have Just local storage for the ephemeral storage cases because this is where We think most of the Most of the applications within cloud foundry are actually fine without Any cinder volume so they they are already built Distributed and horizontal scalable so we can really them just quickly spawn on on local cheap ephemeral storage The control plane we at the first when we looked at it We wanted to have kind of like separating many of the things within many of the network It become became very quickly very complicated. So when we went with a Simpler approach, we just went with one network, which is not totally true because there's We have a separate Network for the storage traffic so that we can at least apply QoS more simply on on storage Which becomes important if you go with a hyperconverged approach and then if you look at the services Within the control plane. We were grouping them more or less by by major components And then one of the decisions we also made is for example Horizon requires memcash D for for caching of session and things like that. So we took there the approach that Helper or supporting services that are Like only for one particular role We put them on the role itself. So no need to have to separate them as well And in general we started really with small-sized virtual machines like I think Every machine got more or less only two vc-pues and four gigs of memory We then later tuned things up a little bit more. So Which is also the nice thing if you're on a virtualized control plane because then You can either say we go horizontally, but you can also have minor adjustments More in a vertical layer where it makes sense depending on on the kind of workload that is running on an individual node If you then look at the life cycle so within within our cloud environment We have a whole framework based around CICD. So we have We have multiple stages where in one we develop things a huge rate of breakage and then The more it goes towards production it becomes we only push the releases that actually prove to be stable that went through testing and This gives us really Confidence to actually iterate quickly on on new changes Also, I think this is very important And always to notice that we We strongly believe that should there should be a clean separation between code and configuration So the only things that differentiate between the the various stages are the configuration for the particular stage like DNS servers and the P server or the actual IP addresses, but The code it's packaged once at the very beginning as part of the CI process And then we only push static artifacts through through the different stages. So code never changes When it's pushed through the changes because otherwise you will never know what what actually You're not able to compare the two For for our automation we We use puppet we also started to develop a Puppet deployment orchestrator which helps us Surrounding more orchestration around puppet Nowadays probably a lot of people are usually like using puppet for configuration management and ansible for orchestration Our puppet deployment orchestrator does goes all also more. It also creates all the VMs within the virtualized environment and Then takes care of their lifecycle So this gives them all also the possibility that we actually can also Describe a deployment of such a control plane as as a piece of code Which then can also again being generated and similar to and being fed from a similar tool like AT&T's tool that they presented various times now at the summit that is just The storage of all the configuration data and then you can generate all the remaining code and even configuration data from it This also gives us the possibility to easily scale out purely on API calls For storage as I mentioned We're running hyperconverge compute nodes. We're using scale IO from EMC underneath Scale IO is really nice because it scales with the amount of disks that you put into it and so also with the amount of servers and then object storage We're not Doing object storage as part of OpenStack At Swisscom. We already have a huge utmost installation which provides us object storage Replicated over four data centers. So there was really like no need to to develop object storage services as part of the OpenStack and then Glance uses an object store usually and if you want to like have multiple plans Storage nodes which which is something that you would like to have in the HA environment We're actually then using again at most as an S3 backhand So we're pushing the images to at most once they are uploaded and then we have caches on on the plans Notes so that when people start Are starting to to launch VMs? Then they get cashed look locally on the stack, but we can lose that everything so we can just throw away the VMs As part of our Stack we're also giving we're also running a SDN. It's from Plumgrid It also was really an important part giving the scalability needs that we saw with With the my cloud approach Because they they are really pushing a lot of data. So we needed a distributed network Services so that like the data plane really scales with the amount of servers that we put in This is then how it looks like usually so On more on the left-hand side, we have supported Supporting services like a puppet master or pulpit repository server Then we have a this control plane, which is part of our arista layer free fabric They're like all the VMs are are attached HA proxy Nova Keystone and so forth and All these VMs they are running on top of a red hat enterprise virtualization cluster. So which Has its own scale IO storage. So we're actually like having two virtualization cluster ref is more the traditional virtualization cluster with features from that you know from VMware and things like that and On the we could also put it on another open stack We could also put it on on a VMware cluster. It doesn't really matter It it was what what was easy to build for us and what also made sense for us Then we have a separate network the storage network within the data plane Which which is then connecting all the storage service So for example Cinder requires access to that storage network so that it can talk to all the scale IO SDS then we have like the huge box all the compute nodes from open stack where The tenants are running on top and then the plumb grid gateways being The gateway between the virtualized world and the external physical world Meaning then the outside internet being routed or or another department or so Access within the fabric is kind of like separated but given that we still want to to access Open stack API and things from within tenants and we're bridging there as well into that and and they're using a Pan firewall to secure the access Yeah, so maybe let's look Now that we have an overview of our design It was also quite a journey going on and Alberto will give you more insights into like the various things that we encountered Things that maybe worked well things that we saw that were open stack services are not yet ready Yeah, the whole point is that we lack we lack feel experiences So we weren't able to anticipate the problems with it in the in the hard way So we design it we deploy it we run it we failed we come back to the same phase deploy it again File again and so on so that does the whole point of coming here and say this is beating with you So you you are able to anticipate these problems if you go for this architecture. So let's start with the first one We are aiming for a nested less architecture. We are aiming for an active active Architects without any clustering software. Guess what? Cinder volume is not prepared for active active configurations. So we had to decide Are we going to production without a chain this important component because this is the component that handles the life cycle of the of the of the volumes of the persistent storage, so There is a commitment From the community to fix that. So we thought, okay, let's create a small pacemaker cluster only for this role And we will get rid of it once it gets better So if you you are curious and you want to see what's going on you can go to this to this link There is this is documented by the guy who is assigned to solve this decision So he's very comprehensive and you will get a quite good view of what's happening But the strapping clusters so these components when After a complete failure of all no after the whole cluster goes down they require some manual intervention to come back online So we found the money the the Maria that galera cluster If the whole cluster goes down you you have to identify the node with the last data You had to bootstrap the cluster on that with that note And then you had to join the other cluster members to the cluster with everything you happen something similar Yeah, you had to boot it in order So if the whole cluster goes down you have to identify which node was the last one going going down and Bootstrap the cluster with this node Being the first one and then join the other nodes if you cannot identify at the proper order You had to reset the cluster by removing the amnesia database Which is not recommendable, but it's the only way to recover it and MongoDB it happens that either you know You get these fancy errors saying the cluster was done in an unclear way and you have to execute this repair Procedure to bring the cluster up again So we don't have this again, we don't have a Base maker we don't have something that automates all these steps So you find it in the in the in the in the hardware and you have to prepare your procedure You have to prepare automation call for for recovering that and this is what? Marcel is going to yeah, so simply we don't have any magical recovery. So It becomes very important that within such horizontally distributed control plane. You're actually Monitoring the health of your various components We're using console for that. We're using console also as part of the deployment and the service discovery Which also helps us to further orchestrate? deployments we can do things like the First Galera cluster can set up Galera and Maria DP and the other ones are waiting and then joining the Galera cluster afterwards so we can like really orchestrate these things in between and it also gives us service discovery and at the same time also the service health which we can then consume these events in a Event processing engine which is a own project that we started. It's called orchard. It's based it's in in its core. It's based on Riemann and It it is then able to see what kind of failures are going on within your system And then it can actually go out and like starting remediation Tasks so so we we're looking into automating more of the recovery Processes in an automated way within orchard so that when orchard detects Some patterns that we see at some time it it really goes in and does it automatically without any operators Doing it manually So maybe It's also time to look a little bit at the benefits and the drawbacks that that we saw in general making a summary of These overall architecture and our experience. Yeah, so the first one is Okay, is that we achieve our goal. We had our client like architecture we can we can we can treat the control the control services as the less applications because we don't have any Stiffle component that prevent us to do that We can operate them in a similar way that we operate cloud workloads We can forget about doing backups because the the it will only back a configuration and the configuration is in the In the automation code. We have a dynamic and a gel control control plane So we can scale out we can scale we can scale up We can do whatever we want because we are running virtual machines We are deploying them with with we are managing their control plane as a code We can we just need to call an API to deploy a new a new virtual machine So is your stuff and it's a cost-effective solution Everyone knows that the virtual virtual environments are the best way to save resources because you have this fancy stuff that is called Overcommitment so you can consume more resources that the available resources you can configure more resources that the available resources in the underlying first Satur and the control plane does not depend on infrastructure So you can do life cycle on the hypervisor where the control plane are running Without impacting the the control plane you can even if you don't want to continue with the your current Virtual virtual environment vendor you can you can move these workloads to a new Virtual virtual environment because this is the this is one of the greatness of virtual of virtual machines Yeah, and especially also We saw a lot of opportunities and actually benefits when when we look at clouds like they to operations because We're we're now having We're now having that this distributed architecture We can actually like treat the in middle components and scale them more separately But also like so we started really with the minimal set of services and now we're starting to onboard new services So actually onboarding new open stack services to to an open stack cloud is Becoming you just deploy deploy new roles and you don't like need to care to integrate them in into an existing deployment Also, we're actually thinking that although we we think we Our upgrade path should different But something that we saw is that you could actually start Deploying a whole set of of a newer version of the control plane and then just moving things over Where with a bare metal approach this would require new resources while on the virtualized environment You can just shift things over to the new VMs and then take the old one down also And but I'll Bert already mentioned that the only thing that we really back up are only the user data So it's more or less the database dumps and all the other things are just coming out of automation And if we have nodes that are in a weird state or are just You don't know whatever happened to them You don't know what people might have run on it or or so to to debug things and you're unsure whether this VM is still in a Clean state You just throw them away and restage them and actually this can happen without any interruption of the service itself because we Have a j-prox in front which will which we can drain and then take take the node down Redeploy it and once it's up again and major proxy will just get it back Yeah, the drawbacks. So we have seen the center volume is not Active active reddit. So we we have our base maker cluster running there So hopefully we will be able to to remove it soon Galera cluster Galera is the same thing We have the cell for updates a staff that creates locks in the database So you have to configure it in active hotest and by way using a j-proxy Also Maria the way and rabbit in queue don't scale Horizontally or the same happens to see their volume because if it's active passive you deploy 100 nodes You will have only one active and the with Maria DB and rabbit in queue happens that If you add more more more more nodes, you will have more more more more replication Overhead and less performance and in the case of Maria DB. It has no point You are only talking to one database due to the that's a proxy model in in active a standby Hotest and by so we had the no magical no magical recovery So we don't have anything that take care about the services So if the senior API goes down, it will be down So you will you will need to you need to have monitoring monitoring system That's see they are sent you an alarm and then automation code that bring up the service again or trained operators Or or whatever the same happens with the bootstrapping with the bootstrap of clusters They you lose the if the whole Galera cluster goes down. You need something to bring it up Network partition and keep a like the so keep a like these based in VRRP and VIP uses multicast message to Coordinate the VIP's across the nodes So if node a loses connection with node b node b and note a is there is the active one node b will stop seeing the messages from the node a and we say a I'm the master and you will end up in In explain various scenarios you can mitigate this risk by providing ha in the network infrastructure so bonding some bonding some bonding some bondage and Something that I forgot to mention is that we use run robin DNS to split the to distribute the load across the different HAProxy's because otherwise is point that you have only one VIP So you are only talking with with one HAProxy So if you can do if you do dynamic Roving DNS you can point you can distribute the load across HAProxy But with horizon you cannot because you don't want the user logging in every time it talks to horizon You have to create a sticky session based on cookies So this service cannot benefit from the from the active active active model with the run robin DNS So if we look a little bit at future work We would like to start first with a call out to all the open stack developers like Something where we would really ask you to keep in mind. We're building a cloud. So we should also build the services in a Cloud native style. So it would be good to get services and being built active active from the beginning on Because if we see the the discussions happening regarding Cinder volume, it It starts to becoming more and more pain once the service was more and more established And also something that we saw and like we built in for example for HAProxy We built in health probe for for Galera in the back. So like Having health endpoints where you can query the services. Are you healthy or not? And not only and would be really helpful to keep that running because otherwise It's it's kind of unclear, I mean, what do you check like HTTP return code 200 so as soon as a 500 gets fired back it it's a failure and then we're taking you out but 200 sometimes also just means it just sends you the list of service endpoints So so having healthiness endpoints where you can ask each service. Are you healthy or not? Would be really helpful for for integrating more into HAProxy When we started and so actually if you look at and this architecture taking all the pieces apart It's I mean we could also model things just within containers. We started with this approach one and a half years goes and at that time a Containers were not yet that major and especially container scheduling were not major enough yet But we definitely saw at this summit that a lot of Things happen within that part to project Kola evolved really a lot There are now Schedulers around like Kubernetes we saw many presentations showing the how they work together so this is something maybe we are considering for the future that that's to To you to rather package the service not within individual VMs But just in containers so that we would even get rid of the overhead of a VM This is something that we will definitely investigate and something other is also the usual discussion About hyperconverged storage or not at the moment We're not seeing any bottlenecks within our setup when it comes to the hyperconverged storage So it's If if we talk about performance we we see other challenges When it comes to hyperconverged storage, but like the usual reasons for it being performance or memory Exhausting on the compute nodes. We don't have the problem at the moment So so therefore it's not that high on the priority list to reconsider that decision But it might be something that comes up Yeah, and the that's it from our side Thanks a lot for listening and I guess we might still have some time for questions No, no good Otherwise, please come up and you can ask us


What's up guys, Michael with Jaspy's doing a quick recap for our 2023 tops pristine two-box break random team number 16. This was done auction style on Fnatic's live It was the last break of the night as well. So thank you to everybody who broke with us tonight Here's the list positive you need to And let's get into the recap Alby's tow bar gold to 50 gold Jim told me to 50 New bar Prado to 99 gold Chris Bryant Vladdy swings of summer and then we had a popular demand Randy Johnson relic autograph to 25 six to 25 Very nice, and then a nester Cortez around the diamond relic autograph now the encase cards What's Nesquie to 75 Dylan Carlson fresh faces auto Pete Alonzo oh snap auto Joe man tip lead to 75 Kronoworth leave on Soto auto now. Here's a weird one. So we had an Adley-Ruchman gold here out of 50 28 of 50, but the cart was all the way hanging out of the mag the customer Dave Asked me to cut it open on the top and then fix it. So that's why it looks like this But yeah It was like literally the edges was hanging out of the mag. It was really bad Anyway, getting on to the rest of the recap The same customer that hit the Adley actually hit this Dave to 75 James Altman nice color match auto right there Rio to 75 and a Sammy Sosa So thank you. I hope everyone has a great night Great weekend, and I'll see you guys on Monday. That's it for me tonight Yeah, see you guys later. Bye guys


Let me introduce myself again. My name is Natalia Minto and I'm the Developer Advocates team here in Bradat. Some self-publishing, before we start, I'm a city foundation ambassador this year. The city foundation is the Continuous Delivery Foundation. It's a Linux foundation organization which is promoting open-source software for CD, like Tecton, like Jenkins, and other software like that. Today, we're going to show and talk more about Tecton, Tecton Chain. I'm also a Kubernetes Community Day Organizer and Red Hat Certified Engineer, author of those two books. Tomorrow, we have some books signing, so if you are interested, we can give you some free book signed for you. Let's start with the why, like everything, right? Why we need security? Why we need to put security in the first place? Well, generally, when we buy a car, we expect that every part supplied to be genuine. Moreover, where the car are expensive, we expect that those cars are perfect and the components are perfect. We can say the same about software, the part of the software. Maybe we are not taking much in consideration all the components, moreover the dependencies, and we just discover things when there's a big event impacting lots of stuff. If you remember, the Node.js dependency that block the whole world, basically, because there was some guy that was retiring this package, or the infamous Log4j vulnerability that affected so many companies, so many applications running in production. It's important we know also every single component of our application.  If you look at those numbers, this is a report that's been several reports, like the state of Kubernetes security report, the state of enterprise open source, also pretty recent reports. You see the numbers, 742% average annual increase of software supply chain attack. 20% data breach. This is really important, the data breach. We've seen in the news lots of data breach. Those data publish it on torrent with all our password and we need to change the password each month because our password is basically in all the database in the world. And 78% of enterprises' businesses have increased and took some initiative to increase collaboration between DevOps security teams and I can say also developers. This is another important number, 92% say that enterprise open source solution are important. Today we're going to show why open source is important in this security story and how Red Hat is helping with that. This growing attack surface with the new emerging trade is really worrying. If you think about the technology, it's very fast. Just think about chat GPT and what things can be done with chat GPT automatically to inject some malware or try some attack. The surface of attack really increased. How can we just mitigate? We cannot prevent everything. How do we mitigate the issue, vulnerabilities and those attacks? Let me go into how we could do that. Three pillars I think we can define in general the software supply chain security can be divided in three main pillars. The first one is we should be able to prevent and identify malicious code. As we know, our app running app in production starts from the source code. We should be able to control this source code. If there's something injecting a dependency that we're not tracking or something bad on the source code we should be able to prevent this attack. The other part, the second pillar is the safeguard build system early. This is really important as well because once we move from the code to this other part this is the part where we run our pipeline. If you want, this is the DevSecOps part. We want to run those secure pipeline that will build our application, run our tests, integration tests, security check, static code analysis, container image scan, anti-virus, any possible check to automate security. Finally, we're going into the third pillar which is the continuous monitoring and observation. We're hearing lots more and more observability rather than monitoring. Observability is really key because we can detach any attack, any change and react and restart the loop if we think about the DevSecOps pipeline in this case. How Redat is helping with that? Well, Redat is helping in general in the open-source industry from 30 years of software development in the Linux kernel and the operating system, Redat Enterprise Linux and all the open-source software that Redat contribute to and deliver and build it and ship it as a product. Redat has also a strong distribution mechanism. This is from the beginning. Even from the operating system with the famous package system called RPM. This system is really some certain version. There's some open-source software like Forman or Spacewalk that you can use to track the version of the RPM in your operating system. This is also evolving during the time. It evolved with pipelines, Kubernetes. We've seen in the keynotes in the other demo that OpenShift is a Kubernetes Enterprise version that has security in place for the first time as well and also is providing more solutions toward this. What Redat did recently is announcing at our major event called Redat Summit a new series of cloud services. Three products that implement the three pillars that we discussed before. If you look at this diagram, the first one talks about how an application usually builds. You have some base image, you have some language runtime, and then you have your application library. On top, you have your app, your running code, but those are the fundamental layer where you have to understand the provenance, and you need to be sure to verify the attestation of curated content. That's why you move into those three pillars, which are three products for Redat. Redat trusted content is a product and a series of tools. We show in a demo in a moment those series of tools help you identify vulnerability in your source code, some kind of static code analysis in the so-called inner loop where developers start coding. Then when you move to automation to pipelines, there's this other product called Redat trusted application pipeline. I'll show you in a demo how it works. It's a SAS system that built out of the box DevSecodes pipeline with all the attestation, provenance, SLSA3 level we'll talk about in a moment. Then there's another product called Advanced Cloud Security Cloud Service, which is able to observe and assess and do perform vulnerability assessment. All those products I'm talking about are based on open source software, and they are part of Redat trusted software supply chain. The main message I want to give you today is secure your open source code and dependency early. So how you can start doing that? Before doing that, I need to show you this table it looks like a table from the 80s, a nightly table with long text. Nobody will read it really carefully, but I want to stress on some of the key terminology. One is the SLSA, which is the supply chain level for software artifact. It's a set of standard and you can find the definition on the official website that you can adopt to improve artifact integrity and build it. The other one is this one, SAST, Static Application Security Testing. Another important one I'm sure you already heard about is the CVE. When there's a new vulnerability, there's a public website called www.mytree.org, another website that publish those CVE. The common vulnerability and exposure. There's the description, there's the root case, there's the exploit, explaining some POC of the attack and then the mitigation hopefully. Other two important terminology before we move into the other part of the demo, provenance, so you're recording the origin, the history and who made the change, that's very important. Another one is attestation. You are making some kind of certificate that some step of some software artifact has been executed or is present. That is the attestation. There's, of course, the SIG store and there are tools like the Cosign, it's an open source tool to do signing for your software. Those are the main terminology that I would like you to have a look at. Talking about SLSA, those are the levels. The first level is really cool, right? It's no security at all. There's nothing. It's like, you know, best effort. So, there's no security, it's best effort and you cannot do anything. Once you move from level one to three, you start getting some ground on security. So, the level one is able to prevent a mistake and automating the build process. The level two is able to prevent tampering after the build. The level three is the one we'll show in the demo is the one that provides you a platform able to prevent runs from influencing another. So, it's more granular. It's full control of security in terms of this definition of level. And here's, I'm sure you heard about it, Shift-led, this famous approach where you have to Shift-led, you shift all the responsibility up to the source and, you know, you move from the final users, right? Your production app is consumed by the user and then you move back to, you know, the networking, the production, the staging QA, development, source code, developers coding and dependencies used by developers, right? Up to the root of the cause of the issue or of the possible risk. Very, very simple example, right? You need an HTTP library, a JSON parser, a database access, any application needs something, no? Usually you use a dependency. If you are a Java developer, it's a POM XML. If you are a Node.js developer, it's a taken JSON.  But the people that write those files are responsible in bringing those dependencies into the project. And this is the analysis, it's the Maven dependency tree. It's the tree of dependency of Spring Boot application example, L award. As you can see, and maybe you have noticed when you do Maven packages, it's download the world, right? And you need to be sure to follow everything, sometimes we don't care much about it, but there's a lot of information here. There are lots of dependency downloaded. And what happens if the maintainer of one of these dependency is not publishing an update? What happens if this dependency is injected with malware? It's something we need to be able to track. Likely we have open source software that help us. So the open source software is an intelligent approach. Of course, this is an opinionated approach. There are lots of open source software that are able to implement secure software supply chain. But I want to go through this one because those are the backbone of that product I'm showing you in a while, the Red Dot Trusted Application Pipeline, that you can also try yourself for free in our developer preview. I'll share the link in a moment. So you can start from any source code management system, GitHub, GitLab, Bitbucket, GitE, I don't know what you like. You can use whatever you want. Then the Red Dot Opinionated way to implement secure software supply chain, the one we ship out to the box is using Tecton. Tecton is a Kubernetes native open source software for delivering CICD on Kubernetes. You don't need to install an external agent. It's just available out of the box, bringing API into Kubernetes to manage pipeline task execution. And Tecton Chain is a project that helps you providing attestation provenance for each step executed in the pipeline. For each execution step, you can define a manifest that you can sign and that manifest testifies that execution has been executed with those dependency, with those volume. Talking about attestation and provenance, Cosign is another open source software which is able to analyze, verify, sign the famous software bill of materials. In the slide maybe it was not visible because it was done, but another important terminology to consider is the software bill of materials. Your dependencies are defined how much dependency, what are your dependencies. This is this bomb in the flow, we'll see how to use Cosign for that. There's another, I'm doing the list of all the open source software, there are many, but those are, you know, our opinionated way on how we build the secure software supply chain. Another popular one is Clare. Clare is an open source software that scan container images. So if you want, if you have your container images and you want to scan against a public list of CVE, you can use the software that you can use because it has this public registry repository of CVE and can scan your container. So if your base image is red dot or another, I don't know, another base image that you want to use Ubuntu or other is able to consult the CVE list and give you a scan of the container image. Going into the end of this overview of software and finally going into a demo I want to tell you that the other software involved is Open Policy Agent. OPA is very popular in Kubernetes for delivering policies and rules in the clusters and when you need to deploy something, you can use GitOps approach. We've seen in our session before the demos that we've done, we are using a lot of GitOps. It's like today is a standard way to deploy application keeping them in sync securely. Argo CD is a software, an open source software that can do that. Of course targeting Kubernetes and in our case we're delivering it on top of OpenShef. So that was the overall view and how we implement this in the flow is in this way. I'm going to now go into the demo. Let's go into the how do we prevent and find malicious code. I have an example here and I want to start from that. This example is again for those of you that were not present in our keynote we created a sample or GitHub organization where we are present as user and in this organization, the WinTurbine Inc, we have some repository. This is a simple repository containing a Spring Boot application. Really simple, no docker file full of vulnerability that's why we want to use it to try it out. So what we've done is just have this Spring Boot application that we can execute also locally and it's really simple. I'll show you the source code it's just printing out and hello endpoint, we can query and it's going to replace something and it's also providing some starting content. Really simple but the thing I want to show you is the dependency file. So as a developer this is my code, really simple, but look at this. I have my dependency file and in the dependency file there's something saying to me that I am using this version but this is a known vulnerability I should use another version and there's also the infamous log4j here and we put that version in for purpose, right? So why Visual Studio Code in this case is suggesting me that because Red Hat is providing an open source extension that I'll show you in a moment it's called the dependency analytics report and if you go to the list and extension and you look for dependency analytics already is already installed, you can install in Visual Studio Code in IntelliJ and this basically is just scanning your dependency in the code and providing you a report that you can use to verify what are the vulnerabilities. As you can see here we have lots of vulnerability log4j, struts H2, those are all versions and you can have also a detail if you want to open it by clicking this is going to go on SNCC website because this extension is made in collaboration between Red Hat and SNCC so we're able to scan in early in the inner loop if there are any vulnerabilities so we should stop here, right? because we found some vulnerability but let me go through the other pillar how do we automate the building part because a quick fix here folks is of course going into the Pomex ML the suggestion is a recommendation in 220 and doing that simple as that, so this is our fix but I want to keep this error because I want to show you how other tools in the so called outer loop can help us with that and the tool I want to show you today is Red Hat trusted application pipeline Red Hat trusted application pipeline is Red Hat SAS against those software I was talking to you about Clare, Tecton, ArgoCT is basically implementing SLSA level 3 so it's compliant to all of this and it's offered as a SAS so the only thing you need to do as a developer, as a user it's getting a repository accessible and you can start from here and you can import this code and you can then this wizard will ask you ok I found this is a spring boot application and this is the target port, I can deploy to this also deploy to an environment which is in this SAS or can connect to your cluster somewhere if you have open shift on any Kubernetes cluster you can design the number of instances injecting variable build time secrets if you need to do that and what is gonna do is basically define your first secure pipeline now what is gonna do also is pushing to your git repository some settings to implement those secure pipelines so this is also called pipeline as a code it's really interesting let me show you how the system is gonna suggest you to add some change if you're using github you can install a github app in your organization or repository but what the system is doing it's adding as you can see here some tecton object pipeline run with some steps to implement all those security gate it's fully automated as user as developer you have just to login into your github and approve that I think I'm logged in here so let me go back here in the partner catalog have a pull request here we go and you have just to merge it what is happening here is that the system the tool recognize the merge in git and then will will apply the pipeline as you can see this is applied and now the pipeline is starting the pipeline as all the security gate I was talking to you about but since this take some while I want to show you an already run execution of that so it takes some time to clone the repository to build a container inspect the image let me show you an execution I already done in another user so this is the execution I've done as you can see the pipeline has been start and then after building the container image has been has done some scan with Claire Claire if you remember is that open source software that can scan for container image and if you if you look at it we have 17 critical security issue and some some some lower score but we can go in much detail and go and go looking at what are those vulnerability and check what's wrong here what is the what is the layer for this vulnerability so we can go really granular on that but the system already identifying some vulnerability not only the vulnerability is able also to give you an an overview of what's going on with an anti-virus scan so in this case is using clump V it's an open source anti-virus that can perform that scan and is also able to perform the check on the software bill of material and some other check with some other tool so long story short this will perform all the scan now at this point you can also do this operation you can visualize the software bill of material so this will tell you all the dependencies in all the version that you have and you can decide to verify with cosine and also sign it if you want so it's a convenient way to have an overall view of everything that you need to run a DevSecOps pipeline and not only that if you right now this software you know it contains lots of vulnerability but after the after the scan is able also to perform another type of execution which is the integration test those are called in the terminology the enterprise contract so the partner Gallagher enterprise contract is able to show you that for each after the pipeline execution the system give you a security tab in this security tab you see all the layer or check that has been done for the application so is there a base image is there a build test containing the steps what are the collection what is the provenance that match the build test image result so this is not really it's all success because it's not about the security it's about the conformity on all the check that you need to do before pushing that somewhere and for this reason I also want to show that the system is able you to deploy this to the default location in the SAS or your own cluster and for this reason I deploy this application in this cluster this is an OpenShift cluster that I connect to the system and here's the we have the partner catalog so the tab was able to deploy the partner catalog you can see the spring boot up running over here and here's our hello endpoint without the HTTPS right so this is absolutely a non-secure application non-https with full vulnerability but just to show you that the system is able to the tooling are able to help you on the inner loop on the code side on the pipeline so you can stop everything you can stop signing stop delivering it if you want or last but least also on the observability how you can observe all this well there's another tool called Advanced Cluster Security for Kubernetes that you can attach into the execution and I'll show you here I've installed also in this cluster and I want to access it because I want to show you that you can do the observability also using this other tool which is connected to the cloud service and here's an overview on the old cluster where you are connected I'm connecting this cluster and the cluster recognizes that there's log4j vulnerability is a violation of your policy and also you have a list of the container images containing all the those of vulnerability there's a list of all the container image but you can have a list of top CVE you can order by the last scan as you can see there are lots of stuff that are not going very good over here and it's really cool also the thing it manage the vulnerability management so you have a list of CVE in the cluster also the risk policies the partner catalog is having a high risk indicator this is give you a very granular detail on how you can filter and organize the policy and discover the policy violation that you have in the cluster I want just to close just showing that this observability tool can also be very granular and going not only in the execution of the pipeline but also in the execution of the application and here's a diagram that show you all the application running and if you click on one of this entity over here you can have the list of all the flows all the network flows, which port which protocol who is contacting what this is the internal port, this is the traffic and you can inject network policy around time if you want so to recap everything security in place from the beginning in the code, in the pipeline and also in the target Kubernetes cluster you can do that, you can try red dot tools for that and I'll give you some links here where you can try for free what I've just shown you, if you go to this website redht slash trusted you can subscribe and send a request and you can try this tooling for free. Again this tool is fully composed by open source software we are just delivering as a service but the backbone is open source you want to do the same thing in your own cluster just take tecton, tecton chain cosine, clare argocity, put that all together in some pipeline scheme and implement your secure software supply chain in the same way if you want it out of the box here's the service that you can use this is another reminder of things that you can do, if you subscribe to developer.com you have some free ebooks tutorial and what about the ebooks you are interested on developer setting supply chain security in DevSecOps, you can download for free this book, this will walk you through on how to set up a DevSecOps flow I know we are out of time just a quick reminder that if you want we do some book signing tomorrow, this is the modernizing enterprise Java if you are a Java developer, probably you'll love it this is a book more for people interested on tecton argocity, so pipeline and GitOps it's a list of the technology that you can use to start implementing your GitOps driven secure software supply chain thank you, that was a pleasure to be here with you, all of you today and I really look forward to speak with you here about this product that opens our technology, thank you


Clarke, te rungu te 5th at te enda dāi aste dāi, jason 4th, Jason Gill out this morning. Jason out? Isi? Wadon't aware of that. What happened? Basitley, unlaikus, nt the best of communication with our parts we'd put on the car. I knew I had new brake pads, didn't realise that they were unbedded as we'd bedded pads in for every car that we raced generally. I knew straight away was such a short time up to the start of the stage as soon as I took off and used the brakes in the first couple of corners just had massive brake shutter at the front so I basically knew what was going on and then as we just persevered with it and as I was going down the other side I just pinched the rears going into a corner just to brake and balance and turned me round, clipped the bank, flipped it over back on its wheels and restarted it and carried on so realistically not too much time lost but subsequent stages of course we're not quite on our game given a little bit of superficial damage but the car's still strong and we're okay. So is it driving like it's bent or is it driving like it's still straight? The first couple of stages after the accident I had to put up with a tow-out issue going on on the left front which we've rectified for the last one but the last two stages being rather fast I was missing my rear wing and the back of the car wasn't really letting me go much more than about 180 so I've given up a little bit of time to Gavin and possibly to Martin Dippy but you know there's a long way to go and um... You're strong still mate. Absolutely right up there and in contention what do you reckon you lost? Look I think when I rolled probably two or three seconds but I definitely have dropped the wee bit more time on the subsequent stages just sort of taken a little bit easy till we can get the car back to 100%. And you reckon you'll do that for this afternoon? Absolutely I mean hopefully you get this wheel alignment issue under control we'll see the wings back on so we've got some aero again so it'll be interesting. Good luck and well under the crew. Thanks very much, we've got a great crew and it's just one of those unfortunate things really it's just an oversight with a big, big start to the rally and Brownie and I had already raced Waimati last weekend and we were pretty tired last night and it's just missed some of these most basic things sometimes when you shouldn't say. Thank you very much.