What's going on everyone? Sam here, Leighton Sports Guard, Drippin' 2021, Penini Prism Football Hobby 12 box, full case break number 23, Random Division style. Here's a look again at your random divisions, random results. As always you can find these on the website under the results tab as well as the link that's currently in chat. So good luck here everybody. Let's do it. A full case of Prism man since like release like week basically.  Box one will recap all of your autos and any color, case hits, that kind of stuff as well. See if we could pull like a manga or something. That'd be kind of cool. Or like one of the super short prints. Stained glass or the other one. Stained glass or color blast. That'd be pretty fun. All right. Gold on the back there. Lager molded. Brichon Slater. There's Kellan Mond. Gold wave to one or gold wave. Blue wave to one 99 rookie and gold Ed McCaffery going to the AFC West. One of 10 sensational signatures. Rats on that one there, Edison L. That's fun. Trace Sermon, Jalen Camp. There's Dante Hall, the human joystick. It's a 149 red wave color match. Silver Zach Cunningham. He blew his shoulder out. Oh dude, he went up and threw the first one. Just whipped it. Oh man. It wasn't good. Now, Ramon Dre. Levi Muzerike. There's Tyree Kill to one 99 blue wave. And Silver Billy Sims. A lot of damage on that Sims. We'll send an empty box and wrapper with the NFC North. Skid. What's up on the skids? Friar and Muth, Noah Gray. There's Purple Ice, Vernon Hargraves, the 225 for the AFC South, and Jonathan Taylor Hype. I don't know.  Who's the culprit, do you think? I think it's right today. Got Jalen Smith, the 225. Purple Ice. Fireworks, Joe Burrow. An orange coming up here. Orange, Khalil Herbert. Nice one there. 249 for the NFC North. Silver Mike, I'll stop. It looked like a train trying to stop in there. I don't want to take for a train to stop in a while. Orange wave coming up here. Helen Hilder. There's a Jamar Chase-based rookie. Orange wave, Nick Bosa to 60. Set out at 60. Trace Sermon. Devontae, Larry Roundtree. There's an orange, Joe Burrow. Color matched to 199. And Kellen Mann, Green Scope. Rookie Auto. 11 out of 75. That's Jersey numbered to the NFC North. Ben Elf. It's just gross.  Devontae Smith. Nick Bolton. Blue Ice, Big Ben to 99. And Christian McCaffrey, 14 out of 99 on the Brilliance. Blue Ice as well. Bless you. Bless you. Bless you. Thank you. Thank you. Naomi Brown. Purple, Ben Roppelsberger. This time to 125. Again, a lot of damage on that. Empty Box and Rapper coming to the NFC North. Silver Shane Buchele. Remind me on this next one to give it to you. There's Jalen Waddle, Purple Ice for the Dolphins. Nice one there to 225. Grats on that to AFC East, Matthew L. Could toss that in the recap. Silver Austin Eckler. There's Matt Ryan, Hyper to 125. 175. Condix. Socks one is done. They're just a walking steamer. Just a big old bottle. Purple Vernon Hargraves to 125. Silver Javon Holland Rookie. Am I having a good day? Akeem Davis Gayfier to 199. Silver Russell Waddle. Josh Jacobs to 149. A big changing table. Things like this to scream and try to wobble. Wildcard points, random to all at the end. Jalen Darden. Tyson Campbell to 60 on the Orange Wave Rookie for the Jags. AFC South. Gross. Orange. Russell Wilson to 199. NFC West. Silver Jimmy Graham. You want to be a lot too stinky. Yeah, Pierce. Terrius Leonard to 249. Or 199, Blue Wave. Trevor Lawrence, Emergent Rookie. Oh, Snakeskin. Case hit coming up, guys. Good luck. Come on, baby. Let's see something big. Xavin Collins. Monty Rice. Rookie. Packers is Kylan Hill. Very nice. Congrats, NFC North. Rookie Snakeskin. Gonna be nasty if what it is, what I think it is. Come on, baby. Have Mac Jones Rookie. Have some ink. Amon Green to 225. Yes, it does. Jamar Chase on the Forest Camo Auto. Boom. 11 out of 25. Let's go. That is AFC North. Kevin H. Congrats, buddy. Let's go. Nice. Jamar will get that magged up. That's disgusting. That makes up for the points, I'll be honest with you. Orange Wave coming up here. Pete Burner. Davis Mills. There's Orange Wave. Damian Harris to 60. Derek Henry. Purple Ice. Kenan Wang Wu. Color matched to 225. Silver, Devin White. That's a big time card right there. Big boy card. Jamar Chase. Base, Rookie. Green Scope. Andre Reed to 75. AFC East. And two of them. Ray Sermon. Blue Wave. Amari Rogers to 199. Rookie for the Packers. NFC North and Jeremy Chin. Lockdown Silver. Maybe working up. Yeah, what's comps? Not necessarily even the same one, but like any number at Auto. Jamar. That's it. Auto. Yeah, Obsidian. Jamar Chase. Oh, Obsidian. Okay. Not Prism. On Hill. There's a Hyper Sam Hubbard to 175. Jake Funk, Silver, Rookie. Jaylen Waddle, Base, Rookie. Red Wave, Devin Bush to 149. Silver, Marcus, Max. Jamar Chase, Rookie. Jabon Holland. CJ Henderson. Blue Wave to 199. Great Kyler Murray. Wildcard points again. Rental. Patrick Seth Williams. Rookie, Hyper to 175. AFC West. Orange, Michael Vick to 199. Silver, Deandre Swift. I'd rather be a big hit in here after that now too. Orange, Andy Dalton to 199. NFC North. Joe Burrow. That might do it. That might be good because it's Gold Vinyl. Drew Brees to 60. Nasty. Was that Najee? Yeah. Najee Harris. Gold Vinyl. Kevin H is killing it, man. That's awesome. Got that mag, man. So I guess if there's wildcard points, we're getting big hits out of it. Sean, it'll be the first break after this group breaks over. So I'll have to go collect your boxes. But yeah, it'll be the first break. Yeah, it'll be tonight. It'll be tonight, Sean. Yeah, right after... Oh, wow! Dude, another one. Nick Chubb, Kuller. AFC North. Dude. Fireworks, Jalen Waddle. We'll get that mag too. Yeah, eight of them will be from a fresh case and then just two loose boxes. Yeah, I'll get a full case for it. I won't open it until the break starts. This is unbelievable, dude. Everyone but the Ravens ending up their end of the deal. Got it, Sean. No problem, man. Chris Carson to 149. Devonta Smith, new generation. Sane, dude. Insane. All right, you know what? I don't care. I hope we get wildcard points in every box now. We're gonna start getting the big time hits like that. Boogie Basham to 149. AFC East. Silver Chad Johnson. Tighten up. God, dude. Just throwing stuff all over the place here. There's Miles Sanders. Green Scope to 75. Merchant Justin Fields. Michael Parsons, rookie. Purple Power coming up here to 49 is Caleb Farley. The AFC South. Nice one there. Silver Derek Carr.  Look at that. Three boxes in. Well, two major, major hits. See if this case can keep going, man. Jalen Phillips. Eric Stokes. Kyler Murray to 225. Purple Ace. LaVisca Chanel. Honestly, Coach. One coach. Newsome. Chacobie Myers. Red Waved to 149. Silver. Trailer hands. Boom. NFC West now. Thomas Jay. Congrats, buddy. There we go. Wow. Heck, yeah, man. What a case. Get that magged. Go, dude. Yeah. Orange Jamal Adams to 199. And fireworks. My home's to 99. Nice one there for the AFC West. I still think, like, pretty much regardless of what Purdy does, Stray Lance is still going to be the week one starter next week. Or next year, I mean, as long as he's ready to go. We still have eight boxes to go, Coach. Orange, Ernest Jones to 199. Michael Parsons, rookie. Orange, make a Fitzpatrick to 199. Silver, Trey Nixon, rookie. Place, Damien Harris to, what is that, to 99. Silver, Sean Alexander. Kyle Trask. There's Deuce McAllister to 175. Silver and Antonio Gates, he was a beast. Jalen Waddle, base rookie. Green Scope. Jalen Hurts. Nice one there to 75. Trevor Lawrence, new recruits. Oh, you think the culprit is, you got, yeah, it's trying to tank. Chewba Hubbard. Yep. Ron Morick, Trey Sermon. Davis Mills, nice to 199. And nice. Shaquille Griffin for the Jaguars. This is AFC South. Jaguars to 99. Orange Wave to 60. Bracey McMath for the AFC South. Silver, Cameron Hayward. Purple, Miles Gaskin for the AFC East to 125. That's Stafford. Four boxes in, four cards magged. See if we can keep going, man. Davis Mills. Orange, Hardy Nickerson to 199. Travis E. T. N. Emergent. Blue Ace to 999, coming up. Oh, Cameron Hayward. AFC North. Two up. What up, Ash G? Yes, sir. 247, 365. Miners. Shane Buchele to 225. Purple Ice. Silver to Marcus Lawrence. Tank Lawrence. Come on. Let's see it. Let's see some ink. Come on, baby. Give me some ink on this. The Danian Tomlinson to 99. Yeah, Randy Moss. Flashback, Blue Ice, NFC North. 64 out of 75. There we go. Dude, this is insane. This is awesome. A card may have gotten stuck, a rookie here, too. The greatest to ever do it, man. Straight cash, homie. That's it. There's Travis Kelsey to 175. Break, Joe Burrow. There's Asante Samuel Jr. to 175. And lockdown to Waitfreenie. I think he's still trying to come back, Ash G. You've seen him as a monster. Yeah, he's still in great shape. Unbelievable. That fried me. Still didn't fly. I went in Williams to 149. Like, it wouldn't surprise me if he does come back. Yeah. Devonta Smith. I am. I'm in the championship at Lucis. There went James to 99. No, it's a 225. Silver James Conner. Yeah, but I have Derek Henry and he didn't play today, so I'm all done. No shot. No shot. Orange to 225. As soon as that. CJ Mosley? Yeah. CJ Mosley. No, he's not, Ash G. He's not. We're Mange and Eckler. That's solid. That's solid at Lucis. What is this? Look at these cards are completely missed. It's the parallelogram right there. The prison parallelogram. Oof, yikes. Luckily they're all base, so. Michael P. Rhine to 275. Silver shy Smith rookie. Another parallelogram coming off here. Mack Jones rookie. Looks like we do have an RPA. We've got Jake Funk to 149. And Michael Carter. Going to the AFC East. Nice one there. 23 out of 99 on the RPA. Congrats, AFC East. Really missed a cut, man. Jake Funk. CJ Henderson to 225. AFC South. And Patrick Mahomes. Fireworks. Purple, Terry McLauren to 125. McChubb. Got a funny one coming up here. Tyson Campbell to 125. Sam Darnold. Sensational signatures to 149. NFC South. There you go. 2018, that's a mag and a half though. Funny part. Damian Harris, you're right. It's a 199. Silver Brett Farr. Chris Evans, Jaylen Phillips. Dobbin Cook to 175. Mack Jones, fireworks.  Gross. Couldn't pick anybody better. There's Brandon Ayuk to 225. Dobbin Ridley. Michael Parsons rookie. Orange, Noah Phant to 199. And Silverado, Chuba Hubbard for the NFC South. Nice one there. Panthers theoretically swept this box. Sean Chirrup. I'm cheery, man. I'm cheery, cheery, cheery. There's LeDane and Tomlinson to 75. AFC West. Trey Lant's break. Purple, Jaylen Darden rookie to 125. Silver, Zeke Elliott. Sablevarr. Jaylen Waddle rookie. There's Asante Samuel Jr. Blue Wave to 199. Silver, Buda Baker. Orange, Deandre Hopkins to 249. And Mack Jones, emergent rookie. Shod Bateman. There's Purple Power. Charles Woodson to 49. Silver, Isaiah Simmons. David Johnson, Blue Ice to 225. Silver, Trevor Lawrence. Very nice. Great way to end the box. Gugat's AFC South. Gold Vinyl, Najee. Gold Vinyl to five. Marques Stevenson. There's a Nick Chubb to 199. David Smills, emergent. Blue Ice to 99. Nashon Wright for the NFC East. Silver, Antoine Winfield Jr. Nice one there for the NFC South. On the Silver Auto. Grat's NFC South. Shai Smith, Michael Carter. There's the Michael P. Rhine to 149. Silver, Josh Jacobs. Purple, Ice. Aaron Jones to 225. McAfrey. Jordan Poyer, Hyper to 175. New recruit, Trevor Lawrence. Oh, baby, let's go. Come on. Trevor's ETN. Jared Goff, Orange to 249. And the Scridge. NFC West. There we go, Thomas Jay. Scridge. There he is. Oh, biggest name in football right there. It's Wright. The Scridge. Justin Fields, rookie. Blue Ice, Eater, Gross, Matos to 99. T Higgins. Orange, J2Fallet, 249. Silver, Drew Brees. There's Scridge again. This time to 149 on the Red Wave. Silver, Ty Wall. I remember once I gave it to Forrest, maybe Caleb or maybe Kenzie. Top Floating, I just put a Scridge base guard in. Jabonte. Purple, Ice is Joe Schobert to 225. Matthew Stafford. Caleb was so easy to get on messing with his recaps. Oh my God.  He just didn't, he would never, like he would never, he would never notice. Jabonte Smith. Love, Shorts. Shorts. Purple Power, Deuce McAllister to 49. Silver, Peyton Turner, rookie. Oh yeah. I mean, I could literally be over there and be like, hey Caleb, I'm going to mess with your recap and he wouldn't notice. So I would always throw in like kid reporters and just blanks. I'd mag stuff, that mag base card just to mess with them.  There's Sam Darnold to 75. Double Scridge, baby. Silver CJ Anderson. It is Nick Chubb, Shorts. Nick Chubb is the color blast. Nick Chubb. So this is a divisional break. All three of these cards are going to the same division, which happens, man. I mean, if there's a division hits hard and I would go and say like, if we, if we go back to like when 2021 stuff first came out, the NFC, the AFC North would be like the sixth division you would want. Because they don't have a quarterback in there. You have Najee and Chase are your two big guys. I mean, we hit both of them, but like you'd want the AFC East, the AFC South, the NFC North, the NFC West, and I stool. There's Danny Dime, Sean's boy, Travis ETN. That is Sean's boy right there. Quinn Miners. We've got Red Wave to 149, Tyler Boyd, AFC North, Silver Nelson Agallor. See a big Mac or Wilson or a Waddle. That'd be nice being on that. Michael Collins, Tray McKinney. There's Patrick Sartan. Nice one there to 60. AFC West, color match. Silver, Joe Thiesman Otto, NFC East. Take that. There's Walter Payton to 225. Silver, Logan Thomas. The Najee base rookie. Orange is Billy Sims to 299, 249. Orange, Ross Blacklock to 249. New recruit, Zach Wilson. Justin Fields base rookie. Orange, Davis Mills to 249, and Silver Minka. Ooh, we got Camo coming up here. Barmore. Tray Lance rookie. Falcons. Nauta rookie is Dion Jones. Nice one there, 9 of 25. And Nico Collins, AFC South, rookie Otto Silver. Uh, probably not Andrew. Probably not would be my guess if we're going to get more Eminence World Cup. I would be, I would be pretty shocked if we do. Green Scope, Miles Gaskin. Patrick Mahomes. That's, and that's one of those things. If we bought one, we'd probably keep it for a while. Keep it sealed. Scridge. Purple, Brandon Ayak to 125. Chua. There's Quity Pay to 149. Mashaun Wright. Cam Akers to 175. Silver Ian Book rookie. I wish it was a one-on-one. It's out of five, Joshua, because it's prism. Yeah, the Black Finite Najee would have been crazy. I've not pulled the Black Finite out of prism. That's one, another one that eludes me. There's Nebula. Nebula for the longest time. And now Black Finite's the next one I just don't have. Piss, Sean. I'm not happy about that. They're tight enough. Trask. Isaiah Simmons to 225. Silver Caleb Farley rookie. Guess so, man. Just trash, dude. Yeah. I've been telling you that for a while now. Price-wise, yes, Andrew. Yeah, price-wise it's more expensive. Chuba Hubbard to Sean Watson to 75. Jaylen Waddle fireworks. Harris, there's Canarius Tony to 175. Hyper. And Simi Pahoko, NFC East, Silver Rookie Otto. Yeah, I know, honestly, dude. Purple Dalvin Cook, Justin Fields rookie. Now it's going to flash on the big screen. From SG, just telling me to tighten up. Shot Bateman, Sam Ellinger. We've got Orange Aaron Donald to 249. Silver Jordan Akins. I think Sean just needs to, he might have three decades on me, but he acts like he's 20 years younger than me because he's three. Yeah, I know.  Tyler Wallace, Seth Williams. Blue Ice, AJ Dillon to 99. Silver, Curtis Samuel.    Everything will be a little bit better.  Every day I gotta come in here and talk to you. Shimmy Garoppolo to 149. Start. See you hanging. Childcare, daycare watching. Gotta take you out back in the body. Oh my dog. It will be, yeah. It will be a puppy dog. Micah Parsons, rookie. This is Deandre Swift to 175. Silver, JK Dobbins, JK All Day. Going to the AFC North. Second-year auto. Time is right. True. Yeah, by the time. There's Bradley Chubb, AFC West to 225, Purple Ice. Tyler Murray. The B of Boogie Bashum to the AFC East. Nice one there to 49. Slowbird, Deandre. Statistically, one of the best edge rushers in the league right there, Boogie Bashum. Solid card. Take that. Might actually have to go to the National. You should, dude. That's true. You need to, man. 199, Cam Akers. Justin Herbert. Yeah, the dose. Yeah, I'd imagine you're probably gone. I don't know. For sure, but what's the Vegas one? J2Fallay, Calvin Joseph. Javante Williams, Purple Ice to 225. And Deandre Sanders, the Mint Collective. The Mint Collective? Yeah. Or the Industries Summit, one or the other. It's probably the Mint Collective. All right. Let's go. I'm down with that. Absolutely. I'm going to the show in Vegas and the end of March. Oh, maybe they'll get to go to Burbank. Yeah. Burbank was fun, dude. Yeah. Yeah, honestly. It will be the summer, though, luckily. It's true. There's Red Wave Drew Bledsoe. Silver, Racy, McMath, Rookie. Yeah, I'd be down there. I've never been to Chicago. The Vegas one, that's it. That's going to be fun, dude. Antonio Gibson to 199. Devonta Smith, Rookie. Yeah, that's going to be a good time. Yeah. Randall Cobb to 175. Silver, Michael Pittman, Jr. Going there to make those happen. Oh, yeah. Man. Oh, absolutely. Wreck Vegas. Mint Collective SG. I think that's what it's called. Kyle Van Noy to 199. Silver, Daniel Hunter. Ooh, Redemption. Okay. Okay. I wonder what that's going to be all about. Noah Gray, Devonta. This is J2fella. We've got Rookie Autograph, Prism Silver. Card number 337. Jamar Chase. Boo-hoo-hoo. Dude, that's unreal. Two Jamar Chases, man. That's crazy. Dude. Wow, AFC North have a break, man. Get that magged. Yeah, that's nutty. Yeah, Josh, we're going. Devonta Smith, Rookie. Purple Ice, Ladinian Tomlinson to 225. AJ Brown. Probably, yeah. Is that one of the big ones? It's a big venue. There's James Harrison to 249. New recruits, Jamar. Another gold. Trequant Smith to 99. And gold. Roger Craig going to the NFC West. Nice one there. That's Thomas Jay. That's going to be numbered one of 10. Sensational signature is gold. It's Purple Tony Romo, 125. Yeah, I think it was March 22nd. 27th through April 2nd. Oh, wow. That's a long show, then. That's awesome. Mack Jones, Rookie. You'll have to imagine there's a dealer day before the show's open to the public. Hunter Long to 99. Silver TJ Hujmanzada. Yeah, we'll be there this year. Yep. Davis Mills. There's Orange Wave, David Montgomery to 60. Book and Bellagio. Pashy Harris. There you go. Let's go. Easy. Easy money right there. It's going to be a good time. Orange, Pat Fryermuth to 249. And Josh Allen. I'm pretty positive I wouldn't be going. I'm going to have to say and break. I'm definitely going. Yeah, Sean's definitely going 100%. I probably won't. I'd be pretty shocked if I did. Like K-Level probably go. Lane will go. Rich might go. Cortes will probably go. Yeah, Sarah might go. Kyle Pitts, Rookie. There's Jeremy Chin to 225. Silver Elijah Molden. Today it's the one that made this show. I'm seeing a slot machine. It's like a fly flying into the light. Shorts. There's Lamar to 175. Yeah. Silver James Chai. You got that right. Trevor Lawrence, Rookie. Orange Baker Mayfield, AFC North to 249. Emergent Davis Mills, Rookie. There's Trace Sermon to the, uh, to 240. No. You know, to 199, NFC West. Cornell Powell, Rookie Otto, AFC West. Purple Power, John Brown, AFC West to 49. CMC. Zach Wilson, Rookie. There's Purple Ice, Amon Green to 299. 225. Silver Jeff Acuda. Oh, that'd be awesome, man. Oh, nice. Listen, I'm just alone for the ride. There's Drew Brees to 60. Oh, I'm super locked in. Trevor Lawrence. I'm so locked in, actually. It's unreal, dude. It's a little terrifying how locked in I am, honestly. Peyton Turner. Purple is Bobby Wagner to 125. Silverado Antonio Gates, AFC West. Nice one there. Grats on that, Edison L. Take a look at Antonio Gates. Future Hall of Famer. Focus on all the bright lights. There's Kenneth Gainwell to 149. Silver, Devin White. There's John Taylor, NFC West to 175. Justin Herbert, Fireworks. Blue Ice to 99. 66 of 99. AFC West. Fallen DeVegas. Coronel Powell, Purple to 125. Alvin Kamar. And it was just 247. Amon Ra, Rookie. Alvin Cook to 199. Without catching it.  Me and my brother, Amon Ra. Las Vegas Fun for Sean. There you go. Let's go. Now, we need to start saving now for that, honestly. Tell me what, man. It's going to be silly, man. I'm ready.  Sean is really going to... Sean might not come back. Yeah, you never know, man. Sean's not going to be allowed to wear Leighton shirts. I'm not going to wear Leighton in the way back. You know why. Purple, Keem Hicks. Mack Jones. Ha-ha-ha, boy. Let's go. Gainwell, Quinn Miners to 149. Silver, Deuce McAllister. We always end up home. Oh, yeah. Yeah. True. That is true. I'm excited, though. There's Blue Waves, Zach Cunningham. And Drew Bledsoe. Nice. AFC East 82 out of 99. Franchise Legends. Listen, that could easily happen. Oh, yeah. Yep. Easily happen. I think that's happened before. Almost. We couldn't call my boy Mike the whole time. We went on my 40th birthday. Michael Thomas to 175. Nick Chubb. The story told us I was like one of my goodness. To Carson Wentz is to 225. And Justin Fields, Purple Power. 19 out of 49. NFC North. Drop, toss that. I'm ready to go. Yeah. Orange, Dolvin Cook. And Kylin Hills, Silver. And Rudy. Chef CTN. That's awesome, dude. Fred Warner to 60. Right on. Yeah, that's Jay. We do. Who's that? Who? That's Jay.  There's Orange, Brevin Jordan to 60. Silver, Russell Wilson. Still have a good time. Good time. Orange, TJ Woff. Silver, Miles Jack. Countdown Days, my first show. Oh, yeah? Yeah.  Field's rookie. You got that one. Honestly, there's Mack Jones. Blue wave to 199. There you go, AFC East. You got Matthew L. And N'Shawn Wright, Purple Power Auto to 49. AFC East. Anthony Schwartz to 149. Tre Lantz, Break Rookie. It's going to take you a lot more than three months to tighten up, my friend. Devonta Smith. And Tyree Kill to 75. Silver, Andre Reed. That'll do for the break, guys. Do a quick points random here. We have two wild card points. So let me take you guys over to the random screen. All right, guys. Going to do the points random. It's two wild card points. So whatever division is on top and whatever division is second, we'll both get points after five dice rolls. One, two, three, four, and five. That's going AFC South, AFC South, and NFC West. AFC South, NFC West. Let's do a quick recap here. We've got N'Shawn Wright. Justin Fields. Drew Bledsoe. Antonio Gates. Cornell Powell. Gold Roger Craig. J.K. Dobbins. Simi Fahoka. Nico Collins. Joe Thysman. Scridge. Antoine Winfield. Chuba Hubbard. Sam Darnold. Michael Carter. Shaquille Griffin. Jalen Waddell. Helen Mond. Gold Ed McCaffrey. We add Silver Redemption. Jamar Chase. Blue Ice. Randy Moss to 75. Flashback Auto. Shrailance. Silver Auto at NFC West. We got a Nick Chubb Colorblast. AFC North. We got a Najee Harris. Gold Vinyl Auto to five. AFC North. And a Jamar Chase Camo Auto to 25. AFC North. That will do it for the break, guys. Thanks again for the fill. Next up, Personals.


So I thought this was really interesting. I have a feeling you're conflating risk with adverse circumstances in the sense that suppose that you knew for sure there's going to be five more weeks with high temperature. Wouldn't the same thing happen? So is it really risk and coping with risk or is it adverse circumstances? And the adverse circumstances, the evidence you show about remittances and the correlation with the fraction of people who had immigrated before, that doesn't tell you that it's risk sharing. It could again be income support. And I do think it's really important to not say risk if really you mean income. And then the other thing that you didn't touch upon was what about switching to crops that are more heat resistant? And do you see any evidence on that? And if that is possible, maybe that would be a good source of policy, you know, policy reforms. Do I just do all the questions first? Yeah, yeah, perfect. Yeah, great. I actually have two, two. First of all, super interesting. I've seen this paper presented before, but I love how you guys are able to really pin down exactly the mechanism. What's going on? Very, very interesting. First question is on property rights in El Salvador. I wonder if part of the effect could be driven, especially on the discrepancy between the landless and the landowners. I'm thinking of the paper, like the Amaric, the Genvry and Sadole paper in Mexico that shows I want to give farmers titles to their land. That's when they're more likely to migrate. So they actually want to own land. They don't want to migrate because it would take, like the property rights aren't secure enough for them to do so. So then you see actually the landless one migrating more because they don't have that challenge. So that would be good to clarify. And then of course myself, I'm always curious about the interaction. I'm sure you've run these things just on rainfall. I had expected rainfall to be a big one, but and also the interaction of these two, right? I've kind of heard that like often it's not just the fact that you would have very hot days, but that the hot days that remain dry as well is where the issue was, I believe. But again, you've fully run these things. Thank you. Very interesting. Thanks a lot. So suppose there's significant heterogeneity in our willingness to migrate. So each of us, for each of us there is a threshold, an individual threshold, on the size of the shock that would lead us to migrate, right? And then what could be the case is that people in those regions in which there are tons of migrants, I mean, many people left, maybe the issue is that all those with low thresholds are not there anymore. So the fact that you then observe low migration, low additional migration in those regions might not be due to the fact that they're better insured, but that the population itself is less willing to migrate. I mean, the migrant pool has been depleted. So my question is how do you, I mean, could there be a way to address that concern? Thank you. Very interesting paper. So there are lots of points, but very quickly, why two standard deviations? So you give the choice, but you don't explain it. Do you look only at the adjustment on labor? If the shock is persistent, maybe capital can also change if you have the information. And my third point is similar to the colleague that talked about income. I think, yeah, it's probably income heterogeneity rather than, and what maybe you can look at even if we exclude remittances. If you have a small farm and the big farm, it's not the same. So I don't know if you look at farmers by quantile or by whatever. And my last point is, you said you don't look at the shock for a different, for a long period, but I think if the shock is persistent, maybe two, three, four years, maybe this could push them more to migrate rather than if they know if it's just one year. And thank you. Thank you so much. I think you are like touching all the points we are working on. So let me just go back to first, Anna Maria, please help me with anything that I forget or that I don't answer complete. The persistence of the effects, this is so important, right? Particularly because if you think this international migration, this is very costly, is one shock going to be enough to push you to migrate internationally again with everything that is happening in the U.S. So yes, I think that is very important to address and we don't have it right now, but now we are, we just run those regressions where we are doing exactly what you are saying of we have the temperature shock in T-1 and we are controlling also for the accumulated shock T-2 to T-5. When we have, when we run that regression, we do find that those accumulated effects that also matters, but it doesn't really change the magnitude of T-1. So it also matters, right? Like definitely what happened two or three years ago also matters, but when we compare those magnitudes, it's really what is driving the effect is what you just perceived the year before. So that is, that is one. And I think again, it's because of the context. These are very small farmers that are like, they rely on that crop so much. Capital effects, yes, that is great and the agricultural survey actually is really good. We have explored the different things, but yes, we should look at again what we have like the stock of capital. What we see is just like what is happening with the inputs that they can manage with, but for more like medium term effects, we can see what is happening with the capital. So I can, we can do that. Yeah, Tomás, I think that is a very good point and I would, I want to give more time to the other presentations, but I would love to talk more about it with you. I need to be honest. I'm the one that is like married to those results because I think, yeah, you just have like, it has a very nice story, but we cannot, honestly, I just don't think we can identify it well because of all the problems that you are raising and Raquel and you raise as well. Is this really access to rescoping mechanisms or are these just like regions that are very different? These are regions that are just richer in other ways, right? You have more migrants and because of that you have better income and that's why you are staying is really now no access to that. But I would love to talk more about it if you can think about like any way of really exploiting these effects. I accept this is right now, I think one of the weak parts from like empirical point of view. It's not well identified. There are many things happening at the same time. Yes, rainfall. Yeah, again, I would love to talk more with you about it. We do control for rainfall and I went super fast through that, but we control for rainfall and actually we have been debating, is this a whole like weather shocks paper or is this temperature shock? What we see and what we have seen like later in the literature is that temperature is more of a shock, at least with rainfall they could store it and it's not, it doesn't have such a perfect prediction on corn production whereas temperature has. So we are following that literature and we do control for rainfall every time, but we don't see a clear pattern with rainfall shocks whereas with temperature we do. And I think the property rights is very important and now we are actually playing more with it and now we have like completely people that have no access to land at all, people that are renting land, people that really are the landowners and we have important to generate it there and we are, we were just working yesterday and trying to understand those results, but I think it's very important, particularly if we think about policy implications. Yes, and other agricultural sectors, yes, we were thinking about it and we see no movement at all. We see that they are not, we were surprised by it and we were surprised by not seeing that they go to the non-agricultural sector, but we see no evidence about like movement to these other sectors. But thank you so much for all your suggestions. We are rewriting these papers, all of these is very, very useful. Thank you all. About the increase in reporting crime to the police, I think, so you said it's conditional of, there are surveys, opinion surveys where people are asked if they like living close to a migrant or not, so we've used this in one of the papers on integration and maybe you can use it to check if the people who report or not are correspond to these places where there are high levels or low levels of people hating migrants or who dislike living close to migrants. These are super interesting results and I was wondering if you could also, I'm not sure, but I think maybe the IFLS has a module on victimization and fear, and fear of being victimized, so I don't know if you could see if not only they are being victimized, they are saying more or less like the victimization but whether they are reporting more fear. I think the Mexican Family Life Survey follows the module of the IFLS and they have a whole module of fear of victimization that could be interesting to explore. My question is about the instrument and how can it be explained by state presence in the sense of a rainfall shock is way more important in the area when the state doesn't do enough investment in the handling of that rainfall. So could that be maybe tampering with the actual effect of rainfall? To the instrument as well, I think that the effect of rainfall and migration might not be monotonic because like you have the monsoons in Indonesia that like you have low rainfall, you have more migration, but if you have too much rainfall, you have more migration as well, so do you deal with that trying to make maybe dummies on rainfall for instruments? Mine may not be really a concern very much, I'm not sure. I was wondering about the exclusion restriction. I don't know what's grown in Indonesia particularly, but I was worrying about the extent to which rainfall shocks are correlated across different areas, they're migrating out of those areas and therefore you would have a terms of trade, basically in terms of trade shock within the country. Just very quickly, very quickly, is there a way to reconcile the two results that you have like a quick back of envelope calculation to say what's the share of the effect that you find that's due to reporting, more reporting in a sense. One question that I don't know if you will be able to see it, but we don't know where the victimization, the crime is increasing, why is it increasing? Is it increasing because they arrive to the destination cities and migrants get involved in crime or because migrants are more victimized? Here in Colombia what we have found, a paper by Ana Maria Trivina and Brian, I don't remember his last name, he finds that the ones who were victimized were the migrants. So crimes reports were increasing but it was the migrants. The other thing that I wanted also to raise is what you were mentioning about the reports, the newspaper reports. There is a very nice paper for Germany where they see what happens when a newspaper changed their policy such that now they reported the nationality of the migrants and instead of increasing xenophobia it decreases because then people knew, so I don't know if with the newspaper report you are able to see whether they are reporting that the crimes were committed by migrants. This is more difficult because these are internal migrants but it would be interesting to see whether that is the case. You have more newspapers reporting that crimes when they are committed by migrants, like highlighting that it was migrants. Thank you so much, I love all these comments and I'll be around in case anybody else wants to talk after us as well. Just because it's fresh in my mind, let me start with this last discussion with an unfortunate note that we know nothing about the perpetrator, nothing, there's no information about the perpetrator. That is unfortunate, keep in mind that we are not scraping these newspaper articles, this is existing data set that's been collected by various folks, various folks in the Indonesian government, World Bank, various groups, so the data is what the data is. So we don't know much about anything about the perpetrator. The victim, however, and Maria we do, from the household survey, so yeah, that's definitely on our list and that's why I'm presenting that household survey results a little bit very preliminary, there's just so many more things, you know, migrant origin, gender I can imagine being interested in, skill level like I can imagine of various heterogeneity being really interesting. So we'll definitely do that. Now let me go back in order, yes I'm very familiar with the data you're describing, I have a very old paper using the World Value Survey which I think is the main survey I had in mind and I'm actually going to show a slide from that very old paper, if you could click please on this little attitude button here, it's going to pop up, there's actually three of four main questions from this World Value Survey, only got this one on the slides, one is do you want to live next to a migrant? This is the one, if jobs are scarce, employers should give priority to natives over migrants and it asks do you disagree, neither or agree. This was done for a human development report so we don't have by GDP what we have done by the Human Development Index and one thing that we actually see in all countries a vast majority of people think that priority should be given to natives but actually especially in these medium income countries, the attitudes towards migration actually most negative which we explain in that paper, it's a paper with Jenny Klugemann which we explained by this idea that well in these very high HDI countries sure we hear a lot about negative attitudes towards migrants but at the end of the day there's social safety nets. People don't have to worry about feeding their family as much, there's certainly some of that worry and then when we go here the levels of migration are really small so again you know there's not so many negative attitudes about these yet, it's really in these middle income countries, medium HDI countries where we see a lot of this competition going on. I love your idea to look more into this, the one constraint that I have I think I don't think the World Value Survey has any geographical information other than the national level from what I remember. So I don't think, I love your idea to like sort of look geographically, do you think I'm wrong or? I don't remember which survey but the survey was used and they were, did they do the survey? Oh I would love to use that, thank you so much. So the Gallup and if you have, maybe we can talk afterwards, I'd love to look into this. I'll give you the name of the survey. Please, please don't leave without, I want to make sure because that would be super interesting to kind of like pin that down a little bit better. Let's go back by the way and let me make sure. What else did we have? My of course didn't take, oh yeah so okay I actually have one other thing I want to show. It's a little bit about these questions about the instrument, exclusion restriction etc. So if you could please go back and I'm going to ask you one other thing, I'm going to ask you to please put on a little button, sorry, the button of the testing exclusion restriction because I think it's going to come exactly to some of the words that people had which I think are very valid, particularly on trade and here I have to put a disclaimer that the results I'm going to show you are actually based on my earlier paper with Jeremy Magruder but the first stage is the same so it should be the same result but we just haven't run it yet for this paper. So what do we test? I actually think it's a fairly powerful test. If there was something else like trade patterns that could explain, you know that would lead to sort of similar variation then we would expect that if we use any kind of different weighting scheme rather than the half, quarter, quarter but there's some other weighting scheme maybe that would just produce similar results. So let's test it. Let's just bootstrap our weights a thousand, ten thousand times and let's just see how often do we see results similar to the ones that we have appearing and because if it were the case that our migrant rainfall measure is just picking up on something else, trade, whatever it is then we would expect that a lot of these other weighting schemes which has happened to also lead to very similar predictive power. So we run that here first on the first stage. Our first estimate, our first stage estimate is right here and as you see it's even cut here in the horizontal axis. None of our bootstraps weighting schemes comes even close to it. So what this is telling me is that there's something about specifically where these migrants were coming from. Not trade, not anything else. It's specifically where these migrants or any, could be anything, right? Any kind of correlated productivity, gravity model of areas being particularly close together, none of that is happening. Same with a reduced form and then the last thing that I'll mention is we look at long distance migration as well. So rather than having just any move we can say you need to move over at least 100, 200 kilometers. And if anything we actually see that migration over longer distances has stronger effects, well if there was any kind of trade or anything going on there wouldn't be really a reason to believe that any kind of gravity model would predict that trade is greater if locations are smaller together. Does that make sense? Can I just say that we're going to talk about in terms of trade improvement, i.e. are richer than before. Maybe that richness or that inequality in that area is aggravated, where they're going to. Sure. And that's what's leading to more harm. That is different than what's going on in migration. Yeah, yeah, sure. I mean, it's more like a mechanism of why, yeah. In terms of trade to be growing the price, that was my concern. No, I think it's, well, I'm always a glass half full person. I don't think that's a concern. I think that would be just a way that we could explain our results. I don't know how I would use that to explain the pattern that we see results in the newspapers, but not on the household survey and on crime, that I couldn't explain that. But I do agree that like whatever, and that's why I actually, like the previous paper presents so much, it's sort of very carefully laying out every little step of the causal chain, so to say. All that we have is, there's migrants coming in, there's effects on crime. That's kind of where we're at. I may have more questions, but I may be out of. Okay, let me see what else I had. I have, oh yeah, so actually, yeah, your question, Andrea. I have to admit, I've worked with the IFLS for many years. I do not know of this, of course. I know you have a lot of experience with the AMACS FLS. I will search for this module. I hope the module exists. There is one crime module, IFLS 4, but it was actually so bad that they discontinued it. So the IFLS 4 crime module we have at some point looked into, but it's just not a good module at all. But you seem to be talking about some kind of fear or something like that, right? So, not that I, but the IFLS in general, I love that, and the AMACS FLS too, and I love the people who've worked on it, these are such great surveys. They have people sit down on average two days to answer questions, like these are, we know everything about these people. Monetonicity, again, kind of coming back, like what is the exact weather term. We try a couple of other things. Again, I'm not going to show more bonus slides, but for sure, a lot of rainfall can be bad. We actually don't see evidence of that in the Indonesian context, and that's mostly because it's a lot of rice growing. I have no doubt that it's true, right? I mean, there's floods, et cetera. But for any of the kind of variation that we're looking at, that was never a negative thing. And in fact, David Levine and Dean Yang have a paper that actually does the very similar job as what they're doing in the beginning, where they look at the effect of rainfall in agriculture, like they combine it in a paper. I just cite Levine and Yang, like that basically said, it's a monotonic linear relationship. Use that. I'm a little lazy. All right, any other questions? I'm happy to talk more after. Thank you so much for your feedback. And Maria was wondering whether if there are any other benefits such as tax collection, net of transfers to the migrants. So I think it would be important to see the whole benefits to society at the destination rather than just the benefits for the migrants, yeah. Sure, thank you very much for the presentation. I just maybe have just a question of clarity. I don't know if you might have mentioned it. But I'm quite interested in after the regularization of the emigratory status. One, was that time bound? And then secondly, I guess if it was time bound, what then subsequently happened? Because I think in many places, you know, in the world there's big question marks around specific amnesties or dispensations and what subsequently follows. The second one that I'm quite interested in is your earlier comment. And I'd love to just hear your reflections on this. Syria, Venezuela, and Ukraine. Now if I look at all three of those places, I mean, you know, two of them conflict, right? Syria, Ukraine. But Venezuela, and I would probably add another country, there's Zimbabwe, are direct outcomes of economic sanctions. And effectively, if you think about Zimbabwe, a large part of the working age population is outside of Zimbabwe, so I'd be interested to hear just some of your own reflections whether or not the cause of the displacement is also important. So if the displacement is caused by conflict, should the policy response be different if it's caused, for instance, by say economic sanctions? I have a quick question. I have a quick question, if I may. I'm just curious if you get information on the Colombian side, kind of, if when migrants were more incorporated and they feel like more welcoming, do people actually, like more welcoming, but rely more on the state? Do they also rely more on the Colombian counterparts in the municipalities, like the Colombians, receive them? Well, probably it's beyond the scope of your work, but I don't know if you get something of that. Thank you. Thank you. I was wondering as you finished, and I was talking to another colleague here about that, the sense of, I mean, for integration, we need to, both sides. And this is one side, and I think we could find something interesting here. I was wondering if the qualitative data or in the service, you asked about first the sense of belonging, or sharing values with Colombians, if that changed, or if you have anything similar in the questions. And second, how much exposure to Colombians was, for example, when you are not regularized, you interact more with Venezuelans and with, and stay in the neighborhood and stay there. And on the other side, when you feel that you are integrated, whatever they perceive as integration, you will talk more to Colombians and you will feel empowered to talk and interact more with them. My question regards maybe, maybe it's beyond this scope of the paper, but I would like to know, and that's a question that came up to me, is that maybe this program had some spillover effects over the access and the wellbeing of other Colombians. In the sense that I know that this program it was financed by the national government. So many institutions and municipalities and departments gained new resources for attending these populations. So maybe that had some spillovers in access and quality to Colombians. Yeah, I was surprised to see that take-up of that PAP is actually quite low. So I wonder if you could at least tell us like what predicts a take-up. I guess you can do that in your data just to kind of like look at who are the people who take up and who don't. And the other thing I'm just really curious about being from here, why did the government do this? Like I just love to hear the motivation behind this because this is something that we don't usually see. Just a very basic question, maybe I didn't understand but do you assume that all the people that arrived after the closure would all apply while we've seen that for the others the share was low so I may have missed something. Just to finish, I wanted to build on that. And can you check like if the migrants that came after round close, they are different because I don't know if they hear that they are opening this registration, they might think this is like to help them somewhat and the people that might come could be different. I'm going, I have some minutes. Okay, thank you very much for all the questions and for all the suggestions. Rerata about tax collection, yes, this is very important. Here it's a very short term effect but I didn't show that but you can see it somehow when you compare subsidized versus contributive health system because in the contributive one you are paying taxes. And we have not looked at that but we can do back of the envelope calculations for that. And when they get formalized they pay taxes. So that's important. So in the new version that when we are doing at the second wave we are going to start to look into all those issues. Something that we're finding for example for the second wave which is very interesting is that fertility rates dropped for people, for the woman.  So that's important because then you have, the state is going to have less kids to take care of and to provide social services. But yes, we still have to do that and that's something that is very important to do because migrants contribute in many ways and one of those ways is to start paying taxes when they become formal and that's important. What happened after? That's a tricky question here because they could request an extension after two years but when those two years were going to end the program did the new one, the new PEP which is called ETPB. So now they can stay for 10 years. So what we need to know is what's going to happen with this 10 year program. What we are finding that is very important with respect to what you are asking is that we ask whether they want to return and when do they want to return? We ask that question in the survey and we don't find that the program changes that. So willingness to return is very similar to the regular and the regular migrants and we really need to understand that a little bit more. About whether the effects are different whether there are economic sanctions or conflict. I really, we don't have enough data to see whether the results can be different or not. My perception, I have worked for many, many years here in Colombia with forced migrants, internal migrants and what is very important about all these processes of migration is that these processes are quite hasty. They are not necessarily completely voluntary because the conditions are so bad that they need to migrate and they do it in very poor conditions and in very difficult conditions. So regardless of what happened, what I think is more important is the migration process itself. That it was hasty, that you didn't have funds to fund the migration and that the persons were in quite vulnerable conditions but that's just a hypothesis of that. The Colombian side, we have surveys for that. Colombians, Senafobia in Colombia, Peruvian Ecuador who were the countries that received more migrants increased significantly and when we look at the surveys for that, the spike after some time increases a lot. But and very interestingly, so when we ask them, that's a survey that we just did, whether they are willing to provide entrants to migrants, whether limited or not, people are willing to do that and they are also willing to provide state services. So they don't trust migrants, they think that migrants are hurting the economy but on the other hand, they are open to provide social services and to allow them to enter the country. Which is, I don't understand very well why. Yes, it's kind of contradictory but we have to understand it a little better. Sandra, your question is very important. We have questions of that in the survey. We didn't show it here but when we were doing the focus groups, we had focus groups for those that were PEP and those that were not and the difference between the two groups was really stark because the PEP ones were much better. They had Colombian friends and the other ones were completely over the wearer. They were really, they cried in some focus groups. They were all crying. They were very pessimistic. So we do believe that there is a huge impact on integration. In the second wave, we include better questions because in the first wave, we include some questions and I think the questions were not, we are not capturing that but we do believe that that's a very interesting avenue for research. A spillover effect. I'm not sure that there are spillover effects. There is a study, a paper by a student of mine and he finds that municipalities have to spend more for migrants and the tax effect has not kicked in yet and social services sometimes they feel are overwhelmed. So that's kind of, you have both sides. Why is 64, that's a huge mystery, Mike because basically what happens is that the process to get into the registration is very easy. It was online and for the TPE, it was the same thing and the take up, even though people already knew what was happening and the benefits of this, it was at the beginning it was quite low. So there are problems of people that left to Ecuador and to other countries but also problems of people not being able to register and we have information about that. I should have brought it and we asked those questions in the survey. The motivation, the person who did that is at the IDB right now and we are going to organize a lunch with him so he can tell us that. So if you want to come, it's going to be a closed door lunch but we can invite you. And I think that's it because we need to close. Thank you very much.


Good morning everyone My name is Steve Bader, and I'm the associate director of open source applications at the distance Digital education learning technology applications at NC State. We like to call ourselves Delta for short So that's pretty long. I started with Delta 10 years ago when we Delta needed help upgrading from 1.9 to 2.3 And every year since then we've upgraded Moodle with our upgrade process, which we've worked on During my tenure, I've had the privilege of working on the local course copier, which copies courses across instances of Moodle a web services that that push Student grades into our student information service and several plugins around gamification within the course and the event system As a part of a grant recently I've gotten to program the Moodle course roadmap, which there's a poster presentation on tomorrow Recently we've adopted the mod zoom plugin and my team is the maintainer on that and we've been pretty excited about that Oh, no, I'm a pretty big fan of Moodle So I'm here to present to you the guide that we use to upgrade Moodle It's a refined process that changes every year because we usually get a Throwing a curve ball of some type and it either proves that we need this type of process or that we need to add More more to our process This year we learned that there were millions of questions in our and our questions table that were growing out of hand There were random questions So now we look for crazy growth in our question table. So starting with our timeline we Begin our process around the end of September and we started with a very important planning process and then we get when we get our Hands-on Moodle in the November release. We'll start making it our own. So we'll add plugins. We'll add our our commits and We will add outside plugins from other vendors and our core modifications And if the train's running on time at the turn of the year, we'll look at config The new settings the remove settings. We'll look at capabilities the ones that been added and removed and Sometime in January, we'll get our first version set up for our our department to start looking at and creating support materials Hopefully by the end of February, we'll have a working system ready to go and we'll stand it up All right We stand up one instance of Moodle a fresh instance and then after that we work on an upgrade for our two perpetual service And we'll practice that from February to May so we're going to look at the details of this of this plan a little bit and The first step that we're going to take is selecting the version Our plan is built around that November release Because we don't like to ride the wave of a new release So we won't immediately grab the latest and greatest and put it into our production systems We'll grab this November release and we'll put it into production sometime in March That gives us time that gives the community time that gives the tracker time to find those bugs Which we're happy to help with but we don't want to find them in production or have our instructors encounter them We also like to respect the supported date range so the security date range is very important to us So we ought to make sure the lifespan of that matches the matches or exceeds the lifespan of our production server within the year And then finally we're going to look at new features New features since our last install so our previous install was three nine We'll look at three ten three eleven and four oh, and we'll look at the features within Moodle A lot of times that we find too many changes is actually a negative thing for our faculty and students So we kind of we kind of trying to find out that great balance This year we really tested them with the 4.0 release With all the interface changes that we had we had some folks that had some struggles After we decide on our version, we're going to go to the infrastructure We're going to make sure that our PHP version and whatever database version We're using is going to be up to date and its life cycle is good with ours We chose PHP 8 We did not go to 8.0. Just 8.1 because it's a it's a very new release And we've got to respect all the vendors that we rely on and make sure that they support the current PHP version We couldn't stay on 7.4 because seven port four's lifespan is going to run up this year And we wanted to make sure we were supported for the full life cycle. So we chose eight We did have some struggles getting some of our vendors some of our plugins making sure that their their code was ready for eight The the big issue there was the ordering of parameters within functions your optional parameters had to go last so we note all these changes and we Document them as we prepare for our upgrade. There we go Next we're going to look at the important code modifications that Moodle has made and the best place to go to start with is the Moodle documentation they got a very nice new website at Moodle dev.io We're going to go and we're going to look at that 310 release that 311 release and the 4.0 We're going to look at the major tracker items that are listed and if you get into that tracker you can you can filter that tracker by Release so you'll find not just the major but the minor tracker items and sometimes the minor is major to you But there's also a section to play close attention to it's called the for developers section It'll list out the core plugins that were Removed in Moodle it'll list out the deprecations which are important to your code Make sure that you you're also removing them in your code And it's also going to list out component APIs that were upgraded if those are important to you You want to make sure that you pay close attention when you revisit your code? So we're noting all these for later Also, I like to look in the lib deprecated lib PHP It gives you kind of the history. It also gives you a little look into the future of deprecations Things that are going to start throwing warnings as opposed to errors You'll see that coming and you can kind of prepare for that coming down the line Also lib DB upgrade is a great place to look for a running history of the database changes So you can see the way the database is changing in The current version and some things you won't find in the tracker that you say why are they doing that? So we'll look there as well And then finally we're going to review last year's data So we're going to go into our current database We're going to look at activities and we're going to look at the usage there. We want to see that Just got weird We want to see how much our instructors are using what they're not using And we want to decide, you know, maybe it's time that a plug-in retires because it's not being used or it's not Because it's not worth our time for maintaining it. I'm sorry all right that will lead us up to the November release and We will get into our development review The first step in our development review is getting a place to work We will get our dev and test servers set up Our dev server is a place that all of our developers can spin up their own instance of Moodle They can tear it back down and spin up another one We like to test our plugins or our Commits in a clean environment so that there's no cross contamination between what we're testing And we're going to go through all of our plugins our commits and stuff there And then we'll have a test environment that our larger department has access to so that's where they're going to build their support materials and test for us It's fun to note that we have two protected branches that we maintain once the test for a branch Where our developers will create pull requests and we'll approve them And then there's the main for a branch which I integrate the approved changes into Our main repository It's something to note this year There were so many changes visually in Moodle 4.0 that we set up a Moodle preview server It's a production like server We set it up early and we allowed anybody on campus to opt in so they could see those changes and kind of get rid of that Shock that we're going to see when they saw the changes in Moodle. So next we're going to do the tedious Core commit walk-through. We have about a hundred commits that we make to Moodle. It's core changes They're not necessarily bug fixes because we try really hard to give that back to Moodle But these are behavior alterifications that work better for us at the University and we'll walk through each one of those commits instead of just doing a Flat rebase and hoping it's all gonna work We go through and make sure that the change is still needed that there are there are no new conflicts because of the code changes From Moodle and we'll make sure that the patch still works as desired We are also working really hard to get our own set of the hot and PHP unit test for these commits So that this step isn't as tedious in the future Next we'll look at the plugins that we maintain So the course copier that I mentioned before the course roadmap our gamification plugins And we have some plugins that we've adopted because the original maintainer kind of flew the coop And we needed to take over because our instructors didn't want to see that plug and go away We will look at the updated component APIs that we mentioned before look into those Into those plugins and make sure that everything's up to date there will make sure PHP 8 works for it And we'll also look over the interface because Moodle has changed so much We don't want the plug in to look out of place. So we will update the UX UI in that as well And that was a significant process this year Then we're gonna do our community and vendor plug-in audit You would like to think that when you Get a plug-in from a vendor that it's gonna install and you're not gonna have any issues There's no bugs or anything, but that's that's It's rarely the case a lot of times we have to give some code back to them. We have to test it for them There's a lot of PHP 8 that wasn't ready in our vendor plugins So we go through the same steps we did with our own But we also do a health of plug-in check with our vendors or with our third-party plugins We'll see we'll go to the repository see if there's a community still alive and around that plug-in We'll see if it's well maintained or if it's gone stagnant, which is kind of a warning sign and we'll see that if if there's any issues being reported and if are there are those issues being fixed and if the health of this Plug-in is not well is it one that we adopt and start maintaining if it's something worth our time for the instructors looking at those usage numbers Or is it something that we can finally let go there we go So now we get our we have our code base pretty well intact. We've got our commit review done We've got our plug-ins installed We probably have some loose hanging ends, but we can we're moving into the start of the new year and we want to start looking at our Config setting changes and our capability setting changes and what we want to do is we want to extract those changes so Years ago. I developed a script that goes in and pulls out the Site-level settings and the plug-in settings and then some settings from other areas in Moodle And I put them into a data file and then we'll run that on the our old version We'll run that on our new version and with a secondary script. We'll find out the differences so we get a full list of new settings a full list of Settings that were removed maybe because we deleted a plug-in and then a very small list of settings that had their defaults changed Which was a little hocus-pocus we ran in two years ago when we thought we our settings were right But because the default change we kind of got Bambuzled Yeah, so we'll pull those out one thing I would want to mention that was really cool this year when we we upgraded using the CLI command of 4.0 Moodle did this really cool thing and it spat out all the new settings So it's starting to do what I've been doing by hand. So I thought that was really nice of them Then we're gonna do the same thing with our capabilities except we have a local plug-in that's on our repository. It's in public view This local plug-in will pull out capabilities both roles and capabilities in the system and how they're set And it'll push it out to an XML file We originally created this plug-in so that we can grab that XML file and sync all of our instances So they were identical that way no one you know one instance got really weird or anything. They were all the same Well, I take those XML files for the old and new and I compare those as well So we have the new capabilities with the new instance of Moodle the change capabilities And the ones that were removed. We'll take all of those both Config settings and capabilities to our tactical committee their governance and let them decide How do you guys want this set and when they decide how they want it set? I put it into our config script that runs against the server and sets everything the way we want We've got some LTI Considerations if you're just upgrading your server It's not so bad because your course IDs are the same your user IDs are the same the configurations stay in place So the LTIs are kind of still set to go But if you're standing up a new instance like we do every year and We're moving our population into that new instance every year We kind of run into some issues with those course IDs restarting and the user IDs getting jumbled because of them loading in differently My advice here is to approach the vendor Tell them your scenario and have them handle it on their end because we're going to set up that configuration We're going to connect to them. We need them to know what our issue is Fortunately, most vendors have some type of solution whether it's pause the server sever the data and start us over or give us a new configuration detail whatever it may be Be upfront with them and let them know and work with them My biggest advice is whenever you set up an LTI Contact that vendor and say hey, I want to walk through this with you I want you to look at my config settings and I want you to show me You know set us up an instance live real fake real fast either on test and and or production And most vendors are completely open and happy to do so because they want to avoid issue as well And that's been very successful for us one thing to note whether you're upgrading or you start new instances every year There is a move from 1.1 to 1.3 LTI And if you're on 1.1 most vendors go into 1.3 you're gonna have that little hiccup where the instructor backs up their course It's gonna have that 1.1 LTI in it. They're gonna restore it It's gonna have that 1.1 LTI and you're gonna need them to move over to the 1.3 configuration And then there's not really a way to avoid that that I know of So finally we test our integrations. We've got that course We have course creation Automation we have user enrollment scripts. We have great extraction. We have the process of back-uping and restoring When we get that into test we test that with our our unit tests So we have a test that we can run against that test server and go through all the functionality for each of those and make sure They work because testing and production isn't that great? So That's our last step make sure all integrations are working after that We can set up our new installation of Moodle So we stand up our new new installation during our spring break It will go live in the summer, but we let allows our instructors to get on board and get in But if you're upgrading your Moodle server, there's a few more steps I want to mention for us when we practice our upgrades we go ahead and take a snapshot of production and we put it on a replica server and We we change Convig values like divert all emails to an address so that you know this the server doesn't send out emails to anybody and We we run the url replace tool Against the server to take it from the production url to the staging url to that replica url Once we get our replica set up so that it's running on its own and it's identical to production We'll take a snapshot of its database and we'll take a snapshot of its Moodle data folder And we'll set those aside and now we can run it a practice upgrade if things go wrong, or we don't like it We restore that snapshot and we can run it again So we can run it over and over until we're really happy with the output a lot of times There's there's plug-ins in the background that don't like going through the upgrade process. They may spit out some errors And we want to make sure that you know, we're we're getting through those and working out to get a smooth upgrade Sorry, I skip that So the Important thing here is if you're removing plugins remove them before you upgrade That way it doesn't have to go through that upgrade process Just make sure that you know that when you remove that plug-in You're gonna remove the data with that plug-in too because that that plug-in is gonna take away the tables and along with the Tables goes the data for that plug-in One thing that we had to do a few years back We moved from form ng to Moodle cores new forum because we really liked it and form ng wasn't wasn't right for us anymore So this was the step that we had to create a script that moved that data from one plug-in into core so we had a little conversion script and We got that moved in one thing to mention on our code base the way we Have it and get our git repository our main Moodle core is one repository and then we have Roughly 40 sub modules that are a part of that Repository each one of those sub modules represents one of our plugins that's managed in its own repository So if we have changes and we do pull request against it Those happen in those repositories and then I as a maintainer Manage the main branch and which one that main branch is looking at my advice I always upgrade via CLI you get the output you get all the output. You don't have to worry about any browser Confusion or caching which Moodle still really good about but I trust I trust the terminal more than anything I Like pipe in the output so that I can review it later You know if something crashes and it dumps a whole bunch of stuff out I can dig through it So that small bit of advice there making sure debugging is on What am I supposed to point this at and then post launch a Few things here after you've launched my best advice is be available almost So block off some time be ready to respond fast This is your first impression as soon as that server goes up and instructor has formed an opinion So if there's something going wrong Jump on it as quick as you can Be responsive Engage with the Moodle community It's so important that if you run into errors or confusion Reported on the tracker even if it is confusion if a lot of people are having the same confusion. It's probably actually a problem The trackers open to anybody not just developers actually we probably need more non developers More end users supplying your opinions on what our direction should be Help us write test cases if you know how it should work write those steps out If you if you know how it's how it's not working and how it's busted write those steps out And if you have code, of course Help us out by tossing it up there And then my last piece Advice is to actively monitor We use you know look into those errors server error logs. Just take a glance. You'll see stuff in there You'll watch database growth is our advice this year our questions table started growing way out of hand really fast and it was a sign that there was something wrong and Server infrastructure monitoring we use a program called Nagios Just tell tell signs that we can we can identify an issue before someone else does I Hope something in there was helpful for you today. That's all I had So we have a few minutes for questions anybody have any also if there's a if there are any empty seats Could somebody like stand up and point to if there's place available. I don't know if there's empty chairs anywhere, but yeah, go ahead Development processes your configurations reviews Do you implement any automation to your? your stages So we're playing around with it I think we're a little behind in that apartment and that might be my fault because I'm a hands-on guy Okay, I really like that idea But we we're working more of that on the production side and not on the development side, so After I as a maintainer get those pushed up We're getting to where production will start updating itself More automated but on the developer side. We're still old-school. I guess yeah Thank you just a quick question How many people are responsible for doing out this work and do you think that number is adequate? Are you happy with that? so Developers there's four of us However, the whole Moodle upgrade process We have we have an all-in department that that works on it and that that is all of Delta There's a presentation tomorrow. I think it is that is the Moodle for upgrade on a whole that encompasses our entire department so the support materials the ID team the instruct instructional development team The design team so there is a lot more than just us developers, but this is more of a technical thing Thank you very much You talked about your code base and git and adding plugins as subplugins I guess you're doing that instead of sub modules. How are you handling? plugins that have subplugins themselves So that works. I think HIP has subplugins as well and you can run a recursive command that pulls them We don't actually maintain their subplugins, but we do keep a copy of the plugins repository in ours because a lot of our plugins we have commits on top of theirs we We give ourselves the right to change anything In in our install, so we've we have some modifications to plugins that we bring in as well Do you have to handle also integration with the public clouds like Google Google classroom or Office 365 for education similar thing. So our campus is a Google campus, but we don't use Google classroom but we do use File embed and the repositories and we connect those So the integration is just a sharing at the Google Drive level. Yeah, and so forth. Yeah Any other questions? Nope up here. I guess that's a little bit out of out of touch with the update process but I have a question about the copy processing and since I worked with the copy process I Would like to ask if there's any planning on simplifying the copy process so Moodle cores process is As far as code goes is not simple it's rather involved, but it makes it easy for the end user We simplified it by a Another program we run. It's called wolfware. It's it's our portal to our Our University and the instruction can go in there and say I want to copy this course to this course and Our our code does all the work. So it'll run the backup on one server It'll it'll pull it down into a shared shared server and then I will restore it on another server for them Because we wanted it to be easier But I don't know if moodle is gonna make it any simpler you said at that you said that when you test the new release you get the learners to have a Sneak peek at the new version for example version four How does you handle that do they sign up to a firm? Do they just get the URL or do they create a new user or how do you handle that? So we're also a shibboleth campus So we run a shibboleth plug-in. So if a user Hits our site the shibboleth will it'll push them out. They'll log in and it'll create a user on the fly So we didn't have to worry about the create user But we did set up a form that if they wanted to try moodle in the moodle preview server if they filled out the form and agreed to the Beta version of our moodle then it would it would build them a course and add them as an instructor So yeah, we automated a little bit there