Hi everyone, Joe for jaskiescasebrakes.com still got Nick with us here for 2022 Bowman baseball eight box jumbo pick your team number one brand new release Just dropped today big. Thanks. Everybody here for grabbing your teams If you have little rooftops next to your name, that means you won those teams and those fillers Appreciate everybody getting involved in that as well appreciate appreciate it May 4th may the 4th be with you. Hopefully the 4th the force will be with you in this break Now this is jumbo edition. So that means three autographs per box. I Think everyone read the instructions on the Description no vet paper No, rookie paper or prospect paper will ship Only Bowman first paper cards will ship which is a change Which is actually an upgrade from previous years where we've traditionally not shipped any paper at all so this year You'll be getting the Bowman first Paper and obviously all the hits all the numbered paper all the inserts Those of course will all ship as usual the sounds of an angel's baseball in the background Taylor Ward who's been on fire Just hit a two-run bomb over the green monsters in the top of the 10th Give the angels a 6-4 lead I don't know they were just They just weren't good last True true You know what you know, it's better The relief pitching is a lot better because there I don't know how many games last year I would just bet on the bed against the angels I knew their bullpen would blow it in like the last three innings, but that that has been the big change to me I think their bullpen has been able to lock it down more often than not Rex Is acting the unique Joe and Jason continues to refuse to give him a free hobby box of prison basketball We say that I told them too, but Okay, we're the we're the bad guys. Yeah, we're the bad guys. Here's another jumbo box right here as well All right, good luck everybody So just in case you're just seeing this for the first time so stuff like this won't ship These won't ship even I know they say rookie's on it, but they don't ship these guys don't ship All right, obviously that ships obviously that ship because it's Edward Cabrera blue paper and look at that It's a gold shimmer right here so this will ship to Mark and the Marlins and We got Brandon Valenzuela 22 out of 50 Valenzuela Gold shimmer for the pirate that definitely ships to Chad and the pirates Rexes I knew it insubordination Snooze you lose Free pack for Rex as soon as he gets into the chat nothing All right insert ship, of course those ship Chrome obviously all ships That's chrome first so that obviously ships This won't show we saw Shailin Planco a while ago But these Bowman first papers will ship this time. There is Eddie's Leonard 150 out of 150 blue shimmer I really like that design this year where they Almost like a tech tech sort of look in the background there that goes to Jason and the Dodgers one that in the Can you pick whoever you want to go in second in net turnings or does have to be the guy who was last at bat last at last outmaker I believe I think they had more at bats I think they'll maybe maybe not maybe he made though. Maybe he was the last runner on base then Why not just do whatever you yeah not playoffs. I know I Kind of object to it like Right in the 10th inning Why would why not just give them an in here to just to do it the old way and then if it gets like the 12th or 13th inning Then be like hey, we'll put the runner on second Right you're not gonna have those games right I'm like 15 16 I guess I was still 17. I guess we'll still say it in the playoffs There's a Yorbit Viva To 499 for the Dodgers Jason By the way, these are these are slightly thicker cards right there on those I don't know what they call these but they look pretty cool. Here's our second auto of the box Here's the first one. Here's the second one. That's Ronier Quintero 451 out of 499 for the Cubs Jeremy Harder with the Cubbies No Michael the schedule is in the chat. I think that's gonna be important resource for you and everybody to use This is great one. Yeah, was there an Indians game Rex remembers a few years back that went 26 innings I mean, I guess technically that could still happen because I mean, I don't know if it even makes the game go faster Does it Nick because what if everyone has the runner on second? They just keep scoring one They can just trade runs That's true Although you see what they've messed around with the baseballs though, yeah Like a lot of a lot of home runs Yeah, it doesn't seem like they're going out. There's Bobby with junior to 125 and there's Randy Vasquez our third autograph And that'll be for there you go. Okay, Sean with the Yankees And I've got green speckles CJ Abrams. I think maybe got called up They may be made his debut that's for the Padres. That's for Kareem the Bobby with junior Bowman 100 oh That's right to 125 Andrew with the Royals No, I'm middle of maybe a couple more months. All right, so we had our we'll do an autograph recap at the end as well and there's Nico Cavadas 117 out of 250 purple chrome going to Addison and the Red Sox is Joe Adele washed Yeah, I know I saw that you guess well Taylor were Brandon Mars pretty good Maybe put the Joe Adele cards back in the drawer dust off the bread and marshes Yeah, that was a little I thought they'd be a little bit better this year There he is. There's we're just talking about him. There's Brandon Marsh insert Oswald Cabrera another Yankees autograph for K. Sean Yeah, they were there were the Robbins for a little bit way back in way back in the day Brooklyn Robbins Brides groom Brides groom I think is another Another name for them for a little bit in the early 1900s. Oh, let's go Jared He went to Jared. There you go.  Yeah, he heard us. He was just like to show you guys Six run top of the 10. Don't worry. Okay, Sean. Thanks for thanks for buying in appreciate it It's a great prospect hunting here ladies and gentlemen. There's Jay Allen purple paper to 199 for Greg and the Red Legs There's Luis Verdugo for the cubbies Jeremy Harder with the Cubs bowman first refractor And our third autograph of the box is gonna be Khalil Watson Miami Marlins mark end with the fish 16th overall pick nice So those are your three autos. Let's see if you can find some fun parallels here at the end boxes here That represents the case folks on on the cart here. There's one jumbo box Here's another jumbo box another jumbo box Jumbo box awesome. Thanks Nick and that's the break right here folks one two three four five six boxes right here packs are stacked and So that's gonna save us a good chunk of time So let's breeze through these three autos the box once again Remember bowman first are the only paper that shipping Her the item description, which I'm sure everybody read these cards are cool a little bit on on a thicker card stock Yeah, Rex help us pass the time hit us with the trivia Rex has a trivia question entire history baseball. How many Boston teams have been have there been and can you name them? MLB professional team. Are you saying dating back to like the 1890s? They had some random teams back in the 1800s before they settled on the Red Sox and Boston Braves but there must have been a Handful of different iterations that maybe only lasted a season or two in the early days So basically who were the two were the boss who are the baseball teams in Boston that were not the Braves and Red Sox, right? That's the question Does anyone anyone want to venture a guess? Maybe some Boston sports historians out there. There's Luca. Luca Thresh Thresh 002 out of 150 blue paper for the Royals Andrew. I want to say There had to be a Boston like bean eaters team or something like that So there are three others Rex is saying there's Pablo Aliendo Very me harder with the Cubs It's our first autograph of the box From what you saw like I mean just look up.  Well, don't look it up folks Not yet. Anyway, but baseball reference will have all those should have all those teams a purple autograph That's Jack Suwinski 160 out of 250 nice Like seeing color with the autos that is for Chad and the Pirates There's Carlos Aguirre to 199 for the twins It's a fuchsia parallel for DMAC and Minnesota No, no one's venturing guesses. Well Rex hit us with the hit us with the Red Sox team names or I guess the Boston professional Baseball team names that are not the Braves and not the Red Sox There's Jonski Noel 21 out of 100 no one's venturing to guess. I got our three autos already So let's see if we can find some numbered cards here. I've got some Noel V Marte 43 out of 199 fuchsia lava For the Mariners, that'll be for Patrick. They were the Boston Reds at one point Boston bees. I see I remember bees. I don't remember Reds or a Boston Americans as as team names there They must have had red stockings at some point. No They maybe had a season or two of the red stockings There's a you want to see Yon Yon Kenzie Noel again 234 out of 299 speckle auto this time For Mark and the Cleveland Guardians Cleveland. This is for you You got Yachty to 299 fuchsia paper for the Cardinals. That'll be for a Barry Barry David Shouldn't be expecting two more eyes on the box. I think that was just the first one Do see a little bit of color here. Let's see if it's Some color on the auto Yeah, we do have some color It is for the Red Lakes Alan Serda 190 out of 250 Greg be since Natty track of the autos here and we'll do an autograph recap at the end. There's Braylon minier to 75 yellow speckle Also for you Greg in the Reds And there's our third autograph. It's another red for Greg Justice Thompson Bowman first autograph Justice is served like mr. Red on his on his sleeve right there as well There's Malcolm Nunez 43 out of 499. Who's the very first? Very first baseball team in what year that I have no idea that must I mean the first baseball team must have been like the 1890s There's Zayed Salinas to 125 Reds are one of the oldest teams in baseball Professional baseball at least even around forever. All right next jumbo Yeah, it was a since I see there. I knew there was a red stocking team. It was a Cincinnati red stockings There's my sale Gonzales speckled to to 1869. Wow. I didn't think it was that early White socks by the way, Greg With that speckle and we got a another Yankee Oswald Oswaldo Cabrera 19 out of 75 Bowman first autograph. It's another one for K. Sean Got the Yankee straight up Being rewarded with some autos Jackson co-art of 199 purple paper and a junior San Quentin to 199 for Cleveland Guardian with that fusion parallel that'll be for Mark and Andrew has the Royals. All right next act here. Is that a super nice one? Good. I'll be honest with you I'm usually a little more prepared When Bowman comes around good to kind of snuck up on me so I'm not super familiar with a lot of these names, but Teams were picked up really quickly. So it looked like look like prospectors knew what they were going for Thanks, everybody For making this all half appreciated and we got a twins autograph. That is Carlos Aguilar Aguilar, maybe Minnesota Darren and we got a speckle autograph for the Covey 295 out of 299 Ronier Quintero That is for Jeremy Harder and the Cubs Got purple paper right here Simon Muziati 172 out of 250 Bowman first purple paper for Austin and the Phillies won that team in the filler One of the Phillies in the filler There are your three autographs next jumbo box Good luck everybody on words and we've got a Nico Kovates 110 out of 499 Addison with the Red Sox You just suffered a six run top of the 10th from the Angels just close it down now. I now I switch it to LA Kings at Oilerts game to standing cut playoffs my Rex saying I was watching on YouTube last week with a saying Abner Double-D died without knowing that he actually created baseball How so? I mean he knew about the game Are you saying not knowing that it would be as organized Yeah, or to see how they how far that game actually went. Okay. Yeah, I hear you. I hear you Here is Dustin Harris bow and first autograph for the Rangers Alex. I mean I Feel like that happens often right? I'm sure the inventor of golf In like Scotland just probably never thought it would blow up the way it has there's a Elvis Martinez to 250 Second half of this jumbo box looking for one more auto out of here and here is Gavin Conticello I think he goes with a Conticello or do you think he goes with a Conticello? That's Diego with the diamondbacks. I guess Conticello would be a little more Italian I guess if he wants to go with that pronunciation. Don't know We'll have to wait for him to make it to the bigs Diego to see how he wants his name pronounced in the media guide Do I read the Adam Sandler Netflix movie called ridiculous six? No, what's that about and here's Brady House 49 out of 50 high-five futures Gold take it to the house Giuseppe with the nationals. We've got some lime green on the bottom there and it's It is for Cleveland To 399 George Valera to 28 out of 399 Lime green paper for Mark Passett and the Guardians two more box to go almost there So here is the first jumbo box is the second jumbo box You kind of see In the background camera right there All right, almost there. This is it for jumbo one. Good luck. It's a Western coming When did Is this a recent movie? I've not heard of this. You got Andrew Lara 35 out of 199 for Giuseppe and the nationals 2015 this is the first I'm hearing of this. This is this was a Netflix production We got a Jerry Vargas to 399 Mark Passett with the brew crew first autograph of this box is for the O's it's Creed Willems It's Greg with the O's. Oh This is our first train whistle. It is five out of five Leo Verpeguero Man, there looks like there's these dents right there in the front. This looks like it's from the manufacturing process You can see that those two indents right there, which is a real shame. I Would who has the pirates Chad? I would check with tops Not sure if it's gonna be a very fast process, but they might be able to get you a replacement there But nevertheless our first train whistle out of these bowman breaks Chad all aboard the big head express He is one of their sort of top prospects I think he was first in Bowman's maybe a year or two ago Either in Bowman or draft and we got a rocky speckle autograph 89 out of 299 warming Bernabell Wow warming Bernabell warming that's a great name that speckle autograph going to the rocks Andrew with the Rockies Our third autograph is Anthony Rodriguez bowman first auto for the Giants. That'll be for Steven Steven W. Won that spot in the filler got the Giants Who we looking for in Bowman? That's a good question Jilo. Not too sure Think there's a a Watson on Miami. Delacruz since Natty Valera on Cleveland wood for the Padres a Montgomery for the White Sox VVS for the Dodgers Water Franco Tampa Bay. Those are some of the some of the bigger names 2975 Luis Gonzalez yellow paper But I mean since this is Bowman It's just future hunting prospecting. So any one of these players could be Could be the big name The big names that are big now may not be big in a few years and names that Were not big now could be big in a few years. That's the beauty of this Bowman product I do remember Magnificence. Oh, so it's a parody of Magnificence 7. I got you Darren Baker I think yeah, Darren Baker is Dusty Baker's kid Remember when when he was three years old He ran onto the field in the 22 2002 World Series and was scooped up by JT snow Darren Baker That's for that's for Giuseppe. And you know what Giuseppe? I I want to say his dad Dusty Baker Had a milestone win. Did he win it? Did he have his was 2000th win or something like that as a manager? And I want to say that same night Darren Baker for his single-layer AA team had a had hit a walk-off home run So nice day for the for the Baker family Dusty Baker for former Dodger There's Matt Manning to 99 see got all sorts of information for Matt Manning for Detroit Green Paper for Greg Yeah, it was 2000 right Rex? Yeah, I saw that All right, nice Final jumbo box Jilo what happened to Bobby Whit jr. First home run ball. I Did see the replay of that wasn't that was a nice hit and I scooped it off the ground We got Luis Gonzalez fuchsia to 299 and we've got there you go And Rex was just talking about this guy Jordan wicks 101 out of 250 That's for Jeremy Harder and the cubbies. Yeah, your first round 21st overall pick and there's Malcolm Nunez to 299 I did not see that to 11 year olds ran on the field and they were tackled like Security tackled them like it was a football game Those kids will uh, those kids will bounce right back Harrison Bader threw the ball into the fountains How How did he get the ball back and for the diamond backs? There's Ryan Bliss That'll be for Diego and the snakes second round pick right there So oh the someone in the crowd dropped it onto the field he picked it up and threw in the fountains Come on. Yeah guys first homer. So what happened with it? Were they able to dig it out on Harrison Bader? And we've got our third autograph in our final one of the break Brandon Valenzuela 346 out of 499 That'll be for the friars Kareem with the Padres Nice refractor autograph now. Let's see if we can find some numbered cards low numbered cards before we call it There's Adele Amador to 399 nice lava parallel So Gilo saying they did fish the ball out and got it. I don't know. So hater probably didn't know it was Or Harrison Bader probably didn't know this is first home run ball Yeah, I don't think I don't think any home run ball I would I would pick up and throw back into the fountain It's a little uh, I don't know He's a big leaguer, right? He's a pro. We shouldn't have to be doing that and that my friends Is that no randomizers do know nothing a nice clean start to finish break appreciate everybody getting into the action All right, here's a quick uh recap autograph recap. Thanks everyone Oh plus that five out of five No redemptions in this a lot of nice color here So thanks everyone for getting into the action I'm joe for jaspercasebreaks.com. Thanks for watching. Thanks for breaking with us And I'll see you next time for the next break. Bye. Bye


Welcome to the Crimson Engine. My name is Rubidium. If I'm looking extra luminous today, it's because I have a new lighting setup thanks to the Digital Sputnik DS1. This is one of the most impressive, not just lights but pieces of film equipment that I've ever got my hands on. The DS system from Digital Sputnik is highly compact, incredibly powerful, able to be powered by V-mount batteries, transportable, full-color RGB LED light. This is the DS1. It's a single unit. You can also get a DS3, which is three units, or the DS6, which is six units, which has the distinction of being the most expensive LED light kit on B&H. They're not just full-color, meaning you can dial in different colors. The unit itself broadcasts its own Wi-Fi network that you can connect to with your cell phone or laptop, and you can dial in a specific color or color effect, specific brightness. These are flicker-free at every intensity, regardless of frame rate. They have advanced DMX features. You can set up a DMX network within the light or slave it to an existing network. These things have been adopted by some of the biggest names in cinematography. Fellow Australia and Greg Frasier used these as the main light on Star Wars Rogue One. They were also a primary fixture on Ghost in the Shell. They do it by being designed not necessarily for a high CRI rating but being designed for the camera sensors, being designed for the particular way that camera sensors perceive and record light. A lot of people talk about CRI as a way to measure color fidelity in lights. It is a old standard from 1939 that measures between zero and a hundred. How well a light reproduces only eight colors compared to either tungsten blackbody radiation or daylight. LED technology has certain color spikes throughout the spectrum, and what lighting manufacturers have learned to do is skew their color spectrum towards these eight particular colors which don't include red so that a light may have a really high CRI but give really poor color reproduction. There are lots of new standards emerging to replace CRI. There's a new CRI CRI plus. There's also a broadcast industry standard out of the European Union and a few other different ways but none of them are standards yet and none of them are perfect. The only way to get perfect color and to test a light is to see what it looks like on skin, see what it looks like in the environment that you're going to be shooting in, and these DS lights have been tested and found to be as good as they get. I connect the white find at work and I can turn this light to all kinds of crazy shades of red and blue but it's not just the fact that the this light will emit those colors it's that I can control very specifically which colors are being emitted and how and at what brightness. This means that I can control what my colors are looking like to a high degree of precision and do so consistently from shot to shot and from day to day. I have the unit going through a thing called a light blade at the moment which is an accessory the digital sputnik cell. It's a very small softbox that doesn't really diminish the output of the light. I've got this on less than 50% right now if I choose to and go up to 100 you're going to see a lot of emission. At three feet this light is 30,000 lux or 3,000 foot candles which is pretty much brighter than anything else on the market in the led range and really starts to rival the hmi's for output. I'm going to continue playing around with this light getting the most I can from it and discovering how you know a ridiculously high quality small unit very transportal led can be used in a whole bunch of different ways. That is my look at the digital sputnik DS1. Thanks very much for watching leave your questions in the comments and I will see you next time.


and Schumacher, civil defense. So police are highly trained. This is something that I hear a lot from the civilian disarmament camp is that you know the police can have these weapons or have this type of weapon or whatever because they're highly trained. So they deserve the guns and they can have the guns but you as an untrained civilian you know you're not qualified right it's basically the line of the line of reasoning. Well I think that's interesting because I read this article today which I'm going to link it below and it's an article that's on a police website a pro police website called police one and the interesting part is is that it goes through this study that was recently published on how the the hit rate for this department that they studied which I think was the Dallas police department and this is no slagon on the Dallas police department this is just you know the study found it was over a period of like 50 years I mean it was a very long study and uh what they found during during this this study is that the hit rate the average hit rate was somewhere between 22% and 52% 22 to 52% of the time that officers shot at somebody they actually hit the person they are trying to shoot at which means that give or take at the at best half the time you're missing one out of two bullets is not hitting the bad guy you pull at your gun you shoot at a guy six times three of those bullets goes god knows where right and the the article goes on to talk about how this can be generalized other police departments and like I said you can read it for yourself but I just think this is super interesting so you you always hear this thing that police are highly trained on average a police officer gets about 16 hours of firearms training a year okay that's a two-day class that's what that is they get about one of those a year on average so when it comes to this line of police officers are highly well trained I just I'm not buying it I haven't been buying it for a long time and I'm certainly not buying it the more information that comes out right the police officers god bless them they have a tough job to do and I wish them all the best and I'm not making fun of them or coming down on them at all but I'm just saying the facts are they're hitting their target at best 50% of the time but these are the people that they call highly trained and that are allowed to carry the guns and you're saying I'm not now if you're a citizen and you're watching this and you think that you can hit better than half the time when you're supposed to now granted maybe you can't because there's a lot of different factors at play here okay someone might be trying to kill you and they might have a gun and it might be dark and etc etc etc there's all kinds of circumstances and you will fall you will not rise to the occasion right you're going to fall to the lowest level of training that you have meaning whatever the skill is that you've mastered that's how you're going to perform that day if you're like yeah I can do my draw when I think about it your draw is going to fall apart that day right if you're like man I can I can really shoot at 50 yards and are ideal conditions when I take all my time in the world you're not going to be able to make that shot today right like you're not you're going to be on adrenaline which is based like being on drugs you're going to have a lot of issues right so your accuracy is going to come significantly down but my point still remains the same which is I believe that you as a citizen as a responsible trained citizen can do at least as well as a police officer can there's there's no difference between you and them after all you're both human beings this whole line of police are well trained only they get guns is complete complete trash and we should not pay that any mind and we should be quick to just get rid of that hogwash okay you can brush that one aside that's not a valid argument in light of facts and reality the second thing is let's all be better if you're watching this and you're a citizen civilian if you're a police officer if you're in the military let's hit the bad guys and no one else right only hits count if I pull up my gun and shoot 10 times and I miss the guy he's still trying to kill me because I didn't hit him with any bullets so let's all shoot better let's all train harder let's all train smarter and let's get really good at this so that these things of 50 percent hit rates are a thing of the past and we're at a point where we care about where our bullets are going because we want them to go into the bad guy and not into the six-year old that's on the playground that has happened to be in the wrong place the wrong time five blocks down right that's not what we want to happen nobody wants that to happen do brave deeds and endure


How's it going guys know from kicking their best TV here with another video and today's videos are my tackle grab unboxing for the Month of March. I'm done one of these in a while. I actually have Subscription of them on your ground, but I've been really busy my big company with tournaments tournament videos A couple of them came with us alright comment below if you want me to start making some tackle grab unboxings or mystery tackle box I'll be sure to get a membership with them if you guys want me to if you guys want to see this I'll do that. So first thing in the box is A little booklet and it tells you everything that's in the box There's four things in the box this month gives you the prices gives you the details on brand name everything And the first thing in the box is a striking spinner beat. This is white and has a little bit of red I'm actually really like these I fish from a lot cost them good fish on Just slow rolling on the bottom when you're going to knock that rock or whatever structure you're fishing Most of the time are fishing shallow or you can throw it up in the grass and stuff like that I'm really good bait. So it's got a lot of fish on that Highly recommend it second bait is by sub bill and this is the magic swimmer and this is pretty much in a bone color White and I actually have a lot of luck on these. I use these a lot I'll use two swim baits and once my swarm of horny lures in this one by sub bill and During the summer on the near when they're on that swim bait bite. They're just crushing the shad and everything We're steaming those using my river rocket just steaming the swim bait. That's a really good bait I actually use that a lot and I'm really glad they threw that in the box because that's about $14 itself Next bait in the box is a seven inch ribbon tail by gambler This is green pumpkin and I actually use a lot of gambler baits. We have a linear tournament last year I believe it was around April and we're bed fishing and stuff and you could only use gambler lures It was pretty neat. I believe there's one this year too I'm going to definitely be fishing it if there is it's gonna be a lot of fun So you only have to use gambler baits. We're bed fishing And that's where this bait came in the hand. This is the little baby cricket This green pumpkin with a little bit of red flake in it and I actually use this one or bed fishing And it worked pretty well, but I saw I got pretty much familiar with a gambler baits is I Start fishing them during that tournament and pretty much how to fish a lot a lot of their styles of baits Really enjoyed it. That was a fun tournament as well So that's everything in the box for this month for talk of grab unboxing for the month of March I hope you guys enjoyed this little quick episode Definitely go check out my social media sites Twitter Facebook Instagram and obviously YouTube I'm subscribed and like the video comment what you think if you think I should be doing some more of these comment below Like I said go follow my sites on social media sites Instagram just hit 20k really excited about that Thank you guys for all the support. See you guys next time


يقوم بأسرار من الشخص و إستطاع أن يكونوا أخذين قرآن. الرجال قوامون. من أسرار الممتعين. هذا ليس مقلل من القرآن. لا لا لا لا تحرن. أنا أسرار مجلس. صلو على محمد و آل محمد. صلو على محمد و آل محمد. إذا بسرار الممتعين يقولون أن أسرار الممتعين. لا. في تلك المساعدة. أنها تحويل كل شيء that came in her position. حتى عندما كانت تتعاق. و كانت تخبرت. يا أخ تهارون. ما كان أبو كمراس أو إن. و ما كانت أمك بغية. كل أخيه من هارون. ليس هارون the prophet. يعني هارون. نعم. يا أخ تهارون. ليس the prophet. but in line of the fact that they are holy personalities. و أخكه كانت محمد. و أخكه كانت محمد. لماذا تقوم بأخذ. هل أنت أبكو. هل أنت أخذ. لا. أنها تحصلت و تحاولت على المساعدة. الأخيه من شعيب. ما هو نظر الأخيه من شعيب. أخوة شعيب. أخوة شعيب. أخوة شعيب. لماذا كانت أخوة شعيب. أخوة شعيب. أخوة شعيب. أخوة شعيب. كانت أخوة شعيب. هل كانت هنالك الغيب. أخوة شعيب. أخوة شعيب. هل كانت، هل كانت؟ حسنا، لم أفهم أن أحاولة لا يعمل. لم أفهم أنها تكون لتفكير فرصة. أو أن تكون لها لطبق و قراءة. و نحتاج إلى مجموعة. نعم، يمكن أن تكون في حرامتراسه. من تعرفها و أن تبقى دلتها. في المرحلة المقلقة من مالذي يقرأه ومالذي يقرأه بالقرأة كانت تذهب، she worked she knew she doesn't have to mix with the men she used to take and herd you know she was a shepherd one of the most difficult task to do you know to to to be a shepherd of you know she took them with her sister came across upon the water men are watering the herds and cattle or sheep she stands aloof with dignity and honor you know but she's working then she observes Musa coming with respect see we need to raise the level of respect when it comes to the question of interaction between men and between women and men we need that we need it in practice not in theory right in practice so he comes gracefully he said I see that you are taking you know a side pass she said yeah لا نسقي حتى يصدر الرعا we do not water our herd and tell the other shepherds move away he said can I take your sheep and I the story you know it now here the crux the girl goes back الله أكبر look about independence at its best decision making at its best imagine if your daughter comes these days he says بابا I want to talk to you خير what is it can you just come down please first I'll make you latte okay can I make you a cup of tea what is your favorite drink dad you know what is my tea كارك okay she goes makes him sit I met نعم she hasn't finished but give her at little talk I met a good man for marriage يا مصيبتي what a disaster why what have I done in my life is this the way I raised you I must have done something in my life that he gave me a daughter like you that she has seen a man for marriage يا الله وى مصيبتا right وى مصيبتا yet the daughter of Sha'aib comes and she says he says you came early home today said we met a very good man he wanted our sheep for us يا أبا تستأجر oh dad هاية him إن خير من استأجرت القوية الأمين oh my dad هاية him the best of people you can hire someone who's trustworthy and someone who is good trustworthy has the six pack good you should قوية أمين right شعب straight away he says call him so she goes she calls him gracefully he said straight away what is that what is she telling him that mousa is married material or not she's telling her dad mousa is married material he straight away understood he's a prophet he knows he knows he said أوري straight away سلام عليكم موسى وعليكم السلام without formalities إن أوريدو أن أنتحك أحلى ابنتي I want you to marry one of my daughters mousa says excuse me he said yes my daughter likes you يا ساتر يا الله شخ جهاد is going to be deported tonight tonight this guy is a danger in our community in our society get him out not my word Allah's word Allah's word right إستجر هاية him he says yes I'm willing because he knows she's a decent girl too she's a very good because something happened on the way that the air or the wind blew her dressed somehow and she was directing he said for God's sake walk behind me not walk behind me because she's lower than him because he doesn't want to leave room for shaitan he says now you tell me where is the direction turn left turn right so he knows she's a good girl so she's going turn right turn left this is the house what a decent girl amazing yes I'll marry her I'll marry her not only I will marry her and I will honor her شعيب says her maher is that you serve me for 80s ان تأجورني سمانية حجج موسيس said no no no what is 8 حجج no no I'll make them 10 huh don't ask for the dowry of your daughter if she's worth it he'll give her her heart don't raise it if she's worth it and she's worth it he will give it just like موسيس said he said no 80s is too much it's too little I'll give you 10 years huh حجج he raised the dowry he raised the dowry right then another example أسيا why أسيا أسيا because she was in an environment of total corruption الله أكبر maybe you need to read the مسيب by yourself brother شي اسمه tonight honestly I didn't realize the time but I this is very important أسيا in the midst of corruption in the midst of corruption right in the midst of corruption أسيا بالقيس oh now the crux بالقيس head of state head of state you cannot get any higher in position than that head of state queen of shepa look what زمخشري said زمخشري is an interpreter of the Quran he says she had a council of advisors working under her all of them women so she's the head of the state the rest of the what is the number of her advisors listen listen to this number I was shocked والله العظيم I was shocked 313 advisors الله أكبر the same number الصاحب العصري was زمان the supporters by the way there's a رواية in Al-Kafi that says among the elite of the advisors of Imam Al-Mahdi عجل الله تعالى فرجو شريف 313 men and 57 women the elite not workers not workers advisors the elite 313 men and 57 women in positions of leadership


The last talk for today and unfortunately it means we are coming towards the ends of first time So how many of you have been to post MPG day, which happened on Friday? Awesome. So if you haven't heard before we every year just before first time we organize post MPG day One day full of postgres if this is not enough for you And then just just just just visit post MPG day dot org for more detail. So we will be here again next year So the final of talk of today is from Ilya One of our most famous speakers in the community So he's going to speak about the latest evolution of Linux audio stake explained for the database people not hackers Thank you, Debra Hello everyone That's a last talk my congratulations. You pretty much survived this Which is good sign probably the bedside that as last talk after Almost three-day marathon it would be about boring Linux things But I tried to do that Not that boring probably And well the main problem with such talks could be that you need to cover too many things like You need to explain how database this works How postgres works for example, then how Linux works and then how it comes together So I try to solve this Not easy task Let's go. So why we stalk first of all Linux is quite important for the databases I would say today is actually the default Operating system for database use for a long time. It was not like that Solaris HPX sometimes Windows Many operating system are used for databases now actually like it works usually an open-source word many even commercial database companies investing in Linux to achieve the better performance for their database and postgres regret to say maybe for 3bsd project of from open bsd project now Somehow aimed just to improve performance on Linux not because those operating system are Worst but because well Linux is what people want to run postgres and Send the central thing for database workload is fast. I or because you know sometimes We are running to CPU problems. Sometimes we run into this and that but well If we have intensive workloads, I or most likely a common problem Which we need to fight with well Another problem is then you try to figure out what to do with Linux and its iOS tech to improve your postgres call mysql performance for example is that You can find some posts on Linux network some emails into some mailing lists like postgres hackers or kernel mailing lists and all the information you can find there is actually made by developers and the language like they use Requires a lot of knowledge and it's written basically for kernel developers. So not for database and That task I tried to solve I tried to Get some clue in which Direction you need to go for a Google for to dig for information and another problem is Actually that Linux iOS tech recently redeveloped quite intensively because for a long time it was Really lots of problems inside the Linux iOS tech Different other problems which kernel developers need to solve. So for a long time it was like nothing happened nothing happened and recently during the Developing cycle of version 3 and version 4 and now version 5 It's really everything changes and wall systems overhauled etc. So What we are talking today about Very brief introduction Especially for the first line how postgres work with disk and Then slightly historical part What was in Linux with IO in all good times of old kernels and Then brief introduction what was new so basically maybe you will not have the complete picture after this talk But at least you need To put down the keywords Where to find the information after that so a very typical database based on these two Things you will guess that this typical database is typical postgres code database works in With a kernel space with the kernel memory the page cache for kernel buffer And it works with the user space its own shared memory segment So Linux takes care of this part and database code takes Care on this part and basically the same idea this page model is For many years here, and that's very convenient then you read some information from the disk you just put the whole page in memory and then if you Change If you do not change something. It's quite easy. It just like modern in-memory database. You just can read Some information return is it's a select but when it comes to updates You can mark some of the pages as dirty pages and then the are your problem starts usually so if you update something you need to write write the head log and Actually at some point you have your information about your recent updates in your right ahead log and This memory snapshot is inconsistent comparing to the disk image so from time to time you need to issue the nightmare of any DBA especially ten years ago The checkpoint and all the dirty pages are going down To the disk and that's that are your problem. You usually hit So basically if you had only read workload, that's not that bad then you have writes That's probably can be a problem for you If we are talking about database because we can talk about full-text search about file server for Database for a very specific key features for It's workload shared memory today Well, could be defined with The prices of RAM and then I started to perform talks about how to tune Linux for postgres I used to say well now 32 gigs of memory are cheap Some people start to love because it was quite expensive at that time Now actually I would say that one terabyte of memory is not that expensive so Basically, you can have a lot of memory on your database server and you need to use specific settings and well Linux and Database your database your favorite database all possible. I hope should adopt to to that So it can be really a lot of data and then you synchronizing those pages This huge amount of data travels down and up. So basically Here's the IO problems Besides of that, there are different things with IO which can be not that bad like Checkpoint spikes, but well, they can be still troublesome like right the headlock should be Written quite good that have some limitations on copyright file system sometimes and well Pretty much every point of this is tech should be optimized for that exactly type of workload then we put loads of dirty pages down to the discs What generates most of IO problems in postgres as I said this Page synchronization when we need to write a lot Besides of these auto welcome can be sometimes troublesome, but well it It depends of exactly how your workload works Sometimes cash refill can be bad, but well today many of you. I'm sure using SSD SSD disks, which is much better and sometimes you can have lots of problems with normal postgres workers With their IO, but this is out of scope of this talk and basically I can say then your ordinary Postgresquail processes performing some IO operations That's generally bad and you need to avoid that like those processes. I'm not designed to Make checkpoints for example if they trying to Dump the dirty pages to the disc that means that actually something Is quite wrong in your database setup. That's an emergency measure. It's not like normal process So for a long time for databases them Huge problem was how to maximize the throughput This word throughput was quite common for all talks about database performance in terms of IO and well Then you're talking about throughput from the user space from database to to the disks every part of this stack could be involved and Most likely we were talking about throughput because This part of the stair a stake of the stack was quite vulnerable The disk was low. So because the disk was This work quite slow a lot of affords and time of developers of linux Journal of postgres were actually concentrated around how to maximize throughput in the rest of the this stack because Latency of the disk was quite high. We need to move the heads on the disk and so on Which could not be improved And most people were looking on these not on these but technology actually don't stay in one place and Some evolution actually goes on and the station change Why I actually concentrate on throughput and latency If we have like so complicated is stack It's actually sometimes easier to maximize throughput like Using parallelism where we can the typical example of this well not Correctly parallelism, but some helper process was like then postgreSQL checkpointer cannot manage of the Checkpoints the dumping off all those dirty pages postgreSQL people come up and invented the Background writer so between checkpoints. We can use background writer to help checkpointer That's a typical example of Maximizing throughput because we could not minimize a lot and say any more Because yeah minimizing what and see is quite tricky but now the situation changed and now we have SSDs which probably Do not make the Dba job absolute but they can actually reduce this latency component in the iOS stack and We will system need to be adopted for This modern situation So Because of high latency of rotating disk that's some historical part There was lots of afford how to improve the performance of this stack in terms of throughput and You know probably all these recipes like you need to tune VM Dirty ratio and those things That was the times of Rotating disks as well as better back cash and things like this So This is like the Dba task to turn those parameters and so on but inside the Linux kernel There are lots of internal optimizations like that We're using SSDs, but the methods inside the Linux kernel are designed to move The heads on the disk efficiently, but SSD has no heads Basically, and it is a much more parallel aware thing compared to even disk array so This is an IS stack We can use direct IO we can use page cache in terms of postgres we use page cache But we need to go through all this stack Well file system that's nothing interesting here probably, but there are lots of benchmarks about this There are several approaches how to improve file system performance for example do not use write barrier on x4 But we actually look deeper into the kernel In the kernel there is a so called bio layer or block input output layer And the task of these parts of the kernel is actually to form input output request so this is basically biodesy structure and We take those blocks like like in database practically And we form some vector of those blocks to put it finally to the disk The interesting thing here is that We operate pages inside our database and in user space And on the disk on the old disk we are operating with cylinders sectors and those rotating things Heritage which was quite obvious than people were programming those sd driver scasi and so on and These part of the Linux iOS tech was specially designed to make some smooth and efficient transition from the pages to the cylinders sectors and those old-school things with rotating disks Then we actually form the request which goes for Ior and Instructs driver like put this piece of data there and so on We can optimize the input and output in some way and basically for a long time all this optimization was about where we store this data if we can Just dump this data to the disk using single movement of the Disc head that's efficient. So all the optimization here was based to like merge and sort these vectors of blocks to fit to the disk if they for example can be stored together And that's why emerged this idea to have an elevator or Ios Kedler which can actually help with sorting of all those pages and Putting them to the disk in most efficient manner Before the kernel 2.6 quite old time There was it just a single elevator so-called Linus elevator And well, it was like many things which Linus made himself Considered as a perfect thing very simple and very good working but in effect Nobody just cares if it works. So it's just It does something if it does that efficient nobody knows we have disk latency and well to optimize disk latency It's difficult physical limitation, so we just use something And this type of elevator had lots of problems mostly because It doesn't fit the job even for rotating disks, but for modern disk that simply wouldn't work Starvation of then you Then you write some information you need to read information from another part of the disk and cetera, etc So lots of problems between kernel 2.6 and early versions of Third kernel some people come up and invented some different schedulers but actually inside The logic of those schedulers there's still pretty much some improvements over the old Linus elevator The first of them more universal and more typical was like complete fair queuing the idea behind this type of elevator is like You have processes and for each process you provide input output queue which Basically provides fair access to Input output But when we have postgres just imagine how efficient it would be for example You have some connection to the database and they have some percent of IO When we have auto work on process it basically have the same access to the IO then we have check pointer and It has the same access to the IO This is pretty much not very efficient because for check pointer we need a lot of IO for a normal Postgres core process which performs on select. We probably do not need any IO at all maybe just takes the data from the cache or just Handles the connection of the DBA Which is idle so we don't know so for a specific workload like database This scheduler was always not that universal not that good maybe for desktop environment. It was better Then emerged the deadline scheduler deadline scheduler was like some sort of Improving the the idea for improving the situation Basically, it has two types of cues like cue for reading cue for writing and it just starts to read or to write but all the requests are actually tagged with timestamp and That timestamp allows kernel to figure out if this request timeout it or not and if it is timeout it like we have huge amount of Information to write it takes long time. We hit the timeout Then the kernel changes the priority of this Queue so basically If we have a lot of input output finally it would rise in priority and Work more efficiently It did it actually for rotating disk with normal rate controllers. It was much better than CFQ but still not perfect and well especially not perfect for SSDs and Some people come up with idea of no op or none scheduler for devices which allows much more parallel Execution of IO like disk arrays SSDs the main difference is like they allows much more parallelism and This idea was like basically this scheduler doesn't Change anything it doesn't perform Merging sorting things like that. It just do nothing. So it's like placeholder for a scheduler and it was turns out it was much more efficient for High parallel storages in compare comparing to other two and Probably at that point or slightly earlier and many people started to work on real improvements of IOS tag and now we actually hit Some terminology problems because As you remember on that diagram with Stack There was a IOS scheduler, which was some part of the kernel working with request layer There's lots of discussions if we need to improve this but finally Linux developers came up with idea that we need Substitute practically a lot of these so basically not only substitute the wall request wire and add some Elevator here, but adopt the device driver to work with a new analog of request layer and Probably change many things here so after the New approach emerged We practically have new input output stack Part of this is in VME or normal to memory Driver and part of this is so-called bulk MQ which is the scheduler and The request layer Simultaneously and now it actually has some new schedulers inside Because of effectiveness of this knob just the idea was we need the IOS scheduler which is initially designed to Support lots of parallelism First this thing was introduced in 3.13 and I think the latest version was merged into the kernel 4.10 together with in VME so before that it was not that efficient, but you can probably Run into it and probably use that together with late third kernels If you use in VME Because in the me It says that it's not but basically in late third kernels. It was in VME In spite of what you can see in your grab or whatever So idea is that SCSI is Not parallel and you cannot scale your input output requests So basically if from user space postgres with fsync in checkpointer you initiate the right Request it goes straight to the disk driver whatever you have Beneath And this is a problem basically because you issue input output request it doesn't scale it basically goes through the hardware How to improve those things the old approach to elevators was like we have a CPU a Q and the disk and that's just straightforward. So we basically go through and If we are busy we are busy then At some point There were some special cues for single process for example, which tends to be slightly more effective, but still not the game change for bulking queue approach was that it basically Paralyze these queuing and now in Linux we have for example CPU on human node Which has each? its special software query and through this software queue we can actually put a lot of input output and In this software queue you can do any optimization like tagging for specific processes of a specific virtual machine like Sorting merging things like that which tends to improve the performance of input and output and then all of those things I ended up in Queue in queues on the hardware and in case if we have an SSD we usually have more than one Hardware queue and this is much more efficient. So basically we got the parallelism on the Level of request layer. That's why it's substitution of request layer not the just Scheduler which works aside So basically Then we rebuilt the this part of the stack People start to think that we actually need another scheduler But the scheduler which can be aware of Modern SSDs Currently there are two major schedulers for bulking queue and VME Aware kernels newer kernels One of them which is more complicated and some people Tend to compare it to cfq is bfq or budget for a queueing the idea is It has some math behind which allows To figure out that we have of these input and output budget for this application for this device and based on this budget it actually Increase or decrease their priority for This input output. I wouldn't say it's quite efficient from my observations. So it's Complicated, but well it works The keeper is a different approach is just like a very simple scheduler which tries Not to Mess up with lots of mathematics around here with merchant sorting and things like that Whichever you prefer I have actually no recommendation right now because it's relatively new thing I would say that actually use the default with your current Modern Linux kernel most likely it would work better so From my experience there is no such drastically changes comparing to Like if you use deadline or no op on SSDs. So basically Not that important After that we have in VME driver and then sometimes we have improved Parallels cousin driver for that There is a good upgrade the ball which Maintainers keep current diagram of Linux input output stack You can take a look and figure out Much more details when I can put on the slide It's basically not that up-to-date about bulk impu, but well actually It's up-to-date like for two years ago one year ago So basically it's fresh enough to figure out what is going on and I hope the guys will update that soon What is actually in the EME in the EME it's not just a driver It's a set of standards for input output drivers, which is quite good currently and well We all appreciate that finally Major producers did that For Linux it's just a driver and set of standards how other parts of the stack interact with Ios Kedura For Industry now it's actually the new standard which is under construction. So basically We have only in VME currently working in stable for Local disk if you will put something into PCIe that works perfectly well fast and so on But there are lots of work to make this real for fiber channel for disk arrays And that's really a future because there that part needs lots of parallelism too So currently industry works on in that direction and results are quite good. So stable now is version 3 of this standard and the already Pre-production version 5 can basically allows more than 32 gigs per second for One channel of Fiber which connects you to the disk array. So it's very impressive disk performance. I would say But the next problem is like with that latency change Do the other database actually aware of that development and is it Okay, just to put the database on this extra fast storage Would it use that good? I would say that's actually a difficult a difficult question and We still for example in Postgres have no Real parallelism in bulk input output operation So basically we have a checkpointer, which is not quite parallel and we have a background writer, which is non-parallel and That's it. So basically The improvement of current storages are all based on hyperalysm store in storage and well the database Cannot handle this. So probably It should be a lot of things improved before we can actually benefit but well If you move from no op to modern kernel with bulking queue I saw the performance improvements like four times So it can be actually quite good quite good for you, but I'm not sure because I don't know your workload so well Situation could be improved. Maybe not so drastically like Excited developers on NVMe reporting What's the latest things in NVMe and Bulking queue during the development cycle of kernel version 4 The first thing was IOP pulling IOP pulling That's an interesting example For a long time the idea was like if you form an input-output request You send it to the disk and then this driver takes care about the results so you have an IQ and you handle it then the operation of IOP ended and then you return to the kernel to the user space at sound for Low latency disk This is actually not very optimal because you need to wait for the Interrupt and this is a long time probably your operation will end up sooner and you will have a huge overhead Immediately come up the idea of pulling So basically then you send the right request through the stack to the disk you can Constantly pull Your device and figure out if it finished or not and because SSDs are quite fast We run into another problem on this polling you can actually Spend lots of CPU resources and your CPU is busy and well your database is not happy so after the first naive approach Their so-called hybrid polling was introduced So basically current idea is that you send to the right request and at some point you pull the device and Try and figure out if it finished then you'll sleep for for a while and then you actually Pull again and most likely it would be much more efficient than wait for Interrupt so that was a huge improvement of performance of bulk imp. Q and NVMe together There are no new schedulers like bfq ecuber for 4.10 or 4.12 here, I think 4.12 is much more correct Iot taken was introduced so basically you can move the request from one cue or to another cue and based on those texts you can Manage the priorities of input output that was specifically good for Virtual machines, but I think actually for Databases it can be also quite useful because different processes have different IO profile And besides of that there are some direct I.O. improvements in the NVMe Connected to the internal optimizations of SSDs and A final small note on the direct I.O. because we're talking about databases. We are that's PostgreSQL the room and well, that's a question people constantly ask What is the current situation with direct I.O. in postgres and why not just? grab all the source and Open every file before direct that's simple why you don't do this So currently postgreSQL doesn't support direct I.O. for Anything useful in production. I would put that in that wet way So we basically can use direct I.O. For write-in-write headlock, but here's the problem and explanation why postgres Do not use that for something useful If you open the file with or direct you need to work with this file exceptionally with or direct because if you open the file with or direct and then I don't know archive command or Something like pgdump or something like this handles will Handles this file without or direct you will have a problems Most likely some crush or something like this and if postgres Works just like a standalone database that's okay to Write write a headlock with or direct, but if you enable replication you probably will have an archive command which is in postgres can be like Just bar script or something Completely unaware of how you open the file and Well, you will run into the problems and because of that Postgres automatically switch to Buffered I.O. for write a headlock if Even if you try to use Direct I.O. in this case The main problem from my point of view is that Direct I.O. is very little specific thing and you need to invest lots of efforts to Introduce and maintain Platform dependent Code so basically even if postgres go community will agree to do this that would be Like not easy task because you need to write lots of code specifically for Linux and Generally postgres go community is Not quite easy about Bringing into the project very always specific things well General direct I.O. maybe is the best solution we have now in spite of many People talking that it's not quite good In terms of implementation and so on That's well, I think finally postgres will move towards this direction Because now is like basically the only classical database which doesn't use that. I don't know actually It actually is good idea if we try to figure out if Linux version of MS SQL server uses that But well the only exception is MS SQL server for Windows because they do not have direct I.O. MySQL uses oracle uses DB2 users So that's all about direct I.O. and all about Recent Changes in Linux tech and if you have questions, it's time to to ask them Thank you Question In your talk you described only like bare metal implementations of post SQL Which means like private cloud private cloud where you can negotiate certain things with a provider and the public cloud has certain Has those Things inside of it, but it's kind of totally in different way. Oh well. I would say that Most likely they all have the same things inside because even if you deal with the public cloud They have serious problems with improving performance and I don't believe they do not use this Achievement of Linux kernel, but with public cloud Basically, you can never be sure what exactly they do and that's a part of the game but With so but it stops being being the postgreSQL problem. It becomes a question of choosing the flavor Well, I still believe that many people use private cloud cloud or bare metal installation Actually, and for them it's problem so well We are not talking about maybe private clouds here, but for Public clouds here, but for private clouds, it's still a problem. You need to tune your Linux You need to figure out what's going on So basically many many of those improvements were actually introduced for Private clouds like but so a little bit on that So the thing is you are provided with virtio BLK device in case you're lucky you might negotiate virtio BLK mod With multi queue support. Yeah, but it's still different from what you described because virtio BLK device is not SSD or HDD or NVMe. Yeah as a thing on its own Yeah, well, I wouldn't I would say that the idea of how to improve performance of postgres on Virtio IO on any virtual IO it's quite different problem because for example here We're talking about the locking of parallelism in the Linux kernel infrastructure to handle SSDs That's one problem, but if we talk about Virtualization for example immediately emerged the problem of unstable latency Which is quite different story and well, it's outside the scope of this talk It's also the problem and quite serious problem, but well, it's it's a different story Yeah, thanks Thanks for the talk Have you seen much demand or traction for open channel SSDs and if so like how far out do you think that might be? Well, I would say I have heard about that because I was interested in the topic, but Regret to say I did not see that Much in production because well my primary job I'm working for the customers and then the customers running databases They tend to buy good SSDs and use vendor-specific things for them That's it just real life, so I will quite appreciate to have some feedback if someone use and well I I will take a look at it Any other questions, please In just in your last slide you have atomic flag. May you give some details about? Atomic Well Some SSDs have Another option or atomic which is quite useful for rights But the problem is you cannot use or atomic without or direct So basically you need to use or direct to benefit from such low-level optimization forces this But will you support it for any? block size 16k 64k or only 4k I Don't know to be honest because well postgres doesn't support that I don't know And what is the smallest block for direct to you? Acceptable just speak about blocks, but you have five system, right? So even you write one byte it will be still 4k today. Well Postgres operates 8k if you don't recompile it so basically I can bring benefits on that block size and Basically, I believe it also will bring lots of benefits on larger sizes of the blocks Because well the whole mechanism was introduced partially for Databases and many analytic databases tend to have a larger block size Okay, and any plans and we don't need to call it sync when you use direct tail because right now it's It's a different story It doesn't depend basically postgres heavily relays on fsync I don't know if you probably visit Thomas talk Yesterday, yeah, I believe you About fsync problems. You will see that basically all mechanism is about fsync. So basically it's like post-extended as We understand that and Anyway, you know you need to issue fsync But why if you already own on all direct so 20 years ago Solaris use it all directly without fsync So why lean and still you need to think It's a good question Yeah, probably we have several right persons to answer that low-level question Yeah, the reason is that there is a development cost of implementing direct IO on all operating systems So we don't have the manpower to do it yet. We may next year or the year after that, but that's the only reason Thanks a lot. Any other questions, please? So thank you. Yeah, thank you


Hello. Thank you for the opportunity to talk today. As I understand it, my role here today is to talk about what the field of meta science is and how best to grow the field. So to start off with, here are a couple of definitions of meta science that are in current circulation. The scientific study of science itself, the science of doing science. The risk of starting the talk on a sour note, I'm going to say I don't like these definitions very much. I don't like them because of the way they hide behind an appeal to method. I think the appeal here is meant to be to a quantitative and objective method. And my suspicion is that that is in itself an attempt to differentiate meta science from other disciplines that also study science, like the philosophy of science or the sociology of science. And I understand the motivation. It's not the attempt to demarcate our epistemic community from others that bothers me. Here are some more definitions. Research on the scientific process or the study of scientific norms, practices and cultures. These definitions do indeed describe meta science, but they equally describe philosophy of science and sociology of science too. And if meta science is to be distinguished from those fields, and I think it should be, then we need to add something to these definitions. But what we need to add is not an appeal to method. We've already heard from Samin Vizier at the start of this forum about some of the ways in which appeals to method fail to do the job. Plus, it's just kind of intellectually empty. We all know that there's no monolithic scientific method that we'll narrow going to follow in some sort of meta way. It's a promise that we simply can't deliver on. Most still is that definitions that rely on method put limits on how our meta science community should grow. Because these definitions only invite scientists into the program. And that simply won't do. We need ethicists, philosophers, librarians, sociologists, historians and more in this meta science enterprise with us. So to finish off these definitions, the study of scientific norms, practices and cultures, to finish them off so that they capture the work of the meta science community, but without appealing to method, I suggest adding the following phrases. The study of scientific norms, practices and cultures in service of science for the purpose of intervening and improving science. So what differentiates this community from others is not our methods, but our goals. We seek to correct errors, fix structural problems, improve credibility and public trust and so on. In contrast, sociology and philosophy of science describe and deconstruct. They are rarely prescriptive or interventionist. So now it follows from this new definition that there's a greater burden on us, meta scientists than there is on other fields, to understand our end game. If we're doing more than just describing and cataloging problems, if instead we are intervening in the service of science, then we had better have thought deeply and extensively about what better science looks like and how to measure progress towards it. We had better have an evaluation and monitoring research program. We also carry a responsibility to very carefully distinguish between means and ends. Means like pre-registration and replication and ends like accountability and trustworthiness. If we end up mistaking the means for ends in themselves, then we'll lose sight of how to make appropriate interventions in different contexts. We'll limit our ability to be able to find the relevant pathways to our ends in different disciplines. Another nice thing about this new definition is that we can quickly make it more inclusive by substituting science for research. So I guess the rest of this talk is really about the purpose and the scope of meta science. Meta science is a field whose primary responsibility in in my opinion at least is evaluation and monitoring. We evaluate and monitor open science initiatives and other interventions to improve science. We evaluate and monitor the impact of institutional reward structures and resource allocation methods. And we evaluate and monitor peer review processes. Both current operations and proposals for alternative models. This is not a comprehensive list of course but I think it does cover most of the current activity in the field.  For example we ought to be running evaluation and monitoring programs for recommendations to improve statistics communication or proposals for improving methods education. If we make claims that Bayesian statistics or estimation or whatever it may be will improve our scientific judgment or speed up the progress of science then these things need to be on our evaluation and monitoring list. And all of this work is underpinned by the exploration of essentially contested concepts and by the labour of self-correction and error detection work. Later in the talk I'll explain those things and I'll talk about what happens when we don't make space for this under labour and what happens is bad. So running through all of this is this recurring question of where should the work be done? There's meta science work that perhaps should be done inside of primary disciplines in psychology, in medicine, in economics itself. Then there's other work that's perhaps best set up outside of those disciplinary homes in the way that sociology and philosophy of science sit outside the disciplines that they study. And then there's a work that requires interdisciplinary collaborations. And everywhere there are constant tensions, tensions between disciplinary relevance and independence and tensions between wanting to learn from other fields so that we don't reinvent the wheel and then the risk of overextending those lessons to places where they don't belong. Now I'm just going to quickly run through some examples of these different categories of work. This is a library of all of the articles that have ever been assigned an open science badge. It's colour coded by the badge type so you can see when an article has a pre-registration badge, when it has one of the others or when it has all of them. So this database now provides the infrastructure for several evaluation and monitoring projects. We can ask with it, we can ask questions like are articles with open data badges more likely to be computationally reproducible or are pre-registrations typically followed? Is there noticeably less p-hacking and cherry picking in articles that have these badges? Evaluation monitoring sounds easy but of course it isn't. First there's the problem that most initiatives are introduced without a time frame for evaluating their success. So it's the first round of articles with pre-registration badges aren't discernibly different from unregistered articles. Then do we give up on that intervention? That would seem wrong. We know it must take some time for people to learn the pre-registration ropes. So instead we keep monitoring and we make decisions about what a reasonable amount of progress is for the time that has lapsed. And if improvement doesn't come in time then it's the meta-scientist's responsibility to determine the next course of action. Do we need more education around the intervention? Do we need stronger incentives enforcement at an institutional level? Or do we abandon this program and start another one? In one of our projects we are investigating the open data badge specifically and we look at whether articles awarded this badge do in fact provide a link to data. Whether that data is in fact connected to the published article. Whether the variable labels in the data match the labels in the text. And whether we can reproduce basic calculations like the mean age of the participants and so on until we ask whether we can fully reproduce the whole thing. So we can with increasing levels of difficulty evaluate all of those aspects of computational reproducibility and in doing so we can measure the impact of the open science of the open data badge. But that all of that is really just one step. There are easier evaluation tasks like evaluating the uptake of the incentive. How many articles get open data badges over time. Then there are evaluation tasks like the one I just described for computational reproducibility. And then there are much harder ones like evaluating whether computational reproducibility is an effective means to improving accountability. We have to ask those more difficult questions to get beyond this to what else can achieve this end when computational reproducibility can't or when it isn't appropriate the research at hand. And if we skip that most difficult step then we're at risk of becoming circular or total logical of ending up with transparency for its own sake or to take a different example of ending up with research that's replicable yet trivial and uninteresting. Metascience also evaluates the impact of institutional reward structures. A recent survey by the Wellcome Trust found that 78% of researchers think that high levels of competition have created unkind and aggressive conditions in science. It identified creativity as one of the most common features of an ideal research culture but noted that three quarters of researchers felt creativity was currently being stifled by culture. And as Katie Corker's talk yesterday outlined there's a whole suite of metascience research questions related to the design, testing and implementation of new incentives and new models for distributing resources. I expect that examples of the latter like lottery schemes for funding allocation are well known in this crowd so I won't say anything more about this. The final set of metascience questions on my list focuses on peer review. As we know peer review carries so much of the burden for establishing what is trustworthy evidence and yet we really know very little about the practices that constitute it. In this survey of 280 journal editors across different fields we learned many things about journal policies and editorial practices. Things like how often journals run plagiarism checks or how often they employ blinding procedures. Another thing we learned is that many editors believe that it's okay to edit a reviewer's report. What does editing a reviewer's report mean? Well sometimes it means relatively uncontroversial things like editing our offensive language. 85% of editors think that that's okay so fair enough perhaps. About 40% think it's okay to edit a reviewer's report to take out the reviewer's identity, the reviewer's name. I guess maybe that's okay, maybe the reviewer signs their report but the journal has a double blind policy but it doesn't stop there. 20% of editors think that it's okay to edit a reviewer's report if they simply don't agree with what they said. Now I don't mean that they think it's okay to write their own statement saying that they disagree with the reviewer, rather they think it's okay to actually edit the reviewer's report itself to make it agree with their own judgment. Surveys like this help us understand what is going on behind the closed doors of peer review. They also help us gauge resistance to new proposals like open peer review for example and that in turn can help us think about what alternative models of peer review might look like. So one project that we're working on in this space at the moment is the replicats project, collaborative assessments for trustworthy science. Replicats is a platform for evaluating scientific articles. As the name suggests it's a collaborative group activity centered around evaluating the likely replicability of published research claims. Replicats is underpinned by the idea protocol so what we have here are just layers and layers of layers upon layers of acronyms and in this protocol reviewers first make private individual judgments about the research claim. They judge its comprehensibility, the prior plausibility of the underlying effect and the claims likely replicability. They enter these private judgments and their reasons or justifications for them into the platform and then after entering their own private judgments then the group members are shown the judgments and reasoning of other people in their reviewer group. So this provides them with information obviously but also with feedback for calibration. They can see how similar or dissimilar their own evaluations and reasoning are to other peoples and adjust accordingly. They then discuss these collective judgments as a group. They share information, they interrogate their differences, they explore counterfactuals and after the discussion there's a final opportunity for privately updating their own estimates. Importantly the process is not consensus driven. The quantitative or probability judgments that reviewers provide are mathematically aggregated into a final assessment and this aggregation can occur in many ways from taking the simplest average to using sophisticated models that weight based on the reviewers number of independent reasons for their judgment or the extent of their uncertainty as measured by the interval width they provide. At the moment the replicats platform exists primarily to predict replicability but now we're working to extend this into a more comprehensive peer review protocol and we expect that the advantages of this process over traditional peer review include the fact that it is inherently collaborative, that it has inbuilt training and calibration and that the feedback itself is intrinsically rewarding. It has a defined endpoint unlike many other interactive peer review processes which implicitly rely on consensus by fatigue and replicats captures quantitative and qualitative judgments in a way that encourages interrogation. It is transparent by design. So what's our monitoring and evaluation program here? The first phase of evaluation will occur through the DARPA school program where replicability predictions will be evaluated against actual replication studies. How to measure the protocol success is a more comprehensive peer review process is of course more complicated and that work will require collaborations with pre-print servers and journal editors. Now I said I'd return to this under labor and tell you about the bad things that happen if you don't do this work. These quotes are from James Heather's blog. James is a well-known error detective and self-pronounced data thug and here he's lamenting the fact that there is no in-case term for a scientific critic, that there's no disciplinary home for a person who investigates published science for demonstrable inaccuracy. This work has no name, he says. What happens when this self-correction or this error detection or replication work isn't named and isn't claimed by any field? What happens is that it ends up getting talked about like this. So it's no longer the legitimate underpinnings of meta science, it's no longer the essential labor that maintains science's self-correction mechanisms, instead it's a witch hunt.  We cannot afford to not give this work a name or to not give it a home, we can't afford these kinds of interpretations. Another part of the under labor of meta science is exploring essentially contested concepts. This is really important too. Essentially contested concepts refer to concepts where there's widespread agreement on the value of the concept so we all agree that fairness is good or in the case of meta science that we want to improve research quality but where we do not have a grip, what we do not have agreement on is how to recognize, use, measure or evaluate those concepts. So like linguistic ambiguity, vagueness or underspecificity, essentially contested concepts often result in the kind of arguments where people talk past each other, where they're using the same words but they mean different things. It's a bit like conceptual slippage, only in the case of essentially contested concepts things are often further complicated by the fact that these are evaluative concepts, they deliver value judgments and essentially contested concepts are everywhere in meta science. They're even in places that are obviously normative like in concepts of replication or evidence. So sorting through all the ambiguity, vagueness and underspecificity to eventually get to the value structure behind these concepts underpins meta science or at least it should if we don't want to go off the rails. This is work that must be collaborative, it must be done with philosophers and sociologists of science and it's why I think an inclusive definition of meta science really matters. We write this work out of the program when we employ definitions of meta science like it's the science of doing science. This work isn't science but we won't come to any sophisticated understanding of our purpose in meta science without it. I'll quickly finish up now by just giving a few offering a few ideas of how I think this field should grow. First as I've said several times now we need to define meta science as an epistemic community by its purpose which is service not by the methods it employs. We need to understand how evaluation and monitoring research works. We need to carefully differentiate our means from our ends to find relevant pathways to those ends for different disciplines and we need to importantly distribute the labor and the under labor so we need to fund meta science within primary disciplines and we need to fund meta science outside those disciplines in secondary disciplines like history and philosophy of science science and technology studies research ethics and we need to fund meta science through interdisciplinary collaborations. Thank you.


Good afternoon, I'm really happy to be able to be among these distinguished speakers and to go after Dan, which I think connects with what I'm going to talk about with you today, and that is trust, or at least ideas about what trust is and how it comes about. So we need a definition of trust, and there's many definitions of trust from economics, from sociology, from marketing, and trust is a willingness to be vulnerable. Now, why be vulnerable? Vulnerability is based on a set of beliefs or a willingness to believe certain things about the thing in which you are placing your trust. And I think these beliefs are really important, so I'm going to talk about them in the second. So one of the first beliefs we have has to do with the fairness of the thing in which you're putting your trust. So you believe that this thing is going to act justly, there's not going to be any discrimination related to you or your use or trusting in that thing. We talked about goodness, and not necessarily the nutritional value, but we're talking about goodness on the scale of right or wrong, the thing you're placing your trust in falls on the good side, the right side of goodness, right? Related to goodness is benevolence. Now, benevolence is the actual charitable act, the actual doing of the good thing. So we're talking about behavior here that's really important for trust or the belief. And I put strength and ability together because I think they go together. So strength, we're talking about the power to do a thing, and ability, we're talking about the technical know-how to perform the act here. But I think they go together importantly. We also have honesty that you believe that there's not going to be any deception related to placing your trust in the thing. Please note that the pictures may have nothing to do with what I'm talking about right now. So we also have predictability. And that is that although we can't see all of what the thing is going to do, we can forecast or we can try to predict what's going to happen when we place our trust in that thing, that organization or that individual. So we're really talking about a relationship. So we have a trustor and we have a trustee. The trustor places the trust. The trustee takes in the trust, right? So it's a relationship. Now, maybe more people in a relationship as well as you know. Now, relationships can be of two kinds. One kind is a symmetric relationship. So both sides are providing in equal ways. So a symbiotic relationship, both sides mirror imaging each other. But then there's the other kind of relationship and that's asymmetric. And that is one side has a different level of trust or value being placed in a relationship. Now, this is really important because in an asymmetric relation, one takes more risk or has a higher burden of risk than the other side. So say if you place your personal information in a system, the burden of risk is on you and not necessarily on the system in this case. So how do we get in an asymmetric relationship? Persuasion, right? So you persuade a person or a thing to place their trust in you based on aesthetics, other cues, the smile I'm giving you, telling you that what I'm saying is correct, right? But I really want you to act in a certain way. I'm looking for action from you. Some kind of behavior that demonstrates you're placing your trust in me as a trustee of whatever it is that you're giving me. And basically, I'm asking you to have a positive outlook or a positive expectation about what it is that I'm going to do for you in this trust relationship. I'm asking you to believe in me in some way, right? Now, really what I'm asking you to do is give me something of value, right? Whether it's data, whether it's money, whether it's kindness, right? I'm asking for something valuable. And that's contextual, right? So the context is really going to matter here. But really forming a relationship of interdependence, that means I'm going to rely on you for something, whether it's efficiency for help, whatever the case may be, we're forming some kind of reliance on each other. And this means our relationship is transactional. Now, transactions people think of as a bad thing, but really it's about the exchange of something for another thing, right? So if we look back in this relationship, when trust breaks down, it is because something is missing in relation to those characteristics regarding trust, honesty, integrity, those kinds of things. Thank you.


Yo, my name is Tom DeMilleman, and I am an artist. I did it, I asked you for it. Tom DeMilleman was a switch from me. I would turn it on, and then I couldn't be confident in myself. I wanted people to not know what I look like. Not even to know what the music might be. So that's why I picked Tom, because Tom is a white name, I guess. I destroy all stereotypes. I was an anime kid. Growing up for sure, I did feel like an outcast. I'm from Monroe, Georgia, in the sticks in the country. For the first half of my life, I was controlled. You know, parents kind of want the best for you, and they feel like if you're doing exactly what they tell you to do, then that's the best course of action. My entire identity in high school is this is Sean Brown. He does track and basketball. They didn't really see it worth in me outside of that s***. I was raised by anime. I was raised by Naruto. I was in drama, a lot of high school, and then I did theater my freshman year of college too. Just being a black kid is interested in other s***. People kind of ostracize you. Hey, you should do this. I'm like, get off me. You try to put somebody in a box, and they're claustrophobic. Of course they're gonna spaz. I was trapped. 10th or 11th grade year, after basketball practice, I popped up at my friend's house.  It was really FL and just a mic, but to me it was like the coolest s*** in the world. Recorded a song and just fell in love with the process. I felt deep. When I started feeling like I had a purpose is when I did start writing. I was the kid watching and studying, learning the basics, learning rhyme schemes. How do you get to like the pen level of a Tyler the Creator or the pen level of a Drake? It's repetition. I made up a system to write a song at least once a day. I eventually have to get better. When I was a freshman in college, I came up with TDC, The Delivery Crew. You know, you grow up around the age like the OVOs and TDE's, these collectives. I wanted something like that. Now I was the base for my supporters. Anybody that is a part of TDC definitely wears it as a badge of honor. When I first started, I was strictly like boom bap, rap around like 2016, 2017. One of my friends had put me on the X. He was black and he was cool, but he was also like a weird kid like me.  Something that like, I guess resonated with my soul. And I was like, I'm like, so you can be yourself.   Be free. I think that's what like really inspired me to open myself up to other genres. That's when I started the experimental stuff. A lot of people in my city didn't like really f*** with it, but I'm kind of thankful for that. It made me work so hard at the fattest chip on my shoulder. He got booked for a show by Daily Cheepers down off Metropolitan. Went all out, the crowd enjoyed it. Met Sam from there. I kind of started staying at his crib a lot, not a lot. Sam was trying to introduce me to Dan and Jamie and everybody I air with. Jamie had been trying to get Tom into sessions rages. I begged him, begged him, begged to work with him. Because of where I came from, I still was really wary of people. Like I didn't trust anybody. And I was like, I will stake my whole reputation with you on this, you need to get in with Dan. Like you have to. Sam called me and said, hey, Tom's ready. We need to go to a session. First time I came to Airways, I pulled up and it's a house and I'm like, okay. Jamie comes out with his hands out, he's like super f***ing nice. And then I get in the room and Dan is interested and he cares about working with me. Popped out, short-lived love song. Boom, we just like knocked it out so fast. And then we immediately make last night. His first real session in a studio setting, that was just so special to like be a part of. And then it got to a point where just like a lot of labels started hitting him up and stuff. And he was like, yo, like, can you manage me?  Sam is the guy that's gonna check me when I need to be checked. And you know, it's my best friend. The goal of Airways is to just provide a space where creatives can come and get their artistry out and not have to feel pressured to be cool or somebody they're not. Everybody at Airways was a weird kid on some level. I was the kid wearing girls' jeans and pink t-shirts and f***ing listening to Slipknot. I was heavy into marching band, that was my s***. First off, we're all just close friends. I don't do anything for these people and I feel like it's reciprocated. We could have had a boss and I'd have somebody tell us what to do every single day but there's no fun in that. That's why we chose music. People come from all different backgrounds and create some insanely creative stuff with zero labels to it. It's the rap and the trap and the rock and the alternative all coming together under one roof. I feel like we just have our own pocket. We got Taj, we got Chase, we got me. Airways has definitely embraced who the f*** I was and helped me come into my skin more and figure out what direction I want to go. Those true friends kind of came in, came into my life. The mission is for Tom the Mailman to be a global superstar, for Taj Keaton to be a global superstar and at this stage for the memory of Six Dogs to be everlasting and important. He was just an insanely talented, beautiful person that really kept so many of us driving and so many of us alive. We lost Chase together. And that, you know, if you're not close before that, like you're close after that. And now it's like, you know, I'll go to bat for those guys. Tom the Mailman, when I was younger and coming up, it used to be a shield.  I'm a sweet person. But like that person gets abused and people take advantage of that and I would turn it on and then I couldn't be confident in myself and I couldn't talk to people in my chin up. Now Sean and Tom have kind of fused into one person and I do walk with that confidence. Finding other people who are different, you start to realize like, I don't care about what other people think because I love these people and I love what I'm doing and I want us to succeed. I think the reason a lot of the producers and artists at Air Waves are unique sonically has to do primarily with growing up in solar. That's why I chose making music over any other type of career. It was a possibility of true freedom. When you grow up and like, you say you do music, people are like, what, like, you can't do that.  I did a lot of things for other people going up. I'm trying to do this for me now. You know what I'm saying? I wanna have a happy life. I don't wanna be bitter when I get older. This is like it. I can't work at another job and like, I can't. I'm not cut out for it. I need to be doing something different. Sean's goal is to be the biggest artist in the world. He's chasing Drake. It's not like a disrespect thing. It's just like, that's the benchmark that we're aiming for. You go too crazy, man. Can't settle for a second. I must be the only one. No press is expected. I can't sell my soul to none. I got the pen. I got the versatility. I got the energy. Being bold is just being authentic, being yourself. That's how you become like a long lasting character in the game. You know, I've witnessed a lot of legends become legends. That's something that I want for myself. There is no what if. I've already manifested it. I won't fail. I cannot fail. It's not a thing. One of his real primary goals is to be, as he says, like glue, to bring people together, to show people that I can look like this and be like this and do these things and you will find something in my music that draws you together with other people. My next performance is, Life is Beautiful. I've never even seen what a festival looks like.  He's got the most work ethic and drive of anyone I've ever met. Believes in himself unfailingly, has a really strong moral compass and really wants the best for people. I'm happy that I trust in myself. I'm happy I have friends that trust in me.  Like, you know, we all believed in the same thing and it came to fruition.