All right. Welcome back everybody. I have a lot of slides. This is going to be a great lecture. Yeah, I know. I say that in Jeff's responses. Oh, no. I know you're talking about something else. It's okay. All right. This is the last lecture, but certainly not the least. We are going to cover some topics that I think are extremely important for doing applied statistics. Before we get to that, let's talk about pancakes. Okay, these are my very bad drawings of pancakes. It's just three pancakes. And the hatching on a side of a pancake indicates that that side is burnt. So imagine like you come over to my apartment for pancakes and I turn on the griddle and the temperature isn't right. It's too hot and the first couple pancakes get burnt. This is actually how it happens. Right. And so by the third pancake it's perfect. So the first pancake is burnt on both sides. The second pancake is burnt on only one side and the third pancake is just right. Yeah. Now, I serve you at random a pancake with a random side up and you look down at your pancake and it's burnt. And I want to ask you, since you've taken my stats course, what's the posterior probability that the other side is also burnt? I'll let you think about it for a second. All the information you need to solve this problem is on the slide. You don't know which of the three pancakes it is, right? You know which one it's not, right? It's not number three. So what's the probability the other side is burnt? What's the answer? Anybody else that think a half? We got two votes for a half. Two out of three? Or yeah, it's the answer is two out of three. It's not a half. Half is the standard intuition and it's a perfectly reasonable don't worry. That just means you're human. That's good. The intuition is half because there's two pancakes it could be, right? You think, ah, it could be either one. It's random, right? No, it's two out of three. And let me show you how to figure that out. But in doing this, it wasn't to make you feel bad. It was actually not it at all. This is my intuition too is a half. First time I saw this problem. And this is a famous logic problem actually. It wasn't originally done with pancakes, but I like it better with pancakes.  So pancakes, everybody likes pancakes, right? Yeah, okay. Good answer. So the point of these logic puzzles is not to make you feel bad. It's to teach you some intuitions about or correct your intuitions and teach you methods for solving these things. And as I've said many times in this course, I think one of the values of learning probability theory is that it means you don't have to be clever. You can just ruthlessly apply the rules of conditioning and you don't have to feel like you need to intuit the right answer to this thing. So don't trust your intuitions would be my advice. Instead be ruthless, ruthlessly conditioned. What do I mean? The way we figure things out in probability theory or Bayesian inference, which is just probability theory, is we want to know the probability of something and so we condition on what we know and see if that updates the probability, right? If there's any information in what we already know for inferring the thing we'd like to know, then if we compute the probability of the thing we want to know, conditional on the stuff we already know, it'll be there, right? And the rules of probability tell us the only way to do that. So we do that. Let's do that for the pancakes, all right? Here's your Burke pancake. We want to know the probability that the side we can't see is burnt. Conditional on what we know, which is that the side up is burnt. Now, of course, you could peek, right? But this is a probability puzzle, yeah? The rules of probability tell us that a conditional probability is defined as the probability that both things are true divided by the probability that the thing we condition on is true. So that's what the expression on the right-hand side is. The probability burnt up and burnt down, right? That both sides are burnt divided by the probability burnt up. This is Bayes theorem, by the way, just disguised, right? So this is just the definition of conditional probability. If you ever forget this, just Google definition of conditional probability. There'll be a nice Wikipedia page for you, right? We have all the information needed to compute this. First, we need the probability that the burnt side is up, and there are two ways this can happen. Well, let's think of it this way methodologically. There are three pancakes, right? So you've got a BB pancake, a BU pancake, and a UU pancake. What does that mean? BB is burnt-burnt, right? BU is burnt-unburnt, and then unburnt-unburnt. Three pancakes. Probability that this is the burnt-burnt, that you would see a burnt side up if the pancake was burnt-burnt is one, because either side will show you burnt. Yeah, so that's why it's probability BB times one. Probability BU times 0.5, because only one of the sides of that pancake is burnt. So if I'm randomly flopping it down on your plate, then there's a random chance the upside is burnt. And then for the unburnt pancake, there's no way. So you already eliminated that, right? There your intuition was working. Each of these pancakes has a chance third of being served to you. So there's a half chance that you get the burnt side up on your pancake. And then the last thing is just the top. What's the probability of the burnt down pancake? It's one-third, because there are three pancakes, right? And I served you one at random. So it's one-third divided by half, and the answer is two-thirds. Weird, right? Let me give you some intuition about why. Now that probability theory has given you the right answer. In the text, there's a simulation, a pancake-based, individual-based pancake simulation of this, right? To tell you you'll appreciate this, right? It's like agent-based, but they're pancakes. To prove to this that it's two-thirds, if you didn't believe this calculation.  In fact, I'm not clever at all. I just ruthlessly apply conditional probability and figure things out.  The mistake is focusing on pancakes. You want to focus on sides. So look in this picture. There's a side at the bottom, and we want to know what the other side is. So if you look at the top, there are three burnt sides. The side at the bottom could be any of those, right? So there are three possibilities. The other side of those, how many of those three possibilities are also burnt? The answer's two, so the answer's two out of three. You've got to focus on sides. We're talking about sides, not pancakes, right? That's the mistake. Pancakes are so delicious you were focusing on pancakes and not the side, right? Mental bias. I forgive you. All right. So the point of all this is everything we've done in this course, everything you do in any statistics course really is underlain by the idea of ruthlessly applying conditional probability to solve problems. There's some information we have. There's some other thing we'd like to infer. If there's any evidence in the information we have about the thing we like to confer, you reveal it through conditioning, through the rules of probability. Or another way to think about this, express our information as constraints and distributions, and then we just let logic do the rest. And that's what Bayesian inference is. It's just logic. So rest of the time today I want to take this approach and show you how it produces automatic solutions to two very common problems which are historically in statistics very hard to solve because people tried to be clever. If you avoid being clever and just ruthlessly apply conditioning, you can get useful solutions to two very big problems. These are measurement error. Triassert is always present in data and usually ignored. And missing data, which is a special kind of measurement error. It's not there at all. It's just the extreme version of measurement error. These are really common. So let's think about measurement error first. There's always some error in measurement for sure. And when you do an ordinary linear regression, it's captured in this residual variance. There's this sigma thing that's supposed to capture any, even if you had the true relationship, you don't expect a perfect fit. That's what that sigma error variance on the end is supposed to be. And that's fine if the only error is on the outcome variable. What if there's also error on the predictor variables? And imagine, for example, that error is not uniform across the cases or the variables. Then you're in trouble. You could be in trouble. And there are a whole bunch of ad hoc procedures to try and deal with this, like reduced major axis regression and such. And none of them are terribly reliable. So let's think about an approach that avoids trying to be clever and just conditions on what we know to get there. So think back to Waffles, right? We have pancakes, now Waffles, the waffle divorce data set from early on in the course.  For each one, we have measured divorce rate, median age of marriage, and the marriage rate. And if you go back and look at the data set, you'll see there are columns which were standard errors on a couple of the variables. That is, these are taken from partial census data, from records. They're measured with some error. And that error has been quantified in terms of the standard error on each of those values. We don't know the divorce rate in a particular state. What we have is an estimate of it. And we also have a number that tells us our confidence in it, the standard error, right? There's a lot of heterogeneity in this error in this data set. So I'm showing you on this graph is the divorce rate on the vertical, median age of marriage on the horizontal. And the line segments show you the standard error for each state of this divorce rate. So some of these are big. The reason some of them are big is because some of the states are small, and so they produce relatively little evidence in any given census period. So here's another way to look at these data. The left graph is the graph that was on the previous slide. It's just divorce rate against median age of marriage with the line segments for the standard error of each divorce rate. And then on the right, the divorce rating in vertical axis is the same. Now, the horizontal is the log population of that state. So really big states are on the right. California is the one all the way on the right. And in California, in any particular year, you get so many of the events that you get a fantastic measure of the true, if you want to say the true divorce rate in the state. Because it's just so many Californians. They're all over the place. I'm one. We're just all over the world. And on the left, you've got smaller states. I won't single any of them out. Well, later I will. But, you know, pick your favorite small state. There are states with very small populations, particularly west of the Mississippi, where there are more livestock than people by far in many parts of Western United States. And in those states, there's so few of these census events in any given period that you're going to have an error. Your confidence in having estimated the long run rate is very small. And so the standard errors on those states are big. Does this make sense? Let's think about this in terms of a causal model. Measurement error can be put into a DAG. Almost anything can be put into a DAG. Not anything, but almost anything. And so we want to think about the observed divorce rate here, which I named D sub-observed as being a function of the true divorce rate, which we don't get to observe here. That's D. And the population size of the state, which I call N. And in the data set, we've already taken the N part of this and summarized this as there's a standard error reliability, right? But in general, this is what's going on, is that your observed variable for divorce rate is a function of these two things. And that's what generates the measurement error. Yep. Does that make sense? So how can we approach this statistically? Well, let's not be clever. Let's just be ruthless and apply conditional probability. We state what we know. And we see if it'll figure out what we don't know. So here's the idea about how the observed variables are generated, right? So there's some true divorce rate, which we haven't observed. And we'd like to use that as our outcome variable, not this crummy measured thing, right? With highly unreliable things for some state. So generatively thinking, our observed divorce rate is sampled from some normal distribution. Central limit theorem makes this almost true in this case. And the mean of this normal distribution will be the true rate. And then there's a standard deviation, which has been summarized in this proportional, inversely proportional to the population size using the standard error. Yeah, saving you some work. You could do this yourself. Somebody did this, right? There's a formula for this. Does this make sense? Conceptually, what's going on?  Divorces are happening in a given state, but in California, you get thousands and thousands, right, in any given month. In Idaho, mostly zero every month, right? Yeah. And so, but in the long run, there's some D true that you'd observe in the long run, averaging over a really long data set. But in any finite period, there's error. And that error will be inversely proportional to the population size. It's a function of the population size. And that's what the standard error is. Yeah, so the thing you observe comes out of this generative process. It makes sense. And let's think about the statistical model now. So this was our our DAG before. Remind you, A is median age of marriage, M is the marriage rate, D is the divorce rate. We were evaluating the direct and indirect effects of age of marriage. And this is the statistical model we had before. Where the thing on the top is D true. We acted as if we knew the divorce rate. But now we don't. So we need to add something else to this model. What are we going to add? We're going to put a line on top of it, which is the observation process. And this observation process, you just add this to the model now. And now the D true is a vector of parameters, because we don't know it. We replace all those things, which are previously the outcomes with a bunch of unknown parameters. And then the observation line at the top estimates them for us. Because we have information with which to estimate them. What is that information? Well, we have the standard error. Okay, that's great. But if that was all we had, that would be that would not be enough. We also have the whole regression. The whole regression relationship is going to pin down values for the different states. And you may be getting a tingling sensation in your skull, which tells you that shrinkage is going to happen. Right? Because it's my class, and there's always shrinkage. So let me, I should pause here and say, does this make sense? What's happening? One way to think about this is, if you were going to simulate measurement error, this is the model you could use. It's just right down the same model. And then it runs backwards, right? Bayesian models are generative, and you can run them in both directions.  If you run them in the reverse, they spit out a posterior distribution, right?  You can run them in both directions. And so this, if you were going to simulate measurement error, you do it with the top line, you'd have some true value, but it will be sampled from a distribution. So it would have some error on it. Yeah, right? Mechanically, where's the error coming from if this is census data? Like, you're not, you're not mismeasuring the data. Because in a finite time period, imagine the census period was a day. In a big state like California, you get many more events. And so that day provides much more information about the true rate, right? The variance from day to day will be higher in a small state. It's like sample size, right? So imagine you pick a village instead of Los Angeles, and you try to estimate the divorce rate. It's easier if you pick Los Angeles. Yeah, does it make sense? It's just sample size. It's just sample size. California is bigger than Idaho. And if the period, if the census period is the same for both, it's a sample size effect. Yeah, you never observe the rate. The rate isn't unobservable always. And so the sample size constrains your precision of it. You'll sleep on it. It's just sample size. It's nothing but sample size. Alright, how do we do this in a model? Exactly as it was on the previous slide. The only trick here, you've got to define the true as a vector of parameters as long as the whole data set. So for every state, there's a detrue, and that's what the vector in thing is in this model. So at the top, we've got detrue, which is a vector of parameters. And the second line we define it as a vector of length n. And it gets the likelihood. But there's a parameter on the left now, not an observed variable. But it works the same. Remember, the distinction between likelihoods and priors in a Bayesian model, that's cognitive. That's something you know. Probability theory don't care. It works the same on unobserved and observed variables. It doesn't care at all. So when something in your data set becomes unobserved, the model doesn't change. Yeah? This is like a brain bending thing for people, because you're taught like the data and parameters are fundamentally different things, but they're not. They're just variables. And sometimes you observe them and sometimes you don't. And this is the part where I say you don't have to be clever, you just have to be ruthless. The model exists before you know the sample, right? It's like a representation of the generative process. The fact that you haven't observed some of the data doesn't mean the model changes. Yeah? It just means that now you have parameters there, because you haven't observed it yet, because a parameter is just an unobserved variable. Yeah? The fact that you could observe it makes it feel really different than something you can't observe, like a rate. Yeah? Okay. And then the rest is just the oldy priors, right? Good? Yeah? Some of you are nodding and some of you are like, I don't like this. It can be unhappy. And what happens in this regression? So there's shrinkage. As I said, the tingling sensation in your skull is shrinkage. And now plotting the relationship between median age of marriage, which you know, there's a strong relationship in these data between the median age of marriage and the divorce rate. Plotting median age of marriage against the divorce rate. Both of these are standardized variables. The blue points in this are the values that were observed for divorce rate. In the data set, the ones we previously ran the regression on, back in chapter, I don't know what it was, five or something. And the open circles are the values from the posterior distribution, the detrus, the posterior means for each of the detrus that has been estimated. And the line segments connect them for each state. You with me? So what has happened here? Well, there's shrinkage. Some have moved more than others. And since you're pros at shrinkage now, you can explain this pattern. What has happened? Why have some of these moved way more than others? And why have they moved where they've moved? So they've moved to the regression line because that's the expectation. That's the expectation. If some state's observed divorce rate is really far from the regression line, then it will shrink more. But how much it shrinks is also a function of its standard error. So a really big state like California could stick far from the regression line. It doesn't here. It's actually pretty typical. But because it has such a precisely measured divorce rate. But a small state like Idaho, look on the left of this slide, you see Idaho. That's ID. On the far left, Idaho is more sheep than people. All right. Mostly potatoes. Just potatoes and mountains for the most part. It's a beautiful state. And it has a very imprecisely measured divorce rate. It gets shrunk. It's still off the regression line by a good amount. But this model says like, given this relationship and these variables, that measured rate is way too extreme to be believable. Probably due partly to sampling error. And it shrinks it a lot. You get similar effects for North Dakota down on the bottom. Wyoming's an interesting one there. That's the next one over W.Y. It's not so far, but it's so uncertain that it gets shrunk directly to the line. Right. Because Wyoming is another one of these states. It's mostly sheep. Right. Another beautiful state. And so on. Maine has an extremely high divorce rate. It gets shrunk a lot too. And it's small. And Rhode Island's a small state, etc. You can look at this. Again, compare it to this plot with the standard deviations where we calculate the shrinkage. So on the left side of this plot what I've done is I've taken the difference between the estimated D observed. This is the mean of the posterior distribution of the detrus. And subtracted the observed rate in the data set. And that's the vertical axis. And on the horizontal axis I put this standard deviation that's in your data set. The standard error of the measure. And you'll see that if you're any state that has a difference of zero means there is no shrinkage. So on the far left you've got California, for example. And then as you move to the right, the standard deviation increases, you get more movement. Right. That's what the shrinkage is. There's a bigger difference between the observed rate and what the model thinks is plausible. Does it make sense? Okay. That's error on the outcome. When it's not constant it varies across cases. You can also, of course, have error on predictor variables. And those can go into the model the same way. Again, be ruthless. Don't be clever. You've got a generative model. Imagine sampling an observed version of a predictor variable, but now with error. And then you insert that observation process into your model. So that's what we're going to do here. So on this plot, on this slide, is now we're looking at the marriage rate in each state. And that's also measured for the same reason with error. And again, plotted on the horizontal against log population. California's on the far right. Idaho, Wyoming on the far left. The line segments get bigger because of the sample size issues. Here's the model. I'll do some notation on this on the next slide. So don't panic. Top part is the same you saw before. The very first line is the observation process on divorce rate. Then we've got the regression of the true divorce rate on agent marriage and marriage rate, which is m, but now inside the regression, the linear model, we have m true, not the observed m. What is m true? It's a parameter. Right? There's a parameter for each state here, and it goes in. So this last term is a parameter times a parameter. Don't you like the course now? Yeah. So every state is going to have one of these m truths. We don't know it, but it goes into this thing. Exactly the same. It's the same model because it's the same generative process. You haven't observed it, but that doesn't change the model. And then we've got what you might call the likelihood for the observed rate. The m observed, the marriage rate for each state that we saw, comes from this sampling process. Again, normal m true with the standard error, which is also in the data set. Good? Yeah? Again, you've got to go home and draw the out, of course, but this is really all it is. You just think generatively about the thing that right down the stat model. You can run it both directions. One last thing to talk about before I show you how this model behaves. You've got to put in a prior for these m truths. You can do lots of interesting things here. In this example in the text, I set it to zero one because it's a standardized variable. It's not terrible. What happens as a consequence of that, though, is that you're ignoring information in the data because if I tell you the agent marriage in a state, you get information about the marriage rate. Right? Look at the DAG on this slide. If you believe this DAG and you do, yeah, you don't have to, but there's lots of evidence this is a reasonable DAG for the system. Agent marriage influences marriage rate. And so we can have a better prior for the marriage rate if we use all of the regression information, put the whole DAG into this model. And I'll do an example of that, not in this, but later on today. I'll have an example when we do that. We put the whole DAG into the stats model. All the variables have relationships. And if we do it all at once, there's even more information that can help us pin down and get better estimates of the true values. But this won't be awful. Okay. Okay. I know there's a lot going on in this graph. It's not the most beautiful graph in the course. What's happening here? On the, we've got two variables now, which are observed with error. And I'm plotting them against one another. We've got divorce rate on the vertical and standardized and marriage rate on the horizontal. Again, standardized blue points are the observed values in the data set. All right. So the combination of the observed marriage rate, the observed divorce rate. And then the open points are connected by line segments or the corresponding pairs of posterior means for the true, estimated true effects. True rates in both cases. Yeah. So you've got shrinkage in two directions now. Right. Both of them. Towards some regression relationship that you can, you can see. I haven't drawn it, but you can kind of see it there. Right. It's like a constellation. This is like the Milky Way. And some of these shrink a lot more than others. So I want you to notice, the first thing you're going to notice is if you're really far from the regression line, you shrink more. You expected that and you see that here right away. There's a more subtle thing going on, which is that there's more shrinkage for the divorce rate than for the marriage rate. So look at a case like in upper left. There's some state up there. I should have labeled this. I don't know. Let's guess that's Wyoming or something like that. And well, no, it's high. It's probably Maine. Something. And it's extreme in both. Right. It has an extremely low marriage rate. Yeah, this is almost certainly Maine. And an extremely high divorce rate. And so it comes down really far, but it comes down a lot more on divorce rate than it does on marriage rate. Why? And then you can see in the other cases, this is also true for the most part. Yeah, all those things at the top similarly. Why does that happen? And the answer is because the regression says that marriage rate is not really strongly related to divorce rate. So the shrinkage doesn't happen as strong a marriage rate because there's not as much information in the regression to move it. The model doesn't know where to move it exactly. So it doesn't, it isn't attracted to the regression relationship as strongly because the real causal effectiveness model is agent marriage. Remember? There's this association between these two variables that arises through the back that that other path. But that means you don't get as much shrinkage on this predictor. Does that make sense? Yeah, I thought this was a cool effect when I made up this example. Anyway, go home and draw the owl. You will have fun with this. I am absolutely sure. Let me try to put some context around this before we move on to the next topic. So measurement error comes in many disguises and the version I just gave you is the simplest where there's a variable in your data set that's called the error. Right? And sometimes you're lucky and you get that. And some expert has told you here's the measurement error in this variable. Then you can proceed like this. But there are many, many more subtle forms as well. One of the things that I see a lot and I think is a waste of information is people will pre-average some variable and then enter that as a predictor in a regression. That removes the fact that you have a finite sample with which to estimate that mean from. Yeah? So people will do this all the time. Like you've got some sample from a state and then you just create state averages and then you put them in the data set. That takes variation out of the data set. And if you're doing that consciously as a way to get your p-values to be smaller, I would call it cheating. But I think usually people are cheating, they're just doing what they were taught to do. Yeah? But we don't have to do that. What else could you do? You could just use a multi-level model. Right? That's what you could do. And then the means are bearing effects. Right? They're parameters. And you don't have to do any averaging. Do the averaging in the model, not outside the model. And then all of the uncertainty that has to do with different sample sizes is taken care of. Parentage analysis is a fun case. This is done in people, but it's also done in other interesting animals. Right? You're trying to figure out. You've got some population of, say, wild rodents. And you're trying to figure out who sired who. Right? Who is whose parents. And you can't interview them, unlike people. And so you get their genotypes and you try to figure out if they're related. And there's uncertainty. You can do exclusion. But then there'll be some number of individuals who could be the parents and there'll be different probabilities. And this is a standard sort of thing that happens in this. Phylogenetics. So when I did the example last week, I used a single tree. There's a strong fiction there. We don't know the history of primates. Phylogenies are rarely very certain. And so on the right hand side of this slide, there's this trend now, the phylogenies like this. I'm a really big fan of this. I see this in papers all the time now. I like this a lot. So you're showing the whole posterior distribution of trees. It's a big fuzzy graph. In some cases, there's massive uncertainty in some parts of trees. And you want to keep that in mind. And you can do the analysis over the whole distribution of trees actually. Right? You imagine you just feed it into bays like this and now you've got this whole distribution you need to average over. It works like lots of other ways that we have distributions in bays. In archaeology, paleontology, forensics, measurement area is the norm. It's absolutely standard. Your data are decimated in some way. So think about like radiocarbon dating. You don't know the radiocarbon date. You've got, you know, a few hundred year, a thousand year period, right? The archaeologists, the audience, know the pain of this. And people take this very seriously now. At least most people do. Take this very, very seriously. I had sexing in here.  And this is no joke, right? To try and do this correctly. You can never be sure. It's very, very difficult to sex a primate fossil and, but you can assign probabilities. Absolutely you can. Okay. Yeah. Determining ages is another issue. In my department, we work in places where people don't keep track of birthdays. So you can ask people their age and they'll give you a number. But you don't want to naively use it, right? So you think biological facts like average birth space and things like that. You can reduce the error on those estimates. Okay. Let's shift to a very related example. Grown-up measurement error is missing data. There's lots of things which are sort of mechanically similar about this, but it feels really different because often it feels like the data is missing. There's nothing you can do. You want to do something about missing data, typically. And I want to teach you today why. So this is really common, right? You're used to this. Most of the standard regression tools in software packages will automatically remove cases with missing values without saying anything to you, right? So if you run LM or GLM and R, if it finds any of the variables you include in the regression, if it finds a missing value, it deletes that whole case. So all of the variables for that case are removed from the dataset. This squanders information, right? So that's the first thing to worry about. But it can also create confounds. So missingness can create confounds. Complete case deletion is not harmless. And that's one I want to convince you of. And there are ways to deal with this. Sometimes there's no guarantee. So how do people deal with this? There are lots of different approaches. The worst approach, and you should absolutely never do this, as I say on this slide, is to replace the missing values with the mean of that column. This is tragic. This is a really, really bad idea. Why? Because the model will interpret is if you knew that value. You don't know that value. You want something with error there. That's what you want. And the mean is, if you just put it in there, you cognitively know that you don't know that value. But the model doesn't. The model thinks that it's the mean. And then bad things happen, really bad things. So don't do this. I haven't seen this in a very long time, which is nice. The word has gotten out. You should absolutely never do this. What else could you do? There's this procedure called multiple imputation, which works. It's one of these things which shouldn't work, but works really, really well. And it's a frequentist technique for imitating what we're going to do today. In fact, it was invented by a Bayesian back when desktop power, Don Rubin, back with desktop power couldn't do these things. And so buddy created a frequentist technique. It works unreasonably well. It's really effective. And basically, you do the model multiple times on different samples from some stochastic model of that variable. That's what multiple imputation is. You don't need very many multiples to get a really good estimate of the uncertainty, it turns out. We're just going to go full flavor Bayesian imputation here and just put in the probability statement about how this works. Okay, impute. What does impute mean? Impute means to assert some feature of a thing. In law, it's usually a crime that you're imputing to somebody, right? But here there's no there's no valence like that implied. So before we get to the mechanics of how to run a model that does imputation that tries to guess the value of a missing variable, let's talk about DAGs again and try to get missing this into the DAG. This is a literature that is deeply confusing because the terminology is really awful. It's just about the worst terminology I've ever come across in any region of statistics and I will convince you of that on the next slide, I am confident. So let's think about the primate milk data again as an example. This is a small data set. We've got a number of primate species. We're interested in understanding why the energy content of milk varies so much across different species and we're focusing on body mass and proportion of the brain that is neocortex. So here in this DAG, I have an M as body mass, B for brain is the proportion of the brain that's neocortex. Why are we focused on that? Because humans have a lot of neocortex and we focus on things that we have a lot of. It's this kind of narcissism of our species, the whole field of anthropologies and exercising narcissism. K is the milk energy, killer calories of milk.  So I'm just putting a U there to say I don't know, something is generating it. It's not directly causal for men to be because it's not just a lometry. So brain size, if we were just talking brain size that would be maybe it was just an arrow for men to be but that's not what's going on here. You can have brains the same size but some of them will have more gray stuff than others do. So there's something going on here we just don't know what it is. Now let's talk about the three types of missingness. All types of missingness can be classified usefully in this taxonomy because it tells us what we need to do and that's why this taxonomy exists and this is where the totally confusing vocabulary comes in. So you've got to know this vocabulary or at least when you recognize it you can come back and check the notes and figure out what's going on. This is horrible right? So on the left we've got something called missing completely at random. I'm going to walk through that starting on the next slide and explain what that means. It's abbreviated M-car and I'll explain this dag to you. In the middle we've got the second type it's called missing at random. Does that sound different to you than missing completely at random? It sounds about the same to me but it's totally different in terms of its consequences and then I'll explain that to you as well after I explain M-car and then there's M-nar sometimes written in mar instead and because you know in English you can put a knot anywhere and it has some random effect on the meaning of the sentence right and so this is missing not at random. So I don't know about you but as a native speaker of English when I hear the phrase is missing completely at random, missing at random, missing not at random, I don't think of these processes at all that I will explain to you. This is a tragedy. This is another example of the law that statisticians should not be allowed to make terminology but I think you can't understand what's going on here and these three types are incredibly important because they tell you what you need to do to make an unconfounded inference about things. So let's start with the first. Here's our milk energy DAG the triangle at the bottom is the basic DAG and now we're not going to get to CB the true proportion of neocortex anymore because it has missing values in and in this data set it does about half of the values are missing almost half of them are missing I think and I think there are 12 missing values in this data set. There are lots of primates that no one's ever measured this for. Maybe you measured brain mass but they didn't measure the percent neocortex and so we've instead we've got this variable be observed which has deletions in it gaps missing values in it and to get this we know it's partly caused by be that's why there's an arrow coming up from be but it's also caused by this missing this mechanism whatever it is that places missing values in particular on particular species and we want to name this thing and in this literature these missing this processes are given the letter r for some reason I guess for random and then use a subscript to say which variable it's affecting so r sub b is the missing this mechanism that creates missing values in be observed think about this is what DAGs always say is they say for any variable the arrows entering it are the things the arguments to some function which generates that variable right so this says be observed is a function of be and the missing this mechanism that's all it says it makes sense now since you're all experts at graph analysis I ask you are there any back doors from be observed to k why is that the question because we're going to condition on be observed we can't condition on be because we don't have it but the graph stays the same and now k is our outcome be observed as our predictor are there back doors from be observed to k give you a moment any backdoors remember what a backdoor was it does go through in but that's not a back door it's a front door so that's the distinction there's there's two things to think about here right there's no back door that's the answer is no there's no back door it's only back door when the arrow enters the back of the variable right there's no back door but there are two paths from be observed to k there's a direct effect and an indirect effect but the total causal effect of be observed on k can be estimated by simple regression would just be observed on the right right because there's an indirect effect through through him yeah exactly indirect path so there's some you know other path there but there's no back door make sense so you can in fact you can condition on in here and you can get the direct effective be but there's no path that takes you through are through our sub b no back door that takes you there through it you see that it's just like stuck on the end of the graph and this means that the missing this mechanism is ignorable it's not a confound you analyze it just like any other variable right there's something that's influencing the thing you're going to condition on but it doesn't create any back door confound and so you can ignore it right remember the rules you don't have to condition on it and that's true here you don't have to condition on it you don't need to know that's nice because usually we can't discover the missing this mechanism yeah so this is the this is the benign case what's called missing completely at random yeah remember that it's completely m car k it's m car when k is unconditionally independent of the missing this mechanism you don't have to do anything condition on anything in this graph to keep your inference about k independent of the missing this mechanism yeah you're safe and that means it's ignorable so this is the benign case is what everybody hopes for when you find missing values right it doesn't people pretend oh it's in car but let's pause for a second and think about this sorry yeah yes you can so complete case analysis will not create a confound when this is true this is what licenses you to drop all those values is this assumption and this is the only time it's going to turn out that that is okay however if you do the imputation which we will you can do even better because you get more power right you'll get a more precise estimate of the causal effect if you do the imputation so you still don't want to drop the values you could drop the values it's not a sin right but you can do even better if you didn't drop the values and imputed that's the m car case and in car you don't have to impute but you should yeah right exactly and that's why you're losing power exactly you with me before we leave m car i want us to think about does this ever happen so what would this graph mean the only way you can get m car is if like your research assistant used a random number generator to delete values in the spreadsheet right what what could do this now maybe there are cases where it could truly be unrelated to every other variable in the graph that's what this means the missingness mechanism is not influenced by anything else we know right or anything else that we might need to know even an unobserved variable and that would be yeah if this your your research assistant your heebie comes in and just like randomly deletes some values right it could happen could happen probably has happened but uh probably not this is the monkeys on typewriters sort of missing this mechanism i assert that this is a highly implausible in most real research situations that this is the case i'm sorry to say but i think it's you can come up with a convincing example for your data set congratulations but it's really hard to think of one where this happens in this case what else is probably going on well here's one proposal m is influencing the missingness mechanism perhaps uh this will give us the situation called missing at random i know we had missing completely at random now it's mere merely at random something like that it's missing at random and i i i should say the person who came up with these terminologies is don rubin who is an absolute genius it's just not with terminology right see he's the first person to analyze these cases and talk about the conditional probability requirements for each it's a super achievement but these terminal this terminology is not not helping to spread the gospel um but it's i don't mean to make fun of the topic uh so uh m is now entering rb influencing it what does this mean the missingness mechanism depends upon the body mass values species that have particularly large or small body masses are more likely to have missing neocortex values how about that ha excuse me how might that happen well anthropologists have different research interests and they find different kinds of species attractive to study and measure and in particular for example maybe small ones are really hard to measure neocortex for we're just not as interested in them right there's like a bunch of calitric kids uh they're out there in a little furry and they're cute but there's not nearly as much effort on measuring them as say chimpanzees right where there are whole armies of people in this building studying chimpanzees right so uh and that that makes sense but it generates a pattern uh where some of the things features of a species predict missing values that are associated causally with the missingness in other values does that make sense I think this is extremely common and in this case we get the missing at random case and now I ask you the same question as before are is there a backdoor pass or be observed to k and I won't you know go through the the socratic thing of waiting for you to say something yes there is now because there's an arrow entering rb from the back you've got a complete path all the way from be observed around through m to k how can you close that back door you condition on m as it says at the bottom of the slide yeah sorry I shouldn't have put that there you condition on m and then it shuts that path but still you should look at it right remember this I know it's it's rusty but remember all the path closing procedures yeah if we condition on m we block that fork right m forms a fork and you you close the fork by conditioning on the middle of the fork so we close the fork by conditioning on m and then again the missingness mechanism is ignorable we don't have to know it but we do have to condition on m and we do have to impute otherwise there will be a bias in the estimate but you but you don't have to know r which is nice because r is usually not knowable right in any any detailed sense but you do here you don't have to know the missingness mechanism I've got a summary on the next slide but you do need to do imputation otherwise you're going to have a confounded a bias estimate of the causal effect so what is mar missing at random missing simply at random maybe is any case which k is conditionally independent of the missingness mechanism that is there's some variable in the graph or set of variables in the graph we can condition on and separate the two de separate if you remember that term from way back when chapter six or so and this is missing at random missing at random is a nice situation to be in and it's the situation that's probably most common there is something else in our system which is associated with a causing the missingness if we can condition on that and do imputation we have hope of getting a good causal inference out of it I'll show you how to do this why do you need to impute because otherwise you're polluting all the other variables with this associated missingness pattern and this can create really strong biases in the inference yeah and final case which is the worst case to be in is called missing not at random I know the last one wasn't at random either right but this one's really not that random and in this case there are a couple ways to get this let me show you the most obvious the variable itself causes the missingness particular values of neocortex percent are more likely to go missing than others right how could this happen well this could happen if for example well in this case I can't think of an example what is to be true but I've got another mechanism that could do it in this dataset but maybe species with low neocortex you guessed that from the background information and so you don't measure those and so you don't have any precise estimate for those species in that case it would be the actual value that's doing it this is nasty because you get a backdoor that you can't close the mission this mechanism is not ignorable in this case there's nothing you can condition on that will shut it because you don't know the missingness mechanism if you did know the missingness mechanism you could shut that backdoor path and that's what's required and your only hope in this case is the model to missingness mechanism and thereby condition on it so if you've got enough scientific information about how the missingness works you can do that if you're lucky in the right case but there's no guarantee the other way you can get this effect it isn't just an arrow from B to RB you could have a latent variable that does it good times right so here I've drawn on the right another version of missing not at random there's another unobserved variable U2 and this is a fork which influences both neocortex percent and missingness what could this be like it could be like phylogeny imagine humans since we're narcissistic we like to study things that are closely related to us things that are closely related to us have brains with a lot of neocortex so in this case U2 if it's phylogenetic proximity to humans will influence the neocortex percent and it will also influence missingness good times right this happens like all the time in primatology right good okay so there's my summary of missing not at random this is a case where k is unconditionally dependent on rd there's nothing you can condition on except for the missingness mechanism itself which will shut that back door and this happens too yeah I can't say how commonly but when you when you find yourself in this situation your hope is to model the missingness mechanism which can be done okay I've got 10 minutes to go let me do this slide because this is about concept and then there's a bunch of mechanical slides to come which I can go quickly through because all that's in the text and it's just how to run the model yeah so here's here's my other I'm trying to develop a way to teach this stuff so here's my other attempt at redefining these let's think about dogs eating homework and many parts of the English speaking world world this is a way we talk about people lying why they don't have their homework done right my dog ate it it's a standard joke my dog ate my homework sometimes your dog does eat your homework though right so it happens happened to me when I was a kid my dog ate my homework it's true you can imagine me I was a grade A student going to the teacher my dog ate my homework she's like really you Richard I thought better of you but it really happened so so my cats are better they don't eat your homework so imagine a a dag not a dog a dag with four variables in it labeled h h star a and d h is your homework and that is the score it's worth the quality of your homework as a quantitative variable h star is the version with missing values so a bunch of students are coming turning their homework so some of them are missing yeah a is some attribute of the student which causally influences the quality of their homework right attention span working memory Adderall whatever and d is your dog the missingness mechanism right it was R on the previous graphs it's now a dog and on the left we've got missing completely at random here I've relabeled it the dog eats any homework and this is the dag for it so the attribute influences homework on the top of that the true state of the homework influences h star the version of homework with missing values and the dog influences h star but nothing influences the dog the dog will eat any homework it's not selective right that's missing completely at random you with me okay I'm working on this I just need some development I know so in the middle we've got missing at random the dog eats particular student's homework they care about the student the attribute of the student so now it's like the dogs of students who have particular values of this attribute are more likely to get their homework eat right I don't have a mechanism that's why I said I need to work on this I have a mechanism for this the attribute could be something like attention span or something like that and so if you don't if you don't pay close attention to your homework and you turn away the dog eats it something like that right so it's an attribute of the student not of the homework yeah of course it's correlated getting eaten when your homework is correlated with the score on the homework but not because of the score on the homework it's because of the attribute of the student who was working on it that's missing at random and that's the thing I said is really common in science incredibly common in science okay finally the worst case dog only eats bad homework the dog sniffs the homework assesses its score eats it right so you I know or more likely the homework's bad and the student feeds it to the dog so that's another way this could happen but it depends upon the score on the homework right and so that's missing not at random or dog eats bad homework and now in the DAG we've got an arrow directly from the true H to the missing this mechanism D does this help I'm working on this I think I'll add this to the book it might be a little too weird but it's never stopped me before okay so let me show you a little bit about the mechanics of this and this is all in the book the code to do this so I'll necessarily move a little bit faster this just to give you you know the first step of drawing the owl the conceptual bit of it and the key insight again is just we think about the generative process and we write down the same model when we go every missing value just gets a parameter now because we haven't observed it so it becomes a parameter model stays the same we run the model that's it basically that's it well there's all this drawing the owl part in between that has to do with the algorithm but let me give you the intuition so there's 12 missing values for a new cortex in this data set on the right I'm showing you the whole data set the last column on the far right is the neocortex percent each of those n a's is a missing value and we're going to assume missing at random that m is influencing the missingness the body mass is influencing missingness conceptually what we're going to do is we're going to replace each of the n a's in this column with a parameter and then we're going to get posterior distributions for each of the missing values and the information in those will also flow into the regression so you'll get different slopes out of this too so let me show you how this works the idea is you think about each of these gaps now getting assigned a parameter because it's unobserved and unobserved variables are by definition parameters that's what they are in base and these things will be imputed by the model this is what the model looks like b is now a vector in which some positions are observed values and some are parameters but it's all mixed together and we're going to stick that mix of things into the linear model in an ordinary regression model and then the only additional thing we have to do shown in blue here is have some prior for the b values you can think about this as the model of b and sometimes your dag will tell you this right what is b caused by your dag will give you some information about this in the case when b is observed it informs the parameters inside this so nu is the that's nu the Greek letter so that little v it's not a v it's nu is the mean of the b values of the of the neocortex values this is a standardized variable so it'll be very near zero and sigma sum b is the standard deviation those will be estimated from the observed values when the value's not observed this has been a prior for that value it can keeps it from being any old thing mind blowing I can see there's at least one mind blowing excellent but it's the same model as before it's all right here's my my annotation to say the same thing that's a b is a mix and then when b is observed this thing's a likelihood when it's not observed it's a prior in code form it looks exactly the same except we add this prior around here what ulam is going to do is it's going to detect the n a's and it's going to construct that mixed vector for you tries to help you it automates this and once you get out in the posterior distribution there's a parameter for every missing value so you see 12 b imputes here and each of these is an imputed neocortex value and the question of all your minds unsure is what does this do to the slopes in this model now we've added 12 cases to the data that's nice and almost doubles our sample size and so let's compare the same model you don't have to change the model code at all you just delete the cases that have missing values and rerun it right the model stays exactly the same and now we can compare the slopes remember this was one of these masking effect cases we've got two predictors that are positively associated with one another but one is negatively associated with the outcome of what's possibly associated model 15.3 is our new is our new imputed model that uses the full sample and 15.4 is the old one from way back in the previous chapter notice what has happened is the estimates have gotten more precise they've also shrunk a little bit towards zero so the previous model was probably overestimating the influence of each of these but we've gotten precision by adding 12 parameters for things we don't know we've got more precise estimates of the slope yeah this is what you expect in a missing at random or dog eats particular students homework situation is that you get you de-confound and get extra precision by doing the imputation let me show you what happens as a pattern in the data so we can plot these imputed values up mixed in with all the observed values but they're going to have standard Arizona and that's what I'm showing you here we don't know exactly what these values are the posterior distributions are pretty big right despite that they help us understand the slopes more so this on this graph we've got neocortex percent on the horizontal each of those open circles is an imputed value the blue circles are observed values they follow the regression line the posterior means follow the regression trend right because the regression informs them if you've got some species with a big body mass that tells you something about its neocortex percent because those two variables are strongly associated in all of the observed cases yeah and so the the model automatically counts for this you don't have to be clever cool right I don't like being clever it's very hard disappointing thing about this model is that the relationship between the imputed values and the other predictor is zero which is wrong so if you look at this graph you see a regression trend for the blue points and the observed points there's a strong positive correlation between log body mass and neocortex percent but the imputed values don't follow this at all and that's because we didn't tell the model that these two things are associated so in the text I show you how to fix this just very quickly because I know I'm out of time we do this by saying m and b come from a multivariate normal and we model their correlation we did this just like an instrumental variable right it's the same trick the same kind of code but you can do it now even though b has missing values inside of it you can still do it it's a mixed vector of parameters and such and observed values there's code show you how to do this you just have to manually construct this mixed vector of things and there's some code to do that that's the drawing the alpha and then at the end happy days they're associated and you get even more precision from the estimate of these things okay this is a really big topic missing data and there are lots of things which are kind of like missing data but don't feel exactly the same one of the the areas that I think is most important is in this family of models in ecology called occupancy models mark recapture methods these are really missing data problems in a sense you think of them they're kind of like measurement error there's a true occupancy is the species there but you can't observe that zeros are not trustworthy right and so there's this special relationship you do imputations of the true states right there's this latent thing whether the species is really there or not and you need to impute it that's how these models work they're like missing data models but they have special structure which comes from the detection process that you model right okay I realize the amount of time I'm gonna put up a final homework later this afternoon after I do it myself I think it's good but we'll see after I try it in which you will do some imputation practice with some primates and it's doing a week even though the course ends today please turn it in a week for a full sense of satisfaction and if you so want some certificate of completion I'll be happy to give you one as well so with that thank you for your indulgence for the last 10 weeks we've gone a long way from the Golem of Prague and as you go home and deploy your Golems I just want you to remain humble in their presence and I hope you've learned something valuable thank you you


Hi, folks. This is Dr. Don. I want to spend a few minutes talking about Posit Cloud, which is the in-the-cloud version of RStudio. It's something we need to talk about because Posit Cloud, the free version that we're using is limited in the number of hours, contact hours, that you can use each calendar month to 25. Now, that in the past has worked for most students by far the large majority. But in some cases, it has some students that needed additional hours over the 25 hours per month. So let me show you some things to think about. When you get into your workspace, one of the things you should do periodically, like I do it almost every time just out of habit, click on your name up there, and this will show you how many project hours you spent so far in this time period. You can see my current usage period is January 18th to February 18th, which is just what, five days ago. So it'll restart on February 18th and give you another 25 free hours. But if you're running out, and that's why you need to check this periodically, you need to do some things before you run out of your time. What I suggest you do is to go in here and click on account, and this will take you to the deposit cloud page, and it will talk about the plan you have. Here you can see I've got the cloud free plan, and it tells me the licenses for 150 projects, 25 hours per month. The RAM, the CPU, those are standard. When you're running out, you've got an option either to upgrade or to switch to RStudio Desktop, and we've got resources that will show you how to install RStudio Desktop. RStudio Desktop is totally free, and it doesn't have any limit on the number of hours you can have it running. The downside is that you do need to download and install it on your local computer. If you prefer though, instead of going through the trouble of setting up RStudio Desktop, if you're going to get into this like me, I of course have RStudio Desktop set up. But what you can do to get by, if your budget will allow it, is to upgrade your plan, click on the upgrade plan, and then you can see it tells us here, we've got the current plan is cloud-free, and you read this, it says, you can go to the plus plan for $5 a month, and that'll go from 25 hours to 75 hours. I've never had a student run out of the 75 hours per month. But if you do, they'll charge you 10 cents per hour for the additional hours over that. That is pretty easy.  But it is, like I said, it's just $5 a month, and again, $5 is $5, I know that, I'm not diminishing that. But like I said, for most students, they don't need to do this, and your other option for free is to install RStudio Desktop. So here all you would do would be to click on plus, I'm not going to do that because this is one of my accounts I don't want to put the plus version. I've got a plus version plan on the account I use a lot, and it will switch over and give you those additional hours. Now, if you run out of hours or Posit Cloud will send you an email saying you're out, but when you try to log in, it will also give you an alert. What you need to do is, like I said, check your hours periodically, and if you're getting close to 25, that's when you got to make the decision to either upgrade to Cloud Plus or install RStudio Desktop. What you want to do if you're going to install RStudio Desktop is to download the materials that you need to your Desktop so you can load them into RStudio Desktop. Just export those. So this is kind of a heads up. If somebody needs some more information on this, just reach out and grab me and I'll be glad to set up a Zoom and walk you through getting RStudio Desktop if you prefer, or if your budget does allow to switch over to the Plus plan. That's the easiest, cleanest way, just one click and it's done, saves you a lot of time. So hope this is helpful.


Hey, this is Brett and this 2012 Chevrolet Corvette 3LT Grand Sport is stock number 13116Z. I am here at Summit Automotive in Fond du Lac, Wisconsin, your new and used sports car headquarters. This 2012 Chevrolet Corvette Grand Sport 3LT has the 6.2L V8 LS3 engine, puts out 430 horsepower. This car has been fully safety and inspected by our service shop. It has a fresh oil and filter change. All the fluids have been checked and topped off and this car is 100% ready to go. One of the cleanest Corvettes I've seen come in this year and I'm going to go all the way around in this video. Inside, start it up, take a look under the hood as well. Inferno, orange, metallic is the color and I shoot all my videos in 4K so if you have HD capabilities on your computer, tablet, smartphone, or television, I highly recommend turning those capabilities on right now because it is your best way to check out the quality, condition, options, and cleanliness of the vehicle before seeing it in person. And if you like the video and how I do things here at Summit Automotive, consider clicking the subscribe button on my YouTube channel and then click the bell notifications. You'll get updates every time I do videos here at Summit Automotive. This one comes with the chrome to 18 inch alloy rims in the front. You get the cross drilled rotors with the Corvette brakes and it has Goodyear Eagle F1 tires. These are 275 35 ZR18s in the front and I would say they probably have 60 to 70% of the tread left on them. Front fender is in excellent condition. Those stripes are in really nice shape as well. It does have the HID headlamps. Those headlight lenses are crystal clear. Front bumper is in fantastic condition. The only thing I saw is that the lower valance has just a couple little scuffs and stuff but it's not. Those pieces are pretty easily replaceable and the paint on the actual bumper has no scuffs or scrapes and is in really really nice shape. This whole car is in this really excellent condition. The hood is in fantastic shape. I didn't see any major scuffs or scrapes on there. Passengers side front fender looks really good as well. Passengers side front rim is in nice condition as well. I didn't see any scuffs or scrapes on there. I think it's got just a little bit of sticky stuff on there yet that probably comes off. But I didn't see any scuffs or scrapes and as you go down this side of the car take note of how clean that body is, how reflective and never like that paint is. I take these HD videos so if you are far away or even if you're close by and you just cannot make the trip down but you're still interested in purchasing the car, you can see the car, hear the car, and have confidence in the vehicle that you're looking at before you even get here. So when you do get here there's absolutely no surprises and you can make a smart and informed buying decision from wherever you're at. And if this video helps you make that buying decision let your salesman know that you saw the video that it was helpful and that Brett sent you. Very clean down that side. This back rim is in very nice shape as well and the back tires are good to your Eagle F1s as well but they are 325-30 ZR19. So this is a 19 inch rim in back and you can see just how much tread that those tires have in the back. Frame in the underbody kind of looks like new. Very clean under there. Coming around to the back of the vehicle looks really good. It does have the Borla exhaust and that sounds really good. We'll start that up in just a second. You get the dual exhaust with the quad tips. The trunk area is very nice and clean as well. It does come with that cargo nut. You can see the shocks are doing a nice job holding that rear hatch up. And the hatch is in excellent shape as is the glass. Going down the driver's side just as clean as that passenger side. No major scuffs or scrapes on the rear quarter and for full disclosure this back rim is just as nice as the rest of them. Driver's side door looks really good. It does have power mirrors inside. The 3LT package gives you the black leather interior. There are no rips or tears on the seats. You get the Corvette logo stitched in the headrest. Power driver's seat. These front seats are heated. They're both power factory formats. Auto headlamps has heads up display, memory driver's seat, power windows, power locks, power mirrors, both sound. We'll hop inside check out the miles, the radio and everything that this car has to offer on the interior. I'm going to have to start it on. You can see that this car has 9,573 miles. Instrument cluster is very nice and clean. No check engine lights or anything like that. It does have the heads up display on the windshield there. You get Bluetooth and audio controls on the leather wrapped steering wheel. You get the Grand Sport logo on the steering wheel there as well. It comes with the factory navigation system with the nav disc included information center controls. This one does have the telescopic steering wheel so you can see that goes in and out. Not all of them have that. Dual climate controls, heated seat buttons, automatic transmission. There's one of your key fobs right there. That's in excellent shape. Passengers side floor mat and seat are in excellent condition. I don't think this car has ever been smoked in. It smells very clean inside and the headliner is in nice shape. No rips or tears. You do get home link buttons for your garage door security systems and lighting systems and on-starring SOS and compass display in the mirror. Since we're already started up we'll go check out that Borla exhaust and then we'll check out all the lights and under the hood. Borla exhaust has a nice little rumble to it. I would personally like to thank you for checking out the video today and hopefully from this HD video you'll have been able to verify the quality, condition, options, and cleanliness of this car all the way around inside and out. You can see those HID headlamps are working nicely. Fog lights are working nicely as well and just a really really nice car inside and out. Under the hood you have the 6.2 liter V8 LS3 engine 430 horsepower engine base. Very clean, runs very smooth. Once again this car has been fully safe and inspected by our service shop. Has a fresh oil and filter change. All the fluids have been checked and topped off. This car is 100% ready to go. That is not a scratch on there, that is just a little spider web. Anyways I would highly highly recommend this car from a quality and condition standpoint. I don't think you'll find too many 2012's as nice as this one especially an inferno orange with such low miles and see more pictures of this car or one or other 450. New and used cars, trucks, SUV's, minivans, Wranglers, sports cars, Corvettes, Camaros, Challengers, Chargers, Mustangs, GT500s. You name it we got to go to that website right there summitauto.com. Full pictures and descriptions of every single vehicle from two locations all at summitauto.com and I don't think you'll be disappointed in this one. I'd ship this one to California today. And if you want to see more videos you can go to youtube.com slash summit auto. Remember to like, subscribe, and share. In fact any second you will see a link to subscribe to my YouTube channel on the upper left. A link to more Corvette videos that I've done in the upper right. A link to this vehicle on our website in the lower left. Any link to one of our latest YouTube videos in the lower right click those check us out and we're super excited to help you with this ultra clean 2012 Chevrolet Corvette Grand Sport 3LT in inferno orange metallic. Thanks again for checking out the video I really appreciate it. Remember to like, subscribe, and share on my YouTube channel and thanks again for checking out the video.


Hi everyone, happy new release day. I'm Joe for jaspyscasebreaks.com and we're about to bust open some 2020, 2021 Panini Crown Royal Basketball, A-Fox half case pick your team number one from jaspyscasebreaks.com. There's the fresh case right there, looking good. So fresh and so clean. And there's everybody right there. Thanks everyone for hanging out with us on a Wednesday on a new release day. Everybody right there. All right, let's do this. Let's pop open this fresh case. 16 box case, we're doing half of it. All right, so there's one, two, three, four, five, six, yeah. So there's eight boxes in that top row there, which you can see in the camera right there. And there's eight boxes in this bottom row right here. We'll do it live. It's a live show, folks. Let's adjust the color a little bit right up there. All right, warm it up a little bit. Okay, we'll select die, we'll roll the die. Like that one right there. One, two, three for that eight right here and four, five, six for this eight right here. Six, so we're gonna do that side right there. This side we will save for next time. All right, so we'll mark all of those two so we know they're all from the same case. Or Z, it kind of looks like a Z. My twos look like Z's. So we'll leave that on the back table there. I'm certain that we'll do that tonight. All right, box number one. Got Steph on the front right here. Find one autograph and one memorabilia card per box on average. We're looking for the ultra rare Kaboom inserts. A lot of fun stuff in this crown. First box out of the gate. I think, do all cards fit in this? I think all cards fit in. Everything's pretty much an insert anyway. And Kaboom, wow. Luca Donchich Kaboom. Wow, and Lamello Ball heirs to the throne. Die cut relic. What a start. So the Lamello relic goes to Charlotte, Brian Watford. And who has Dallas? That's for Huilin, right there, nice. Kaboom. Now it says ultra rare. So maybe, I don't know how rare they are, but it's a pretty nice one out of the gate.  I think I like the, I feel like they didn't do, so it looks like it's got more of a live background there. Wasn't it in previous years, there was a solid background? I mean, it pretty much looked more like this. I don't remember. But there's Jayshon Tate for the Rockets and Colin Sexton to 49. So we've got a lot going on in here. Actually, let's put that over here. Put those over here. All right, good start. Next box. There's Kuzma, there's Tyrese Halliburton. And there's Killian Hayes. Heirs to the Throne, Relic. For the Pistons. All right, so remember we are using top loaders that are slightly too large because of the top loader shortage. It's just the way it goes. This should go into like a 100, we have to use a 130. We'll put blue painters tape right here before they ship out. But in case it's not there or in case you're removing the piece of tape or whatever, just be careful because the card might be loose inside that top loader. Tyrese Halliburton and there's Jackson Hayes, nine out of 10 die cut autograph for the Pelicans. That's gonna be for Nick and the Pells. I think I saw the other night Zion throw a nice alley-oop over to Jackson Hayes. It's pretty nice. There's James Weisman, rookie cracked ice die cut for Golden State. That's for Yuji. We've got Aaron Naismith right here as well to 99. Second half in the store right now, jaspyscasewrakes.com. Yeah, it's the great top loader drought of 2020. We brought it for early of 2020 and 2021. So it'll be top in and another Lamello ball die cut. It's kind of a cool looking die cut. Knights of the round table, piece of his jersey in there. He's back and playing well already. Just hashtag good for the hobby. Another one for Charlotte Bryant. But yeah, the great top loader famine. We thought we were prepared. We have a whole storage unit full of top loaders and then little by little. Here's to 49.  Once again, that's Nick with the Pallicans. And even those stores had kind of dried up. Here we are today.  It's Cole Anthony for Orlando, Jesse. It's like a Mad Max scenario out there. There's a Azubuque, jazz to 99. Another die cut there. Yeah, I like that too. Traditionally, well no, I think they, didn't it used to be vertical back in the day? Then they changed it to horizontal and they brought it back to vertical. I forget, they all kind of blur in together. But I do like the vertical a little bit better. A little bit easier to deal with. There's another Luke Donchich. James Weissman, heirs to the throne, relic. Die cut relic going off to Eugene in Golden State. Kyle Kuzma, nice. Five out of 49 for my Lakers. Die cut autograph going to Katie. Rough time for the Lakers. All right, there's an RJ Barrett. And there's a Jaumarant to 25 for the Grizzlies. That'll be for Chris. Yeah, I'm pretty sure we'll get impeccable soccer on Friday. I don't know how much we're getting, but we should have some. So when you see it, go get it before it's gone. There's a couple of Isaac Acoros here. Someone was saying Isaac Acoro had a nice game last night. So that's for Cleveland, Raymond. Amazing, what's going on? Where's the Mets in New York? Knights of the Round Table, Ricky Rubio. They won't be in this break, that's for sure. Nice. There's Jared Jackson Jr. And there's Trey Young to 99. Who's the king of some, I'm not, I'm Joe. Not Rob. All right. The redemption is gonna be Lamello Ball. There it is. Jason Wainer with, no, I'll strike that. Brian, Charlie. Brian with Charlotte. Names are right next to each other. There you go. Oh, you're talking about Robert, sorry. You see, there are no other places. Robert, you know this. What other places? All right, nice one once again for Brian and the Charlotte Hornets. I think just the regular rookie Silhouette's autograph. It's nice. Sign those cards, Lamello. Guess he had a bum wrist, we'll give him an excuse. Yeah, definitely an auto, I mean, Redemptions are always autos. Redemptions are always autos. Aaron Rodgers told teammates that he has no plans to return to the Packers. Who wins the Aaron Rodgers sweepstakes? There's another redemption, who could that be? There's Pocosevsky for the Thunder. It's gonna be for Drew. And there's D'Angelo Russell and Peyton Prichard, which is to 75. And the redemption is gonna be, no, not another Lamello. It's Onyeku Okongu for Atlanta. In fact, he played with the ball brothers in high school and then went to USC. So that's Brian Croft again with the ATL. Nice Anthony Edwards, Matthew with the Minnesota Timberwolves. There's Okongu right here, Eris of the Throne, Rookie Relic. It's once again for Brian and another redemption. There's Kyrie and then there's Aaron Naesmith. Any guesses on that one? Nice Yanis die cut here. Deandre, the Sun's playing some good basketball. Now Brandon Clark die cut. Knights of the Round Table die cut and Relic for Memphis. That's gonna be for Chris. There's Isaiah Stewart, Silhouettes Jersey and autograph to 199. There's Tyler Hero and there's a Clay Thompson to 99. No guesses on the redemption? No, no one wants a guess. I wasn't gonna give $20 a break right to whoever guessed it right, but I guess not. It's gonna be Cole Anthony, rookie Silhouettes autograph. That is magic, right? Orlando magic, why am I blanking on Cole Anthony? Yeah, Orlando magic. That goes to Jesse with that one. Sorry, too late Robert. Must be lagging a little bit. Orlando once again, Jesse with the Cole Anthony rookie Silhouettes autograph. And there you have it boys and girls. I'm Joe for jaspyscasebreaks.com. The first half looked really nice. Got that kaboom, among other things. The Lamello autograph redemption. Pretty solid stuff. Second half of the case is in the store. That's pick your team number two and then pick your team three will be from a fresh case. Let's get all of them done. I'm Joe, I'll see you next time for the next Hoops Break. Bye bye.


I hear technology is a geek's best friend. I happen to agree. I don't make movies. Movies make me. It's not about the viruses. It's about going viral, baby. Live for the moment. That teaching moment. Strive not to be a perfectionist, but rather an excellentist. Because you can achieve excellence. I'm armed with the tools to make learning fun. Nancy's my name, and vocabulary is my game. Helping technology make friends one teacher at a time. Maybe, just maybe, someday I can be as cool as Tony Vincent. Although technology may seem to work like magic at times, it is actually teachers who are truly magical. I love using technology to make learning meaningful and fun. Information producer. I'm a curriculum developer. I'm a published author. You'll be one too, and soon. Keep in mind, those who dance are considered insane by those who can't hear the music. Are you ready to dance?


I hope everybody is well and taking care of themselves. In the Congress party, we have been having an internal discussion about some of our suggestions to the government. And I thought in this press conference, I would lay out some of the ideas that are being discussed internally in the Congress party. And it is in the spirit of attempting to help the government and to provide some sort of input from our side. You know that we've been now 45 days in lockdown and we are beginning to run into a little bit of a problem. There is a very strong feeling that we need to immediately, without any delay, get this package to our small and medium businesses, get money into the hands of the poorest Indians, have a strategy for our migrants and start preparing properly for the opening of this lockdown. So that is what I wanted to discuss with you. Feel free to ask me whatever questions you like. Fauji, we are in the middle of lockdown 3 and various experts across the world including the AIMS director here have said that the peak will come sometime in June and July. What do you think should be the government's decision on May 17 and what should guide it? And since you said the Congress has also made some suggestions in this regard. The central thing the government needs to do is it needs to now give a little bit of transparency on its actions. We need to understand when they open, what is the criteria for that opening? So what are the boxes that they want checked off, ticked off before they actually start to open? Number one, and I think it's important that the government tells the people of India that these are the criteria that we're going to be using. And if these criteria are met, then we are going to open. Second, we simply cannot continue without providing support to the people who are suffering as a result of this lockdown. And the thing that is most important to understand that the lockdown is not simply a switching on a key and getting rid of the lockdown. Lockdown requires number of things to happen. It requires a psychological change. Currently the disease in India is seen as a very, very dangerous disease. And it is true. The disease is dangerous for certain groups of people. It is absolutely dangerous for older people. It is absolutely dangerous for people with diabetes, heart disease, hypertension, chronic infection, lung infection. But other than that, it is not a dangerous disease. So we are going to have to make a psychological change in the mind of our people. Basically the people are very scared of the disease. The government, if it wants to open up, it has to turn this fear into a sense of confidence. Do you think that the strategy of this lockdown was the purpose of this lockdown? It is being defeated and people have lost their faith in the government. Is this the reason that people are coming out on the streets? My second question is that you have started a series where you are talking to all the experts. What is the purpose of this series? What are the suggestions or feedback you are getting? This is not the time to criticize. I will not criticize. The situation in which we are now, we have to move ahead from that situation and get out of it in a way. The lockdown did not happen, everything is fine. The place is there, it has happened. It is in the past. But now we need a strategy to open up. I will tell you the nuance in two or three of these. If you ask any business owner, he will tell you that our supply chain, that red, yellow and green, red, orange and green, comes out of the middle of the system. So the healthcare system of red, orange and green, and the economic supply chain, there is a clash. So he says that these two things need to be resolved. Migrants have to give money today, support today. Poor people have to give money today. And the small and medium industries have to help them today. Not yesterday, not tomorrow, today. Because if we don't help today, then the job losses will become a tsunami. So we have to give them confidence and protect them. So the first question is that we need to get a strategy, a way out, a way out. And Congress is ready to help them because we also have states. We have a lot of people who understand these things, who understand economics. And the spirit of the press conference is this. Your second question, these are my conversations. See, normally I talk to a lot of people, in a normal course. And among them, the conversations of a lot of people are very interesting. So I thought that I will show those conversations to the people of India to the people, to the other people. And the basic idea was that the conversations from the experts that I am getting to learn and understand, I will also show that to other people. There is no strategy behind that. Do you think the time has come for a national migrant labour policy? There are pushes and pulls with regards to the migrant labour. The first broad thing that we are seeing is take the idea of Niai and start putting money directly into 50% of India's poor households. Just without thinking of it, just start doing that. It's not going to cost so much. 65,000 crores is what it's going to cost. And it will completely transform the way people are thinking about this current situation, their current situation. Because we have to understand, if you're on daily wages, you do not have choices. You simply do not have a choice. So we have to give them a choice. That's point number one. Point number two is the transfer of migrants. I'm not an expert on this. So I'm not going to set an opine what I think about trains. But what I do think is that a conversation between states has to happen. And these decisions have to be made with empathy towards migrants, with thinking about their rights, so not crushing their rights. But they have to happen between states and the centre has to oversee them. The pain has to be reduced, absolutely. So you're saying the minimum income right away, Mr Gandhi? Am I correct? I'm saying that we are in an emergency. We require absolutely the idea of Nike. Call it whatever you want. Call it something else. Call it run for the run, Manthri, Yojana, whatever you want to do. But the idea of injecting immediately 7500 rupees directly into 50% of Indian households is critical and it's not such a big ask price. Second, the idea that we can simply let our job creators drown. This is not feasible. We have to protect them. We have to make sure that we give them a wage protection scheme, 1 lakh crore wage protection scheme and 1 lakh crore credit guarantee scheme to MSMS. And then we have to give them 6 month interest subsidy. So we have to build a wall for them so that they can fight what is coming. We have to give them a financial support behind them. Look, it is pretty clear that a lot of these companies are going to go down. If we do not do anything, massive number of them are going to go down. So we have to ensure that we build a wall and we protect as many of them as possible. Now, there's another thing here, which is something important that when we think about India's business system, we cannot simply say MSMEs and not big business because there is a link between big business and MSMEs. Most of the stuff the MSMEs supply goes to big business.  So there has to be a view where we are thinking systemically, where we are working to start the economy, where we are certainly giving much more benefit to the small and medium industry. But we are also keeping in mind that there is a link between large business and small and medium business. Suddenly say, okay, only SMM, only small business is going to be out and big business is going to be left to its own devices. We'll actually harm small business as well. Thing to understand in this current situation is everything is connected. And if you want to start the engine, you cannot think of starting just one part of the engine. You've got to start the whole engine. That is why creating demand, putting money into the system, putting money into poor people's hands, helping small and medium businesses, making sure you're protecting some of the larger players. These are all things that are interlinked if you want to start the economy. We haven't still heard from the government anything about fiscal assistance package. Why is it necessary? The assistance is necessary why? No, sorry, you're saying the assistance is necessary why? Why is it necessary? Why is it essential to announce it soon? Because the Indian economy stopped because businesses are collapsing and you need to create demand immediately. You need to get the system started, otherwise we'll have a catastrophe. Now I understand that there is a view in the government that if we move too fast and we spend too much money, we might end up getting a downgrade and we might end up creating problems with the rupee. But my sense is that you've got to take that risk. You have to move aggressively now because if you do not control and defend the foundation of our economy, downgrade and all will not matter anymore. Thank you, sir. India is all about domestic consumption. We have to start domestic consumption. We have to start the engine and I'm sorry to say we're losing time and the more time we lose, the worse the impact is going to be. But why do you think the government is delaying it? I said to you that there is a sense in the government that creating a large deficit will create problems externally as far as the rupee is concerned and as far as downgrading of our country is concerned. But I think the government needs to stop that and move quickly to protect the heart of our economy. Sir, you are talking about decentralization again and again. What do you think is the government's attitude towards the states? What is the benefit and loss of the Prime Minister's quote-unquote strong leader? Thank you, sir. Frankly, if you ask me, the Prime Minister's style and that is his place. That is his style. But in this incident, instead of a strong leader many strong chief ministers, a strong Prime Minister and a lot of strong DMs and a lot of strong collectors are needed. I want us to put the disease at the local level.  Whether he is a DM, whether he is a farmer. But his style is different. I will give you a small example. These zones are made from the national level. These zones should be made on the state level. Our state chief ministers are saying that the red zone on the national level is actually the green zone. And the green zone is actually the red zone. So information is with the state level leaders. So it is necessary that the zones that are being made should actually be made on the basis of the DM and the Chief Minister. The information is with the DM. The information is with the Chief Minister. There is no such information in Delhi.  Do you think that the government is going on trial and error and there are thousands of people on the line for the safety and the life of the people? Look, if we speak fairly then the situation in which there is India today and there is no normal situation then there will be no normal solution. I want to say that there is a solution. If we decentralize and take this fight to the district level then the Indian solution can be removed. If we keep this fight in the PMO then the fight will be lost. So the Prime Minister will have to devolve the power. The Prime Minister will have to trust the Chief Ministers and the Chief Ministers will have to trust the DMs. And if we centralize it then there will be calamity. Prime Minister Narendra Modi, how much money has been spent in the PM care fund? Will the Congress Party ask how much money has been spent? The Government and the Indian Party have to say that Congress is making a decision and it is not helping. Look at my press conference. I did not do any political attack. You asked me. You gave me a lot of opportunities. I did not take any opportunity. Because I know and understand that this is not the right time. This time is of help, frankly. The people of India are suffering. We have to stand with them. We are doing that. PM fund. We should have its auditing. We should be clear who gave the money, how much money and whom. Now clear it. Audit it. No problem. We brought the Indians from Italy, Iran, and three of cost. They were students. They were in distress. But when the workers and workers were brought from Khaadi, the Government was taking charge of them. How is this right? It is wrong. All Indians are one. Everyone should get one treatment. And if we talk about transferring people in this situation, we have to check that whether they are medically checked or not. If they are medically checked and safe, there is no problem in transferring them. In my view, do two or three things. Number one, reduce the fear of the Indian public. Job number one, make India believe that look, yes, it is a scary disease. Yes, it is scary for a certain amount of people. But it is also not a deadly disease for many people. Number two, start talking with the Chief Ministers. Not talking as the boss, but talking as a colleague, talking as someone who is helping them. Forget about Congress rule states, BJP rule states, CPIMs, forget about all that. They are all Indian Chief Ministers. And they should all be working together with the Prime Minister.  That would be very important. And a partnership type of call. Don't dilly-dally, put money immediately into our people's hands. Don't worry about it. Our people are solid people. They will turn this thing around if you give them the opportunity. Thank you very much.