Welcome to lecture 18 of statistical rethinking 2023. One of the difficulties in teaching this course is that I have to find a way to move your mind from the narrow perspective of introductory statistics and help you see that those kinds of approaches and models are very special cases. It's not that the man is moving but the river and once you realize things like this lots of solutions to well ordinary realistic scientific problems open up. There are still coding challenges but the conceptual part is the most important one and that is to get your mind to move and stop seeing the river or the man. In the previous lecture I showed you this much more realistic kind of analysis. Finally, we're almost done with the course, a data set that has lots of missing values to remind you this is the primate family tree. The ends of each branch there is a species and the dots represent different variables. There are just three of them and we'll become reacquainted with these variables later in the lecture and where there are missing dots there are missing values. We simply don't know the values for those particular species they haven't been measured. I like to thank in the previous lecture when we spoke about measurement error that I started to convince you that an observed variable is a very unusual thing which is to say an observed variable with no error or uncertainty of any kind and in this lecture I want to double down on that intuition and convince you that missing data is quite typical. In fact it's the ordinary case. Observed data that is data that we treat as if it had no uncertainty at all is a very special and unusual case in real research. Sometimes it does occur because our measurement device is really really good and we're measuring exactly what we want to measure but most of the time we're just fooling ourselves into believing that we have measured something with no error at all. So measurement error in the previous lecture is a set of methods for confronting that directly when we have some information about the measurement process so that we can put bounds on the uncertainty of a measurement and in this lecture we're going to think about data that are completely missing that is we have no measurement all of them directly and this is what is usually called missing data that is some cases are unobserved. Now of course there could be whole individuals or cats or whatever it is you're measuring that are also unobserved and you could also call those missing data but we usually think of that as a sampling problem but I think it'll start to soak in that it's really the same kind of problem and we can approach it through probabilistic modeling as well. In either case missing data are not really missing when you have a generative model because just like in the measurement error case we do know something about them because there are implications that come from the generative model for cases we have not observed. We know for example the constraints on the variable because we know something about the nature of the variable now so assume we were studying human height you hadn't measured a particular individual's height but you know that it's positive yeah that's a constraint you also know something about the valid ranges it could be it's not going to be seven meters yeah the other thing you often know about missing cases are their relationships to other variables and you know these things through the causal model and those implications through probabilistic modeling can be very powerful and help you make use of the available measured data when otherwise people just tend to throw it away so in this lecture I hope to show you how we approach this first conceptually how do we think about drawing assumptions about missing data into causal models and then talk about the sorts of procedures that people use to deal with missing data because in most real research you will have some one of the things it's often done is simply to drop all cases that would be species or countries or whatever it is whatever the unit on each row is to drop all those cases that don't that aren't complete that have any missing values in the variables of interest and sometimes this can be justified but it can only be justified through drawing causal assumptions now so there's just no way out of it and the same causal assumptions that will allow you to drop cases with missing values will also permit you to do something called imputation which allows you to make use of the present cases that is the observed variables for the cases that have some incomplete values and therefore recover some efficiency in estimating some of the parameters in the model let's start with the concepts up through the break and then after the break we'll do some calculations okay so let's think about a totally abstract parable about missing data now let's suppose as is often rumored that students don't like to do their homework and sometimes the homework is not turned in and there are various reasons for this so we're going to look at a simple dag here where there are students and they cause homework and we're interested in the quality of homework from different students that is ingrating them but we don't get to observe all homework from all students because some students just don't turn it in we don't know how good their work would have been if they had done it so i'm going to draw the dotted circle around homework meaning we haven't observed the true vector of homework values instead we've observed this descendant of it h star which is also a vector but it's got missing values in it that is the students who didn't turn on their homework they're just blanks in there this is what we usually mean when we say missing values we've observed for some cases and not observed for others now what can be done about this should we just ignore the students who have not turned in homework what should we think counterfactually about their homework well depends upon what we believe is causing homework to go missing let's consider the simplest case say the students say my dog ate my homework here's the dog this is a mechanism that leads to homework to going to missing and so the the descendant h star the vector of homeworks with missing values is influenced both by the true homework yeah that was submitted or would have been submitted had the student done it and the dog that eats homework yeah and in this particular dag i want you to pay attention to the dog that is the missing this mechanism in general and what is influencing the homework that the dog eats and in this particular case the dog is as we say random there are no to figure out if there's any bias that will arise from the missingness and analyzing only the present samples we need to well obey the due calculus analyze the graph with your eyes and think about biasing paths is there any biasing path connecting the homework to the cause of interest the treatment of interest that is the student's ability s and there isn't there isn't and i'll show you an example in the next slide where there is and as you'll see how to work with that but in this case there's not because the dog is just like a competing cause it eats homework at random it's not influenced by the student's ability and we don't expect a bias in most cases in this circumstance as we say that the dog the random dog is usually benign i do say usually because in particular measurements sometimes even randomness can be bad here's a simple simulation so you can play with this and think about this causally there's a hundred students and a hundred dogs simulate standardized student abilities in variable s and then their homeworks are correlated with their abilities and then the dog eats 50 percent of the homework totally at random without any regard for the quality of the homework as dogs do and then we have an observed variable h star which has missing those missing values in it and we can plot and what i'm showing you on the right is the total sample in black that's the total sample and then the incomplete sample in red and if we draw regression lines through these you'll see that the slopes are about the same on average and you can run multiple simulations here to play around with this and reassure yourself i haven't picked any special simulation we don't expect a bias for missing us when the dogs are random like this we do lose data though and that's not good so we lose efficiency and we lose precision okay let's modify the parable of the dog in the homework and let's draw an arrow from student ability to the dog that is that the dog is influenced by the student's ability maybe for example students who study a lot work really hard in their homework and don't pay enough attention to their dogs this makes the dogs grumpy and the dogs eat the homework more as an active revenge yeah this is a possibly biasing path now we're ignoring the missingness mechanism that is the reasons the dog eats some homework and not other could result in confounding in the general sense plain english sense that i often use it meaning that you will be misled so this is a possibly biasing path the way you could think about this kind of dag is that the dog eats conditional on the cause of homework yeah some cause it doesn't have to be the student but the student in this case is the cause we're interested in and so this is the most alarming sort of situation so this can be benign yeah but i'm going to show you benign case and then a less benign case it depends upon the measurement scales and the functions that relate the variables unfortunately it's it's you just have to think harder about the generative process in this business so again a simulation 100 students 100 dogs 100 homeworks same relationship between student ability and homework quality now the dog is going to eat 80 percent of the homework but only when but only for students who are above average that is s greater than zero and because they neglect to play with their dogs and then we plot and what i want you to see is the black points the total sample um are showing on the higher values of s because the red values the observed sample has been depleted in that range i'll say this again the black points for the total sample are showing in the on the right hand side of that graph for students above average ability because the observed sample the red points have been depleted in that range now for linear functions like i've assumed here you see the two regression lines doesn't have much of an effect right because it's linear it doesn't matter what value of s is there's the same relationship to the quality of the homework on the vertical but that's a special case that has to do with the functions i've chosen here and the linear additive case is sort of the most benign sort of situation you could assume which is why people often assume it but it's very implausible for lots of situations including homework right so let's imagine something a little more realistic that as student ability goes up there's a ceiling effect on the quality of the homework right eventually you just get everything right on the homework and it can't get any better right we're not grading on penmanship here so now the dog eats the homework of students who study too much just as before but there's a nonlinear ceiling effect on the on homework i've chosen a particular exponential function for this just to make a curve so if you look at the black points plus the red points that's the total sample and you'll see how it eventually homework start stops getting better with increasing s yeah left starts to level off now we deplete the sample again for the students of high ability because their dogs are upset with them it's an active vengeance and we observe the red points and we fit straight lines and you'll see we do get the wrong answer here because we're using the wrong function yeah so this is just to remind you that part of degenerative the reason we go from daggs and then write generative models with functions is because the functions matter okay this can unfortunately get worse and often is worse in real data now let's draw an arrow from the homework itself to the dog uh what could this possibly mean well uh say the dogs have a preference for a certain quality of homework bad or good um in particular say students who do bad homework and are aware of this tend to feed their homework to their dogs now it's the quality of the homework moderated by the students uh who um who that cause a certain homework to go missing this situation is very bad yeah so now you've got a biasing path for sure uh and unless you can model the dog you can't close it there's nothing you can do yeah um the dog eats conditional on homework itself this situation is usually not benign in fact it's the it's a kind of nightmare of statistical contexts and again a simulation on the left I chose linear functions again we'll go back to the simple case but now what's leading the dog the dog eats 90 percent of homework where the homework is below average yeah so students are feeding their their below average homework assignments to their dogs and we plot again on the right and the black plus the red is the total sample and we only observe the red because the bad homeworks on the bottom half of the graph bottom half of the y-axis are depleted and we fit two lines and we get a bias yeah I hope this is intuitive to you it tends to make more sense uh this situation is very hard to recover from unless you can model the missing this mechanism and you know something about the functional forms let me try to summarize these are three idealized cases and they're uh certainly not all the situations you can be in because you know dag can get complicated and you can have missing this in multiple ones and and uh so don't think this is the universe of things but these are the stereotype cases and you want to start by being easy on yourself and learning the stereotype cases so you can scaffold up your conception of the problems so the first one I showed you at the top here is the what I call dog eats random homework uh sometimes in status this is called missing completely at random but that's not a very memorable phrase think about the dog the dog eats random homework in this case in this sort of situation if you want to drop incomplete cases that is um cases where there are missing values that's usually okay that won't result in a bias but it does result in a loss of efficiency if we had other variables here we needed to adjust by we would be throwing away information that lets us estimate coefficients for those adjustments yeah and that's that's a shame we want to use all the information on the table but it's not wrong to drop incomplete cases number two dog eats conditional on cause again in stats this is dreadfully sometimes called missing at random which again is completely uninformative sort of name think about the dog the dog is eating and it's conditional on a cause some variable that we have observed yeah a treatment or something we want to adjust by and what we need to do is we can need to condition on that cause or stratify by that covariate in order to deal with the missingness but we must model it correctly and that was the point of my example where they were diminishing returns on the quality of homework there's no there's no get out of jail free card here and then finally level three of the inferno I hope you never find yourself here the outcome of interest itself is causing missingness and it's extremely difficult to deal with situations like this but they're not rare now the dog story is obviously a comic yeah it's meant to entertain you and draw your attention and be memorable so you can come back to these stereotype cases but there are lots of variables which are which cause them where their own value causes them to go missing I'll say that again there are lots of variables where the value itself increases the probability that you will not observe it think about income you're trying to do a survey on income and people in certain income ranges will be motivated either to refuse to answer or to lie yeah now a lie is not missing you might call it measurement error but that just makes it worse than missing in many ways this sort of thing is not so unusual unfortunately I say at the bottom of this slide this is usually hopeless that's the word that I don't tend to like to use because I'm a hopeful person but this is usually hopeless you just want to report it honestly that this is a likely thing and describe the sample you have and say you can't draw causal conclusions because of the missingness that would be the honest thing to do I think in most cases but there are times where hope springs forth and you can do something about it if you know enough about the missingness mechanism a really common case of this is survival analysis I had a bonus in an earlier lecture when we analyzed the black cat adoptions which use survival analysis and in survival analysis we we nearly always have missing values there are adoptions which have not happened yet and but we know enough about the missingness mechanism and we have strong enough distributional assumptions about the the adoptions that haven't happened yet that we can recover those cases and we can do something about it so it's not always hopeless so what do we do in those cases well in all those cases in the standard middle case dog eats random homework dog eats conditional on cause and exotic cases like survival analysis what we want to do is something called imputation or a more mathematical trick which which achieves the same goal but just avoids having to develop probability distributions for the variables themselves something called marginalization what does this mean Bayesian imputation it means we compute a posterior probability distribution for each missing value remember in Bayes an unobserved variable is a parameter yeah and and the special rare case is a perfectly observed variable we call that data but data is in the minority in in science right usually we have imperfect measurements and those things require distributions information goes into those distributions of course and gives us priors but then we then we need to update through a generative model so we're going to do Bayesian imputation in this lecture and I'll show you how it works in in principle you've already done Bayesian imputation in this course when we did multi-level models remember the Bangladesh fertility example there was a district which we had no data for but we nevertheless got a prediction for it that was Bayesian imputation it just happens automatically and I'll show you some examples after the break the next sort of thing which achieves the same result is this thing called marginalizing unknowns often we don't really care about the posterior probability distributions of the missing data but we want to leverage probability theory so that we can use the efficiency in all of the observed data without throwing away incomplete cases and in that case we can do this marginalization trick we don't have to bother with computing posterior probability distributions for those for the unobserved cases the unobserved values instead we can just sort of average over them using the probability distributions of the other variables I know that sounds weird but it's it's an automatic sort of thing you can do with with probability models I'll say a little bit more about that in a moment and in principle you've done it in the previous lecture in the misclassification example I just didn't call it that okay why does Bayesian imputation work this idea that we can compute the posterior distribution of the unobserved values well because if you have a causal model of all the variables and that's what a Bayesian generative model is it's a joint probabilistic model of all the variables at once then there will be implications for the values that are missing because the available evidence gives you probability distributions for the coefficients that tell you how the variables are related to one another how they're associated and that lets you do the imputation and lets you put bounds on the plausible values of the unobserved of the unobserved variables conceptually this is weird but technically it's even weirder so I'm going to go slow here but don't worry this is a very common sort of thing to do it's not at all avant-garde so sometimes you don't need to do imputation at all it's just unnecessary so if you have discrete parameters for example then we almost never bother with imputation and it's quite expensive and difficult to do the sampling anyway and so the misclassification example in the previous lecture was a sort of covert example of this where I had missing x values that was the extra pair paternity assignment of each child and I didn't bother to compute probability distributions for those I just I just averaged over them using that little probability tree that's marginalization sometimes you want to do imputation though because it's actually easier than the marginalization and one example of this is actually in survival analysis with some censored observations if you have a complicated hazard function the hazard function is what determines the scheduling of the event that is time to event if it's at all complicated something more than a simple exponential the marginalization can be very computationally difficult and sometimes quite unstable and in those cases it's actually easier to treat the censored cases as missing values and model them as parameters and there's an example a coded example of how to do this in the script that goes with this lecture for marginalization there's a fully worked example in the book and I apologize for not putting in this in this lecture but this lecture would be three hours if I did all the interesting material in the missing in the missing data chapter I'm sorry it just has to be this way but please take a look at that if we start with the generative model and we build up to the marginalization code and talk about numeric stability issues and the whole thing the focal data example for this lecture is just going to be the primates data from the previous lecture but now we're going to deal with the missing data and we're going to revisit that analysis and we're going to do imputation for the half the data that are missing and you might be saying that's a lot of data can we really do that of course you can remember in Bayes the minimum sample size is one or actually zero because you get predictions just from the priors and this all of this also goes for imputation there's no magic number which tells you how much data you're allowed to impute yeah if you don't learn anything from the samples and the posterior won't be different from the prior and we can always check that so just relax and trust the axioms yeah to remind you about this data we've got 301 primate species lots of missing data in the three variables interest that is mass body mass and grams brain volume and cubic centimeters and typical social group size there's also a measurement error here and lots of potential for unobserved confounding i want to spend a little bit of time just talking about this sample again conceptually before we get back to the data so remind you what the tree looks like i started the lecture with this picture it's the 301 species if we did a complete case analysis which is what we did before then we end up dropping half the species and this is what we're left to analyze just those and you see you end up with big gaps in certain parts of the trees because there are some species which are just not so glamorous as apes apes are quite well measured but even in the apes we're missing a lot of data so we're going to impute some primates the key idea as i keep saying but maybe it's good to hear it over and over again is that we already have probabilistic information about missing values because of the relationships among observed values in the sample and that lets us leverage all the data that we have observed right so say there's a species where we haven't measured body mass but we've measured their group size we want to use that group size to inform the coefficients in the model not throw it away and the imputation will let us do that and the good news is it sort of happens automatically from the same statistical model you don't have to really do anything different writing the mathematical version of the stat model to justify imputation because in Bayes there's there's no deep conceptual distinction between data and parameter a missing value will be a parameter an observed value will be called data but they're just observed and unobserved that's all there is yeah and so whether something's a prior or a likelihood is well that's whether the river is moving or the man is running in it yeah it's your mind that moves not the distribution so let's take you through this and as I say at the bottom of this slide this is conceptually weird but you get used to that in a little while right do yours in meditation think about the man in the river catching fish it'll come to you you can you can pivot your mind's eye back and forth between the duality of parameters and data the coding is awkward and there's just no way around being honest about that I will always be honest with you the coding is awkward it just is and sometimes packages will hide this from you and that's great but at some point you have to face that technical awkwardness and there's just no way around it but worry about that after the break the technical awkwardness before the break here we're not long from the break let's just focus on the conceptual issues of drawing the missingness into this particular case okay to remind you here's the dag I had drawn in the previous lecture where actually wasn't the previous lecture it was like two lectures ago we've got group size and brain size and body mass and there's some evolutionary history which is influencing a bunch of owners or confounds and that was the justification for including phylogeny and we used a Gaussian process to do that however all three of these variables group size and body mass and brain size have missing values and so what we want to do is draw that on the dag we haven't observed the full g vector we've only observed g star which is group size and missing values and it's influenced by some missingness mechanism which I write here as little m sub g now what is influencing missingness the typical assumption is that it's totally random but that's very unlikely in evolutionary college studies yeah we know scientists don't study species at random and so the species we have data for are a non-random sample of all the primates so for example there's a very strong bias among primatologists to study species that are closely related to humans why well because we're basically narcissists right and that's the whole premise of my field of anthropology it's a deeply seated and unembarrassed narcissism but the consequence here is that it means the the smaller and less related to humans primate gets the greater the probability we're missing some some variable for it another possibility is that larger species are just easier to observe and so body mass it's one of the other variables in the data like body mass might influence missingness on group size so for small imagine small body primates they live in trees they're hard to observe we don't know their group sizes yeah that seems plausible as well but for something large like a chimpanzee they're easy to spot you can count them you know how many chimps are in a group another possibility just to give you night terrors is that the variable itself group size in this case influences its own missingness and what would that mean for example well imagine solitary species are less studied and so we don't know their group sizes yeah these sorts of things can happen and so they're worth considering and maybe you know enough scientifically that you can reject this option but it's it's the sort of thing that is an assumption yeah and it's an assumption that can't easily be tested with the sample so all these arrows are potentially in play whatever assumption you end up making what you need to do is use the causal model to justify an analysis procedure yeah to build some either you admit defeat and simply describe the sample and don't claim that anything any causal estimates can be made or you argue that here are the assumptions that are necessary to interpret the results as causal these are all good options you just want to put your assumptions on the table because assumptions are what license conclusions yeah if your conclusions would hold under any assumption that doesn't sound like a conclusion does it arguments always depend on their premises so lay out your assumptions lay out your premises let your colleagues inspect them I'm not meaning to argue here for any particular version of this dag because I don't know what causes the missing values in this sample I just gave you some hypotheses but I want to show you if you were willing to say it was something like evolutionary history or body mass is influencing missingness in group size then we can proceed yeah but only because we have drawn out those assumptions and we can prove that there's a way forward from there using the generative model and testing the analysis pipeline the reason we can make progress is because once you've got the generative model and and you program this as a probabilistic model the missing values even though they're uncertain that uncertainty will cascade through the whole model in exactly the right way you don't need to be clever or intuit how this works just trust the axioms and all the necessary constraints on the information will be obeyed and the posterior distribution will take it all into account so with that I think we should pause and I really encourage you to review the first half of this lecture before you continue after the pause this is conceptually strange I admit that took me a long time to wrap my head around missing data and imputation when I started this so I'm completely sympathetic to that so do the review jot down what's confusing you can bring that confusion to me if you can't resolve it on your own and then take a break take care of yourself and when you come back I will still be here before the break I had added missing values to group size but obviously all three of these variables mg and b have missing values so I've added the analogs for them a b star for the observed brain sizes and an m star for the observed body masses and then missing this mechanisms for each of them and if we assume that missing this is totally at random that is there are no causes into those little m variables on the graph we know a model that will deal with this because we did it back in the Gaussian process lecture when I introduced phylogenetic regression we will have a covariance kernel k that is informed by the phylogenetic distances d among the species that we get from the consensus primary phylogeny and then we stratify by body mass because we believe it is a confound right it's a it's at the middle of a fork between g and b okay that's just review if we were only modeling it this way this is the sort of reduced graph in the way you think about it that g and m are influencing b this is like a sub model of the whole thing the only part the only causes that we're interested in right we're not modeling the influence of body mass on group size and so the tag at the top of the screen has deleted all the arrows that are not represented in this statistical model and we don't necessarily need them right the due calculus says we don't need to estimate those relationships given our assumptions to estimate the influence of group size on brain size but to do imputation well often we need the whole graph and the other relationships because the dag simultaneously implies um a um relationships among the other variables right we can focus instead on a different estimate on group size and the influence of body mass on it and it will also be confounded by phylogeny or evolutionary history and shared environments lowercase u in this graph and so there would be another simultaneous phylogenetic regression that we could run to estimate that the influence of body mass on group size and of course there is also the influence of evolutionary history on body mass itself neither g or b by assumption in this example influences body mass but evolutionary history does and so we might want to estimate that as well this would be for for the evolutionary biologist this would be an example of trying to measure the phylogenetic signal on body mass all three of these regressions uh big Gaussian process regressions coexist simultaneously in the dag and we can run them simultaneously and that will be the way we will do imputation on these things at the same time uh and be perfectly uh compatible with the assumptions in the causal model and any other approach any other ad hoc approach to doing this is going to go wrong somewhere yeah and this is a point at which i want to point out too that even though i'm using the word imputation and this is a word that's used in non-basian missing data methods as well what we're doing is different uh non-basian imputation does not involve assigning probability distributions to unobserves right because they don't do that um it involves simulating data sets using a generative model and then running the analysis multiple times we're not going to do that we're going to run the analysis once and we're going to get posterior distributions for all the unobserved simultaneously um compatible with the generative assumptions okay a model like this three simultaneous Gaussian processes is not something to take lightly you don't want to try and build it up all at once you want to take small steps and even then you're going to fall down uh making these models is hard it's hard for everybody when you start out so you take tiny little steps you want a friend walking beside you the first time you try it and even then you might fall down stumble a bit and when your friend laughs they're not laughing at you they're laughing with you and they're there to pick you up eventually you can build it all together and practice and get it to run and in our business we all fall down so don't feel bad so we're going to take it slow i'm not going to draw the whole ally once here i'm going to draw a little subcomponents of this model and build it up and remind you um if i were doing this as part of a research project i would also have a generative simulation with synthetic data and i would be testing each little step of building the estimator of the statistical model as well i have to leave that out of this lecture because it would be three hours long but that's the sort of thing that's really worth doing it's not a trivial case to do a synthetic simulation of phylogenetic data but there are packages to help you do that okay we're going to go slow the first thing we're going to do is we're just going to ignore all the cases with missing brain values why well that's the outcome and the species with missing brain values the model will at the end be able to make predictions for those but we don't anticipate getting any value out of imputing the missing cases in the outcome those are just predictions yeah um we then want to impute g and m uh ignoring the models for each which is almost certainly the wrong thing to do but i want to show it to you because first of all this is how you build up code you start with things that are slightly wrong but have some structure to them so you can get the get the machine running and then you add in the complexity and layers uh it will also turn out to be very useful for showing you the consequences of adding the causes of g and m into the imputation you'll understand this when i get there so then we get to step three and we impute group size using the model and you'll see the consequences of that what i mean by using the model is using the causes of g which is both body mass and evolutionary history and then finally we'll get to step four and we'll do it all yeah and i'll show you the results that arise from all of that i will not walk you through the detailed code of the last model because it would take up multiple screens but all the code is in the script for this lecture so what does it mean ignore cases with missing b values well we can take a look at what's missing here so here's a table uh where we see what's present for all the complete cases where brain size is present and you'll see that there are patterns of missingness as well what we're left with after we reduce ourselves down to all the species where we have observed brain sizes you can see that what this little table does is true means observed and and false means missing so you can see that we're missing a lot of values for group size yeah and there's some correlation and missingness as well in these variables but this is what we're left with you did that 151 number that's the case where both m and g are observed and that's what we saw before so now let's impute group size and body mass ignoring the models for each what do i mean by that well what i've got on the screen right now is the full thing the full luxury base approach we're going to end the lecture with when i ignore the models that means i just treat g and m as if they were standard normals yeah uh no causes at all um this is not the right answer but this is almost always the right place to start when building a fancy model like this and go easy on yourself because you're going to slip on the ice okay uh got to take small steps or your fall is going to hurt a lot more so when gi is observed this is the thing to think about this distribution normal zero one that's assigned to g sub i some of the g sub i values have been observed their measurements so when it's observed uh conventional statisticians we call this a likelihood it's a likelihood for a standardized variable yeah it gives us the probability of observing that measurement it's okay to assign it to standardized because we can just standardize group size right when g sub i is missing however since we're basians we get to call this the prior but again this is your mind moving and not the variable yeah is the is the man moving or is the stream moving um these categories uh likelihood and prior are features of our mind they're not features of probability theory and we can exploit that dualism we only need one definition whether g is observed or missing it's just that sometimes when it's missing there's a parameter in that place um and so we will get a posterior distribution for it and uh in this case normal zero one will be the prior for it and but that will not necessarily be the posterior it'll get updated um and uh when it's observed it'll inform the coefficient uh for it for that variable so this looks like a typical uh this is the same kind of code we used in the the Gaussian process lecture this is a Gaussian process regression where the phylogenetic distance matrix there is d mat um and uh no surprises I hope you run this and you get a huge vector of imputed values you get two imputed body masses remember there's only two missing body masses in these uh in this case body masses is much more often measured it's easier to measure than group size because it's not a behavior and uh and then a bunch of missing group sizes you see there that have been imputed as well and you don't want to stare too hard at this table because it'll drive you to madness yeah that's not how we interpret the outcomes of these things we want to plot posterior predictions yeah and so let's do that uh let's think about body mass on the horizontal here versus brain volume on the vertical and what's the relationship between these things and you see the black points of the observed cases there's a very strong correlation between body size and brain size this is totally unsurprising because bigger bodies have bigger brains um and the imputed values there I'm showing you the posterior distributions for the imputed values in red and each of those is a single point remember there's only two and the circle is the posterior mean and then I think those are 89 percent uh intervals you'll see they follow the trend yeah uh even though they both had the same normal zero one prior and that's because the coefficient was estimated and so the imputed values uh follow the trend yeah because we know the brain volume uh for the species and that gives us information about its body mass now what about the relationship between body mass and group size uh the model we just ran is silent on this because there's no coefficient to connect these two variables even though we believe body mass is related to group size it's certainly strongly associated in the sample and you can see that in the plot on this graph in the black points that's the raw data these are there is an association it's not nearly as strong as the association between body mass and brain size but they're associated but look at the imputed values in red those are just posterior means each of those is an uncertain point remember that but these are the posterior means for ease of visualization and you'll see they don't follow the association trend between these two variables we've left some information on the table and this is a consequence of ignoring the full generative model yeah and so we're going to fold that information in now by updating the generative putting the generative model into the statistical model and this will change okay what happens to the estimated causal effect of group size on brain size is the consequence of this imputation well it gets a lot smaller actually as you see here the black posterior distribution on the right is the so-called complete case analysis that's what we did in the previous lecture and the red is after we've done this imputation this is the kind of thing I would call naive imputation because it ignores the relationships among the right-hand side variables we just treated them as normal zero one in the prior and that's almost certainly a mistake because the dag says it's a mistake but this is the first step it's still right to do this first both because it helps you get the code to work remember the bear on the ice take small steps you will fall down but also because then we can later compare and we can learn from that comparison so let's do that let's still going to ignore body mass for the moment but remember small steps we're going to add the generative model for group size which means I'm we're going to fill in the regression in the middle here the center column so that there's a coefficient for the effect of body mass on group size and again we have a file genetic covariance matrix but it's a different one right with its own parameters but it uses the same distance matrix the the so-called phyletic distances among the species but it has its own parameters see they all have sub g on them and that's because the file genetic signature for for different traits can be different okay and now we run this and on the top I do it without phylogeny which is to say body mass is influencing group size but we don't but I don't worry about phylogeny confounding on group size we ignore that issue so there's only one covariance kernel in there yeah one one Gaussian process line in the middle and so that's this model here yeah you can see the model on G the brain model is just above it and it's just an ordinary normal regression it's not one of those multi-normal Gaussian process monsters yeah so again this is not where we wanted to be but we take it step by step and you would do the top model here and get that to run and mix and then you would put in the Gaussian process and that's what I have at the bottom down here where I convert that g tilde normal to g tilde multi-normal and we have another Gaussian process covariance kernel k g this time the covariance kernel for group size and it looks the same but it has its own parameters yeah that weird rep vector thing in the middle is we just want the means here to be zero yeah so that there's just phylogeny in this example so that I can contrast the two again this is not where we want to be because I've taken out the influence of body mass in the bottom model but this will let me contrast the effects of considering phylogeny versus the effects of considering just body mass and then we can combine these two things in the same model just by putting the the line from the top the new is ag plus bmg times m into the bottom model as well and get them so I'll show you all the combinations and again I apologize for taking all these tiny steps actually I don't apologize at all I'm not sorry at all I'm taking all these tiny steps with different sub models because this is the way you should develop stuff even though you know where you want to be but you can't get there right away it would you would you would take too big a step and you'd always fall down okay so let me show you this is what we had before this relationship between body mass and group size the black points or the observed values the red points of the posterior means of the imputed values this is obviously not so great yeah it'd be nice if they follow the trend so let's do that let's layer in on the right I'm going to layer in the other effects here are the imputed values the posterior means of the imputed values for the model that only considers the influence of body mass on group size ignoring phylogeny you can see now it captures the trend yeah it follows a regression line that's clumsily drawn through all those points yeah but notice it it's still quite weird in the sense that group size has a very weird distribution and this is one of the issues because there are lots of solitary species there at the bottom yeah those are the ones at the bottom those are the the ones that that where adult females live alone is there what we call solitary in primatology and there are a lot of solitary prosimians so also some apes yeah and our imputed values are not doing a very good job of accommodating that sort of thing that's not too surprising but it's the sort of thing you want to remark on then we consider phylogeny only ignoring the influence of body mass and these are the blue points these are the posterior means of imputed values using phylogenetic covariance and that is when we don't know haven't observed the group size for particular species the imputation of its group size is informed more by its close relatives on the phylogeny i'll say that again when we haven't observed the group size for particular species the imputed value is informed more by its close relatives on the tree and now you see there's a lot more structure here yeah this is because there's a lot of phylogenetic signal on these things and so it captures a regression relationship without assuming anything about a linear relationship between these two variables it's just the information in the phylogeny so here's the way you can think about that we plot the the OU, Ornstein-Ulembeck Gaussian process kernel here and you see that there's a lot of phylogenetic signature for group size in these data and that's why the imputations for nearby species are hugging one another so much in the graph on the right the blue points on the right okay now purple points i know this is one of the uglier if not ugliest data visualizations i've ever done in this class i'm always trying to outdo myself the remember to remind you the red is the relationship that ignores phylogeny only pays attention to the influence of body mass the blue is only phylogeny ignoring body mass and now purple is phylogeny plus body mass right it's blue plus red which is purple and you see this is very much like the phylogeny part because the phylogenetic covariance is so strong it really dominates the imputations here yeah it moves a little bit you see the purple points are moved a little bit towards the what you might call the regression line but the phylogenetic information really dominates imputation here and that's not that wasn't our assumption right it's it's a natural consequence of the generative model so now let's summarize the inference of all of this and remember in the previous lecture when we only did the complete case analysis that's the i call observed here the black posterior distribution that was the largest effect strong effect of group size on brain size and the different kinds of imputation models only reduce this the one that reduces it the most is the one that ignores phylogeny and as you add in phylogeny it moves it up a bit but overall doing the right thing the honest thing in imputation reduces the strength of the evidence that there's a strong causal relationship between group size and brain size okay we're not done yeah so now we need to do the m model too because body mass also has phylogenetic signature so to remind you so the left column that's the model we started with this is the brain size model it's the model from the Gaussian process lecture really the center column is the model we just focused on where we're modeling the influence of body mass on group size and simultaneously the phylogenetic signal to deal with phylogenetic confounding between these variables and now on the right to get the body mass imputations right we also want to think about phylogenetic signal and we can do that at the same time so this is a very big model i'm not going to show it to you but it's in the script for this lecture and here's what we get if you want to see the details of this it's in the script as i said at the top of this slide i'm showing you posterior distributions for the regression effects and i'm contrasting the complete case analysis to the full luxury imputation but on the same model so when i say complete cases i mean the full model that considers phylogenetic covariance matrices for all three variables for brain size for body mass and for group size simultaneously and i show that in black in each case and then the red is the full luxury imputation so on the in the top left you see the the effective interest as it were the one that motivated this example what's the effective group size on brain size and it's essentially unchanged for the complete case analysis yeah uh so you might feel a little disappointed say you went through all that effort and you got the same result um but listen uh this is duty yeah uh we it's not enough to say well i didn't do the right thing uh because it might not matter yeah you have to show it doesn't matter it makes sense it's just an issue of professional responsibility and sometimes it doesn't matter um and that's because of well the generative model uh saying that you could get away with the complete case analysis in the first place um but you have to show it the other effects it does matter a little bit and so there might be uh something going on here that's worth following up on if you were really into this question so the effect of m on b has gotten larger um and uh after imputation and the effect of uh in uh on body mass on group size has gotten a little bit smaller and this has to do almost certainly with the non random missingness uh on these on these variables this is the kind of thing if i were interested in this sort of project i would explore through synthetic data simulation to see the kinds of um uh biases that arise from complete case analyses when you have these uh sorts of sampling artifacts at the bottom we're showing the phylogenetic signatures so to speak in these cases and on the left phylogenetic signature for brain size is very small but remember this is after accounting for the things in its equation that is net um body body mass and group size there's essentially almost no covariance among the brain sizes of primates after considering those things and then in the middle phylogenetic distance a kernel for body mass so this has changed yeah and this is one of the things that changes the coefficients at the top is that there's less phylogenetic signature after doing the imputation and then on the right for group size the imputation leaves that essentially unchanged so i hope i convinced you that this is worthwhile despite it being incredibly awkward you learn things from the contrast between the complete case analysis and the imputation modeling but it's also duty the key idea here is you already know things or rather probability theory knows things about missing values and it knows those things because you have taught it a generative model and therefore it can deduce posterior distributions for the unobserved values yeah if you believe the model you teach it then you can believe those distributions but remember when we say we believe the model this is a very small world statement there's always model uncertainty that at least in my opinion cannot be easily put under the umbrella of probability theory there's a vast model space an unimagined model still and it's a different kind of creative really artistic exercise to come up with scientific models and interrogate them and the little deductive part of the small world where we build posterior distributions from specific generative assumptions that's indispensable but we need to bounce back and forth between this this highly deductive and objective process of Bayesian updating and specific models and the more subjective and imaginative part of science that is most of science which is theory construction and debate to build the small world part in in this lecture we had another example of thinking like a graph we had multiple equations we used them simultaneously so eventually that when you see enough of these examples it starts to sink in and it starts to seem natural to you and doing isolated regressions single equation regressions will seem very weird i hope this example also convinced you that imputation of of relationships among the predictors is a very good idea if they're in your model and you start doing imputation you probably want to start thinking like a graph immediately yeah so that you're modeling the covariation among the predictors that'll give you partial pooling in fact i didn't make that point during the lecture but it'll give you partial pooling among the imputations across the variables and final thing even if it doesn't change the result it doesn't mean you wasted your time because you did your duty and remember do the analyses that you would like your colleagues to do yeah you don't want your colleague to tell you that they didn't do something that they knew was the right thing to do because they thought it would be hard and it might not change the result that's never a professional excuse okay i hope that was useful and we're closing in on the end of this course next week i will start off by talking about something i call generalized linear madness by that i mean i will introduce scientific models which are not typical statistical models but actual scientific models based upon premises of the things we're modeling and i hope to see you there


Household hazardous waste, chemicals, detergents, petroleum products, pesticides, herbicides, and fertilizers are stormwater pollutants, so proper disposal helps protect our water. That's why Fort Worth operates the Environmental Collection Center for its residents and those of eligible participating cities. Located at 6400 Bridge Street in East Fort Worth, the center is open 11 a.m. to 7 p.m. Thursdays and Fridays, 9 a.m. to 3 p.m. on Saturdays. Visitors need proof of residency, a valid driver's license, or a current water bill. The facility is for residential waste. Commercial, business, or industrial waste cannot be accepted under Texas regulations. The ECC is a drive-through facility, so when you pull in, remaining your car and staff will unload your waste. Leave the products you bring in the original, marked containers, and if the waste is unlabeled, please label contents clearly. Place leaking containers inside a second container. Secure all items in a box or bin, no trash bags, in the truck of the car or bed of pickup for transport. Fort Worth residents can contact<PHONE_NUMBER> to learn more. Residents of other cities should contact their city for more information and to see if a voucher is required. Do your part. Bring your hazardous household waste to the Environmental Collection Center. To learn more, check out the program's details on the city's website.


Welcome to the Donahue group. We're delighted that you could join us in this award-winning show We've been priming for the award. Where is it? We haven't received the award quite yet But when we do we'll be sure to prominently display it so you can share with us our thrill and excitement Along with other shows on Channel 8 So it's a great TV station wonderful people behind the cameras And so we're very lucky to be here joining me today is our usual cohort of Nair de Wells and do-gooders Cal Potter State senator assistant Which are which here now? I got a feeling I know this is going to play out In any event Cal Potter former state senator, and I won't go into the rest Tom Pineski UW-Shaboygan Mathematics professor, and it is my understanding with an administrative position Associate Dean really Congratulations, and we'll try on this award-winning show not to say anything to rob you of that wonderful position You know through scandal or whatever The scandalous Ken Risto Still currently just sitting here at least for a little while minding my own business the king of social studies for the Shaboygan area school district. I am Mary Lynn Donahue or so I have been told Lawyer with O'Neill Cannon Holman de Young in In Shaboygan, and so we're in our city show our county show, and we have lots to talk about I Was not able to attend the Memorial Day parade, which I had been looking forward to as our Son called from Ashland, Wisconsin to indicate his ride had fallen apart, so we were 12 hours on the road on Memorial Day anybody attend I Was in the parade I was in the Dean as it no no no as I was a shaboygan early bird I had a wrote the Rotary the Rotary Club, and we were sponsoring our new lobster Logo we have somebody dressed as a red lobster and Red lobster to be named we gonna have to find a name for him, but we were in the parade and Our red lobster walked down the parade and Yeah, so it was funny we handed out flyers for our lobster boil and no little pieces of lobster to entices to the And I asked people what a little what a baby lobster is Called and I they said I don't know and I said I don't know either So if anybody knows what a baby lobster is He's making this up as we go Oh Third week third week in July, I don't I don't have the date believe it or not. I can't recall Or something yeah, excellent fundraiser at Fountain Park lobster boil $40 a ticket entertainment Supports scholarships that Rotary Distributes to people and lots of other good things. Yep. It's a great club, but I was in the parade. They were like 60 or 70 Entries, so we were like 56. I mean that's as big as the 4th of July and it really went fast because most people They had a couple bands and it went fast and we stopped at the park Fountain Park Speeches were very good. It was fairly quick and And what is it 21 gun salute or whatever it is and I hear the turnout was excellent turnout was excellent It was very nice. I mean what what a great way to turn Nothing into something Silk purse out of a sows ear. I mean I congratulations to the vets groups and to the mayor I think who really you know brought the issue into into sharply for people and Everybody responded so sounds like it was a good time. Yeah. Yeah, it was a good time And it was a it was warm too. So I mean it actually was a Nice day for a parade and I stay for an event so the lobster got hot, but the rest of you were doing okay, but I wore a long sleeve shirt red I Got a little warm running around in the crowd handing out flyers for the lobster boy Well, some other good things happening You should get a dunk tank with the lobster for the event Put the lobster in a tank of water And you're cooking it. Yeah, you should actually have an actual dunk tank. Oh, you and others Oh, and they can sell tickets, you know dunk dunk Maybe we should Okay, did you have like a lot of coffee before you came here today Not much more than usual. Okay. Well, just like calm down a little bit and we'll see if we can move forward here But if anyone does have any ideas for the lobster or the name we're gonna have to introduce Yes, please contact the associate dean Just to bring the the level of conversation either up or down depending on your perspective There have been some good things happening at the city recognition of both at the city and the school district of conservation efforts and It's nice to see municipalities going green as it were. What's been happening at the school district?  I mean across the district We're turning off printers and turning making sure computers are turned off at the end of the night rather than having things on standby You've got televisions in a lot of the high school classrooms and they're in standby And you can turn switches off on walls and there's been an effort to close doors during the winter I think there's been real efforts to turn the heat down, you know, it's April 1st, and there's no more heat No matter what happens to the temperature So that's been a little bit of an interesting experience this summer this spring And a lot of use of if there are overhead fans in some classrooms use fans during the winter Which is something that's sort of counterintuitive to a lot of us, but by changing the direction of the fan We get the heat that's up on top down below So lots and lots of little things and just being a little more aware of not leaving things on at night more than anything else And this may be apocryphal, but it is my understanding that Charlie Sykes had heard about the Energy efforts at the school district and had made fun of it saying that can't possibly be true Someone from the school district called and explained everything that the district is doing and presented hard facts about reduction in energy costs and so forth and Charlie Actually apologized on air or so I I think a rare moment or a rare moment facts were brought to bear and Charlie's opinion changed It doesn't happen that often, but there you go I thought that was pretty cool, and I think that Jean Clayoun is a current alder person who is heading up the city sustainability task forces At least according to I'm very allergic here today. Sorry for the sneezing and coughing and rubbing, but Jean seems to be Looking at more than just token kinds of things, but sometimes even the token things will save you money so it'll be interesting to see how it goes and That hasn't quite come into private businesses yet in terms of energy reduction and so forth, but well There's a business out in Plymouth. It's Orion That's become a very large business and their business is to go into a business and retrofit the lighting and various electrical and energy consuming entities that are in that business and Showing how that what they're paid to do this is recouped within a very very short period of time And there are a number of businesses that have availed themselves of their service and this company is the stock I guess it's doing very well Some of our remodeled rooms here, you know be it's motion activated lights.  I've been in a meeting. It was kind of quiet meeting and all of a sudden the lights went So we go And they go back on again This is just somebody throwing something Yeah, all the rooms that north and south are Organized along the same line So if you leave your office lights on or you step out of the room for really not much more than a couple of minutes And the lights go off and then they come back on when you walk in the room It's made a big difference not a bad idea and particularly with gas at 394 and we're among the cheaper Communities in terms of gas prices. I think things really are changing at least to some extent Mother Jones just to go off subject for a little bit had a long a whole magazine devoted to Alternative energy and what was on the what was legitimate? What was a little questionable rating different alternate energy ideas as their you know the cost of production? I think Ethanol has basically been shown to cost more to produce than you can sell it for and those kinds of things So I mean that these are just interesting times in terms of sustainability, but I think The fact that it's cool and the people are doing it and that businesses can save money at it I think it's just a huge step forward, but you know I wonder what's going to happen to the city and the county budget You know you got all the sheriff vehicles and all the police vehicles are out on the road You got our bussing costs are gonna be absolutely awesome and you got all the public works vehicles They're out regularly work, you know so the fuel budgets gonna have to take a big jump Although I don't know how that's gonna feel like Roger Lies are now retiring Superintendent assistant superintendent for business services the finance guy and just one of the best people in the world At least at certain points when I was on the school board. He was buying gas futures so that Not risky particularly but just good planning that with the idea that prices will always go up to you know It's kind of like buying a forever stamp That you know you've got a fixed cost and and really did save the district a fair amount of money at various times So it'll be interesting. Well, I just want to talk a little bit about Both a newspaper article that was fairly short-lived But then a letter to the editor that appeared recently and this all circulates around that Controversial position of the mayor's administrative assistant. I'm not sure that's the the title Held by Susan Hart, but who's not really doing that job now because she's the interim HR director I was surprised at Steve Sharp One being hired and two being deciding to only stay on the job for a day I don't know quite what was going on there I do think that the mayor on a temporary basis has to fill that position one. He clearly needs it And didn't I mean Ed Serg now as an alderman so he doesn't have he does not operating in his Personnel director mode or human resources mode, but wasn't there some sort of condition on benefits? You know he's a Steve Sharp was a retired fireman and benefits kicked in now He took this job and he was going to lose some benefits and so then he had it I mean Siric was aware of those kinds of things because he was director for Eight years and I think I thought that was part of the discussion that there was some benefits that he Sharp would lose because he's back to almost full-time When he was retired I'm not sure it was that so much as just I Think that there were rumblings about how how it all happened and I mean it just seems to be fairly poisoned in terms of filling that position I don't know what you do. I mean Susan Hart is the interim HR person well Which ties in the letter to the editor was essentially? Why aren't we hiring? The human resources director and why doesn't you know this this other position get filled And it's because they're both the city and county have agreed to talk about shared services And so Susan Hart is in the interim HR position and from what I hear doing a fine job But that administrative assistant position remains open and I mean I don't think until the city and county either decide they can do something or They can't we're gonna have to set a deadline at some point where you say okay We can't come to an agreement. So we're gonna hire or we're gonna put out a Call for an administrator or assistant human resource person. Well, I think the city county Discussions have you know a bit of a flavor of you know mid-east peace talks You know their progress is made and then you know There's certain personality flares and and then progress isn't made anymore. And so I I guess I I would be Both hopeful and a little discouraged at the same time about anything ever really happening But the city is not actively looking for a human resources director. I mean it just isn't Because there's an interim who's doing a good job and They're looking and exploring with you know with the county about ways things can be shared It's interesting. I don't know. I don't know what the answer is to it, but Did they get a finance director by the way Yes I That's good. Is he started or she the young man's name and I say young because he is young Of course almost anybody is young in my view these days except well no and He's 30 just sitting here 33 and from a suburb of Duluth and I'm very affable has a great skill set. I think and You know anxious to move the city forward and So I think the change all the computer technology get new stuff and bring that up again Because it took a while to find a suitable candidate within the price range of the city. It did it did yeah But the couple the the city has not even begun the process of filling that human resource person right well, there was the big brouhaha when when the mayor appointed Susan Hart and Right and so since that time Susan has been acting. She's withdrawn her application To be HR director, but his acting is the interim and it's my sense probably doing some of those administrative Assistant jobs as well. She's you know pretty energetic about it But well now the city does have the the new IT person to Julie. He's going full guns I mean, he's like shot out of a cannon and so the the I think the city has made more progress computer-wise in the last two Months than it had in the last Well number of years. Let's put it that way We've moved up away from 1985 and how far much farther. I don't know but but it should be interesting I don't know city politics is It just never does seem to calm down particularly does it? We have these different camps Perez camp and then you still have the old shrimp camp and there's a recall folks that are still out there And you know, we are seeing it with the people who are already saying they're interested in running for mayor And so when any type of these decisions come up, you're gonna have somebody Coming in with a contrary decision or opinion and a letter to the editor just So this pot is just ready to boil and it's gonna and then during really boil during the next election Oh, I think so. I think it's gonna be a hot one. I think it'll be very interesting Yeah, and strategically maybe the mayor didn't necessarily want to announce quite sorely That he was running for re-election, but he did and so I'm surprised only two people have come out Well only one formally belong in The word is certainly that Bob Ryan will be doing that and that is very early I mean we're talking about a year next year like yeah, the next election is the major presidential election That's not till November right talk about after that. It's just too early. Well, I remember Back in Susha's time Richard Susha You remember Eddie Darko Remember the name I remember I was a new alderman Eddie Darko was the new alderman and after council meetings we would go down to Susha's bar or something have a drink and then one time I went down with him And Tim Lorenz and we stopped at the Harmony bar. I have a drink after a council the next day Tuesday was the final day for filing nomination papers for mayor This was January we had a meeting in January council meeting on Monday and Tuesday was And having a beer Eddie said, you know, I think I'll run for mayor Next day Got his nomination papers in it when he gave the mayor Susha A run for his money run for his money. Yeah, oh funny. That's how you know, you got plenty of time to decide You know, I think those I think those I think those casual days are gone don't you I'm not sure we would necessarily get anything like that again, but Interesting well also Just changing the landscape a little bit and while I don't blame them one bit and I'm going to ask our librarian To talk about it. We now have I think the headline was even library police You can now go to jail For not returning your your books and Judge Dela Hunt of the municipal court does Is not at all shy about throwing people in jail for not paying fines so Oh dear is this what do you think? Well, I think Things that people don't return I'm cheap any longer. You want to buy a book you're talking about $25-$45 and people Sometimes take whole arm loads along and they don't return them and they've literally got hundreds of dollars that they've Scandid from the library which means the library needs then to replace those materials when someone wants them and Because they're on the card catalog. They're supposed to be there and if somebody says literally stolen it by neglect if nothing else They ought to be held accountable. I think people have maybe got this image that it's a ten cents fine or something You know, there's nothing what's the big deal about we not returning a library book or something But I get you get to a point where some scoffals gotta be held accountable And how do you do it? How do you convince somebody who's got a pile of books in their house that they should return that they ought to do it? Some people you got to hit them alongside the head to get their attention. I don't know how else you do it They do you send them notices saying they have overdue books and would you please return them? And then if that doesn't happen their name goes to a collection agency and the collection agency tries to recover Recover the book and then if they can't well the next step is the police I think a lot of people have not used the library facilities for a while. Don't perhaps realize to the library Loans out CDs and DVDs and a whole host of things other than just books And so, you know, some people said why would you care some folks? Why would you even keep books? Books Car with bunch of books and it would steal books But there's a lot of other things that they loan out as well that can run up a big bill pretty fast if they have to Be replaced right and I do think it's a public trust Yeah, and I do think that at a certain point you when you have just like the county has a large number of collections out in the city And so forth it You do have to take some some aggressive steps to start collecting so And I think in most cases it's not going to be one book. It's going to be after a process that Tom You know explain plus it's going to be something of substantial amount of accumulation $500 or whatever it happens to be and that's gets to be theft to a certain point It really is I mean it's negligent. It's I don't think normally it's not intentional. I mean my boys I always said my Lovely boys who adored the library and were there all the time and yet could not get their things back on time I just proudly stated that we were great supporters of the library Many ways, you know through our taxes and donations that we made and then the fines that my boys had to pay and continue to pay and Michael's credit record is is Terrible because all the fines that have been sent to the collection agency and of course he eventually does pay them up and now We really would like him not to get arrested We will urge him to continue to do that, but other small things Paul Gruber dr. Paul Gruber great guy has Suggested that the city enact an ordinance banning the use of cell phones while you're driving And I understand I think in the hand you could have the car Right for the headset hands off hands off with the Bluetooth. Is that what it is? Don't you still have to dial? You know press the buttons. We're getting to the point where no no you just Depending on the facility depending what you have in your car. Yeah, okay, but it was if you're actually I want those little things Yeah, yeah Well, you know in the last Three or four months. Well, I've been driving through the swing streets on 8th and Indiana Avenue and a couple other places like that. I Have narrowly missed hitting three cars because they blew through stop signs and all three of them were on the phone at the time They went right through the stop sign and they were on the telephone and they were just oblivious They're just that both is There's a whole lot of studies now that have been done that show that you really it's unlike listening to the radio or some Other things that you might be in the car This is a whole different set of tasks that really do take away from your ability to to drive safely Even worse than eating a quarter-pounder, huh? Putting on your makeup Well, and I really had to stop doing that. I guess aren't there some cities in Wisconsin have have already established those ordinances Yeah And I don't think it's so unreasonable in this meaning like Sheboygan Where you have ample parking off-street to pull over to the side of the road and continue your conversation Without going into a heavy traffic situation talking on the phone I don't think that's that much of an inconvenience It really is the rotary situation in particular I mean you really have to be kind of alert and I've discovered you really have to use two hands to turn around the circle and so it did it really does help to have so instead of Moving the hand around in the jerky fashion. Well, it'll be interesting to see what the city council does. I I think it's a great idea it's it's just too dangerous and So we'll see what happens with that. Well, it at least keeps it keeps the city council busy and you know doing productive things I I Also wanted to note that the room tax is up 10% for the first quarter which Blue Harbor, it's my sense is not doing well and And yet for those revenues to be up that much I mean essentially means more people are in hotel rooms. It is an 8% tax and Sheboygan is one of the lower ones, you know, you go to some cities and you're paying 11-12% tax, you know, so your hundred dollar room is suddenly a whole lot more expensive than you then you had Anticipated, but it's a great revenue source and you're dinging the people from out of Dinging the people from out of town. So I am what's the hotel downtown across from the bank? The new one that's going up is called the grand stay Are you talking about the old executive and it's been remodeled refurbished model Those rooms are on right, right That could add well rates are probably up Considering energy costs have gone up and all the different costs of just maintaining a hotel labor costs I'm sure so if you're gonna 8% you know increase of a higher rate. You're gonna collect more. Yeah Well, I am the the new hotel is going to be open I was at the business to business expo yesterday that the Chamber of Commerce did at UW Sheboygan here Which was terrific and one of the exhibitors was the it's called the grand stay hotel and That's the one going in on the parking lot And I went up to the woman who's the general manager very affable and she's very cheerful in their opening. I Think July 16th. She said Which since the brick seems to be going on Brick by brick. I mean it's not going on and a great speed Whatever thought that it'd be hard to find a parking place in downtown Sheboygan remember the vast lots of parking lots You know, I mean you could have parked an army in downtown Sheboygan now Not so much. I think it's going to be Parking places are going to be a little bit more dear and Which is great. I mean it really shows that there's there's good business going on and and things like that so And just finally we just have a couple of minutes left Noting the reopening and the moving into of landmarks square and I Anybody here know anybody who's moving in I? I do I do too, but I can't come up with a name because somebody just told me they were moving into landmark I just know So that's who it is. It's Lucy. Dolly-Bolly. Yeah, my former colleague at South High School Spanish teacher Long-time Spanish teacher and now over Lutheran and some other places. Oh, and they're just a ton of people That's why I ran into her at Yonkers this last week. Yeah, she was devastated by the burgers I was at Yonkers And so now we're getting back into the lobster boil I think that I'm looking forward to the lobster boil. I just don't want to jeopardize our award-winning show and you know I think this is why we got the award The big claw award I'm with you Tom In any event I do think again just the level of building that's going on in In the downtown is pretty pretty amazing So it's it's good stuff and we're on the move and we are on the move We'll say goodbye and hope to see you again sometime soon


So if you go back to when you were an infant, right? Little Tommy's learning how to walk, right? Any faults? And he gets a, any faults?  I cannot believe I didn't know how to walk.  I can't believe I did that. You're probably like, no, Sarah, of course, I didn't do that. So why are you regretting things now?  Okay, and I want you to hold that thought in your head and I want you to think about where it led you or what it taught you because the thing is as much like when you were an infant you didn't know any better at that time.


What's going on, everyone? Sam here with Layton's Sports Cards. We've been 23 at Panini Select, WWE, Hobby, Six Box Break, number four, random box style. Again, we have boxes, one, two, three, four, five, six, how I took them out of the case. Do the random first. We're gonna roll the dice. We're gonna go full 12 times. We've got our six participants, and then our six numbers, one through six, representing your box numbers. 12 times, one, two, three, four, five, six, seven, eight, nine, 10, 11, 12. James H down to Jason L. 12 times on your box numbers. Yes, it is took. One, two, three, four, five, six, seven, eight, nine, 10, 11, 12. Two down to six. Oh, Steve is here. Steve, no birds. Oh boy. Got birds. Got James H at two. Matthew, I'm at one. Ed with four and three. Brian H at five and Jason L at six. All right, let me get these copied over to the website really quick, everybody. So you have your results if you'd like to see them. Create, paste, results for copy. There you go. There's your results, everybody. Sort range, copy. All right, box number one. We're gonna start with Matthew, Matthew N. Good luck again, Matthew. See if we can follow up your red JC Jane with something on par. Again, believe the zebra will be here. Believe the zebra will be in this as well. Oh, there's Serena. Oh boy. That's pretty cool, Tepa. That's awesome. Shrakaala is Kofi Kingston. Oh, come on, Donnie. Eoskeye and Jinder Mahal at Shulton Benjamin to 175. That is the true red. A Tegan Knox and Booker T. That's cool. I like that card. Really nice. Hello, Steve. Tideye Goldberg. That is going to be 22 of 35. Nice one there. Congrats, Matthew. Another one. They're Tideye. That is going to be 33 of 35. Dilo Brown on the Purple Auto. Ring side action. At first I thought it was a Tideye Gold. I was really confused. It's like, what's that barrel? That'd be new to me. Roman Reigns. Nice one there on the silver ring side. Ilya Draganov, Julius Creed. My favorite, probably Ray Mysterio. I was always a Ray Mysterio fan. Six-one-nine. Oh, yeah. Silver Erika Tezawa or Erika Tezawa and Candice LeRae. Oh, six-one-nine, Donnie. People's elbow done in it. That'd be pretty cool. Bronson Reed, Bruno Samartino or Hurricane Rana where he goes like all around them. I think I would try that and we both collapse. I think I'd just try that and we go boom. That would not be great. There's Apollo Crews on the Maroon to 149. Nice one there. Ring side Chad Gable and Stone Cold Steve Austin. We need to talk to Rich about getting a wrestling ring. Yeah, right. Silver Kofi Kingston. Oh, I got a three-might-three wrestling ring. Seth Reakin Rollins. Nice one there.  Zebra, here we go. Good luck, Matthew. We've got Booker T. Zebra, case hit on the concourse. Can you dig that? Love it, dude. That's awesome. Congrats, buddy. On the Zebra. I'd say just not as well. Killed it with your two spots there, Matthew. Hit a green and a Zebra. Get that into a mag for anybody. Silver Sonya Deville. That is a bronze breaker. Nice one there on the red auto. Bronze drum and Stone Cold Steve Austin. Nice, nice, nice, nice. Great picks there, Tipo. Tri-color is Becky Lynch. Got a Sola Sokoa and Gunther. Last pack here. We've got a Silver Dyka, Brooks Jensen, Silver Elias on the ringside, and Madcap Morse. So pretty successful, I would say there, Matthew. Pretty successful. Yeah, no problem, buddy. You got it. James H at two now. James H at two. Plus, Matthew, you got yourself two entries into the national front. So win, win, win right there. Win, win, win. That's a lot of winning. Our first conflict resolution is going to be lose, lose, where nobody wins. Skip to number five. Win, win, win. Oh, we'll do that because I win, too. Hey, Sammy Zane to 175. Which episode is that? Conflict Resolution. Hulk Hogan, where Oscar doesn't like Angela's poster of the babies playing instruments. So the resolution is Oscar to wear the poster. There's a white of Randy Orton, the Viper. Watch out, watch out, watch out. Almighty Bobby Lashley and Bray Wyatt, Bray Wyatt. Snoop Dogg. Oh, are you from Connecticut, T-Po? That's where I grew up. There's Yokozuma, Gable Stevenson, Lita. I've been to that. I've been to that venue. I've had my fair share of nights I don't remember from that venue. There's the Almighty Bobby Lashley, good ol' Xfinity Theater, Dominic Mysterio, and Ravishing Rickward.  It's just, it's so like dangerous being in the lawn.  Oh wow, okay. So like if you go with your friends and you get lost, there's no service, you're screwed. And then Silver Rock Hill Rodriguez, redemption, Sami Zayn, autograph, memorabilia, James, congrats man. I swan there buddy. All right, from Milford, nice. Yeah, I grew up in like, I grew up in like the Hartford area. I'm from like Central Connecticut, nice. We got another tie-dye coming up. There's Silver Guru Raj. One of 25 is Zelina Vega. I swan there, that's an awesome patch on that one too. Superstar Warn slash used material, Oshka.  Braun Strowman and Kevin Owens and like he had to get like taken out and like a wheelchair and his buddy, his buddy is like, he's like, he's fine. He's fine. And we're like, he's not fine. Yeah, there was a, I forget what concert it was. There's Candice LeRae to 199, Charlotte Flair and Tamina. I think it was Chance the Rapper came. And I think 91 people got hospitalized. Wow. Yeah, Silver Mankind. He's being passed out drunker. Paul Kogan, Sami Zayn fighting. There's like, you will, no matter where you're standing, you will probably see between seven and eight fights. Silver, Liv Morgan. Silver is the American Nightmare Cody Rhodes and Roxanne Perez. I remember like my buddy's roommate from college, you're like, I didn't even know because we were going into our freshman year. So like his, his, we got Ed coming up next, by the way. So like his, this kid that he met, who is also from Connecticut, like met us there. And like, I was standing next to him and some kid just like, went like, tried to like get by him.  And I'm like, like, what is happening? I don't know what to do. I just stepped backwards. I'm like, I'm getting out of that. Yep. Good luck here, Ed. Let's do it. Oh, absolutely. Absolutely. Toke. Silver cactus jack. We've got a Raquel Rodriguez, red auto signature selection, selections to 49. Nice one there, Ed. And the Miz. Got, what's up, Dean, by the way. And we've got Donnie here. Donnie next. I'm here. White, Sean Michaels. Nice one there too. 125. I don't know who's asking behind. Dean, Dean, I and Big E. There's Angelo Dawkins, Finn, Baller, Jagerie. Got it. Been always got to keep reminding yourself. I know, dude. Limp Bizkit, Lil John, Ludacris and three doors down, man. That is that is a crazy lineup. Silver of Trish Stratus. Carry on crossing the rock.  That's wild. I've never been to Stafford Speedway. No, I've driven by it before, but I've never physically been there. Silver, Rowdy, Rowdy Piper. All right, Ed, we got a redemption. Carmella autographed memorabilia red prism of Carmella. Nice one there. Congrats. Very solid. Jerry Lawler. That is a red of Lundra Blaze, 2175. That is a Matt Riddle and Braun Strowman. So the way impeccable team all set up, Dean, is it has eight boxes in the case. It has one stainless star's red on top and a single pack. And then it has, I believe, five cards, three base, and then two either autographs or RPAs numbered to 88 or eight or one. So the highest numbered card you could possibly get is an autograph to 88. Purple Stone Cold Steve Austin to 99. The Rock and Braun Breaker. It's pretty solid. Yeah, it's really good. It's really the impeccable team all every year I tell people, I'm like, it is really solid. That is a William Regal, Oshka, and Chili. So in an eight box case, you will guarantee to get 16 autographs. That is an R-Truth, Roman Reigns, and base. Yeah, stainless stars per box and then one bar card per case. I think it's usually numbered to six, I want to say. I think in one case we had a two bar card. Did we really? Yeah, it was Kyle. Dabba Kato to 149 base and base. I think it could be wrong. I thought maybe we had two. When I was really young, I used to go to some of the car shows. Never been any Meats or anything. Piper Niven to 75. That is going to be Kevin Owens to 99. Nice one there. KO on the superstar worn slash used material. Purple Cactus Jack. Nice one there too. 99. A Montez Ford and Dragon Leap. All right, pretty solid one there for you, Ed. Ed, you're coming up again here at four. Good luck here, Ed. Let me drop you guys a link again to impeccable team all. That's got four to go. Had two bars in the case last night. Oh, nice. Oh, perfect done. That's awesome. Tend to go on flawless. Yeah, it makes perfect sense. Check's out. Check's out. Confirmed. Confirmed. Lime Green Joe Coffee to 75. Mysterio and Cruz Del Toro. That's cool. It's Joker themed car. That's awesome. Purple Hank Walker to 99. Sonja. Silver Randy Orton. Shotzi on your superstar worn slash used material. Relic cart. That's Ed and Undertaker. That is a tri-color of Cameron Grimes. Kurt Angle and Shinsuke Nakamura. Silver Johnny Gargano. Hollywood Hulk Hogan. John Cena.  Got Silver Braun Breaker on your sensations and Hollywood Hulk Hogan ringside. Tri-color Seth Freakin' Rollins and a carry-on cross. What kind of car is it, Tifa? White Axiom. That is really cool. Going to be two at 199. We've got Auto. Two. Silver Auto is Santos Escobar. Nice one there. Hey, thank you there. Brian picking up two and Dean picking up one. We're down to one spot to go now in impeccable. And Dean picking up a bunch of different spots as well. Dean, I appreciate that as always. Nice. So good luck everybody. We're down to just one to go in impeccable team all now. We got to fill Flawless and our dual case up, everybody. Jake Roberts to 175. Red, Gable Stevenson, Becky Lynch. That's the only group race with spots tonight. Incredible. Thank you all. Very solid. Really awesome. That is a Diamond Dallas Page. Oh, almost. AJ Styles. That's the filler. And Roman Rents. Chief is packed. Probably a blaster of some sort, I think, Tifa. We don't sell anything by the pack, just by the box. Sami Zayn Silver. Hakai. What up, buddy? Three up 35. Jerry Lawler on the Auto. There you go, Ed. Congrats, buddy. Nice. Worm. Jerry Lawler Auto. That's sick. And the Godfather. Purple. Finn. Valor to one to 99. Yeah. Okay. Matt Riddle. I'm not saying anything you said right. Okay. All right. If I don't hear anything from Donny, that means I said whatever the, I said the name. So there'll be a second pause between every time you. Yeah. I just, I have it in my head. I don't know why I always think that's what it is. From Baylor University. Yeah, honestly. Brian H. number five. Good luck here, Brian. Yeah. Pretty solid for sure, Worm. Thank you. Thank you for selling us out on that one. I appreciate that name. Silver Dica, Eddie Guerrero, Silver Dominic Mysterio, and Zalina Vega. Shrai Kular is Ludwig Kaiser, Emma, and Alexa Bliss. Silver Ilya Dragunov, we've got Ilsa Don on your NXT Silver Signature Selection Auto. Ilsa Don. Nice one there. Congrats. Brian, a Baron Corbin. There's a X-Pack Blue to up 249. Got 11 or 99. Candice LaRae. Superstar worn slash used material. Relic car and base. Helly game one patch card along with two other autos. Wow, that's not bad. That's awesome. Was that in the superlatives break on the fly today, Dean? That's Roman Reigns White. Nice one there too. 125. Mace. Mace. Silver Tatum Paxley. Elias and Ronda Rousey. Yeah, I don't know. They might still, Steve. I don't know if you can get them ripped. You might be able to get them shipped. I don't know. Korra Jade. God, I haven't seen Caleb in months, dude. It's weird. Weird that next store used to be the entire late in gaming operation. Now it's on store. There's Hulk Hogan. Seth Freakin' Rollins. Shawn Michaels used to have them every day. He'd be over there. You hear him screaming through the wall sometimes. Charizard. The American Nightmare Cody Rhodes. Sola Sokoa and Ridge Holland. That guy's a bot. That guy's a big time bot. There's Shawn Michaels to 199. Alexa Bliss and Cactus Jack. No, I think it was Leaf Superlatives, Steve, which we have a lot. I mean, they've been flying off the shelves with Kyle over on Personals. There's a Ludwig Kaiser to 175. And Stone Cold Steve Austin. Last pack here. Silver Angel. That is going to be 57 of 99. Bailey Jersey Auto. Or Relic Auto. Nice one there. Brian. It's our first live Relic Auto. We pulled out of this case. That's awesome. Very nice. And Guru Rajdude. Get late in Channel 2. Really need something better to do. That's all I know. We have our poor customers are waiting for their boxes to be ripped. We have this, this Nair Duel coming into my chat and calling me a bot. What? I don't know. He's glitched over there, God. All right, we've got Jason L at number six. Good luck here, Jason. Listen, I'm running on like my seventh, eighth, ninth year or something like that. Get him out. Montez Ford. Oh, glad to meet you. JC Jane and Bailey. I'll go home and sleep, Sam. There's a maroon of Hank Walker, two at 149. Stone Cold Steve Austin in the midst. I have to, we have a freaking bug guy coming on Tuesday. So I can't even sleep in on Tuesday, seeing him between eight and 10. Korra Jade. And I work on Tuesday. DJ Jack. Oh, yeah, for sure. Those were licensed, especially everything being like game worn. Bianca Belair on the blue to 199. Kevin Owen, Sami Zayn. Do you think it's like they want, if they were willing to pay the money, like they would be able to like lease the license out for like X amount of years? Alexa Bliss. I just, I have no idea how it works, to be honest, with the details of the deal. You're probably not allowed to do that would be my guess. Emma, Charlotte Flair and Big E, because I'm sure whoever has the exclusive license wouldn't want to share it. Silver E.O. Sky, Silver Global Icons, Grayson Waller, and Brett Hitman Hart. I mean, if they've got limitations and they get money for it, why not? True, true. Silver Bailey. That is a Oshka on the ringside action auto. Nice one there, Jason, Brad's buddy. And A, Camina. Yeah, they're really nice. Kyle's been open a lot of them over on channel too. Alba Fire to 249. Global Icons, Rowdy Roddy Piper, and Bron Breaker. There's Bron Breaker to 249. Ultimate Warrior and Ravishing Rick Roode. Two packs to go on this break. Green is Ray Mysterio. To 75, that's the lime green Ray Mysterio. Kofi Kingston, Filler, and Oshka. Red is Matt Riddle to 175. Ray Mysterio, Filler, and Jaggeried. That is going to do it for the break, everybody. Thanks again for the fill on that one. I do appreciate it. Coming up next is Top's Chrome.