It is my pleasure to introduce one of the main organizers of this workshop, Jean-Barbier, which will tell us about bias-optimal limits in structural PCA and how to reach them. So, Jean, please take the lead. Thank you Francesca. So, Federica, I'm sorry. I'm sorry, this is... I wanted to present this work because I thought it was really on spot for this conference and it's something I'm still pretty excited about, so I hope I'll be able to transmit it. This is a work that took us quite some effort to bring about. It's something that is connected to Beijing in France in a problem that we all know very well, which is principal component analysis. And I will tell you some things about this problem in a setting which is slightly different than the one we're used to where noise is considered independent unstructured. We'll try to go a bit beyond that, which is precisely the point of this conference. And so this is a joint work with people that you will, of course, recognize. Francesco Camilli, who is not anymore in Bologna, but who is now in ICTP here. We're lucky to have him here for a few months. Marco Mendele, who is in the crowd that you all know. And Manuel Saez, who is another organizer and that is going to arrive tomorrow. So this paper, you can find it on archive, but hopefully in a week or two it should be accessible in the proceeding of National Academy of Sciences. So what do you do when you have access to a large matrix of data that can represent anything? Just for the sake of simplicity in this talk, I will consider all matrices to be symmetric. So eigenvalues will always be real. So what you do, of course, the first thing in order to make any sense of this data is to diagonalize this matrix and try to find the dominant eigenvalues and eigenvectors. So this is PCA. This is actually spectral PCA because here you really, this is a spectral algorithm. And what happens when you do spectral PCA in the ideal world? So let's start with this case. So the ideal world in the realm of the statistics of inference of matrices is the so-called spike models that looks like this. So the data matrix Y is constructed as a low-rank matrix of information X star, X star transpose. The star will denote the unknown vector that you want to infer. And the noise is Z is a Wigner matrix, which is of size n by n. So this was introduced in the context of statistics by John Stone. And it has been studied by many communities, in particular in random matrices. And this is what led to the understanding of the most famous threshold phenomena, phase transition phenomenon in information processing, which is the well-known BBP transition that stands for Ben-Haus, Bacon, Pechet. We understood that around 2000. So what is this BBP transition? So this spectrum here represents the eigenvalues of this data matrix Y. And what you see is that you have a bulk of eigenvalues that lie below the well-known semicircular law, the Wigner law. And you see an outlier here, which is actually associated to this rank one matrix. So the eigenvector associated to that is not exactly X star, but it is correlated with it. And you see that this outlier pops out from this bulk in the case, actually, where lambda is big enough. And so you have this phase transition. If this lambda, which we call the signal-to-nose ratio, is not big enough, this outlier would not be there and it would be hidden in this bulk and you could not perform in France. And so I call that the ideal well because in this well here you see that this noisy part is assumed, is very simple in the sense that it's essentially Gaussian. It has independent entries. Now if you look at this problem from the perspective of Bayesian in France and information theory, the kind of picture that people obtained over the years is the following phase diagram. So here I plot the so-called mean square law as a function of this signal-to-nose ratio, which controls the hardness of the problem. And the picture that was obtained is this kind of generic phase diagram where you have the presence of a so-called impossible regime, an hard regime and an easy inference regime. So let me tell you what they mean. In this impossible regime, which is below the so-called information theoretic phase transition, you see that the MSC of any algorithm, in particular the black curve corresponding to the minimum mean square law, which is the best error you could reach with the best algorithm in the universe, independently of any computational concern. So usually this algorithm requires an exponentially large amount of time and computation to run. But let's say we don't care about computational questions. This is what you would reach anyway. The performance would be very poor. And so this is a phase where there is simply not enough information in the data to say anything. So it's a statistically impossible regime. In this easy regime, what you see is that the MSC is instead very low and actually it overlaps with the performance you would reach with an efficient algorithm that we've heard about already, which is approximate message passing, which is this red curve. And so we call it easy because there exists a polynomial time algorithm matching the performance of this usually unreachable minimum mean square law performance, which is really the base optimal performance. Instead, if you were to use the spectral PCA algorithm that just take the data, diagonalize it and look at the principal eigenvector. So the first eigenvector associated to the top eigenvalue. This is the performance you would reach. It would still be non-trivial. And you see the transition is at the same point, the so-called algorithmic transition. But it would be not as good as AMP and very far actually from this MMSC performance. And in between you have the presence of this hard phase or what we call a computational gap where we don't know any polynomial time algorithm able to say anything meaningful. So the AMP and spectral PCA lead to that performance while the MMSC performance is there. And so this picture has been obtained through the hard work of many people. Actually, the list here could be a whole slide. I just put some names that worked on this. So this diagram here, let me just precise, was obtained for the case where the low of the signal that you want to infer is a sparse vector. So essentially it has a fraction of zero entries and the rest are plus or minus one taken randomly. And let me emphasize that in this talk the low that I will consider for this signal part, this x star part will always be simple. Instead what will be non-trivial will be the low of the noise. So in this way I will decouple the effect of the correlations induced by the noise and the ones induced by the signal. You have to keep in mind that until now most of the research has really focused on understanding the effect of the structure in the signal part taking more and more complicated distribution for that part while keeping very simple assumptions for the noisy part. While here we do the opposite. We want to understand really the effect of the structure in the noise. So let me now go in the non-ideal world. So the non-ideal world looks like this. So here is a picture, a typical picture you could extract from a random paper in neuroscience, actually probably a very interesting paper where people look at, for example, time series of neurons that are spiking in time. And here is how the matrix look like. And so one of the first thing people do, as you can see from this plot, is taking this matrices, multiplying it with their transpose and doing spectral principal component analysis. And they look at the principal directions in this data. But the striking thing when you see this data, of course, is that whatever it contains, it's far from being just a simple rank one matrix plus an independent Gaussian noise. It is highly structured. Whatever you would call the signal in this matrix and whatever you would call noise, the noise will have a highly non-trivial structure. And in this work we want to capture the effect of this structure. So here is, for example, the kind of spectrum you could get for the covariance of this kind of structured matrices. You see that it is not described by any standard distribution in random matrices. It is highly non-trivial. It is hard to say what is the signal part, what is the noise part, are these outliers, is it part of the noisy bulk? You don't know. And the reason of the complexity of this law is the fact that the noise, whatever it means, is a highly structured object, meaning that it has statistical dependencies. You cannot consider that the entries of the noise in this matrix are independent of each other. Let me motivate a bit further why considering noise is something which we think is important. And this is the following fact, what you would call signal and what you would call noise in any task is actually strongly dependent on the task you want to solve. So, for example, if I show you these pictures, I think that maybe 90% of the crowd will have naturally done binary classifications of these images into dogs and cats. And because this is the standard task we're used to describe in supervised machine learning. But now, if instead I was giving you this data set and telling you that you want to learn something about the notion of inside versus outside, in this case, you see that the features corresponding to what is a dog and what is a cat would actually play the role of noise for this specific task. And of course, the features of dogs and cats are not Gaussian features. They are highly structured things. If my task is to distinguish outside versus inside, this being a cat and this being a dog, would be noise for my task, yet it's highly structured. And you want to capture this. All right, of course, studying dogs and cats is highly non-trivial and we are theoreticians, so we want to have tractable models. So what we've done is to come back to our esteemed spike model, which has exactly the same form as before. Again, the entries of this signal part of this X star will be taken IID according to a very simple law, which is known. And instead, the non-trivial assumptions will be made now on the noise. So what are we going to take? Z will be decomposed as O transpose DO, where now O is R matrix, which appeared in the previous talk as well, meaning just a uniformly sampled matrix in the group of orthogonal matrices of size n by n. Instead, the structure in this noise will be encoded by the distribution of eigenvalues, these diagonal matrix of eigenvalues. And the only case where this matrix Z would have independent entries up to the symmetry constraint would be the case where the eigenvalues here would be drawn from the semicircle Vigner distribution that I've shown before. For any other case, if you plug any other type of eigenvalues here, even if the eigenvectors are generic, are uniformly distributed, this matrix would have highly non-trivial statistical dependencies among its elements. Another way to represent this kind of so-called rotationally invariant matrices is through this kind of trace ensembles. So Z is drawn according to this measure, and here you should think of V of Z as acting only on the eigenvalues. So when I wrote V of Z, so this so-called potential function V here is really a function acting just individually on each eigenvalues. The eigenvectors are untouched, and you see because you have this trace appearing, if you rotate this V of Z by any rotation here, this rotation would simplify, and therefore this law is indeed invariant by rotation. From the perspective of random matrices, this type of ensembles have been studied a lot. In particular, we have, Benet-George and Nada-Couditi have understood very well the generalization of this so-called BBB transition for this kind of noises, but here we want to study this problem from the perspective of Bayesian inference. Let me just give an example. If you take this potential to be a quartic function, in this case, if you write down this law in terms of the matrix element, here is what you obtain, and you see that this PDF cannot be factorized over the matrix element. Instead, if you were taking x squared, what you would obtain here would just be product over ij of exponential minus zij squared, and therefore you would have full factorization over the matrix entries, in this case here. We have statistical dependencies in the matrix element. Let's take a concrete example. The potential I'm going to consider in this talk will take the following form. It will be an interpolation between a quadratic part and a quartic part, and the coefficients mu and gamma depend on each other in a way that when mu goes to zero, gamma increases. Gamma is the only free parameter in this ensemble, and this will allow me to interpolate between a case where I have a purely quadratic potential, meaning we go back to the purely unstructured noise, which is the standard theory, Gaussian noise, to a case where gamma increases and mu decreases, where the noise is structured, where you have this kind of four-point correlations in the law of the matrix elements that I showed before. These kind of dependencies. I will call the asymptotic limit when n goes to infinity of the spectral density of this matrix rho. So these dI are the eigenvalues. And here is how it looks like when mu is equal to zero, 0.5 and 1, and when mu is equal to zero, gamma, of course, is non-zero. When mu is 0.5, we have a bit of the two terms. And this is the shape you get, and let me try to give you some insights of what you get this kind of weird shape. So you see when mu is equal to 1, we have only the quadratic part, and this gamma is zero, so we have the Gaussian noise case, so the pure semicircle law. And when mu decreases and this part increases, you see this kind of double-wale appearing. You have this kind of two bumps appearing. And the reason is that if you write this law in terms of the eigenvalues only, because, again, the law of the eigenvectors is just a uniform law, okay? If you do the change of variable from matrix elements to eigenvalues and eigenvectors, here is the PDF that you get for the eigenvalues. And you have a Jacobian that appears when you do the change of variable, and here is the Jacobian, and in random matrices, this is called the von der Mond determinant. And if you think of this as a kind of physical system, you could exponentiate this term, and you would see that in the exponent that you can think as an Hamiltonian of a kind of particle systems, you would get this term, which is a potential energy term. So these particles, these eigenvalues are feeling this kind of external potential, and you have this kind of pairwise interaction between particles, and they try to repeal each other, because you see here you have this product with a difference, so this term is inducing repulsion between the eigenvalues. So you can think of a kind of gas of charged particles with the same charge, and they repeal each other. So what happens if you put a fluid of particles in a strongly confining potential which are repealing each other, at some point if you confine them too much, which is the case when you increase this term here, because the potential goes from quadratic to quartic, so you are strongly confining these particles, at the same time they try to repeal each other. So what they will do, they will climb the wall, the potential wall, and this is how you get this weird shape, okay? Perfect. Let me now introduce the Bayesian framework I'm going to consider. So here is the so-called Bayes posterior distribution for my hidden spike X, given the data Y. It is a normalization, which you can think as a partition function, times the prior distribution of X, which again is simple, this is just fully factorized over the entries of X, times my likelihood, which is coming there that you recognize with this potential here, okay? So essentially this is the law of the noise, okay? And the objects I'm interested to compute are the entropy of the data distribution, which you would call the free energy in physics, okay? Which is minus the expected log partition function, where the P of Y, which is the distribution of the data unconditionally, is the partition function. And in information theory, of course, this is the standard Shannon entropy, which is identified with the free energy in the context of Bayesian inference. And the second quantity is the order parameter of the problem. It's the minimum and square error, so it represents the scaled asymptotic limit of the square deviation between the ground truth spike that I'm trying to infer and the best estimator in the universe, which is the posterior mean. So this notation here, this expectation conditional on Y, really means the average with respect to this base posterior, okay? And you can show in one line that this is the best estimator in the universe. If you could compute this expectation, which is computationally demanding because it requires computing this normalization, which as usual in statistical mechanics is the difficult part, you have access to this estimator and get the best performance, okay? But of course, it's usually hard. And this is also related to so-called Bayes' risk or overlap in physics, okay? So free energy and overlap. Let me give a few references related to this is a very biased list of references, but these kind of models have been studied a lot in the literature, in particular when the noise is completely unstructured, so it comes from the Gaussian orthogonal ensemble, meaning just a Gaussian noise. We have a long list of people having worked on that. In this case, the spectral density is just the semicircular law. So in this case, we have no structure. In the realm of random matrices, this model has been studied, as I mentioned, by these people and they understood this generalized BBB transition. Again, in the random matrices, the kind of estimators they're interested in are related to the first eigenvector, the principal eigenvector associated to the data. So this is really the spectral PCI estimator. And this rescaling coefficient here can be computed. In the case of Bayesian in France, there exists there is in the literature a very nice approximate message passing algorithm that has been introduced by Manfred who is in the crowd and Winter and then later expanded by Zoufan in a slightly different form. So essentially, this AMP algorithm is what we call the top equations in physics. They have been developed for the structural PCI problem. For the special case, really, of this inference problem, it is really Zou that have made it based on this work. And this AMP algorithm is, in a sense, aware of the data structure in the sense that it takes as input the spectral density of the noise. It is aware of the prior distribution used to generate the ground truth and of the data, of course. But as I will show you, it is suboptimal. And one of our contributions is to design a conjecturally optimal AMP for this algorithm. And I will give you some insights of why this AMP there is suboptimal. Nice works are those of Francesco and collaborators from Bologna and the group of Alice and Justin who is in the crowd and Flo and Lenka who have studied this this PCI problem and there is some structure in the sense you see that now each data point, YIJ is potentially drawn from a different law which is indexed by this IJ which is conditionally on the signal of course but here you still have independence so it means that this law can change from point to point yet conditionally on X star each data point is independent and this is really a crucial assumption and what is very nice in this setting is that through this independence assumption you have a strong universality property that imply in particular from a Gaussian theoretic perspective this model so at the level of entropies, free energies other parameters like the minimum and square that I have discussed before this model is indistinguishable in the asymptotic limit of a Gaussian model where you have additive Gaussian noise where now the noise has a kind of variance profile so you see the variance of the noise that you are looking at so you have a strong universality taking place here which is very nice while in the model that I'm discussing right now you don't have this universality because we lose the independence assumption among the entries of the noise okay so what are the results that we obtain the first result is a replica symmetric formula for this Shannon entropy of the data which again as physicists you can think as the free energy in the thermodynamic limit of the large size so it comes in the form of a variational problem over an explicit replica symmetric formula so let me show you how explicit it is so it's a matter of of taste whether you define that explicit or not I think as a physicist you would maybe as a someone not let's say used with this kind of replica formula it looks like a bit mysterious and it is actually but you can plug that in a computer solve the extremization problem and get actually plots and this variational formula in particular in the case of this quadratic plus quadratic potential used to generate the noise depends on 13 order parameters so but actually if you massage this formula and understand some hidden symmetries in this formula you can reduce you can reduce it to only 2 or 3 order parameters another consequence of this analysis of this replica analysis is a formula for the minimum in square or that looks much simpler but actually don't get fooled this M is actually complicated because this M is the solution it's the M that appear here and you should take the solution of this variational formula and plug it in this very nice looking formula there to actually get the value of the MMSC and a nice insight that we got from this work is the optimality of spectral principal component analysis for rotation invariant priors so what do I mean by this it means that if the signal part in your data has no real structure in the sense that it was drawn uniformly on the sphere or as a Gaussian vector then we show and let me emphasize that all this is non-rigors this is replica based we show that you cannot do better than taking the principal eigenvector of the data as an estimator so you can try to do Bayesian in France you will not get any additional performance ok so if you have no prior information about the distribution of the signal just diagonalize the data take the principal eigenvector this is the best you can do even if the noise is highly structured this is the point now this where information theoretic results on the algorithmic side what we show is that what I would call the natural approximate message passing for structured PCA which was developed by zoo is suboptimal so why do I call it natural simply because this is the kind of recursion that appeared usually in the literature where so how look typically an AMP it's a kind of iterative algorithm where you have two steps you have you which represents the estimator of your unknown signal which is multiplied by your matrix then you remove a so-called onzagger term whose role is to help the convergence of the algorithm in the sense that it will make the statistics of this second iterate F here this second quantity asymptotically Gaussian distributed and this implies first that you can get a asymptotic analysis of this algorithm and it helps for convergence so you remove this onzagger reaction term these big quantities are called the onzagger onzagger terms depend are aware of the spectral distribution of the noise and aware of the sorry of the spectral distribution of the noise so this is a kind of power iterate then you get this F and this F you pass it through a non-linearity that we call the denoiser which is aware of the prior distribution of the estimate of you and you repeat and so what we show is that this algorithm does not yield the conjecturally base optimal performance which is obtained through the replica method this MMSE formula that we obtained before here is supposedly the best performance you can reach in the universe and this algorithm does not saturate it and I will tell you why instead of what you should do is do something very similar in the sense that you're still an AMP algorithm but instead of multiplying your iterates U by the actual data what you first need to do is to apply a so-called pre-processing function J which is a polynomial function of the data then remove the onzagger which are different and then apply your denoising function here think of H and G as essentially the same function so you see the only difference here is that we first apply this function to the data and you see this function is non-trivial in this case it is a polynomial of order 3 and the coefficients are dependent on what they are dependent on the signal-to-nose ratio lambda in the problem and on the coefficients mu and gamma which are the parameters defining the potential from which the eigenvalues were distributed so this is a part which is aware of the noise structure we are in the so-called Bayesian optimal setting we know all the parameters the only thing we don't know is the signal we want to extract so I know these parameters I can compute this function plug it there and iterate this AMP and I claim that this is the correct approach it's not the only one but it's a correct approach so let me just remark why do you get this weird polynomial of order 3 these powers here are really in the matrix sense and this is y times y in the matrix sense so it's not entry wise or you can think of this as a polynomial applied on the eigenvalues this is equivalent why is it a polynomial of order 3? because the original potential in the problem I'm considering at the moment is a polynomial of order 4 the polynomial of order K the function you would need to apply here would be of this order K-1 and it would be increasingly complex as the structure in the noise would become more and more complicated and a third result that we obtain and this is a rigorous result in the paper is the so-called state evolution analysis for this algorithm which essentially states that in the proper asymptotic limit the statistics of these two kind of iterates this u and this f which are high dimensional vectors reduce to Gaussian statistics of scalar variables that can be tracked very easily and essentially the only thing you need to track are the means and covariance of these Gaussians and this kind of effective dimensional Gaussian equation is able to track in time all the statistics you want to extract from this algorithm and the fact that you can obtain these kind of theorems this kind of state evolution analysis is really due to the fact that here you remove this non-trivial onzagger correction that kind of gaussianify these quantities is there any question ok so let's check that I'm not lying to you so here is the first plot where so I'm considering the entries of the signal very simple they are generated as Rademacher variables they are uniformly simple as minus 1s and plus 1s in this case mu is equal to 1 so mu equal to 1 means the pure semicircle law for the eigenvalues meaning a pure gaussian noise in this case you see that the replica prediction is perfectly aligned with the state evolution prediction for our algorithm as well as the prediction for this previously introduced approximate message passing here is a slightly different version whose reference is that so this is also so these are two amp slightly different by zoo for this problem and everything collapses in the case where the noise is gaussian as it should so this is the msc as a function of the signal to know the ratio let me now tune in the structure in the noise so let's look at this figure where now the eigenvalues follow this blue distribution you see a gap appearing between the prediction from the replica theory in black and the state evolution as well as the actual instances with the algorithm this base optimal amp algorithm that we introduced which are here while the previously introduced amp is a bit on top here so it is suboptimal so it's provably suboptimal because we have this state evolution analysis which is rigorous and which is below this blue curve which is also a theorem what is a conjecture here is that the replica prediction in black is actually really capturing the behavior of the minimum and square estimator so you have this gap appearing meaning that in a sense you need really to exploit this noise structure in the way we introduce to fully capture it and get a boost in performance let me now discuss some aspects of universality because this is one of the key concepts of this conference so what we do here is what we wanted to see is whether the assumptions we make in this work were robust so what is the main assumption the main assumption is that the noise is rotational invariant meaning that the eigenvectors are uniformly sampled in the set of orthogonal matrices they are generic so what we did is to take real data let's say the set of images from Cypher 10 which represent cats or planes and what we did is to take these images build their covariance matrix diagonalize these covariance matrices and take the eigenvectors of these matrices instead of generating the eigenvectors totally randomly we extract them from the images of cats from Cypher 10 in between we sandwich the eigenvectors with eigenvalues that are drawn according to the distribution we are analyzing this kind of shape what we do is this but now these are the eigenvectors of the cats of the covariance of the cats images in Cypher 10 instead the eigenvalues are still drawn according to the ensemble we are analyzing ok and we run the algorithm and see what we get and surprisingly we get a perfect agreement with the replica prediction and the state evolution analysis of this amp which is really derived for the case where O is R distributed we do the same with another data set which is coming from some gene expressions in biology and we see again a very good agreement and there is also agreement in the dynamics of the time in the iterates of the algorithm let me now push a bit more the analysis to have even more structure so now the potential I am going to consider is not any more quartic but sestic so this is the potential we are considering and this induces even longer correlations between the matrix elements in the noise so the dependencies are stronger and what you see now is that the gap is even more increasing between the previously introduced amp and ours you see now that the MMSC difference is at the linear scale while the previous plots were at the logarithmic scale and so I think this plot which is also where we did the same for real instances for the cipher 10 images compared to the theory is really vindicating the analysis and I like very much this plot that's all right am I on time at what time did I start I have 5 minutes let me give you just some insights of what is happening through this what we call optimal preprocessing of the data so like I said if the potential underlying the random matrix ensemble behind the noise is indeed quadratic plus quartic this is the optimal function that you should apply to your data before processing it through amp so let's look at what happens to your data when you do so so here is the spectral distribution so the empirical spectral distribution in blue and the asymptotic one in orange for the data before any preprocessing so this is just the spectral distribution of y and so you see this kind of double whale that I showed you with the outlier corresponding to the spike now here is the function j that is applied individually to each eigenvalues so it corresponds to this function applied individually and what you see is that after the application of this function all the eigenvalues that were part of the noise bulk here have been pushed on the negative axis and instead the outlier which was not so far from the boundary of the noise has been pushed even further on the right so you have a kind of cleaning effect due to this function of the spectrum this is when the signal to noise ratio is not too high let's see what happens when the signal to noise ratio is higher so you are more confident in your data the data is of better quality now the function looks like this and you see that the effect the cleaning effect is even more dramatic again the noisy eigenvalues have been pushed to the negative axis so you can read off directly what is noise from what is not noise and instead the outlier which was around 5 before the preprocessing has been pushed around 20 so what is nice to notice is that if you look at this kind of boundary decision of this function between the decision between what this function considers as noisy eigenvalues which will be sent to the negative axis so the transition is there so all the eigenvalues there will be pushed to the negative axis and instead those on the right of this point which is around 5 will be pushed on the right and indeed you see that the outlier here is precisely around 5 so this function is aware of what really should be noise and what should be signal so what is also nice is that think of this problem but not for large instances but instead for smaller instances for n equal I don't know 20, 50 of course in this case the noisy eigenvalues here will not be as cleanly supported below this asymptotic curve you will have some of them that might be there for example due to finite size effects yet this function will be able to optimally clean and send to the negative axis these eigenvalues so you have this kind of cleaning effect for rare deviations but keep in mind that this algorithm that we introduced this AMP is not a spectral algorithm because of course if you apply this function to the data you're not changing anything to the eigenvectors it only acts on the eigenvalues so if you were to look at the top eigenvector of this matrix here you would get exactly the same estimator as looking at the top eigenvector of the original data before any preprocessing so you would not you would not improve the spectral algorithm by applying this function instead the Bayesian algorithm this AMP algorithm which is really Bayesian in nature does feels the effect of this function that acts on the eigenvalues only so something highly non-trivial is happening there which we do not fully understand to be honest and we don't have a recipe yet to guess what's the correct form of this preprocessing before doing this whole replica computation which is rather painful it would be very nice to understand what is going on there and what's the genetic phenomenon it's not yet the case but in theory all this machinery that we developed here could be extended to arbitrarily complex noise structure and there must be a more generic machinery behind that generic phenomenon which we do not fully capture yet but I think there are nice insights from this work and I think that last thing I want to say two minutes let me give you one insight of why this previously introduced AMP algorithm is suboptimal so what we did is the following so here is this AMP where the data is processed instead of the j of y and what we did is a replica analysis again but for another Bayesian framework we did the replica analysis for a case where the statistician would make the wrong assumption that the noise is Gaussian while it is not the noise is not Gaussian it is structured but the statistician is not exploiting the structure and is therefore considering wrongly a Gaussian likelihood for the noise so you see here this is indeed a Gaussian pdf you have a square the prior is still the correct one the statistician is aware of what's the distribution of the ground truth X and the statistician is therefore sampling this mismatched posterior distribution and in this case the replica analysis is indeed perfectly falling behind the state evolution predicting the performance of this algorithm so what does it tell us it tells us that this algorithm is implicitly making the wrong assumption that the noise is Gaussian while it is not yet something this algorithm is still aware of the noise structure it is exploiting it in a way through the dependencies of these Gonzaga reaction terms but actually it's exploiting the noise structure in a way to make the algorithm convergent despite it is suboptimal the algorithm will converge to the fixed point given by the replica prediction which is there so this this AMP is exploiting the structure for algorithmic purpose for convergence issues but not in a way to improve the statistical performance so my last slide so let me give you a recipe to in theory better process your data through a Bayesian approach in the context of this structure spike model so do you have any prior information about the low rank information hidden in the structured noise if the answer is no then our analysis tells us that don't bother just use spectral PCA because you cannot beat it if you don't know anything about the signal the best thing you can do is spectral PCA now if you have some information about the signal and it is not just a Gaussian signal then you should exploit it in some way okay now you wonder do you have any knowledge about the statistical dependencies in the noise if the answer is no then you can use this AMP the standard AMP there which is exploiting the signal structure through this denoising function this is aware of this distribution here and it will be convergent so it's still a good Bayesian algorithm but it is not fully exploiting the noise structure okay so if instead you know something about the noise structure as well then we recommend to use this AMP that does so that exploits both the noise and the signal structure jointly in order to improve the performance alright this is everything I wanted to say thank you very much and thank you very much again okay so thank you very much John for the great talk are there any questions for John? thank you for the talk do you have any idea what the optimal transformation J looks like if your potential is not a polynomial and looks like any regular function if it's not a polynomial because if it's a polynomial you say that it's a polynomial one degree less but what happens if it's a fully yes so we have an argument in the paper where we essentially show that if you have a sufficiently smooth function which admits essentially a Taylor series you can approximate it by a polynomial and essentially the quality of our predictions will go will vanish with the level of approximation that you make in the theory so essentially you can approximate any function by a polynomial and so the theory should be able to describe what happens now what's the generic form of the pre-processing you would get for this arbitrarily complicated function we do not know we have no idea that's one of the missing thing is to get the generic recipe to understand how to process the data the problem is that the computations are very technical so we've been able to carry the replic augmentation for order four and six and we don't see yet the generic mechanisms but of course there's one there's one and in the limit this kind of replica formulas that we get should depend on infinitely many other parameters essentially a functional order parameters and you should get kind of Parisi-like formulas but this generic structure is still lacking it would be very interesting to understand I think thanks John this is super nice work so I guess one comment or question I have is I guess one of the reasons that I ended up analyzing this suboptimally amp algorithm in that paper was because for any algorithm that's more complicated than this I couldn't figure out how to get any explicit characterization of the fixed point of the state evolution right the state evolution becomes quite complicated as you consider more complex algorithmic procedures and I was wondering for your pre-processed amp algorithm here whether there's something that simplifies in the structure of the algorithm that lets you characterize what that state evolution fixed point is or to gain some more analytical understanding of this yes we thought about that I see me Marco doing we thought about that we tried hard actually but we don't have as nice characterization as you have in your paper for the fixed points because the state evolution that we get is simply too hard we don't see at the moment a simple closed equation for the fixed point like you have which I think is very nice so we're not able at the moment to characterize directly the fixed point the only results that we get are for the dynamics yeah hi John thanks so much for the great talk one thing I was wondering about is that in the like a closely related model I guess in the Gaussian noise setting is this spike covariance model right where you could say that every row is independent but the covariance matrix is low rank plus identity or something and in the Gaussian noise case the two models kind of behave roughly the same so I'm wondering like here do you guys have in mind any analog of the spike covariance things because here what happens is that every row in your matrix is still dependent right like if I'm hoping to come up with a model where every observation is independent but somehow is there a way to think of that? yeah no that's a good point the short answer is no I don't see I don't see yet a natural setting let's say a natural extension to the non-symmetric case they I guess there should be one but we didn't investigate too much this aspect at the moment yeah are there questions? okay so maybe I can ask a curiosity John because you were mentioning in one of the previous slides that the noise is basically I mean in that slide where you have inside and outside classification and then cats and dogs and then the noise is played by a sort of image in that case I was wondering also attaching to the previous question whether you have considered the two I mean consider noise structured like with a structure similar to the manifold like in that case but do you think it would be doable or which would be the limitations I don't know I don't know because really the key the key thing we use in the analysis is this rotational invariance because if you lose gaussianity thanks to you can still carry on the computation thanks to a very nice machinery developed by in particular Yoshiyuki that we exploit strongly without this I don't because maybe I did not emphasize this actually to give me this opportunity but let me just emphasize one point why is this model in a sense not so trivial to analyze compared to other type of models so here is the Bayesian posterior distribution let me just compare it to another class of models where rotational invariant matrices have been studied a lot as we've seen from the previous talk which are regression problems and the structure is inside the design matrix if you study this model you see that when you write down the posterior distribution due to the fact that the noise is gaussian the likelihood is still gaussian and so you can still carry on the analysis despite the fact that this thing is structured but the fact that you have a gaussian form here a quadratic form allows you to do computations in an easier way while here really the main conceptual difference compared to this line of work is really the fact that the structure is in the noise itself and therefore when considered in a Bayesian setting the likelihood is different and you have the potential appearing here at the level of the likelihood and this makes your life harder because now you don't have a nice square here and it becomes more painful so that's the main difference but still we can exploit tools developed by Yoshiyuki in slightly different ways without this I don't know but I think it would be very interesting to take a look thanks thank you very much if there are no further questions I think we can...


All right, we're gonna watch another classic game. We are kind of limited to what YouTube has to offer. This is the 1974 World Series Game 3 versus the Los Angeles Dodgers. Oakland won in 72. We watched a game from that. They won in 73. There's not many full games on there that we thought were worthwhile. They beat the Mets. Now, they face the Dodgers. Jim. Yep. Couple notes, Jake here. First, all California World Series. Yeah, nice. That's fun. Dodgers A's. This series, I think it said the first World Series to end on a night game. Which, okay, do with that, whatever you want. Nothing. And, yeah, a lot of good names in this one. And look, packed up or deck at the Coliseum. Yeah, that's pretty cool. The series is tied at 1-1. We're going back to Oakland. We're going to start in the bottom of the third inning or top of the third inning because there's some action in this inning. This is Watching Baseball, brought to you by Johnboymedia. Shop.Johnboymedia.com. Buy some shirts. Support us. Thanks. All right, here we go. Swing and a miss. Al Dowling. Downing? Downing. Downing. Former Yankees pitcher. Jim Hunter. Catfish. Oh, pitcher on pitcher right here. Yeah. Ale pitcher hitting. Don't love that. If anyone doesn't know how he got his nickname Catfish Hunter, they decided he needed a nickname. So they made up a story about how when he was younger, he would go fishing with his brothers.  So it's completely fictionalized nickname. But it stuck. Catfish Hunter. Fictionalized nickname. Hey, it's a nickname. Yeah. They're all fictionalized nicknames. Kind of. No, some stem from reality. That doesn't. They literally invented a story that was fake. He didn't catch a catfish. It's all about the nickname. Okay. Back completely to the player. Just thinking. Hello. Just staring out there and thinking. It's the pitcher. That's one of the best places to be.  They're like, hey, you got to wait on me. Yeah. Classic delivery at the time. Classic wind-up. So many moving parts. What do you think about Ferguson, your big catcher guy? So far, not doing nothing for me. Nothing bad. Nothing good. I need a lot more out of him. Okay. Kind of like his demeanor. Just rocking. The shortstop is 85 years old, it looks like, for the Dodgers. What was that replay? That was good. He's shifting soon. Oh, he's shifting due to the pitches. The fastball or the breaking ball. Top of the order. Burnt Campaneros. Apparently, I just watch Burnt Campaneros play baseball now. Yep. That's a new hobby of mine. I'm, I totally lied. It's Bill North. Okay. Bill North? Bill North, the science guy. Oh, nice catch. What a helmet's in the crowd. Maybe it was helmet day. World Series helmet day. Got to get the fans out. Got to get them out. What do you think Al's featuring? Fastball slider. Hi, fastball there. Was he laying down a bun? Yeah, showed bunt. Showed bunt. One out. Bill North. William North? Yeah, I guess. He can fly. He's a fast guy. Third baseman in umpire. I like that umpire. I like that third baseman. Oh, wow. Shallow, baby. Did he just play him? Did he show bunt? Bring the third baseman in and slap it right by him? I think being in actually gave him a better shot, like the goalie cutting off the angle. Okay. Because I think if he was at third base, I think that's right in the hole. I like that. Here's Bart, my guy. Campaneros. And if you remember from the last one we did, these jerseys are much better. Much better. Yeah, I agree. Because they look like a jersey instead of a sentence. That's the biggest thing. Is he stealing? Okay. Downing's got an all time move. That's not true. You know what? You know what's interesting? The two games we've watched so far, the third base and the first base coach are like in much more ready positions than I recall them being today. I don't know. I think coaches are still in there. First bases coaches just kind of stand there. When there's a runner on first, especially a speed runner, and I mean like they're not doing stopwatch stuff.  He's just literally standing there. He's locked in. He's right there. He's really close. Really close. I think this is before they had boxes. I think that's the part we're missing. High and outside. Oh, that's a handheld camera. Okay. Good piece of information. Need to know. Someone is yelling go. Yeah. They want him to steal. Couldn't see a damn thing there. Man, how much I like watching the pitches. Yeah. You don't see much. You don't get that here. They do a lot of behind the catcher angle. We're getting some counts and stuff. They figured that out. Yeah. Okay. The split screen. Get going. Huge split screen fans. High outside again. Essentially a pitch out. Two and one count. Come on, campy. McGuy. We just kind of did that.  Don't see enough of that nowadays. He's gone. He's off. Hit and run. Good snag by third baseman. Does the runner get to third? Who's the third baseman then?   Dodger's third baseman. Let's see if they tell us. Otherwise I can find out. Okay. What was that? Okay. So Se is the third baseman. We just found that out. What happened here? Okay. So he's stealing. And then he bombs it to third. And he's in. So he just went back to get his helmet, but they just made it look like he was out, right? Yeah. He's making such a call. Okay. What happened here? Okay. Okay. We're good. Bit of a party. All right. All around that was great. Like that was a hot shot to third. Great play by the third baseman. Ron Se. Ron Se. What a name. And then the baserunner north. Yeah. Bombs it to third on the throw. It was a little hit and run. That was great, dude. Nice of him not to slide into second. Dude, that was a lot of action in one play. I enjoyed that. Missed the old hit and run. A hit and run. A hit and run still happened in today's day and age. Not enough. Maybe not as often, but they're still fun. Okay.  Whoa. Yo, that. Where was the center fielder? That was a huge gap. Dude's just made up shifts back in the day. I mean, look at his stance. He's got kind of an inverted stance and they're playing them to. To pull it. They better. This pitcher better not throw a ball away. Yeah. This is our guy, Sal Bando, by the way. Oh, this is Sal Bando? This is Sal Bando. What's position is he playing? I was playing third last time. I'm going to assume. Two years ago. I'm going to assume he's still playing that? Third's not a very switchy position. And you said his only other option was catcher. Yeah. He's not making. No, he's still playing third. You got to first if you wanted to. Playing third. That's a risky pitch. No, that's a beauty pitch. But I mean with the. Bando's not getting out there. With this. He doesn't. He's not looking for that pitch. These eight. These eight jerseys are so much better. I love Sal Bando, man. Yeah. I'm a big fan. Hitting third. Playing third. What's his lifetime? Million. What's his lifetime? Shit. Okay. Yeah. I mean he's six time all star. 53.1 career war. No. That's Burt Campaneras. I'm telling you. My life just wants me to go full Burt Campaneras.  Okay. Here's another camera. Shortstop is found now filming. Sal Bando. Sal Bando is 61 and a half career war. Four time all star. What's his lifetime slash line? Let's see. How many years did he play? Played a while. 16 years. 16 years. 242 homers. 254. 352. 760. OPS. Not great. Never mind. The war is good. Was he a great third baseman? I mean. Sal Bando. Jim. That's a great name. Sal Bando. So we got a huge outfield shift. Walking. Good eye. Wanted nothing to do with him. Good eye. You want to set up the double play ball. But. Here he comes. Here comes the story of the hurricane. The many authorities tried to blame. He's really good at baseball. All right. And talking about himself. Reggie. Nice smile. Dude. I don't know if it's because we know who Reggie is. Right. But he's just got it. Oh yeah. Whatever. Always has. Always has like. Reggie be the first one to tell you that. He just stood and walked in the box and smiled. He's going to look comfortable. Oh yeah. Look at him. Come on. Throw it to me. Throw it. Look at him. Tell me when you're ready. Yeah. I'm fine. He went. I mean he swung. Swung at the pitch is my only concern. That's a bloop over the shortstop's head if he connects. That's a tough break. Jim Brewer's on in the. Brewer. I know that name. Oh that's why I know that name. Oh that had that had a little bit on it. Yeah. I think back in the day you might have liked that camera because at least you could see what the pitch is. It's the only thing you can see what the. But that was a way and then it broke further away. Way. One batting glove guys. It's cool. It's like golf to O count. Oh slide piece. Another little whirly whirly bird swings swings. Same number. Is this 44 versus 44. I think I would have been like to tell be told when I was younger like swing harder. Yeah. Oh yeah. Swing hard. Aim it. Careful shoot the middle. That's all. Like I was just trying to barrel. Oh Reggie Jackson's number nine here. He's 44 on the Yankees. Hill North on third. If you'll remember Sal Bando. At first. No one out. Catfish Hunter struck out right. Catfish out. Yeah I think we got one out here. Three one chopper. That is a week three one. Oh see I told you I didn't like to catch you. You didn't say that you said you felt very indifferently about it. Yeah because there was some wrong. Nope. Yeah how it works. Yeah. There was something I wasn't like I don't I'm not good on him yet. No. Yeah. I was waiting for judgment. I'm glad I didn't say I liked him. Yeah. You didn't say you disliked him either. It's just felt wrong. Nope. That's you would have said it felt wrong if you felt that way. Here it is from the other shot that they've got other camera angles. Yeah I mean and he's he wasn't like looking at second or anything. He just didn't catch it. No I just didn't feel this position that well. Didn't catch it. It's kind of a tough play. No dude if he just catches that he's he lobs it. I'll run scores but they get the out. So who's look at this another really inverting. This is this is Joe Ruddy. Oh yeah yeah yeah we've seen this dance. King and King invert. Like Giancarlo Stan should watch video of Joe Rudy. We should ask him if he knows who he is. Yeah he definitely doesn't. We did from 70. New baby photo. Yeah. In Edison. There's that. We have seen. So in 1972 the umpire was holding the big protect yeah 1974 under the umpire has the vest underneath or he's just tough guy. Just no vest.  It's working. That's all he wanted to do. Oh no. So this is tough. Oh turns out big Al did not get a lot of help this inning. No. Should have been one run. The first hit was legit. Bill North's hit was legit. Yeah. And then he walked the next guy. Bando right. Oh no his first step was the wrong way. And then he just missed it. I mean if the catcher makes the play that's second out. Yeah. And then if that guy just feels it. Third out. He can flip to second. One nothing. It's tough. Was your guy here again. What do you think his name is just from looking at him from this far out. Look at the pitcher. No the hitter. Um that guy's name is Jim Williams. I'll give you another hint. He's your guy from the first one. Oh this is Gene tennis. Yes. I guess in the comments of the first video Gene tennis is referenced in Anchorman. Champ kind. There's like a gene tennis. Makes sense. Yeah I mean Gene tennis is awesome. Gene tennis would have made that play. As the catcher. Easily. And he just walked up and he told that guy. Tennis might be playing first base in this game though. Getting older. Getting up there. World Series MVP two years ago. Yeah. Tennis walked up. Taptic. Taptic. Taptic.  Trash. Trash. Trash. Yeah tennis is playing first base in this game and you're going to find out who's catching next. So just stay locked in. Just stay tuned. Stay locked in. Out. Downing. It's exciting. Reggie Jackson on third. Reginald. Martinez. Did you see that wind up. Hinsgen loose early. Did you see Brewers wind up. I mean swing game in the series. He gave him that. That's tough. That's a wide through on umpire feels bad for him because his fielders are doing nothing. He's number 44. That guy had 44. Yeah. Ferguson.  Get him Jean. Screwed up. So you're rooting ace. I'm rooting Jean tennis. Dowling's lost the inning. Wow. Of course. Is that guy's last name Dart. Three walks. Is that manager's name Dart. Dart. Roller Austin. Yeah. Thought about it. Wow. Wow. I mean there's there's some history pitching coach. Great pitching coach run. That was good. That was really good. Real high in time. Arms were moving. Third baseman has to know you got to get to higher ground on the mound there. Yeah. It's not a good optic for him. But he wants to stay away from the catcher because he's you know catcher doesn't want to be linked with him. Yeah. I don't like to catch her. I believe me. We know now. Oh. Char. Is that Charlie Huff. Knuckleballer. Or is that a like a celebrity. Trying to teach Jim Brewer is knuckleball for the 70th time this season. Jim Brewer is that man. Don't care. Not interested. I can actually throw the ball fast. You know I love guys that connect history and knuckleballers can be huge in that Charlie Huff pitch from 1970 to 1994. Knuckleballer dude. That's what I got to start doing. Grounder. Dowling says I'll do it. I'll do it. My damn self. God. Good for him. Sprints out. Oh. Oh. That's tough. Roodle. Shots fired. All right. So we're going to skip forward now. Let's skip forward a little bit. To the A's get another run later on in the game to go up four nothing. Three nothing. To go up three nothing. And the next inning. The next inning we're going to skip that run. 2 0 after 3 3 0 after 4 we're jumping to the top of the 8th. Top 8th because the Dodgers put together a little comeback. Los Dodgers against catfish because he caught a catfish when he was young. Did you hear about this? Lies. Did you hear about that nice pitch by Jim right there? Do you think he caught a catfish when he was young? Just not the biggest catfish? I don't even know. So then it's an embellishment? I don't know. Claude Washington. The way it's retold is that it wasn't even an embellishment. Did we get a ball in the gap? Gap. Billy North. Holy smokes. They told us he was fast. I mean that ball was smoked. He gets north and south real quick. He got north real quick. We don't know. The south he's coming pretty slow. Yeah. We don't know how he. Look at this. Instant slow-mo? Yeah. With a perfect camera placement. That ball was like, they couldn't have scripted that. Seemed like Billy North scripted this. Well, never mind. We go black screen again. Okay. And we're going to watch this one more time. They're so happy they got this camera shot. They were like, we got to run this as much as we can. Don't go black on us again. Okay. Okay. Another angle. Good stutter step at the end there. Beautiful. He throws well too, Monty. Beautiful stuff. All right. Who's up now? Hey, at this point, has this been Catfish's game? It's a bit of a timeout. Yeah. What's he doing? He's coming in. Or is he going out? Somebody threw something on the field. Yeah. So yeah, we've got a big old timeout going right now. Wait, wait, can you tell me about Catfish's line at this point? And I think this is important. Yeah. I mean, Catfish has had the whole game. So it's seven and a third at this point. Oh, yes. How many hits? No runs. Let's see if I can find that. It's tough. It's no runs for sure. So seven, seven, no run innings. So pitching line. From Catfish. Yeah. I mean, I don't know. I think the line might give stuff away that's coming up. So. Okay. So who's, who's this Buckner? This is a guy that most of you know by the name of Bill Buckner, a guy that should, a guy that should be more well known for that swing. He's not. Dude, he was all choked up. Got all of it. It's a good trot. It's a good trot. Bill. How tall was Bill Buckner? It looks like a short guy. I got bad news for what's coming up for you in the future. Yeah. Looks a little better there. I'll tell you think Bill Buckner is. I'll say six one. Five 11. Let's see. Starting lineups. Bill Buckner. He was batting second. Yeah. He's listed at six foot. So five 11. I'll give you the nod there. I don't want. Oh, his name is dark. Not dark. Dark. So that knocked him out of the game. That knocked catfish out. They're going to Raleigh fingers. So, dude, so he. He went to Raleigh fingers as good as it gets. Just bring Raleigh in. That's New Age baseball. Raleigh could go two innings. I don't know what he did the day before. I believe Raleigh pitches in every game of this world series. Yeah, of course it does. Look at this one. He's the only pitcher to do that. What's the music they're playing? Every play. Opened up. It's a good swing, man. He turned on that thing. Raleigh. I remember that slider. Who's this hitting? He's. What is that? Is it a pitcher? No, I think he's the three whole hitters. He just stepped out and tried to bunt at the same time.  It's got to be the owner, the scout, or GM, or something. Outside. He had binoculars. Imagine like Cashman sitting there just watching the game through binoculars. We got Jim Wynn up. Jim Wynn. Steve Garvey on deck. Jim Wynn? Jim Wynn. How tall is he? How tall do you think he is? 5'10". I think he's shorter. He's listed at 5'10". I get that point. Swing. Three-time all-star Jim Wynn. Oh, dude. Jim Wynn is so much better than Jim Wynn. He doesn't go by Jim Wynn, though. I know. That's a big mistake. Who's this? His wife? You're pretty biased there. Dude, wife cam. It's not bad. Yeah, that is an early wife cam. This broadcast compared to 72 has come leaps and bounds. I hope we keep going incrementally. I think that's actually. I feel like we won't. There's going to be just significant staggers. Oh, goes the other way with it. No, but I'm saying if we keep doing this series and we watch them in order. Right. It would be cool to see the development. I know, but that's what I'm saying. I think like, you know, 75 to 78, you're going to flat line and then it'll be like. Oh, okay. But we're seeing little things. They're doing more split screens. That's what I'm saying. I think this two-year leap is a big one, but I think it's going to be leaps. Okay.  Yeah. Go the other way. I mean, you truly don't really like that is a rarity in today's game. 13 of his 21 home runs were in road games. Stats. Baseball has always been about stats. Sal Bando guard in the line. Yeah. Try to hit it to south. You think Jimmy Wins going to try to steal this base? No, they're down three in the eighth. No, they're down two in the eighth. So no, if he was the tying run, I think maybe. Who's up in the order? There's the four hole hitter, right? Oh. Oh. No. And a punch of the dirt from Jimmy Winn. Oh, no, Jimmy. Lineout double play. Got a freeze when it's in front of you. Yeah. That was tough. Dodgers are playing a bad game. So it takes a secondary one. That's brutal. Yeah. You're hung out to try there. Yeah. Look at it. Oh, the arms used to... I was on...  The arms used to be much more emphatic because that was all... That's what they taught you. Like, doesn't matter what your call is, just be really emphatic. The crowd needs to know.  Yeah, that's brutal for Jimmy Winn. Dick Green. Was this the first two outs? Dick Green. No, I think that was the end of the inning. Right? Yeah. Yeah. One guy. Er, excuse me. I think Mike Marshall was the guy that pitched in every World Series game. Mike Marshall, I did a video all about him. Nice. Most innings ever pitched. I mean, he was just a crazy... Workhorse. All right. Let's go to... This is now... Jim Holt. A lot of gyms. A lot of gyms. Defensive replays. Again, Jimmy Holt's a better name. So biased. Yeah, I am. But, I mean, do you agree? No comment. Oh. Lazy...  We're seeing a lot of fakebunts. We've watched three innings. We've seen three fakebunts. Honestly, but this season, a lot of baseball seasons gets labeled by something. This was the, hey, if you fake the bunt, pitchers more likely to throw a ball. And then they found out the next year. I almost wanted that. Didn't call it. Found out the next year that wasn't true at all. Not at all. So what is this? Top nine now? Top nine. And who's up? Holt. We've got a three... Denical batting average. And... We like that. Oh! Is she gone? Ooh! What? I didn't think that was getting to the warning track. Kept going. Willie Crawford. I thought it was Jim Holt. Willie Crawford. Same batting average the past two years. Jim Holt's the defensive replacement. Chris Davis. We've got an oompa-loompa Batman. Go Dodgers. Kick Oakland's... Don't... I think it said sister. I'll never know. Okay. Looks like fastball. Hands all the way back. That's a middle, middle fastball. Is that swing? Kept his hands all the way back. He knew what to do with it. Oh! Is this Ferguson? This is Ferguson. So you're out.   What's Jim Ferguson's career look like? Do we know his name's Jim or are you just assuming guys' names are Jim? I'm calling everyone Jim. Okay. It's Joe Ferguson, so... Close enough. 21 career war. Buck 22. How many seasons? How many seasons? Home runs. He's got a lot. 14. Holy smokes. Got some serious sideburns. Remember those from the 72 series? Yeah. Yeah, a lot of those are gone, it seems like. Well, those were just eating their ears. What's his career OPS? They started doing sideburns or beers. 767. Not bad. Not bad. 358 career on base. Ahead of his time. 358? He had a couple seasons where he had more walks than strikeouts. Ooh. Burt? I mean... I'll tell you something. That... Did he call him safe? I think they called him safe. He was out, though. I was close. Burt. Supposed to get your jersey, dude. Campy. It's good baseball. It's great name. Uh-oh. Here comes Dark. Dark with the white cap. A... Gatfish. I think that guy was out. Let that go. Is Campy gonna come in? No. I'm not biased at all, but I think that Burt threw him out. Let's see. I mean, I love Burt. He goes with the dribble technique, which isn't normally good for a shortstop. Whips it. Maybe a safe. Looks like a tie. It's close. Maybe a safe. Good stretch by Jim Holt. They're loving the different camera. Yeah. This is definitely one of the first years they have all these different angles and in slow-mo, pre-prepared. I mean, we heard him earlier in the show. They were like, I can't angle. A handheld camera. They're doing live play-by-play. Oh! We got a runner coming in? Yeah, you can't let Jim Ferguson run. What is that? Is that Auerbach? I mean, he's gotta be 5'7". Looked like Auerbach. You think they're gonna bunt here? They're definitely gonna fake it. Gotta fake the bunt. Whoa! We're getting loose in the pin. Double barrel. This guy's 5'. I mean, is everyone short?  I know I am. Look at this. I'm gonna find out soon. Show me more Bando, please. So is this Auer... Show's bunt. Show's bunt. So Auerbach... It's on first. That's Ron C, our guy. I believe. The third baseman? Rick Auerbach came into pinch run. You wanted his height. He's the highest. He's six feet tall. So 5'11". Okay. And Ron C... Usually we were saying say before. Now you're saying say. I think it's say. How's it spelled? C-E-Y. No idea. It's brutal. Six time all-star. Ron... Ron C. He's listed 5'10". So he's 5'9". Okay. He might be 5'8".  He looks tiny. I mean, I'm a huge Ron C fan. Oh, yeah. I'm not... I got nothing against him. There's one guy I haven't liked. Better. Jim Ferguson. His name is actually Joe. Okay. How big is the catcher? Because Ron C is up to his shoulder. It's Ray Fosse catching. Did you know that? Oh, look at this guy, man. Dude, he got... That's Ron. That's our guy.  Oh. You got to bunt that one. You got to bunt that one. Ray Fosse's 6'2". He doesn't want a bunch, Jim. He's a six time all-star. Here's my... He wants to hit a game-winning home run. I don't know how I'm allowed to put... How in 2020's world I'm allowed to put this delicately. Okay. Ron C. Right. Got so laid. Yeah. Okay. More than like the taller, more attractive guys. No. Yeah. He just has it. Like Reggie has it. Yeah. You sure? They left him out to drive with those bunts. He was pissed. Sure about that?  Can you? I got a... Look at Raleigh, dude. See Raleigh? One out. I need some like glamour shots of Ron C. It's Ron. Yeah. 78 saves in his last four seasons. I was like a big flex. It's like two seasons now. Still a good two seasons. Yeah. See, I think you're finding out now you got too excited about Ron C. I mean he's not bad looking, but that was like a very generic dude at the time. No, I don't think so. Yes. He aged poorly. Oh my God. I wish I could see this, the rest of this image. I don't know if that's even on screen. I mean that's workout gear. I don't know what the problem is. He's definitely about 5'8". They were like very much lying. Huge lie. If anyone knows Ron C. Reach out, but he's 5'8". Oh, hard hit. Second for one. Holy smooth. Dude. That's how you turn a double play. That is why... Did you see that? Yes. That's why... We got to rewind this. That's why old people yell at young people. Because that's how you do it. Look at the handshake here. It's a good job. We're here to work. We're here to work. None of that funny business. That was to end the game? Yes. No crazy handshakes. We did our job. The A's won the World Series two times. This is a team trying to win their third straight World Series. We watched three innings. You thought she was cute? Yeah. Which one? That's a cute... Which one? The girl being cute as hell. The girl that looks like she's out of remember the Titans enjoying... So you're talking about bottom middle? You know I'm not. Cute. That's the cutest face you'll ever see. Well, no, no, no, no. I think you can beat her every now and then. See? Go on. Okay, anyway. The A's were so much better than Dodgers. Yes. The Dodgers... I mean we watched three innings of a five game series or whatever. The A's were just a better team. And I know that firmly now I'm watching three. Yeah, I mean Dodgers won 102 games. A's won 90 during the regular season. Dodgers had a weaker division. So, yeah, leagues back then. Press no pressure. Third World Series. I want to say... Dodgers... This was brutal for the Dodgers. They lost three games to Oakland. That the final score was three to two. Little things, man. The A's did everything... Let's watch the double play one more time. I mean that was really... That was as smooth as it comes. To end the game... Dick Green at Burt Campaneras? Can't wait to reference that this year. Do you see Burt didn't want to shake his hand like a... Yeah. He was like, we can do something cooler. No, Burt said... Burt was ready for the next game. Goes to his... I mean that's how you turn a double play. That's textbook. Nice turn. Yep. Done. Dick Green says... There's your cute girl right there. Yeah? Where's the camera? This guy. Could have been another girl wearing a sweatshirt and a skirt. No, no. It's the same guy with the hat and the red sweater in front of her. See? It's those. Which one's the cute one? Well, the old... I mean, if we're being really honest, the old man with the sunglasses and the hat, the flag is cute. Look at this guy on the right, huh? Not cute. That's her brother. That's a memory. That's her brother. That's a memory for him. He wishes he was dating her, but sadly... They're brother and sister. That was watching baseball. Thanks. See you later.


A few months ago, here at our Council Legislative Centre, we had an explosion. The explosion was due to the fact that a contractor who's applied us with our mixing buckets didn't wash the bucket out prior to giving it to us. So when we mixed chemicals in the bucket, a reaction occurred causing the explosion. Luckily, there were no injuries, but by making a few small changes after applying the hierarchy of controls to our chemical handling process, we've been able to make sure that that never happens again. Chemicals are essential in many of our everyday work and manufacturing processes. If they are not managed effectively, chemicals can impact on the health and safety of workers, the general public and the environment. Businesses are required to minimise risks to health and safety by applying the hierarchy of controls. This is a ranking of control measures used to protect workers from risks to health and safety. We need to choose controls based on this ranking and whether they are practical for the job or task. In practice, using a combination of controls often brings the best results. We also need to manage any hazardous products and byproducts of our processes. Workers must be provided with appropriate training in the risks of the chemicals they are using, how these risks are managed and how to use controls. Level one, eliminate. The best way to eliminate the risks of a hazardous chemical is to avoid using it altogether. A council in Victoria found that using a scraper to remove graffiti off glass was just as effective as using a chemical and safer for their employees. However, we use chemicals for specific reasons, so this often isn't possible. But what we could do is eliminate a worker handling activity. For example, buying premixed chemicals instead of hand mixing them. Level two, substitute, isolate or engineer. Where we can't eliminate a chemical from a work process, there are other approaches that we can use to minimise the risks. Substitution. With advances in paint technology, I now find I can use water-based paints for so much more than I could before and I feel so much better for it. We can substitute a chemical with a less hazardous one or use a chemical in a form that reduces the chances of exposure, like using a paste instead of a powder. Using hot water instead of cold water to help remove graffiti can reduce the amount of chemicals required. We need to remember that substitutions can introduce new risks which need to be managed. Isolate. Secondly, we can isolate processes from workers. For example, by fully enclosing or automating a process to avoid operator exposure. We can also separate incompatible chemicals. Chemicals can be separated by using barriers or distance. Information about a chemical's incompatibilities can be found in its safety data sheet. Engineering. Thirdly, we can use engineering controls. For example, bonding and ventilation systems. To make sure the controls are effective, we need to provide proper training and supervision for workers and maintain our equipment. The approaches we have just described are known as higher-level controls and should always be considered first and used if possible. We will often need to supplement these with lower-level controls. These are administrative actions and personal protective equipment. Examples of administrative actions that can be used are limiting access to areas containing hazardous chemicals and safety signs. It is important to develop safe work procedures or standard operating procedures for your workers and provide training that is specific for the chemicals being used. Procedures should talk through the controls to be used and developed using safety data sheets and other relevant information. Personal protective equipment. There are many different types of PPE, but we should only use what is appropriate for the job. Remember to review the safety data sheet when choosing PPE and not rely solely on it to protect workers. PPE is intended to be used to supplement other control measures and when there are no other practical alternatives, like in emergencies or managing spills. It is important to provide training in how to correctly use and wear PPE. So, in summary, we need to manage all health and safety risks of workplace chemicals using the hierarchy of controls. We should use higher-level controls where possible and consider using a combination of controls for the greatest protection. To make sure our controls are effective, we need to ensure our engineering controls are maintained and provide appropriate training and supervision for workers. By remembering the different levels of hierarchy of controls, applying them and monitoring their effectiveness, we can minimise chemical health and safety risks in the workplace.