Hello and welcome everyone to Actonflab live stream number 39.0, it's February 25th, 2022. Welcome to the Actonflab. We are a participatory online lab that is communicating, learning, and practicing applied active inference. You can find us at the links here on the slide. This is a recorded and an archived live stream, so please provide us with feedback so we can improve our work. All backgrounds and perspectives are welcome and we'll be following good video etiquette for live streams. If you want to learn more about dot-coms, which is the organizational unit that puts on all these live streams and many other products or any of the other activities in the Actonflab, go to activeinference.org. All right, well today in Acton stream number 39.0, the goal is to learn and discuss this really awesome paper called Morphogenesis as Bayesian Inference, a variational approach to pattern formation and control in complex biological systems. It's by Franz Kutschling, Carl Friston, Georgi Georgiev, and Michael Levin from 2020. And just like all the dot-zero videos and indeed all our videos, it's just an introduction to some of these ideas. It's not a review or a final word. That being said, we're going to go over the aims, claims, abstract, roadmap, keyword, et cetera of the paper. And then with a focus on the first parts of the paper and less so on the formalism and more on the big ideas, we're going to go over the paper and the figures. And that will put us in a good position cognitively or morphologically, we might even say for the discussions in the coming weeks, 39.1 and 39.2 when we'll get to unpack this. So if you would like to, it'd be awesome to have you participate live or if it's past 39.2, you can still ask questions. All right, we'll start with introductions and warm-ups. We can each say hi and maybe one thing that was exciting or interesting about the paper, which I'll reserve for after you. But I'm Daniel, I'm a researcher in California. And Dean, thanks a ton for joining. Thanks, Daniel. I'm Dean. I'm here in Calgary. And what really got me excited about this was the idea that they talk a little bit later closer to the end. We may not even talk about it today is the role that epigenetics might play in terms of how cells behave and what sorts of things we might be able to turn in terms of simply what we see in biological form into some sort of statistical prediction device. So I'm really excited about that. Awesome. Yeah, it's a complex paper about complex systems. So we'll see what we can get done today, but I'm really excited to bring active inference into this domain, at least as far as our discussions go into the morphological and the morphogenetic areas. And it's just bringing like another lens, another way that we can apply active inference as a filter, another set of phenomena that we're bringing into this active inference realm. So we'll just go right into the big question. So I'll read this and then feel free to give a thought. The big question, or at least one way to put one of the questions, is how can we find an integrative path between math and morphogenesis? Morphogenesis means form, like physical form, morpho, and genesis, meaning how it arises. So how does physical form arise? And how is that related to math? And to kind of unpack that, here's some quotes. The molecular mechanisms, which are like signaling pathways of all different kinds, underlying development and regeneration in biological organisms have undergone a tremendous amount of knowledge gain in the last several years due to genomics and biotechnology advances. So that's kind of the one side with a biological. And then from the mathematical and the formal, the emerging field of the free energy principle in pattern formation, not always morphogenetic patterns, but could be cognitive patterns, rhythmic patterns, provides an essential quantitative formalism for understanding cellular decision making in the context of embryogenesis, regeneration, and cancer suppression. So if that's the if, then how might the mathematical formalism reveal new understandings about developmental change in evolution and for designing new interventions in regenerative medicine settings? So what did you think about that? Well, I just love anytime that two things that seem disparate or distant are brought together, because I think all sorts of good things can happen. And I'm going to do a little shout out. That's kind of what I would like to see if we can organize in August with a couple of other papers that don't start out necessarily appearing to be close or proximal, but by bringing them together, all kinds of interesting things can happen. Awesome. Okay. To the main aims and claims of the paper. So the paper is in Physics of Life Reviews 2020, and we already mentioned the title and the authors. Just to select a few aims that the authors represent, and then a couple of key claims that are relevant for the paper. So as far as aims go, one of their aims is to introduce an overarching concept that can predict the emergence of form and the robust maintenance of complex anatomy. Another aim is to derive the mathematics behind Bayesian inference and use simulations to show simulations that are consistent and within the Bayesian framework to show that the formalism can reproduce experimental top-down manipulations of complex morphogenesis. And then just a few of their claims, more of which will be unpacking in the coming minutes. Classic, i.e. dynamical systems and analytical mechanics approaches such as last least action principles are difficult to use when characterizing open, far from equilibrium systems that predominate in biology. So that's kind of a big challenge that's come up again and again, which is we might have really great equations for a pendulum, maybe even a pendulum with friction, but how about an active pendulum that's doing strategy and trying to run away from you? A bit harder to put those same equations on. The Bayesian inference framework treats cells as information processing agents, where the driving force behind morphogenesis is the maximization of a cell's model evidence, which is to say its reduction of uncertainty relative to a generative model, which is what we're going to be unpacking. And we had previously read this about how they're applying free energy principle to morphogenesis when it goes well, like during embryogenesis and results in, as I go, becoming like an adult life form, as well as all of the ways that it's maintained during that stationarity of healthy life, and including cases where it might be relevant to even think about making interventions like medical settings. So those are a few of the aims and claims. Anything to add on it? Yeah, just real quick. It's really interesting that they said top down. And then we're going to see some slides where there's a top top and a down down. So stick around, because there's actually going to be something kind of interesting happening here. Okay. How about you read the first half of the top half of this abstract slide? Yeah, sure. Recent advances in molecular biology, such as gene editing, bioelectric recording and manipulation in live cell microscopy, using fluorescent reporters, especially with the advent of light controlled protein activation through optogenetics, have provided the tools to measure and manipulate molecular signaling pathways with unprecedented spatial temporal precision. This has produced ever-increasing detail about the molecular mechanisms underlying development and regeneration in biological organisms. However, an overarching concept that can predict the emergence of form and the robust maintenance of complex anatomy is largely missing in the field. Classic, i.e. dynamic systems and analytical mechanics approaches such at least as least action principles are difficult to use when characterizing open, far from equilibrium systems that predominate in biology. Similar issues arise in neuroscience when trying to understand neuronal dynamics from first principles. So they're basically covering their bases here by making sure that we understand this is open system. Yes, increases in tools in biological systems like genomics, microscopy, optogenetics are helping us reduce our uncertainty about the what, but without a bit more information about the how and the why, etc. That's the overarching concept that's largely missing. So we can grind up the cells and sequence the genome. We can extract the RNA and we can even tell what the ratio of different RNA molecules is, but it turns out that that type of information alone doesn't help us understand why two related species or the same species in two different contexts or the same genome in two different tissues or the same tissue in two different environments has such different morphology. Okay, and then the second half. In this neurobiology setting, a variational free energy principle has emerged based upon a formulation of self-organization in terms of active Bayesian inference. The free energy principle has recently been applied to biological self-organization beyond the neurosciences. For biological processes that underwrite development or regeneration, the Bayesian inference framework treats cells as information processing agents, where the driving force behind morphogenesis is the maximization of a cell's model evidence. This is realized by the appropriate expression of receptors and other signals that correspond to the cell's internal, i.e. generative, model of what type of receptors and other signals it should express. The emerging field of the free energy principle in pattern formation provides an essential quantitative formalism for understanding cellular decision making in the context of embryogenesis regeneration and cancer suppression. Okay, and then if you read the first two parts here on the second slide. Yeah, no problem. In this paper we derive the mathematics behind Bayesian inference. As understood in this framework, the use of simulations to show that formalism can reproduce, interesting, experimental top-down manipulations of complex morphogenesis. First, we illustrate the first principle approach to morphogenesis through simulated alterations of anterior posterior axial polarity, the induction of two heads or two tails, ah, spoiler alert, as the planarian regeneration.  Then we consider aberrant signaling and functional behavior of a single cell within a cellular ensemble as a first step in carcinogenesis, the formation of cancer, as false beliefs about what a cell should sense and do. Inference, perception, action, inference. We further show that simple modifications of the inference process can cause and rescue miss patterning of developmental and regenerative events without changing the implicit generative model of a cell as specified, for example, by its DNA. This formalism offers a new roadmap for understanding developmental change in evolution and for designing new interventions in regenerative medicine aesthetics. Speaking of the new roadmap, let's look at the roadmap. Kind of cool that they actually say that it is providing a roadmap. So we've talked about guides. We've talked about roadmaps. Where do you see all of that before we look at the section titles? Well, we're a guide, I think basically gives sort of gives you the parameters. I think a roadmap is a lot more specific in terms of the sequencing, but that's just my interpretation of it. I think other people can interpret roadmap differently in terms of the relational aspect of how the different parts come together. And we've talked about that in other live streams, but I don't want to get bogged down in this part right now because I think we have a lot of stuff to cover here. Cool. Yeah. So the paper begins with an introduction to Bayesian inference. Section two is mathematical foundations that are building on Bayesian inference. So going from kind of Bayes theorem to several dynamical systems, representations, some of which we've discussed before, others which will push it into a little bit of a new area. Then the key contribution and the focus of the paper is modeling morphogenesis. And so instead of just presenting Bayes and then variational Bayes and then free energy minimization on a bacterium, like we saw Axl constant do in live stream number 34, we're going to take that momentum and move it towards an application of modeling in morphogenesis. And that's where we'll talk about like what model they construct and how it relates to some of the formalisms that were brought up earlier. And then there's a discussion and conclusion section, which we won't go too much into today in the dot zero, but it's going to be awesome to go into it in the dot one and dot two, because there's a ton of awesome content and material. All right. So here's the keywords that were listed and we won't go into most of them, just to say that they're going to come up in this discussion. We have free energy principle, Bayesian inference, morphogenesis and developmental biology for generation, kind of got some mathematical stuff we've seen before. We have a triad of developmental biology, which broadly understood includes embryogenesis, as well as aging and cancer and all these other developmental things that happen during biology and top down modeling. And maybe we'll see what that means coming up. Okay. Well, to get right into it. Section one is an introduction to Bayesian inference. So here's a nice picture by Sasha. And here are the opening lines of the paper. Uh, they wrote and then feel free to give it thought. Evolutionary change results from mutations in DNA and selection acting on functional bodies. Thus, it is essential to understand how the hardware encoded by the genome enables the behavioral plasticity of cells that can cooperate to build and repair complex anatomies. Indeed, most problems of biomedicine, repair of birth defects, regeneration of traumatic injury, tumor reprogramming, et cetera, could be addressed if prediction and control could be gained over the processes by which cells implement dynamic pattern homeostasis. The fundamental knowledge gap and opportunity of the next decades in the biosciences is to complement bottom up molecular understanding of mechanisms with a top down computational theory of cellular decision making and info taxes movement towards information. So Dean, what do you think? What should we study and why and how is this related to ACTIMF and FEP? Okay. Well, my background in genetics is, is near zero. But what I did come away from with that last bullet in particular was one of the things that I beat like a dead animal, which is that you need a minimum of two. And I think that the bottom up sort of building blocks aspect of it with the top down, how do we get a better grip on what the signals are that are passing between all of those bricks was really interesting. And so carrying on through, I kind of wanted to open that up and see what that, that marriage looked like. Awesome. So speaking as someone who started in the science journey with genetics pretty much, it always was so interesting how genetics would frame itself as if the bottom up information flow could just simply replace theory will sequence so many genomes, we won't need to speculate about evolution or we'll have your genome. So we won't even need to ask about what medicine is best. And that's kind of this bottom up molecular understanding, which is vital. It's essential. It's important. It's changing a lot. But it's this bottom up sub unit description, the what and the where of the sub units and how they touch and all of that. And that is always met implicitly and increasingly explicitly with a top down theory of cellular decision making and info taxes. And so we're always kind of meeting in the middle with empirical wet lab biology, revealing these mechanisms and these findings. And we're meeting that as researchers doing model based science with what are being called here top down modeling top down computational theories. Okay, that's just how they open up and also set a challenge for the coming decades. It's their expectation of the next few decades. Then they provide a math roadmap, which is an awesome paragraph. So they write, we lay out the mathematical foundations of a type of Bayesian modeling that they're going to use to simulate pattern formation. So red, Bayesian modeling, orange, we start by identifying a Lyapunov function that can be used to analyze and solve any dynamic system using the fundamental theorem of vector calculus, i.e., the Helmholtz decomposition. So we're using Bayesian modeling and layering in what we'll talk about soon to the Lyapunov function. Green, we use it to characterize the generalized flow of systemic states, states of the whole system in terms of conversions to a non equilibrium steady state, a Ness. Next layer, blue. We then introduce the notion of a Markov blanket that separates the external and internal states of the system. And finally, purple. We can then replace the Lyapunov function with a variational free energy function to solve for the evolution of internal and active states, that's of the particle, and thereby characterize self organization in far from equilibrium systems that can be partitioned into a cell and an external milieu. That's the math that they go through. That's the math rainbow. Then sections after that apply this formalism to illustrate morphogenesis and neoplasia, which is the growth of new forms, neoplasia, using simulations. And what's so cool is this trajectory from 400 to 700 nanometers from the Bayes through the vector calculus and flow states to the finding or the figuring out of a Markov blanket. And then the usage of the Markov partitioning legitimated by the orange and the green steps to find a heuristic way to go about solving what was needing to be addressed right in the beginning. We've seen some variants of this trajectory multiple times. And then in this paper, they study morphogenesis. And so then they model morphogenesis. But say for a couple of words, a different paper could have said we do the Bayes thing, the Lyapunov thing, the Helmholtz, the NES, the Markov, and then we're back to doing far from equilibrium strategy in online teams. And then we applied it to online teams. And so let's keep in mind like the paper can be long, there are a lot of equations. But where is this broader trajectory that's helping us fine tune our regime of attention and update our generative model about what we are doing here and how it's different than other approaches? And then where is the part that's actually studying morphogenesis? Just things to keep in mind. Okay. Anything to add on this? Well, you correct me if I'm wrong on this, but I think what we're doing is essentially taking, as you said, we can look at a variety of things. We can look at the physical nature of ants. We can look at cells. We can look at online teams. Whatever we're looking at, what they basically said is there is a parallel way of looking at the formalisms that exist in those contexts with that type of content. That's essentially what this said to me. There's a way of bumping it up into that sort of statistical mathematical realm. And now we're going to walk you through what that is. Great. Okay. So into the bay, the bay's area where I grew up. So it's down by the bay. Sitting by the dock of the bay. All right. Oh, I thought you were going to say where the watermelons grow. Carry on. Bay's theorem rests on three basic axioms of probability theory and is used to relate the conditional probability of an unobservable event A. Okay. So the vertical bar means conditioned upon or given. And so what we really want to know is like the probability of something that we cannot observe conditioned on what we did observe B. So you're never observing the lightning strike. You're observing photons on your receptor. And then you want to know about whether there was lightning in that cloud over a few miles away. So we want to know the conditional probability of an unobservable event A. That's this left-hand side. We want to relate that to an observable quantity B. That's what the data are. And that's going to be calculated using the Bayes theorem as the probability of the data given the unobservable state, which is called a prior. So that's like had to do with cats and meowing or in a previous example, or it has to do with like, if there were lightning, yes or no, what would be the likelihood of me observing photons multiplied by the probability of those unobservable states happening, which is of course a prior about them, but it could be set with empirical data, divided by how likely the data are, which is called P of B, the marginal likelihood or evidence. Okay, so P of A given B is called the posterior, because it's like, after you've done your inference, you want the correct posterior, which is like updated beliefs about how likely the thing that you care about A is given what has come in. Priors are like prior to this round of inference, what are your beliefs about how likely A is, and then the evidence coming in is B. Okay, and the likelihood is how likely the data are under the prior distribution. So that's Bayes theorem, and we've talked about it multiple times, and I'm sure there's other awesome videos and courses that can explain it even better. How are they using it here? To describe the dynamics of an ensemble of information processing agent, like cells, as a process of Bayesian belief updating, we need to relate the stochastic differential equations governing Newtonian motion and biochemical activity to the probabilistic quantities above. Long sentence, but it's kind of saying we need to connect these variables, which are informational, they're probabilistic, they're statistical, to movement in space. Movement in a Newtonian coordinate system, because we need these variables to measure spatial movement so we can study morphogenesis. This is fairly straightforward to do if we associate biophysical states with the parameters of a probability density and ensure their dynamics perform a gradient flow on a quantity called variational free energy. Variational free energy is a quantity in Bayesian statistics that, when minimized, ensures the parameterized density converges to the posterior belief as we will see below. So, yes, this is our first slide on Bayes theorem and we did just kind of go from the total description of the variables and what is Bayes theorem at a first pass to this introduction of the variational free energy. So it can be accordioned out and unpacked a lot more, but what variational free energy is doing is helping us tractably converge to the appropriate posterior belief and that's its role here. Okay, anything to add on this one, Dean? We'll ask you a question. So if you were to talk to this to somebody for the first time, not people who've probably listened to other of our live streams, would you say that it would be dangerous to say that we're taking something that's kind of ratio-based and now using that to try to build a model of what our predictions are going to be based on? Is that fair to say? I believe so. It's like one way to approach that. I hope this would be accessible. The ratio-based part is on the right-hand side and one could say, depending on how much data you're getting and what you're trying to estimate, it could be very hard to go from observations to inference on hidden states. Pretty fair conclusion. So what we could do would be construct a smooth approximatable model so that when we slide to the bottom of our model, just like the ball sliding down the hill, we would actually be doing the same thing as fitting this effectively. So instead of like number crunching and putting everything into this equation and running the calculation, we're going to construct a ball, which is the variational free energy that we can do gradient descent on that is going to converge to a really good solution. Do we construct it or do they kind of tell us that we should assume it if we want to make it tractable? Assume the ball. When we pick up this instrument, we're making variational free energy bowls. Yeah, okay, good. And we've seen this before. In live streams 26, 32, and 34, we did some variants on moving from Bayes theorem and exact Bayes to variational inference, which uses this variational free energy value. So those are a few times that we've seen this discussed before. In neuroscience, the minimization of variational free energy is referred to as active inference. We will see that the basic, when the basic condition for an inference type description of a system, namely the existence of a Markov blanket separating external and internal states is satisfied. Agents such as biological cells form into organized conglomerations based on their generative model of how their blanket states influence and are influenced by external states in the external milieu. So the connection between Bayes theorem and Markov blankets is the unobservables are external states. The observables are blanket states. It's a pretty fair model, whether it also provides like strong guarantees on optimal perception or optimal action. That's another discussion. But at the very least, it's a fair framing that external states are unobserved. If you could observe them, they'd be observables. Then they'd be more like B than A. So we're talking about a situation where we have some A's and we have some B's. And we're going to think about that in terms of a blanket formalism. And the dynamics of a system with a Markov blanket that self-organizes to non equilibrium study states can be described as a gradient flow on this computable variational free energy bound. So we can set up the blanket. And it turns out that we don't have to do the ratio number crunch. We can do the bowl gliding down. That's the beginning part on just Bayes that takes us from Bayes theorem to introducing variational free energy and doing gradient descent on variational free energy so that one can effectively essentially perform Bayesian inference. Cool. Perfect. Okay. Section two, mathematical foundations. All right. So section 2.1 stability and conversions in coupled dynamical systems. And subsection one, the Helmholtz decomposition. So they write the Helmholtz decomposition states that any sufficiently smooth, i.e. possessing continuous derivatives vector field F can be decomposed into an irrotational curl free. So kind of straight up and down, putting the ruler and finding the slope of a hill and a solenoidal divergence free vector field. The divergence free solenoidal is like putting the ruler at ground level and then being able to make an isocontor around a hill. Because an irrotational vector field has only a scalar potential and a solenoidal vector field has only a vector potential, we can express the vector field as insert formalism two. And just so people know the upside down triangle is called del or nabla, which means harp due to the shape. So del phi is the irrotational vector field. Del a is the solenoidal field. We talked about this mostly in number 26 and 32, where we talked about the partition or the decomposition into a solenoidal and a gradient as well as this housekeeping term, which was everyone's favorite housekeeping term. So we're not having a housekeeping term here, but we're keeping in mind that it's not implausible that it's still there. It's just that there was a whole paper coming out after this morphogenesis paper that talked about the housekeeping, etc. So again, it wouldn't be surprising if a future morphogenesis paper or project did have this housekeeping term, but 32 was actually a later paper. So that might be a more advanced place or updated place to check out how the partition, I'm sorry, the Helmholtz decomposition works. And here was a image from 26, just showing how you could have like a kind of hill. And in physics, you could have hill climbing and trying to get to the top. Or sometimes it's easier to think about that as like the flip and the ball rolling to the bottom of the hill. So whether it's the optimistic biologists talking about going up to the fitness peak, or whether it's the pessimistic physicists talking about going to the bottom of the energy well, it's the same idea that there's a particle on a landscape. And there's been a ton of work on passive particles. That's not to say immobile particles, but particles that roll and get trapped. And then once they're trapped, they stay, or they jiggle stochastically. We're studying active particles. And so that's where action selection comes into play. Landscapes of energy with balls rolling down them. But they're kind of like jumping beans, where they also have a few tricks that they can play. Okay, anything to add here? Just a reminder to people that that's a density that we're looking at. Not a vacuum. I know most people, like if I was to talk to younger people, and they started imagining a ball rolling down a hill, they wouldn't necessarily confirm that it's a sexual density that we're looking at. So just reinforce that. Yeah, like the bottom right here, it's kind of like you're looking down at an ink drop. And that's where it's densest is where it's darkest. And then that is like a landscape where where it's darkest is highest. Right. Okay. Section two, one, two, the operative functions. Okay, so the operative functions have been used extensively in dynamical systems theory and engineering to characterize the stability of fixed points of a dynamical system. The operative functions are generally defined for smooth systems through the following conditions. So L is going to be the Lyapunov function. And X is going to be a point. So a fixed point is going to be X star. And a non fixed point is going to be just regular X. So X star, the special points where if you are there, you're perfectly balanced. So this is saying that at fixed points, the Lyapunov function evaluates as zero. And it's not zero. If it's not a fixed point. And the Lyapunov function change in L with respect to time, it's below zero for all X. Equation three a requires the Lyapunov function to be minimal for fixed points X star representing local minima, and B denotes conversions to these fixed points over time. So what does it mean to have a Lyapunov value of zero above zero or below zero? So if you're at zero, just like it said with the fixed points, that means that it's not moving at all. Lyapunov exponent below zero means that things are converging towards Lyapunov bigger than zero means diverging away. Specifically, what it means is two points that are really, really close to each other. Do they stay exactly the same distance away? That's zero. A negative Lyapunov means that two points close to each other will converge. So that's a convergence attractor. And then positive Lyapunov exponents Lyapunov values mean that two points that are placed very close to each other will diverge away from each other. I hope I have not oversimplified or made unforced errors about Lyapunov functions because it's obviously a really technical area. And they write following 16, we can generalize this local Lyapunov function of stability. So zero equal fixed point, positive equals divergence, negative equals conversions to a global Lyapunov function that plays the role of a potential function of any dynamical system. And we won't go into it, but it is the citation to this real sheet paper from 2013. And they do some pretty interesting math. So if somebody is more familiar with this, it would be awesome to hear about. But what this is doing is it's taking this same dynamical systems perspective that we've been thinking about about things changing through time, and then overlaying on that landscape, a stability landscape. And so if we think about like this hill on the top right, again, hopefully not being wrong or misleading here. At the very top of the hill, it's like a fixed point. It's an unstable fixed point. But if one were perfectly balanced there, we could just say it could get knocked off by stochastic things, which we'll come back later. But it's perfectly balanced. It's like a fixed point. Two points that were very close to each other on a hill, two balls placed right next to each other would start to diverge as they roll down the hill. So that would be like a slight divergence. And so that is what the Lyapunov function as potential function is allowing. It's allowing us to take the landscape of ball rolling, where gravity is the potential function, the higher up the more potential you have, and then it rolls down because of the dissipation of potential energy. And they're going to show that any dynamics with Lyapunov function, so any smooth, differentiable, et cetera landscape has a corresponding physical realization, a friction force, a Lorentz force, and a potential function. So we can think about this Lyapunov function being related to potential functions like something that draws the system back. That's where the negative Lyapunov comes into play. Okay, Dean. Just a quick thing, Daniel. When we were setting up the slides, between those two bullets, they talked about something called a saddle point. Did you understand what a saddle point was previous to reading this, or do you know what a saddle point is now? Yes. Let us, I'm just pulling up the paper in the window. Okay, so people can see it. Okay, so yeah, the stability, okay. So it's the following sentence. So we can generalize the Lyapunov function to a global function that plays the role of a potential function of any system. This follows by generalizing condition A to allow for saddle points. So a saddle point is when the landscape is shaped like a saddle. And there's like, so if it were on top of a hill, the curvature is negative with respect to all directions. In a saddle point, the curvature is negative with respect to one of the dimensions, but it's positive with respect to another dimension. And so it's like, just like, just like saddle. Yeah. Okay. Why do they call it that? And so the ball on the top of the hill is like an infinite multi-fercator. Like a little jiggle, it could go any direction because it's unstable in every direction. Saddle points induce a symmetry where that ball is never going to roll up the hill. It's going to fall to one side of the saddle or the other side of the saddle. And one of those could be like a certain attractor. And the other one could be like another elevation basically. Though I don't know the details of how the saddle point is related to some of this Lyapunov stuff. Okay. All right. So following 16, so this is, they're showing that the Lyapunov is equivalent to a potential function. In physics, a potential function psi can be constructed to describe the flow of or forces acting on a particle through a potential energy gradient. So the potential energy function f is del psi. So here's just one way to state the big idea of equations five through nine, which are not discussed here. So the idea is create a potential function. And when you think of potential function, think it's like kinetic energy based upon elevation, but it's not for gravity and elevation. It's like balls falling down tall buildings, but for not gravity for something that's related to dynamical conversions. So if you were like at the bottom of the bowl, you'd only have a little bit of potential energy, the potential function would be low. If you were really far up the bowl wall, you'd have a high potential function, you'd have a long way to fall. That is going to be reflected by a balance of forces, namely in a tractor force, which is the combination of the Lorenz force and the potential energy induced force. And then there's the dissipative force. And that's the frictional force due to dissipative random fluctuations. So that's like the Velcro ball on the Velcro bowl. The friction is so high that it still is being kept on the side, or it's rolling down very slowly or something like that. Combining these definitions, we can express the total balance, total force as a balance of the forces defined above resulting in. And so just like if it was two colliding vectors, and then we were going to express the outcome resultant as like the total forces being applied on something, it's like that, but it's not about the physical forces in the physical forces in the gravity. It's like more about these forces abstractly. And so equation 10 is expressing this balance of forces on X using a gradient landscape. So there's that del psi. And here's the combination of forces being expressed as del psi, Dean. So they use the word tensor here. And when I was reading this, I didn't, I didn't see it. I mean, okay, so if we're having a tug of war on a rope, it might appear to the outsider upside observer that there's a balance. But really, what I read into this, and maybe I'm wrong, was that there's a tension between these two forces, between the attractor force and the dissipative force? Am I, am I misinterpreting that? Someone has a different answer. It would be awesome to hear it. A tensor is like a generalization of a matrix. It's like a matrix through time. I don't think that it is directly related to tensile or tensegrity. Okay. That being said, you're right that there is a tension between these forces or there can be. And they like tension can reflect like a compromised position. Like if you have a rope with tension on it, then the ending of the rope is going to be like some compromise between the various forces. And so we're thinking about like the various forces. And then we're expressing it as like this matrix through time. That's what makes it a tensor, not the fact that the forces are in tension or opposition with each other. Yeah. Okay. I hope that's accurate. Okay. And then they follow 16 again, and transform that expression in 10 into a more standard form using the diffusion tensor gamma and a tensor q. This is like a rewriting that helps them get to this format where f of x is describing the flow of states. So that's the change in states through time. And it's like a vector field. And it is going to be q minus gamma. So tensor minus diffusion, both of that so that multiplied by that landscape. So that's kind of like the decomposition. But if someone could explain this more, let's hear it. Yeah. My simple words. This is where I keep bringing up the idea that maybe when we're looking at these things through an active inference lens, we're not just looking through a frame. We're also looking through, and they talk about filters later on. So how do we make sure that we're including both and the sort of the tension between both of those views working together and being in tension with one another? So yeah, this is very formal. But I think it kind of reinforces that there's what's inside the partitions and then what's going on within them as well. Yeah. And so it's describing the flow of states resulting from these conservative and dissipative forces. So if q and gamma were the same, then the flow would be zero. If one is larger than the other, then it's going to be dominated by that component with respect to being multiplied by this landscape. So we'll return to it. Anytime. Okay. Variational free energy. What did you want to add on this slide? Well, I don't know. I mean, most people already know what we're talking about in terms of variation of free energy. What they're doing is introducing it in terms of, so now where does the model, the model of a biological entity, where is that sourced from? And that's this sort of idea of these things like posterior beliefs, the foundation, or the idea that we don't walk into a situation completely blind. We have some sort of prior and we're modeling situations where internal states can be interpreted and framed as a generative model. So they're focusing on the model aspect of this as opposed to the generative processing side. They're going to talk about what the external milieu is and where the generative process is here shortly. Great. So good point to pause the video and read this because we're not going to read it out here, but you're absolutely right. They're focusing on the generative model of the agent of the cell, not doing that analysis on the niche, for example. All right, section 2.2.1. Okay, so this is a fun part. We can describe dynamics in generalized coordinates of motion, denoted with a tilde, where x tilde is defined as x tilde equals x. That's like the absolute state of x. And then x with a dot is the first derivative of x. That's called velocity. x with two dots is, or a two double prime, depending on the notation, is the acceleration. What people don't always know is that there are higher derivatives and they also have names.  And then the fourth, fifth, and sixth are the snap, crackle, and pop. So that's just kind of funny. But the generalized coordinates of motion, which came up in number 26, have to do with doing prediction on not just how high or low something is, or on the number line left and right. That would be like if x were just one number. But even if it's just one number that we're tracking, like body temperature, for example, we might be interested in kind of unpacking that into this generalized coordinate where we want to know body temperature and how fast it's changing and how fast that is changing. And so one can imagine that once a zero has been achieved, the higher derivatives are also zero. If it's zero through time, the higher derivatives are also zero. If it's zero instantaneously, that's not always the case. But if it's zero through time, then it's kind of like you've cashed out the derivatives, the derivative zero just stays at zero. And so it's like, if the position is unchanging, the velocity is zero. And if the position is five miles an hour going in the same direction, the velocity is constant, but the acceleration is zero. So keep on carrying that out to how fast things are changing, how fast they change, et cetera, et cetera. And then they're going to take that x tilde, how x tilde changes with time. x tilde dot equals the flow on tilde plus a variance. So a noise or fluctuation, a random fluctuation term. This is the form of the Lang Fein equation. Generalize coordinates of motion plus a random fluctuation term. Any of the mathematical colleagues would be awesome to hear how this is related to the Wiener assumptions, et cetera, but we're going to continue. So using the Helmholtz decomposition, we can now express steady state flow in terms of a divergence free component and a curl free descent on a scalarly operative function, L of x tilde to obtain f of x tilde equals, there's the q minus gamma that we saw a few slides ago, multiplied by now the L. So here we had f of x, not generalized coordinates of motion, q minus gamma del psi of x. That was the potential function. Now, because the potential function and Lyapunov are related to each other, we're looking at the generalized coordinates of motion using the same q minus gamma Helmholtz decomposition, but multiplying it now by Lyapunov exponent, or I'm sorry, the Lyapunov function on x tilde. It's the solution at non-equilibrium steady state and is exactly the same solution for the flow of particles in the classical treatment above. Crucially, we can now see the Lyapunov function is the negative log probability of finding the system in any generalized state. The Lyapunov x tilde is the negative natural log of how surprised one should be p of x tilde. This is known as self-information of a state in information theory, surprise or surprise. In Bayesian statistics, it is the negative log evidence. So the change in the generalized coordinates of motion, f of x tilde, breathe, is an irrotational solenoidal decomposition, that's the left part of the right-hand side, multiplied by a Lyapunov function, which also has the interpretation of surprise. So, if you were exactly resting, so to speak, you'd be totally unsurprised. In summary, any weekly mixing dynamical system at non-equilibrium steady state will events give us evidence for, or look like it is, a flow that can be decomposed into a gradient flow on surprise and an accompanying solenoidal flow. Because we can associate the Lyapunov function in 18 with a free energy, the system is effectively minimizing a free energy in its conversions to a set of attracting states, which have a high probability of being occupied. So it's a little circular, it's like we're finding ourselves where we expect to find our self. And so if we just said, well, how surprised are we, and let's gradient descend towards not being surprised, just at a first approximation, we would find ourselves in regions of low surprise. And we would be surprised to find ourselves in regions of high surprise. Is it circular or is it kind of the byproduct of a recursive process? Again, I'm asking, I'm not questioning. It's a great question. In like a really meta way, all of math is circular once the axioms have been stated because like the equal sign is there. So we're just, you can add one to both sides and it would still be equal. So is that circular? It's useful. And that's what matters for this paper. Okay. Yeah. We're not going to talk about it too much, but in a dot one, we absolutely will. And that's this least action principles in two to two. And they even give the example we love to see. For example, in colonies, ants find the path of least action to harvest food and bring it to the colony. Citation needed slash let's see that. But conceptually, no problem. This example considers their paths as flow channels or trajectories finding the least average action for each instance of foraging given available resources. So what does least action principle mean? What does least action mean? And what is it necessary or sufficient for? Because certainly foraging is not the least biochemical expenditure of energy. That's like the sort of naive interpretation of least action meaning just stay where you are. But we're thinking about a usage of least action that impels this ant to forage in an adaptive way, such that even when it's foraging trip is hard and the seat is heavy, and it gets like lost or something, that is still a realization of a least action on something. It's still a ball rolling down a hill as efficiently as it can in a space. So it's a nuance topic that it will be great to discuss. Because they also write minimization of action in an open system leads to structure formation. So that'd be a good thing to unpack. Okay, carrying on. In dissipative random dynamical systems, action is not minimized for each element of the system. But on average, over an ensemble of elements or repeated trajectories of the same element. Since self organizing open systems are not conservative, their structured flow is quintessentially dissipative. Good to think about that and hear many perspectives and questions on it. Classically, for a conservative system, Lagrangian is defined as L. This is L not the operative. Now it's Lagrangian equals T minus V. So T is the kinetic energy of the particles and V is the potential energy. And so that's how the trajectory of system states can be solved for a conservative system, where the total energy is going to be conserved. But they're opening up into this dissipative and open scenario where this is not going to cut it. A little bit more detail on least action, which we're not going to go into. Okay, continuing on. Two, two, three, Markov blanket. Okay, a robust literature is developing about around the ability of cells and other a neural non neural systems, measuring aspects of their environment via specific sensors. They introduce here the Markov partition as this general case of separation of states into four categories. E external states, sensory states, S active states a internal states I. And so the little E is like, it's a realization of big E. That's the bigger space. And then X tilde comes back and the generalized coordinates are going to be a realization of values of those partitioned states. So we've talked about the Markov blanket before, but now we're interested in the generalized flow on the blanket partition states. So here's what the Markov blanket looks like. And we'll talk more about it in the dot one and dot two. What are the arrows mean and why are sense and action connected? What part of the cell are we looking at? Is it a part of the cell? Is it a model of a cell? All these things that I've come up before, but just to say that's their figure one and table one gives the math formalisms. Okay, anything to add on Markov before we continue? No, because we'll unpack. Yeah. So this is where they apply the Markov blanket. So M is describing the Markov partition that defines the underlying random dynamical system such the cell. So that is like the model. That's the partition Markov partition of the cell. So inserting C into A and B is going to give there's a is actions and I is internal states. So the top equation is basically saying the flow on action is a function of sense, action and internal. And then it has a right hand side. So the flow on action, the performance of action is, and then there's that gamma minus Q, but now they have a subscript A because it's those about the action landscape multiplied by Dell triangle on action tilde, generalized action, and then a self-surprising looking like the self-surprise of sense, action and internal conditioned on M partition. And the bottom equation in B 30 B is basically the same, but it's the flow on internal states F sub I on generalized states of sense, action and I and that same gamma minus Q Dell self-surprise conditioned on model. So we're seeing some patterns come up. And even if it's like confusing, and we all definitely are confused by it to some extent, we're starting to see like some patterns. Why does it matter to focus so much on a and I action and the internal states, because those are like the ones we control. We know we don't control external states directly. Maybe we can intervene so that they change differently, but we know we don't control them. We also don't directly control sense states, we're getting dealt this hand every second by the niche, the generative process. And so we can take action so that we can expect different sensory outcomes, but even then we wouldn't be controlling sensory outcomes. And so a lot of active inference comes down to doing inference on internal model, internal states, generative model, learning and action, action selection flows on action. This bounds surprise on the particular states, which is the internal and the blanket states through control of the autonomous states, which is just the action and internal states, the states we control. Because of the sparsity of the blanket, not every node is connected to every node. There might be a factorized and tractable form to bound our surprise about the particular states. In general, it would be a very difficult problem to solve. However, we can replace the Lagrangian. That's the one here that was going to be used for conservative systems, but it didn't really apply with a variational free energy functional or of a probabilistic model of how a system thinks it should behave, or how we think the system should think it should behave. So it's hard to solve these generally, but in practice there are heuristics such that these are approximatable. Section 2.4 goes like one layer deeper into KL divergence in the VFE, but we're not going to go into it. Okay, we're just going to keep on flying through. 2.3 is Bayesian filtering and self-organization. We're not going to talk about it now, but the big questions here are like, how does Bayesian statistics relate to identity? And what is self evidencing? And there's probably a lot of other good questions we could ask. Like, why does Bayesian filtering and self-organization come here? All right, modeling morphogenesis. So now we actually get to the contribution of the paper, which is the modeling of morphogenesis. So they're going to illustrate self-organization to NES using the variational principles above. By trying to explain the behavior of a model of pattern regulation by consideration of information processing and error minimization with respect to a specific target morphology, in this setting the game changes subtly, but profoundly. It's a dean line if I ever read one. Above, which is what we've reviewed, the dynamics of any random dynamical system equipped with a Markov blanket can be formulated in terms of a gradient flow on variational free energy. That was just here, the flow on action and the flow on internal states. Here, we turn this formulation on its head by specifying a generative model and implicit VFE function and simulate self-organization by solving the equations of motion in equation 34. So they're going to specify the form of the attracting set, V, the generative model, and then they're going to let it ride. So we have to specify, yeah, they specify the external dynamics as the generative process. That's the niche and the generative model of that process, which is being described by the flow of internal states. Okay, so we're going to look at the figures and then we're not going to even like go into the details. So let's just look at the figures and see what they're doing. So here's some empirical biology happening in the lab of Mike Levin and others. So in A, it turns out that when you dissect out the center of a flatworm, a planarian, those cells will remodel into a new worm. So cutting out the middle and it reforms into this new flatworm and red is the head and then like blue is the tail. So there's a self-organization of this target morphology even from an initially clumpy cell. What they're going to do in B is showing like the final fixed point of these different cells. So here we have like four different cell types. There's like the red neural or head cells, then yellow cells, green cells and blue cell. And then basically like this, like three, two, one, one and then the bottom one, it's this one. Maybe they change the green and the blue. Like I think these two should be green and the bottom should be blue, but minor point, but it's an attractor on this target morphology. And then C is describing a little bit about how it happens, which is that cells are constantly comparing their sense signal concentration, like of a gradients of some morphogen, to expectations by minimizing their free energy functional. So it's like, what kind of a cell type am I? And what should I be expecting flip side? What should I be surprised by? Because to say what I expect is the other side of the coin of what one is surprised by. Okay, so they're modeling this empirical scenario where a flat worm can regenerate its form from just a clump of cells here. And that if we think about the location of these cells as being like a steady state attractor, like we want to have this body form last, then if all the cells just get in line like that, everything's going to work out. All right. How do we take this first jump that we made from the empirical biology to the state space framing? Here it is an XY state space. And now take the next jump, one more mathematical. Here on the right side is that XY positioning of each cell. This is reflected by the position in X and Y of the cells. So like negative nine and zero. So that's like this top red one. Zero is the midline. So it's like Y and X. And here like negative five, it's a little lower. And then like negative four and four, it's like one is, they're on the same Y elevation, but then one is four to the left and one is four to the right. And so this E star of X is the position. So it's a matrix of position because there's like eight cells and two location variables per cell. So it's like a two by eight matrix. And it changes through time. So it's tensor. The E star C is the external signals. And so in this steady state attractor, all three red cells are getting like signal one. Here's a binary signal. There are four signals, but they only have an on or off state. In reality, there's many, many more signals than four. And there's a lot more nuance than just on or off, but it's a it's a toy example. All three red cells are getting the exact same signaling milieu of 1100. So factor A and B are diffusing near me, but not C and D. The yellow cells are experiencing those two diffuses and one other one. The blue cells are experiencing the first and the fourth, and then the green one is another. And so this is like the attractor state for a stable location and signaling expression. So converging to this spatially makes your body look like that. But the way that you get a beach ready, planarian body like that is actually by reducing your surprise on signal expression. Okay. So here's them running it through time. So it's a time lapse movie montage of simulations of morphogenesis. And so here it is converging towards on the right side, the morphology that's been discussed here. And so the cells start out with undifferentiated. They know what they're sensing. They don't know what kind of cell they are, and they don't know where they are. And then they sharpen their expectations about what kind of cell they are, while also moving into a different spatial niche, but they're not tracking their location like I'm at three comma two, where are you? It's like, this is what I'm biochemically sensing. And so it's a relational morphology that doesn't need the blueprint in the nucleus. So it's a lot like an ant colony, there's not the nest architecture blueprint in the brain, there's the process for stigmer G. And then they show that with some other changes in the generative process, positive squared gradient in the generative process, they get double head formation, which some modulations have been shown to empirically result in in the lab. And they can also make it so it gets double tail formation. So it's just recapitulating this basic example, and then showing that like modifying the external field changes the morphology that gets attracted to. So those are the key pieces that's modeling morphogenesis as Bayesian inference, reducing surprise with a variational free energy flow on action and internal states action states, internal states. Okay, we're not going to go into it here, definitely for the dot one and dot two. So 3.1 is the construction of the model, they then unpack that signal matrix, the combination of the signals. And then they give even more information about modeling signals. And they also imbue it here with like this stemminess, which helps the cell start out with, I believe, a weaker prior about what kind of cell they are, which translates to where they should be. In figure five, they do a targeted intervention in their studying of anomalous cell behavior. And so basically, they start off with these cells that have initially unspecified state, and they converge in A, the panels on A, by 32 time points that converge to the target morphology. But in B, they show that if one of the cells that gets hit with a white arrow here has a perturbed signaling response, it fails to correctly infer its place in the ensemble. So B is like sort of like, could be like a genetic mutation or a targeted modification of the signaling. And it's like that third red cell never forms. And then in C, the same aberrant cell from B is initially is rescued by an increased signaling sensitivity of other cells, leading another cell, green arrow, to switch position with the aberrant cell pink arrow. Pretty cool. Okay. Yeah, I wanted to come up with an analogy that would actually work that would explain this, like if you're out geocaching one afternoon, and then all of a sudden, some something was able to turn all the lights off. And then the person that was geocaching beside you changed their behavior, but I couldn't even come up with a valid analogy to try to explain this. How about we're playing American football. And so there's a plan.  And so if all goes to plan, we're all going to deploy into the exact right positions. But then somebody doesn't move. If each nest mate on the football team has low sensitivity, then they're going to continue in their own expected trajectory as if nothing had happened. That's kind of like what we see in B. It's like a partial rollout. Whereas this is changing the environment, mixing our metaphors, etc. So that a high sensitivity teammate fills in for that critical position so that the attractor state of the strategy can still be morphologically realized even though there still is that one individual who's not moving, but they're not interfering with the strategy's attraction. But we'll come up with probably some other and better ways to talk about it. Okay. And then they just mentioned that this is something that can be modeled and it's in SPM and also on Franz Kuchling's GitHub. So maybe we will look at the code. And then just to say that we're not going to go into it at all today, but all of Section 4 is super interesting. They review some of the mathematical assumptions and limitations of the model. There's a really fascinating discussion about variational principles and open systems. And so just to read, we have shown that the variational free energy minimization in active inference is related to the variational principle of least action. It is worth pointing out where these two approaches diverge. Two instruments in a wood diverged. And then it's all about that divergence and the contrasting. And so I think there's going to be lots of unpacked there. And then they have some closing remarks on the applicability in biological systems and some of the predictive capacities of the simulations in terms of like, you could make a simulation of a healthy functioning tissue and then have predictive capacity about asking counterfactuals. Well, what if this happened? What might I expect? So that is a lot of info. So thanks to everybody who's been watching. And again, hope that, especially with some of these technical parts that we were able to represent it with high integrity. So you won't have the last word, but what would you say in closing as we move from the dot zero into the one two and beyond? Well, first of all, you went through a heck of a lot of stuff in a very short period of time. So that's, that's quite the gradient flow right there. So that's impressive.  And I think in the point one and the point two, we may still be doing a little bit more unpacking just because of the density of this kind of information.  So I think, I think being able to cover this and hopefully we got it right. Like I did my best to try to understand it. And I think you did a good job of explaining it. So we'll see who shows up in the point one and two, whether the point one and two are more unpacking or maybe starting to actually think of ways that we could employ this. You already mentioned that we could, we can apply it to digital teams. But whether or not people have the confidence to be able to take this and apply it like they've done to morphogenesis, maybe that's part of that conversation. Cool. Yeah. I'll be looking forward to going through with multiple concurrent regimes of attention, some of the formalisms that we either disgraced or skipped in this discussion. And then keeping it open to think about morphogenesis, like, where has morphogenesis been in numbers one through 38? Why haven't we been talking about morphogenesis? And if not morphogenesis, then what else have we been focusing on? How does it relate to embodiment and to spatial and physical aspects of cognition? There's so many interesting angles and I'm sure we'll have a lot to discuss. So Dean, thanks a ton for all the help on the slides and for this discussion. Hope to see you in the coming weeks. All right. Thanks, Jan. You'll take care. Peace. See you later.


What's good Josh, we're off to back again with another video. So I'm gonna check out WWE moments that got no reaction. Now, it's okay if a wrestler gets a negative reaction. You know, especially if they're trying to be a heel, you can work with that. You can build something with that. Even if their baby face originally booked as a baby face, but they're getting booze, you can work with that. You can spin that in as something great. You can actually feed into the negative reaction. And then you have situations where sometimes a wrestler gets the right reaction, a positive reaction, a reaction of endearment and support. But the worst thing as a wrestler is to get no reaction. When they're sitting there just looking at you with no type of yeas, no type of booze, just quiet. That's the worst thing to get as a wrestler. I'd rather get booed out the building because I can turn that into an angle. I can change my character off of that than to get nothing. No reaction is the worst reaction. So we're gonna check out some of these moments where fans just didn't give a damn.  I don't care. We're gonna check this out. Appreciate all the love and support you guys have shown on the channel. Should be a good one, man.  I got just said. It can happen to anyone. Even wrestlers like Edge, Kane and The Undertaker have had incidents where they killed the crowd. In fact, one moment was so bad that WWE actually stopped the show and told fans they had to get louder. Before I show you that, this first moment is pretty sad. At Survivor Series 2014, it was Team John Cena versus The Authority. Cena's team was stacked with The Big Show, Dolph Ziggler, Ryback and Eric Rowan, and all of them got a big reaction, except for one. Look at that. Listen to the Dolphz. And then there was Eric Rowan. Oh, man. Oh, man, they didn't even pipe in cheers or nothing.  The reason the fans had no reaction for poor Rowan was that this is the first time he used that particular entrance music. Also, fans just simply weren't into the character. A move like that is bad, but imagine getting no reaction every time you come out. That's what happened to this next wrestler. Charlie Haas debuted in a big way by being paired with Kurt Angle and Sheldon Benjamin. Sheldon and Haas were going to become two-time WWE tag team champions, but things went downhill after they broke up. Haas was used less and less and eventually got released in 2005. However, in 2006, Charlie Haas came back and the response was, well, not existent. Unfortunately, it wasn't just a case of a bad crowd. This would keep happening at shows and fans would eventually start referring to it as the Haas Pop. Y'all are cold, but wrestling fans can be some of the cruelest individuals. Not the Haas Pop. You don't want the Haas Pop because there is no pop. It's just quiet. Aw.  This was bad, but wait until you see the moment when WWE stopped to show because of how dead the crowd was. In 2010, Edge made his return at the Royal Rumble and was immediately a face, a good guy. However, about three months later, Edge got trapped from SmackDown to Raw. The radar superstar made one final appearance in the blue brand to tell the fans how much they meant to him.  Edge admitted that Captain Charisma was right, but the crowd didn't seem to care. I can't wait to get off this show. For the last few months, I've been the puppeteer, and these people have been my puppets. I've been making them dance around saying spear, spear, spear. Any time I wanted them to. And guess what? They did it. The lackluster. And then some sometimes fans, they can, they can be the problem too. At these shows, like, why are you there if you're just there to. Be bored, be bored at home. Oh, your fan response was due to a combination of fans still liking Edge, especially since he had just come back from a major injury. Yeah. Also, just the whole heel turn, not being that great. It's not surprising that W2B made Edge face again shortly after this. Yup. Mick Foley is one of the most beloved wrestlers of all time. Not only was he willing to risk his life to entertain the fans, but he's also one of the nicest guys in the world. For sure. How could fans not react to him? Oh, trust me, there's a way. Until the sex, Foley began a feud with Edge, leading to their famous WrestleMania match where Mick went through a flaming table. Jesus, bro. Classic. After WrestleMania, Mick and the radar superstar continued their rivalry. During an episode of Raw, Edge and Mick Foley went at it again. However, Foley invited Tommy Dreamer and made it a triple threat match. It looked like the two ECW legends were going to work together until Mick Foley betrayed Tommy and revealed he was now working with Edge. The crowd barely reacted. And after the heel turn was over, they stood in silence. Yeah, there was no boo. It was just like, okay. The fans clearly did not want to boo Mick Foley. Yeah. How could they? This was the man who nearly killed himself to give us one of the greatest moments in WWE history. It's not surprising that Mick Foley's run as a bad guy was short-lived and is rarely brought up. Yeah. He was suffering from identity fraud when someone wore his old mask and started attacking him. The heel cane and the imposter cane finally got to fight it out at the vengeance pay-per-view. Well, both men brought the heat. The crowd was lukewarm at best. Well, new hell, fire and brimstone, the imposter cane. Imposter cane, bro. Ironically, something very similar happened to the Undertaker 2, and it was even worse. In the mid-90s, the Undertaker disappeared from WWE after he was defeated by Yoko Zuna at the Royal Rumble. A few months later, the dead man returned, but he was now being controlled by Ted DiBiase. The Undertaker's original manager, Paul Bearer, claimed DiBiase's phenom was an imposter. This set the stage for the return of the real Undertaker at the 1994 Summer Slam, where the dead man came face-to-face with himself. Fans started off excited to see the real Undertaker return, but they quickly got bored of the match. Bro, listen to that, man. And then sometimes you can get these dead reactions just by bad booking decisions and heel turns or face turns that don't really work or matches that's just not working. For example, if you guys watched our crown jewel last year in reaction, there were certain matches at crown jewel date. The crowd was electric for. And then there was matches they didn't give no Fs were given.  A prime example of that was the Rey Mysterio and Logan Paul ring match. That was a good match. It could have been better, but it was dead majority of the match. The fatal five way, fatal five way women's match. That was dead majority of the match. Hell, EO versus Bianca. They were, they were, they were dead. The crowd just did not care. Even with Kyrie saying coming back, they were dead for the majority of the match. So sometimes it just depends on the crowd too, man. They either they care about it or they don't. Bitsick Man was doing commentary and realized the fans weren't into the match and tried to present it as a good thing. You tell me if it worked. It was capacity crowd in awe. In awe. They don't know what quite to think. They're seeing two under takers. This wasn't the only time fans set out their hands for the Undertaker. At WrestleMania 15, the Undertaker fought Big Boss Man for the number of times. Their match wasn't that great. It was the number of factors and the ending only made it worse. So after defeating Boss Man, the brood lord from the ceiling and gave the Undertaker a rope that he put around Big Boss Man. Now listen to this clip and tell me what's missing. The boy came to Boss Man being hung from the cell. We got commentary and the Undertaker's entrance music, but there's no crowd reaction. Yeah. If you didn't see the fans, you would say this happened in an empty arena. Now what could be worse than this? They barely cared. How can this be silent for an entire match? Before I share this reaction, what happened or rather what didn't happen really wasn't the wrestler's fault. Backlash 2017 was probably best known for being the show where Jinder Mahal won the WWE Championship. Here's a question though. What match happened before that? If you said Luke Harper versus Eric Rowan, you are correct. This match received little to no hype in the weeks before the show. To make matters worse, it was sandwiched between two big championship matches. So when that's the case, it's not surprising that this is what happened. Honestly, I miss Otonka. Listen to the silence. Rest in peace. Or you went by Luke Harper in WWE, rest in peace.  Even though the crowd was absolutely dead, WWE still did not stop the show. There is one time they did, and you'll be seeing that very soon. It's around 2010 and 2011, one of the biggest mysteries in WWE was who was the anonymous broad general manager. Whoever this person was- So annoying. They'd communicate via messages sent to a laptop. Man, this general manager was working for poem before it was cool. Anyways, the anonymous GM disappeared before the mystery was solved. But in 2012, the remote general manager returned for one night. Santino Morellov made it his mission to find out who it was and he got an answer. At the end of the show, Santino took under the ring where he discovered Horn Swaggle. Yeah, I think- The crowd was not amazed. Yeah. Horn Swaggle, are you telling me you're the one that's been causing all of this misery? Remember that they were trying to figure out who was the anonymous GM and the best thing they could have come up with was Horn Swaggle. Evolution is a mystery and one of the greatest factions in WWE history. For sure. Which consisted of four of the biggest stars in wrestling. So when evolution returned after being broken up for nine years, you would think they'd get a massive reaction, even just based on the fact that all of them were superstars individually. But you would be wrong. Yeah, that's crazy. I guess the crowd weren't Ruthless Aggression fans. These fans were actually pretty lucky.  And yes, WWE has been petty enough to do that. On the road to WrestleMania, WWE made a stop in Lafayette, Louisiana for Monday Night Raw. They ended up regretting that decision. On that night, several wrestlers got the call-up from NXT, but the fans in attendance- Ah, I think I remember this. Yeah. Yeah. And this is why it's important to depends on where you're at, man.  Who was this person? Why am I supposed to care? So they'll just be sitting there looking at these people that, us at home, we're like, oh, that's cool. They're on Monday Night Raw. Everybody else like, who are these people? WWE was so irate about this that they actually made an entire video about how bad the crowd was. As a member of the WWE universe for a long time. I was disappointed in them. Well, WWE called out the Lafayette crowd. There was one city that was so bad that WWE actually stopped the show to tell them to get more excited. In late 2014, WWE was doing an episode of SmackDown from Liverpool, England. For whatever reason, the Liverpool fans were just not that loud. Really? That's surprising. What? Bigler is one under these conditions. Back slide here on, another kick out. Cesaro looking to take the advantage here. Vince McMahon then decided to stop the show and scold the audience personally. Bro, and that's crazy because it seems like in the UK, boys be going crazy.  So the fact that Vince had to come out there, that's funny, bro. I would have to say, the Liverpool fans didn't do anything disrespectful. Some fans have, though, and to see what wrestlers did to them. Wow, man, that's funny. I wouldn't have never guessed that that's the situation he was talking about. I mean, they were quiet for that match, but it seemed like maybe they were quiet throughout the show because that's the segment he probably came on, you know, came from behind in a gorilla position during a commercial break. And I, hey, man, get y'all livin' it out.  Damn, that's crazy. So it's a combination of things. It's a combination of booking. It's a combination of where you have the show at because that matters.  It looks like what they're seeing is not important. So why the hell should we be watching it? It kinda slows down the pace of the show if the crowds are not into it. So comment down below. Let me know some other instances if you guys were at a show where the crowd just didn't care. They were dead. Or if you've seen it on television where the crowd was just, they didn't care. Like I said, for Crown Jewel, there were some parts of the show that they were electric for and then there was plenty of the parts of the show where the match, in my opinion, was fine and pretty good actually.  But I appreciate all the love and support you guys shown on channel Road to 150K and I'm still here in this video. You just rest in the chamber of the world. Appreciate y'all kicking in with me. See you in the next one. Peace.


So what's up guys? Today I took a drive up to Dairy Farm.  When I took the pictures for the for the almost, oh almost two years. Oh that's right because I came up here before I was looking for the slaughterhouse. This is a year and a half. It's been a while been trying to get back up here. So you guys might remember farm vlog we did where we were showing like the pigs and the chickens and stuff and I've been talking back and forth to Ross for email for a while and I had a couple things I wanted to give him. We had some like feed in the warehouse I wanted him to try out and just come up and visit see how he's doing. So we're just gonna like take a look around the farm today maybe show you guys some animals. What do you buy? The square of the round. Yeah yeah yeah. It's going anywhere from from $25 to $45. A bell. Yeah and that's dry. When you silage ones are wrapped they're generally $45. Then the huge thing is transport. Yeah yeah. Huge cost to transport them. I just talked to a guy over in Springfield that's two hours away. Yeah. He went $350 and moved 12 12 round bales plus. How many bales you feed a day in the winter? Probably two a day maybe a little more. And you have to give them grain too right? I gave them corn in winter and now there's nothing on the field so they need something soon you know. Yeah yeah. Because I would know here they're coming through here. Yeah. Because they want the best. See that's what they're scouting for because I didn't feed yet. That's like a walking through a marsh. It's definitely not a place for a corn. It's dry right now. There's an area where springs come out of here. Oh yeah. It's not that one. What does three tit in me? It's only three quarters. Oh three nipples okay. It's a Jersey cow I had in the barn this time. You can once they dried off maybe though some of them some of them get fat you know. Yeah. They don't hold they don't hold weight not the Jersey crosses because they're more dairy seed. Yeah yeah yeah. But they were good mothers they grew they good growed calves you know. They see them calves running. They're so happy. Yeah yeah. That's cute. They're so funny.  They'll stay in the group the calves. Oh yeah. That's what they did when we grew up little calves. They was sitting a pile in the middle of the field for a whole day and now nursing but I'll tell you another thing well it doesn't matter to you but we had big problem with coyotes and the ravens. Yeah. With the calves. Huh. With the calves.   Yeah that's what they did that's one calf it's a herford here. They run around like the ears. Yeah yeah. There's one. She can't see you and she's wild as hell but she can't see both eyes. They already got them both eyes. Do you know which one? I don't know where she is it's a herford. It's a red and white base like that one. So she just follow some other one? They smell. Oh yeah. But they see when they know somebody there then they'll take off. Another one went through the fence and put a gash in and she actually got the flies in the summer and she got infected so bad she died. Oh you lost one. They put a gash cause they can't see. They went right through the fence and put a gash in them. That's horrible. Oh this is why they went through all this stuff. So we're out here just looking at some cattle. Russ wanted to sell a couple so I was thinking about it but as you guys know we didn't get the slaughterhouse this year so the problem is we got to figure out who can process nearby how to get the cattle to and from the slaughterhouse and then if even after they process the cattle if they're willing to ship it down to New York. I mean obviously money talks probably. If I pay a guy like $100, $200 just to get the cattle over there and then maybe a couple hundred to ship it down to New York it should be fine. It's just trying to sell the meat with a reasonable margin and when you buy stuff from distributors from vendors you have something consistent and if there's a problem you can always address it but as soon as you buy a thousand dollar cattle and you buy that meat you're stuck with it whether it's too lean or it has an off mineral taste. It's really more of a gamble but when you own the slaughterhouse and have the operation then you can make this cattle into jerky you can make that cattle into sausage but if you don't have that luxury then you're kind of stuck with selling the cuts so we'll see.  I know you guys haven't been waiting for the local beef for a while but maybe one or two. City people came in the area the local people's kind of disappeared. Yeah it's like the rich people come here to kind of escape the city because it's not that far it's only like maybe a two hour drive to the city. Yeah that's what's coming up here very wealthy people very wealthy. They call it a blue tombstone because they're so expensive and very costly to put that silo up on there. But I mean if you buy a property with it on it already then and you don't have to spend the extra money then that's not that bad. No because they're worthless. What do they cost to put up originally? Originally I think he paid twenty seven thousand or something. That was my thoughts. That was an eighty maybe. That was an eighties twenty seven thousand. Now that thing probably costs you over a hundred grand. I imagine but they don't even have them anymore.  They're giving them away because it costs more money to take them down. Oh because they're glass lined. They're glass lined on the inside. That's kind of crazy. Yeah because it's something to look at. Yeah but they tax you on that thing. Like per year. The taxes that zones. Yeah because what does it get zoned for agriculture or industrial or something.  If they rip out then can you drop your taxes but it's so costly to pull them down. Then you'd have to probably probably take you five ten years to make up the cost of taxes. Right enough they're killing people. They're killing good milk cows. Milk and cows are killing them. The whole herd's going to kill them.  Hey the vegans want their oatmeal.   My neighbor he was a sex therapist. He was here this afternoon. He's in Manhattan.   You know what he did? He won't eat meat no more. Yeah that's why he doesn't look so good. He looks like a skeleton.  Maybe it makes his wife happy. That his pee pee doesn't work anymore. But this is what you're dealing with. But you find a spot and you'll be alright because you have the profit margin. There's no doubt. I'm lucky because I have what it's weird. Most people have the land and the business but they don't have the marketing aspect. I'm lucky in a sense that I already have the clientele and the business. But it's crazy because they're not paying you more for cattle but they're charging 25-40% more for each cut of meat. You know New York strip steak went up almost double in price. It's crazy. It's crazy. The stakes are going way up. Meat has gone up maybe 20-25% but not the cattle prices. That's why we're going broke. The big packers, Cargill, Tyson, they're all making a lot of money now. They're making even more money. Get richer. Tyson, Cargill, JBS and whose other big beef went wrong? I can't remember. Smithfield? It's pork. That's not the one I'm paying at pork. Tyson, Cargill, JBS. There's another big one. Oh, Masano does. That's the grain. They were giving... Animals don't like the rain at all, huh? No, cats hate it. Oh yeah, the cats don't like water. The dog wants to escape the rain too. Yeah, he sleeps in bed all the time. No wonder he's so healthy as a dog.  No, he's trying to eat the cat too. Anything with food, that's Henry.  He was kind of down there running the day-to-day operations when I wasn't feeling so good. What's up, buddy? I milk fed him and I sold him for $400. Figure that out. What's up, the pigs? $400 total or each? $400. I sold them. You lost your rear end. Because nobody wants to pay. I don't know if you can or not. Pork is cheap. Yeah, it's too cheap. When they do the pasture pork, the only forest stuff, acorns, pasture and stuff, then it gets expensive sometimes, but that's hard to do. You need a lot of land and it's a lot of work. It's not profitable. It's almost impossible. They're a little scared. It's been a couple hours. It's about 4.15 now. Pretty nice day earlier, but it's getting chilly now. Still pretty sunny out. I kind of feel bad for the guy. That's why I'm here, trying to help him out a little bit. He's been having some problems with the dog. The main reason I came up here today was to actually bring him some supplements, just some vitamins and stuff to see if he feels a little better. I shouldn't be doing it, but I think I'm going to help the guy get his farm properties listed on some website so he can sell them because nothing's happened in the past two years. I'll also see if I can buy some beef cattle, if I can work out the logistics.  At least I'll help him with the farm properties. The only reason I'm doing this is because when I did help him take those pictures earlier, I was fortunate to have the people that were helping him reach out to me and help me with the slaughterhouse deal. Although that slaughterhouse purchase didn't go through and it didn't work out, it still gave me an opportunity and I do appreciate that. Hopefully, I don't know if you guys enjoy this or whatever, but I'll give you a little bit of an update about what I do on my Sundays when I should be relaxing.  We might have some local beef because of this. If not, we've got some farm prospects that we might be buying in the near future nearby. So thanks for joining me, guys. I'll see you for tomorrow's vlog and have a good night.


It's been almost a week since our nation and family stood together as we watched Challenger slip beyond our grasp. The memories of that moment will be with us always, as will the memories of those brave Americans who were aboard. The death of the astronauts and the destruction of the Space Shuttle Challenger will forever be a reminder of the risks involved with space exploration. We will always remember the Challenger 7. As we move away from that terrible day, we must devote our energies to finding out how it happened and how it can be prevented from happening again. It's time now to assemble a group of distinguished Americans to take a hard look at the accident, to make a calm and deliberate assessment of the facts, and a ways to avoid repetition. So I am today announcing the formation of a Presidential Commission on the Space Shuttle Challenger's Accident. The Commission will review the circumstances surrounding the accident, determine the probable cause or causes, and develop recommendations for corrective action. And this Commission will report back to me within 120 days. William P. Rogers, former Secretary of State and former Attorney General, will serve as Chairman of the Commission. And Neil Armstrong, former astronaut, will serve as its Vice-Chairman. In addition today, we are announcing 10 of its members drawn from distinguished leaders of the government's scientific, technical, and management communities. The crew of the Challenger took the risks and paid the ultimate price because they believed in the space program. They were excited by the mystery of what is beyond the Earth and to the limitless possibilities of space exploration. They knew of the dangers they faced. Yet despite those dangers, they chose to go forward, not reluctantly but eagerly and with a thumbs up. And we owe it to them to conduct this investigation so that future space travelers can approach the conquest of space with confidence, and America can go forward with enthusiasm and optimism which has sparked and marked all of our great undertakings. This is the end of the statement here, but I understand that these gentlemen, Dr. Graham, are going over to the press room where they can field some of your questions on this. Thank you all. Thank you. Thank you, Mr. President. Thank you very much. Thank you. Thank you. Thank you, Mr. President. Thank you very much. Thank you. Thank you. Thank you. Thank you. Thank you. Thank you. Thank you. Thank you.


Hello and welcome to the Grand Line Review, your source for everything one piece. Today, we are going to be gazing upon a very special page in this here, Double Fruit Encyclopedia, as we examine the ever-mysterious, Yami Yami No Mi. The Yami Yami No Mi is a Logia-type fruit that allows its user to conjure, manipulate, and become darkness. And before we go any further, we do need to address this fruit's typing because there is a lot of confusion in the fan base about it due to its unique spin on the Logia class. However, the direct quote from chapter 440 in volume 45 very clearly states that the Yami Yami No Mi is a rarity even amongst the Logia fruits. Before Blackbeard goes on to quite literally state that it is a Logia-type in chapter 441, thinking that it is anything else as the first of several misconceptions regarding the Yami Yami No Mi that we will be covering here today. But at this time, we should also note that this fruit was consumed by Marshal Deteach, better known as Blackbeard, who went so far as to murder one of his former crewmates in order to acquire its power. This may be because the Yami Yami No Mi is said to be, depending on the translation you've read, either the most evil or most dangerous double fruit powers in existence. And when you think of the kind of crazy powers we have out there, this is a pretty damn big statement. As for where the fruit takes its name, well, it's very directly from the Japanese word for darkness being Yami. And I feel like if you've been a fan of anime or manga for any period of time, you'll very much have encountered that word by now. Although the English translations of both Viz and Funimation decided to emit the nest portion and go with the simpler labeling of the dark, dark fruit. All right, well, let's get into things by stating that the ability to conjure manipulate and become darkness is not as simple as it may initially seem. Because what this fruit more or less does is craft darkness so dense that it sucks everything in, including light and thus begins to function as a mechanism of controlling gravity as a bit of a side effect.  Now, I really don't want to get too hung up on the specifics behind what a black hole can and cannot do in reality because even the definition given in the series very much ignores its own rules. For example, when conjuring a black hole, Mr. Blackbeard claims that his dark gravity shears will compress any object with infinite power. Sounds amazing, yeah? But he then goes on to regurgitate an entire town from his person and yes, it is completely destroyed but certainly not compressed with the kind of power he stated it to be. Now, this is not to state that the user of the Army-Armin-O-Me does not have access to that infinite compression because it may be possible that the user also has control over the level of compression that they are using against objects and being sucked inside of them. And with that in mind, in certain situations it may be desirable to keep light compression because as I've just stated, it is possible to release objects from your grasp which may very well assist your needs whether it be a projectile town thrown at an opponent in combat or simply a nice can of refreshing Coca-Cola that you've kept waiting inside your body for just the right occasion. So you could almost consider this black hole a sort of pocket dimension where anyone or anything could be stored. Very, very handy. However, this absorption is also highly beneficial in that the darkness produced by the Army-Armin-O-Me even has the power to absorb the devil fruit abilities of other users. Now, this is a very unique even one-of-a-kind power in this world because unlike Seastone, which merely weakens fruit users, or Arma-Mitaki, which allows you to bypass the powers of a fruit user to reach their substantial body, the Army-Armin-O-Me provides absolute nullification of a devil fruit power. As such by coming into contact with the user of the Army-Armin-O-Me, Logia, Paramecia, and according to Blackbeard, even Zoan users lose the entirety of their powers and become normal beings once more. And how we think about that in regards to the Zoan classes, particularly interesting because if Blackbeard were to touch Chopper, for example, then would that mean that he would lose his human sentience and become a simple reindeer once more for the duration of contact? And the answer is quite possibly. And now before we all start considering this the most incredible devil fruit to have ever existed, it does come with one pretty massive weakness, which is very simply that the user is engaging absorption within their fruit rather than intangibility, which is the standard feature of every other Logia we've covered in the Encyclopedia thus far. This means that if the user of the Army-Armin-O-Me is attacked, then they can absorb said attack. However, this is an art form and it is entirely possible, if not probable, for the user to be unable to perform this in time. And in that case, the user will feel the impact of an attack, but not only that, the damage taken is actually amplified, making this an exceptionally undesirable fruit if your tolerance for pain is minimal. But for the right-wielder, this fruit can be absolutely incredible. And to touch on that a bit more, let's examine Mr. Darkness himself, Blackbeard. And for the most part, he makes use of this fruit to somewhat level the playing field against opponents who should probably outclass him in most regular situations, primarily via the mechanism of nullifying their devil fruit powers. Although another one of his common usages is to engage in crowd control, by simply crafting a black hole to absorb any small fry that he does not wish to deal with at the time. And now this next part here is speculation, I warn you, but it is also entirely possible that Blackbeard's use of the Army-Armin-O-Me is why he is the only known being in the history of One Piece to wield two devil fruit abilities at the same time after he acquired the Gorogoro-Me from Whitebeard's corpse during the Paramount War. The theory is that the nullification properties of the Army-Armin-O-Me is the mechanism that contains the negative side effects of the second devil fruit destroying the user's body. Now, if this is true, then this fruit more or less instantly becomes the best fruit in the entire series, no contest. However, at the time of this recording, that is not confirmed. And in fact, there have been several strong hints to the idea that it is Blackbeard and his strange, strange body that is the gateway to this phenomenon. And where do you even begin with the awakening possibilities for a fruit like this? Not only have we not seen any confirmed awakenings of Logia fruits, but this is a unique Logia fruit, so it more than likely would not subscribe to whatever their standard is anyway. The thing is that this fruit is already pretty damn ridiculous. Any awakening that could allow the user to create larger, multiple, or even more powerful black holes pretty much immediately takes the Army-Armin-O-Me to a cosmic apocalyptic level. So any form of awakening would certainly make this fruit leaf up to its reputation of being the most dangerous power ever encountered. Some other miscellaneous things to consider when becoming a darkness human. Bear in mind that unlike other Logia fruits which represent elements such as fire or energies like light, darkness is an abstract. And so you can't really think about it as a substance to wield. You know like, we're not going to be able to throw a ball of darkness at someone despite what the Pirate Warriors games would have you believe. And the fruit is focused much more on absorption and gravity manipulation. I should also qualify that the criteria for nullifying devil fruit powers is a bit vague at this stage in the story, as Blackbeard has only shown to be capable of this whilst physically touching an opponent with the darkness active. So if that is indeed the case, then that is another slight limitation.  Even if you take all of the speculative aspects away from it, crafting black holes and controlling gravity to some degree is a pretty enviable power. Really, the only drawback is the whole massive pain thing.  Because you know, you're probably not actively putting ourselves in dangerously combative situations.  But even then for the power you gain access to, it's probably a fair trade-off. So if I encountered the fruit, I would definitely go for it. But I can very much understand if some of you are a bit more reserved about consuming this one, you do you. And with that, we are going to commit the yami yami no mi to the devil fruit encyclopedia. Next week, we are going to be taking a look at a very similar sounding yet completely different fruit to the yami yami no mi, which is the resurrecting majesty of the yomi yomi no mi. If you enjoyed this video and the content this channel produced in general, then please do consider donating to the Grand Lone Review Patreon because the support of all of your amazing people is what continues to make this channel possible. And if Patreon isn't quite your style, then please do leave this video a like, share, or subscribe because it also helps support this channel an incredible amount. And if you'd like to join the fun at any time, then please do head over to my Discord server where a wide array of shenanigan retakes place on a daily basis. And finally, please do comment with your thoughts on the yami yami no mi. This has been the Grand Lone Review and I'll see you next time. Fist of doom. I'm talking of course about the right one with the jewels. His left, the pearls, pearls of wisdom, but fist of doom. The left one's a normal hand. Really? Yeah, well, your hand doesn't like occasionally get shrouded in mist. I'm not black mist. I'm black, so I, mine should. You're not. So maybe like kind of peachy, yellowy, pinky, white man mist? Can you stop talking about my white man mist? Do you?