All right, hello and welcome everyone. It is Act in Flab Livestream number 36.0 and it's January 13th, 2022. Welcome to the Act in Flab. We are a participatory online lab that is communicating, learning and practicing applied active inference. You can find us at the links here on this slide. This is a recorded and an archived livestream. So please provide us with feedback so that we can improve on our work. And also if you're watching along live, please write any comments or questions you have in the live chat. All backgrounds and perspectives are welcome here and we'll be following good video etiquette for livestreams and thanks Blue for helping a lot with the slides and for coming on, because this will be a fun conference. Go to activeinference.org to learn more about how to participate in any of the lab activities or bring some new idea to the lab. Okay, here we are in livestream number 36 in the second half of January, 2022. And the goal is to learn and discuss this paper by Matt Sims and Giovanni Pazzullo from 2021. The paper is called Modeling Ourselves. What the free energy principle reveals about our implicit notions of representation. And as with all.zero videos, the video is an introduction for some of the ideas and a hasty review. So it's not a review or a final word. We're going to have the upcoming two weeks to talk more about this paper and hopefully talk to some of the authors or any other people who are interested in this idea and get involved if you want to talk about the paper. So let's just start with saying hello and an introduction and then what we were excited to read about the paper. I'm Daniel, I'm in California and was excited to read yet another paper on representations and the FEP because it feels like we had a stretch back there of five in a row or something. What about you, Blue? I'm Blue, I'm in New Mexico and I really enjoyed Matt Sims paper on symbiosis that we did a while ago. And I thought this paper was really neat and really a clear elucidation of the different categories of representation and how like there's overarching like representation and non-representation and then several different layers within that. So I thought it broke it down in a really clear and concise way even though it's a lot of material to digest. Do you want to ask the big question? Sure, the big question of the article was can the free energy principle help us advance or even resolve the long lasting debate on internal representation in philosophy of mind? It's a long lasting debate. So this is like the dot zero of dot zeros because it's clearly a topic you could spend a lot of time on. So that's our disclaimer is it's a longstanding debate but here's kind of a meme slide. So it's the first section of this paper right below the title. It has this quotation from Walt Whitman and it says, hold it up sternly. See this, it sends back. Who is it? Is it you? And then here are several different images and just think about your perception of these images and the cultural significance that you might attach to them or the way that black and white pixels or gray pixels on a screen give the illusion of depth or remind you of an experience that you've never had. So that's kind of trippy and representation gets at some of those issues. That's one non philosophical take on it. What are they going to aim to do in this debate, which we're going to sketch out the sides of in this talk or I guess this discussion? Do you want to read it blue or do you want me to? Sure, so the authors argue that even if the FEP can't solve this longstanding debate it can play an invaluable role in revealing our hidden assumptions about the very notion of representation and can create some common ground to discuss and negotiate them. So they say our general strategy is to use the FEP for conceptual clarification of different notions of representation. We work backwards from representational or non representational interpretations of the FEP's constructs to the various notions of representation that motivate those interpretations. So they claim that it emerges from their analysis that the FEP has been or can be used to implement various kinds of computational models which satisfy the requirements of certain theories of representation. Hence the question of whether or not the FEP entails representations depends on what notion of representation one uses in the first place. We're going to unpack that a lot but just wanted to give the first coat of paints on what they're aiming and what they claim to do. So I'll read the first half of the abstract. Predictive processing theories are increasingly popular in philosophy of mind. Such process theories often gain support from the free energy principle, FEP, a normative principle for adaptive self-organized systems. Yet there is a current and much discussed debate about conflicting philosophical interpretations of FEP, for example, representational versus non-representational. Here we argue that these different interpretations depend on implicit assumptions about what qualifies or fails to qualify as representational. The next part, we deploy the FEP instrumentally to distinguish four main notions of representation which focus on organizational, structural, content-related, and functional aspects respectively. The various ways that these different aspects matter in arriving at representation or non-representational interpretations of the FEP are discussed. We also discuss how the FEP may be seen as a unified view where terms that traditionally belong to different ontologies, for example, notions of model and expectation versus notions of auto-polysis and synchronization can be harmonized. However, rather than attempting to settle the representationalist versus non-representationalist debate and reveal something about what representations are simplicity, this paper demonstrates how the free energy principle may be used to reveal something about those partaking in the debate. Namely, what are hidden assumptions about what representations are, assumptions that act as sometimes antithetical starting points in this persistent philosophical debate? There's really two or three pieces to this paper. There's an introduction and an abstract, I guess we can delete that. The first part introduces a short summary on the free energy principle and we'll see that action, perception, cognition loop. The bulk of the paper is in these four segments of each with a dyadic relationship of the representational and the non-representational perspectives. And that section is a lot like a literature review and a philosophical taxonomy of different perspectives and arguments related to representation and FEP and these four subdivisions. There's then a addendum on evolutionary function specifically and that's apt as nothing in biology makes sense except in the light of evolution, as they say. And then section five kind of turns a mirror back on the process and thought just like those earlier images with the mirror. And that's where FEP differences in perspective are used almost as input data for theorizing and speculating about different things which we'll get to. So that takes the authors then to the conclusion. So it's a pretty wide ranging paper and the keywords that are here are active inference, free energy principle, predictive processing, generative model, internal representation, action-oriented representation, inactivism, forward model and Markov blankets. There's no single path or single slide that would do justice to all these keywords. So we're just gonna kind of jump in and knowing that some people will be really familiar with some of these terms and others will be hearing about them for the first time. So first, the big topic is representation. Now, this is just a quote from the paper. Whether or not living organisms have or need internal representations is an old and fiercely debated topic. So we kind of like unzipped that citation to add the titles and the links and just some of the images from these citations. So if these topics or any of this body of literature you feel like is well-motivated or well-reasoned or you've never been exposed to it, that's sort of the continent we're on.  So the authors write, such a debate is reiterated within the predictive processing view. So they're gonna tell the story of representation from predictive processing as sort of an implicit starting point from a more specific and mechanistic angle. I assuming the FEP is a good model of living organisms doesn't entail the notion of internal representation or not. So it's almost like we're conditioning our analysis whether it's a counterfactual or not on FEP being used instrumentally. So we're going to use it just like we would use a ruler not by questioning the ruler against known objects but by going to unknown objects and investigating them. So that's the way that the FEP is gonna be used in this very large scale topic and complex area of representation. Any comments, Blue? All right, another big topic and word that comes up in this paper but also a lot of other of our discussions is inactivism. And so who better to hear it from than the radicals? So Herrick 2014, I think it's a thesis why radical inactivism is not radical enough a case for really radical inactivism. So take it up with the author if this is oversimplifying or that's kind of the joke slash appeal here it is oversimplifying. And here we see three different frameworks contrasted against each other. Cognitivism, radical inactivism and then really radical inactivism. And cognitivism differs from inactivism on the top row in that cognitivism says basic cognition is representational and inactivism is going to be rejecting that claim on all accounts. And then where this author is saying that you could even go further into the inactive camp or forest or whatever is you could even deny that linguistic cognition is representational. So even if it looks symbolic and it looks like it has some representational characteristic and it's the gray zone that makes people go, oh, okay, maybe there is some redeeming aspect of representation, you just have to keep on denying it. So maybe we can pick that thread up again but that's sort of the lay of the land of maybe the center and activists, the moderates and then the extremists. Blue, anything to add? No, it's so interesting to really think about representation and the brain.  Coming from neuroscience, it's interesting to really think about, I mean, the visual cortex is very unique in the sense that we know that there's representation that is replicated in the brain, but everywhere else it's just kind of like, we've never found the word for apple in the brain somewhere, like there's no like apple neuron. So it's just an interesting, I don't know, just a position, I guess, about representation and language, thinking about it in terms of the brain. Also one really important aspect that we didn't mention is it's about action. Like it is basically saying that action is, it's related to embodiment and all these other things but inactivism is just focusing on action and what that means. All right, free energy principle, which we're gonna spend a lot of the discussion on. It's an integrative proposal on adaptive self-organizing systems that remain far from thermodynamic equilibrium. So that would be cool if we had one common framework for things that maybe were far or close to equilibrium. Currently, we only have some of those areas of face space. It starts from the premise that in order to survive, living organisms engage in reciprocal action, perception, exchanges with their environment, they must do what they can in order to remain within a neighborhood of viable states. That's kind of the cybernetic regulator insight. Then the bottom paragraph, the idea is cast in Bayesian terms by assuming that ecologically adaptive states constitute the priors of the agents. The states that an agent prefers to visit become the states that it expects to visit. Hence minimizing surprise or its long-term average, which is entropy, becomes a primary imperative for living organisms as it permits them to counteract an otherwise unavoidable process of dispersion and loss of integrity, which kind of closes the loop back with the resistance to dissipation that was brought up in the beginning. So this is kind of one FEP boomerang from starting with a focus on resisting dissipation and then moving through the action and perception loop to ecological preferences and backs of the reduction of uncertainty and thus resisting dissipation. A partitioning that is natural or at least complimentary to the FEP is the Markov-Blanket partitioning. And we've talked about this in several other streams so we won't go into it in too much detail. This is from 26 and the Markov-Blanket condition, at least in its more narrow slash technical sense is referring to some set of nodes representing statistical variables. And that set of nodes that make up the blanket make some other sets of nodes, two other sets of nodes, which we can call the internal and the external states. It makes those two sets conditionally independent and the edges are statistical influence. Blue, what else would you say about Markov-Blankets? They say it here beautifully. So the blanket states act as an informational boundary between internal and external states and that's like the simplest way to think about it, right? Like my skin acts as a barrier between myself and the world, the blanket acts as a barrier. Yes, cool. Okay, leaving FEP land proper, we can zoom out to some related topics that sometimes get brought up in discussions of FEP that often don't. So first is the predictive processing framework. This is drawn from a citation that was in the bibliography, but not sure if it was in the text, Highway 2020. And this is a paper New Directions in Predictive Processing. So predictive processing asserts that perceptual and cognitive systems engage in prediction error minimization enabling approximate Bayesian perceptual inference. And some, but apparently not all authors emphasize action. So Clark and Howie famously and recently have emphasized that action is essential to predictive processing in the form of active inference where the system infers its own policies. So really emphasizing that the predictions are not just about sensory inputs, but causes of sensory input hypotheses about latent unobserved causes in the world and also one's own action policies, what one expects to do. And there's a really awesome supplemental file for this paper that includes a great literature analysis and a lot of keywords and unique predictions and lists of empirical evidence. So this is really awesome work. And it'd be great to hear from people who study predictive processing or are more familiar with it, how they see it in relationship to active inference and FEP. Something that's in the overlap of predictive processing, Bayesian statistical theories, active inference is the idea of a generative model. So let's recall from DCM, the dynamical causal modeling that which we talked about in the previous weeks in number 35. And here in DCM, it's appealing to biologically grounded models and dynamical systems theory to create a probabilistic generative model of hemodynamic fluctuations. So what is a generative model? It's basically opposed to a descriptive model. So why would one use a generative model in statistics because these types of models can be run in both directions. They can be fit from data, but they can also be used to generate data. And then they can be used in different ways because of that capacity. Lower dimensional generative models can be very computationally efficient because they only have to be updating a few parameters rather than keeping track of every single data parameter. And then a little bit more on the interpretive layer or beyond the merely statistical, generative models capture some of these open-ended and creative or complex dynamics that are associated with action and perception and cognition. And therefore there are links to not only the cognitive sciences, but also philosophy and phenomenology. So it's kind of an idea from statistics that gets connected to some of the fundamentals of neuroscience and philosophy. And anything to add on that blue? Yeah, so just when I think of the generative model, having listened to so many people describe it, my favorite description is almost as like the recognition model is more like the hardware or like the states. And then the generative model is like the software, the action between them or like the dominoes and the like stack dominoes and then the cascading waves. So the dominoes would be the recognition model and then the generative model is the relationship between them, the cascading wave of dominoes. I always like to use that analogy, just it's clear for me. So cool. And here's one more slide from 26 where the idea of the Markov blanket, which we pulled from 26 as well, is connected to the idea of a generative model in the section on predictive processing. And so in this paper, so go check out number 26 or the paper on Bayesian mechanics to learn more. But the idea is that it's possible to use that Markov blanket partitioning so that there's the blanket states, statistically isolating internal and external states. And then there might be some systems where those partitioned internal states are acting as if they are doing inference on external states. So that would be like if I said, I'm gonna hold up three fingers and put it behind my back and then you had a generative model that was about what was the state of that unobserved variable. And that's something to look more into from the details on generative model as with other papers. And that kind of brings us to our last keyword, which is active inference. So we'll go into a little more detail here. They describe that active inference agents are self-evidencing, which is to say that because minimizing free energy over time is equivalent to maximizing Bayesian model evidence or self-evidence, engaging in long-term active inference agents seek out or generate those sensory samples that maximize the lower bound on the evidence for an implicit model of how their sensory states were generated. As such, active inference agents author evidence for their own continued existence via free energy minimizing model optimization. So active inference is using statistics to operationalize some of the information thermodynamic-like formalisms of the FEP. So it'd be a more narrow interpretation that that carries no or little philosophical baggage or claims to how the world really is. It would be a more broad or stronger interpretation to think that this is capturing actual information dynamics or the actual thermodynamic relationships of systems, but the instrumental usage is more of a statistical similarity or at least attractability argument. And that is not without precedent, not even close because the variational Bayesian methods which minimize or optimize this quantity called the evidence lower bound start maximizing the lower bound for how good the evidence is. And others in many places have motivated this fundamental component of modern Bayesian statistics from multiple different areas. And it's kind of like equations are true. So equations can be linked to each other. And it just kind of cool that these KL divergences as well as free energy and the information or description length criteria on all a line. And that's not even like an active synthesis. Applying that to inference on action is something that is bringing together a lot of these ideas from variational Bayesian methods with a lot of ideas from control theory, cybernetics, inactivism, et cetera. And again, we can explore back and find out which ideas came from where but just to keep in mind is like these pieces were not tied together by active. Those are excellent relationships in the literature but ACTIMF does integrate the free energy principle and that center meme that they started with that things have to resist dissipation with all of this philosophy and more quantitative areas that have to do with action and perception. And then in the dot one and dot two we'll go more into the variational and expected free energy but kind of wanted to just give a little thought on active inference. And if someone has a different thought it'd be awesome to hear it as well but this paper was very precise and very subtle in how I thought about some of these areas. So I think it's really good to be clear about what we're talking about in this case. Okay, onto the paper. All right. So this is going to be a slow roll of the introduction. There's a growing consensus in computational and systems neuroscience around the idea the brain is a predictive machine which uses internal or generative models to continuously generate predictions in service of prediction, action and learning. So starting with the idea of prediction. Second sentence. One of the ways that people are studying prediction in the brain is predictive processing. So we talked about that a few minutes ago. The free energy principle is extending predictive processing by providing it with a fundamental principle of adaptive self-organization. That's the resist dissipation meme that isn't intrinsically within predictive processing framework which might describe audio processing in a radar signal. And so that union of FEP and predictive processing are starting to become prominent outside of systems neuroscience which might seem like their natural niche or origin but it's also the case that philosophers in the philosophy of mind are starting to think about it. And despite that attention, the authors are arguing that some of the implications for FEP's existence remain widely debated. I think we can agree on that. And they're going to focus on one of the prominent discussions that they think is the most prominent which is whether the FEP is representational or non-representational. And then to what extent it is also bearing on debates related to internalism, action, orientation and activism. So just it's all over the map. It's a multi-dimensional philosophy face space with the FEP and it's not totally resolved but that's what they're going to go into in this paper. Okay. Oh yeah, blue. So they note here that philosophical discussions or representation wars about the FEP have typically been focused on four aspects of the notion of representation. So these four aspects are organizational, structural, content related or functional. And the organizational aspects have some variable inside a system that's separated from that which it represents outside the system. Structural aspects have representational vehicles that are structurally similar to the state of affairs in the world that they stand for. Content related aspects have internal models that either encode environmental contingencies or sensory motor contingencies, specification or description of how the world is taken to be in turn analyzed in terms of correctness or truth conditions. And then the functional aspects support vicarious use before or in the absence of external events of internal variables of model. Whoa. Yep. It is kind of a whoa, but this four-fold distinction is the structure of the paper. So we're gonna do a few fun things to help understand this because it is the contribution and the structure of the paper. So everyone's gonna interpret all of this in their own way, which is awesome, but we do really wanna be clear about what the author's contributions are. So in an almost unprecedented maneuver, we're going to go to the end of the paper first and then also have the figures out of order. We're gonna start with what we can learn from this debate. So if you're not sure if you wanna listen to the next like 40 minutes on going into this four-fold distinction, you get it upfront. So they're going to review some of the most prominent philosophical interpretations of the FEP. They then summarize those interpretations according to the four different categories that Blue just read. For each of those categories, they're gonna consider multiple constructs of FEP. So kind of tools in the FEP toolkit slash ecosystem. And they're going to argue that depending on which perspective you take on which of these categories and which constructs, you're gonna come to different conclusions about the representational or non-representational nature of the FEP. So it's kind of like a check report. That's their first salvo is we're going to outline a flow chart and a grid and a structure like a taxonomy of philosophical ideas related to this triple dimensional space of aspects of representation, constructs of the FEP and then the categorical variable representational or non-representational claims. And then the whole second part is saying, we're going to use that three dimensional phase space to shine a light on one's own implicit notions of representation. So that's kind of like the looking in the mirror strange loop part, but the first part is more like a philosophical literature analysis and their contribution in figure two is to make this awesome flow chart. So this is going to funnel you from the start in the four different domains, four aspects, organizational, structural, content and functional. And then from those four starting points, kind of like sorry board, you're gonna get funneled towards non-representational or representational FEP depending on decisions. And that's what we're gonna unpack in the next sections because again, it's kind of like trippy and there's a lot to think about. This is gonna be our map. So it's gonna be at the bottom of all of the upcoming slides. What's of these eight sections we're in? It's like a cube divided in eight little cubes or two tetrahedra or some other pattern. But basically we're gonna see whether we're in like representation camp or non-representation camp and which aspect we're focused on. And then here's that table, but it's just the tip of the iceberg. So how can we organize our thinking around philosophy and increase the rigor and the accessibility of different arguments because it can be difficult sometimes to parse it in long texts. And so the authors clearly thought a lot about this. So it's a really pleasure to read about it and learn about it. And the flow chart is a great addition. So that is gonna be our map in the coming slides. Right after- Thanks for making such a beautiful map, I have to say.  So. Well, they made the flow chart, I made the grid. That's what I meant, the grid, the grid. Before we see the grid in action now, let's just recall this action perception loop. And we're not gonna go into it right now, but that's definitely for a dot one and dot two. What are these nodes and edges and which can and can't happen and what do they represent? So that is sort of the partitioning that we're going to be working within, which we brought up a little earlier with the Markov blanket and in a lot of our other discussions. Okay, so let us start in this top left square. So this is the organizational aspect, the representational perspective. So the organizational aspect is describing how variables inside a system are separated from what it represents outside the system. So that's like the architectural take on representations. That's kind of, I don't know, is it classic representations? But the pro-representation camp are going to argue that internal states are segregated from the external world via Markov blanket. Therefore, the brain's activity cast as internal states do represent what it doesn't have access to. Blue, what do you think or anything else to add on it? Nothing I wanna delve into here because I'm gonna save it for the other one. Okay, okay, in contrast, there's other people and other perspectives who are going to, in the organizational aspect, take a non-representational perspective. And so philosophers of the ecological and activist persuasion have approached that same Markov blanket formalism and basically framed it in terms of non-representational view of the FEP. Like Yelle Brunnerberg's paper, The Anticipating Brain is Not a Scientist, Free Energy Principle from an Ecological and Active Perspective. So they argue in those papers, in a lot of papers by Yelle and others, that just because you deploy the Markov blanket formalism, it doesn't imply the behavior of the system is best explained by inferences generated by an internal model, the structure of which is representing that, which is a model of. So read the papers for more detail, but it's like, it's an interesting idea and it was also interesting to read from this paper that the restatement of this argument that these partially informationally encapsulated systems, like we talked about in 35, are parsimoniously understood in terms of achieving high relative mutual information between the non-representational process of generalized synchrony in Huygens 1673, the pendulum clock. So you could get like oscillating pendulums that synchronize, but they don't have representations of each other. Now maybe you need representations to do something else, but that kind of gets to that inactivist, radical inactivist debate. So we'll go more into it later, just kind of cool old citation and interesting idea. So based upon the organization of the system, there's people who say, yeah, the FEP is representational, of course, because the internal states are isolated or no, because you can get high mutual information without representation. All right. To the structure. That's like what Dean called nine o'clocking. It's nine o'clock, that's general synchrony. Exactly. There's doesn't need to be a representation of brushing the teeth in the mind or the anything of the reader. Okay. Onto the second aspect, the structural aspects. So the question to be addressed is whether generative models are structurally similar to their targets or accurate descriptions of external reality or whether models needn't be accurate but merely adequate enough to leverage for adaptive behavioral control. So does it actually need to represent the thing or can it be just some other representation that is effective enough? So here's the pro and the con for representational on one slide. The top structural representationalist view argues that the generative model has to have some structural resemblance with the generative process in order to be useful for control purposes. That's really related to the good regulator theorem from cybernetics. And so the argument there is you're gonna need the good representation about it in order to be on the right page in complex environments. Others disagree. So here's one line of argument that the formal constructs inactive inference specifically the generative density G if it's understood correctly, according to some authors it would turn out to be non-representational. Those authors suggested, Remsted at all 2019 that generative models do not meet the requirements of structural representations where some internal structure replicates some structure of the generative process. So the generative model is the organism's model of action. The generative process is the actual world out there the niche that's giving rise to observations. And so in other words, you might be I don't know if this might be a mal example but like to run you don't need to have an abstract representation of your own body you merely need the action interactions with your body. And so this is kind of arguing that the internal generative density G inactive doesn't have to have any resemblance structurally to even the problem which it's being deployed to solve. Well, and this always goes to the map and the territory and the difference between the map and the territory. So structural similarity like what does that mean? So how similar is there some metric that you're using for structural similarity? Like how similar is the map of the United States to the actual United States, right? And so what does that even mean structural similarity? Sorry, like I'm probably poking the fire, but. Let's hear from Alex Kiefer or Maxwell or anyone else who feels really strongly about this issue because we've had some fun talks on it before and it's just, I just liked seeing the pro and the con laid out together. And then the authors were very, very. I just like arguing what is the difference between the pro and the con?  What is similar and what is not similar enough? Nice. Okay, now to the third aspect. So this is the content related aspect. Whether the generative models need to explicitly model the ways external states produce sensations, aka environmental models or the ways that actions produce sensations or sensory motor models. This is very closely related to the previous aspect. So I think it'd be cool to unpack it a little more but there is a little bit of nuance with sensory motor systems, which we talked about in several places like skilled performance. And basically this is just one sub argument within this section of pro and the con. And they're talking about essentially skilled performance, how sensory motor models can afford sophisticated cognitive processing. And so the first argument here is that here comes that same, yeah, the Brunberg 2016 paper, the anticipating brain is not a scientist, saying that, yeah, actually sensory motor loops, if you're gonna trust the story for one level of analysis, then why are more so-called complex behaviors, not just more complex combinations of modules which don't appeal to any representational content? And then the sensory motor dynamics created by those models may be progressively internalized to support mental operations detached from the sensory motorcycle. So maybe like walking and chewing gum or something like that. Or maybe think about like an insect flying or walking and how much of that is just the shape of its body in motion and just the way that the muscles and the joints just like flex. And so ascribing the total motion of every joint to cognitive actions just is probably asking too much of cognition unless taking embodied and morphological computation as another type of computation. And then firing back for the representationalists is coming from the area of schema theory which is where there is a nucleus of sensory motor models but then they're extended to include external causes of sensation. So that just kind of like a flavor of one of the sub debates and it'd be good to discuss I think how the structural and organizational and content related differ because it is like a nuanced debate. And so I appreciate how clear they did make it given that it's murky waters because these are like four aspects of a philosophical idea. Oh, then of course this meme. Okay, so the embodied cognition literature has shown some practical examples of how good control can be realized using fast and frugal solutions and very simple models. This is an example that Dave described on a live stream just recently. One popular example is the baseball outfielder problem or the fact that catching a moving ball may not require a full model of the ball's position, velocity and direction allowing for trajectory prediction but a simpler control mechanism that only keeps the image of the ball stationary on the retina. All right, so here on the left, this is like the physics class model of some of the parameters. So this is already a map of the territory. We're not going into the temperature of the ball and the wavelength of the grass. So this isn't like a world model. This is just the physics reduced model the physics of the asymptotic ball in this kind of idealized setting. And so that's a lot of parameters like as drawn out there. And here from this wired article how do people actually catch baseballs? Here's the apparent ball position as a function of time and just showing how if you're in the position to catch the ball that there's a simple heuristic line related to the apparent ball's position whereas balls that you're too short or too long to catch have a very different visual trajectory. So in other words, in activism is saying this on the left doesn't have to be the representation. That would be something that might satisfy the most formal representation list but then this is sort of a gray area. Like what if there is a visual representation of the ball on the retina? So there is something that's featuring information about the real world in an actionable way but it is of a totally different type than the parameters in the physics class.  So here is us on the Phillies. We're trying to catch the fly ball. Here's Friston hitting it out of the park with the action perception loop and all the work in this field. So what is the equivalent? Do we need to have the physics class model or is it possible for us to have some other type of understanding? Just a thought, what do you think, Blu? So it just really makes me think about like blindness, right? And I know that like this seems like a way out there trajectory but we know the physics of our natural environment. We know it pretty well. What about when we remove ourself or like remove one sense, like remove vision, right? Now we have like a really different perception of our environment. And we have to completely like retrain through like kinesthetic memory where we are in our environment if like the lights go out. I mean, I was without power for four hours the other day in the middle of the night and I was like totally freaked out because I live in the country and there was absolutely no light, like none. So in that like you have to know where all the things are. So like this is a structural map in your mind of your reality that's really different from what you're able to absolutely perceive at that moment. Just makes me think of that. Nice, that's just a fun slide. No, various slides. This is still on the, this is I guess on the functional aspects. So here's the functional perspective or the functional aspects of representation. Another way to address the issue of what a representation is and what it is not is by asking what functional role representations play within a hierarchical architecture. So this is the function, kind of the pragmatics of the representation, what it does. An idea that dates back to at least Piaget 1954 is the idea that representation should vicariously stand for something external in its absence and afford vicarious operations, i.e. mental operations using an internal vehicle that are executed before acting on the external referent of the vehicle or even when the external referent is absent. So it is able to be cause and effect within the mental ecosystem, like we'll see from these examples, consider mentally whether one would enjoy eating a pizza with no pizza in sight. So be like, okay, think of a pizza, do you wanna eat that? Now, imagine that type of food that I previously mentioned and then what type of restaurant it is and what equipment did they have in the kitchen? Like an oven or something like that. So there's something that's being functionally carried forth in that cognitive sequence. Can that be uniquely explained, predicted, controlled, designed with just sensory motor loops? This functional role of representations has been expressed in terms of whether the agent's internal operations are detached from its action perception cycle and hence autonomously generated versus determined or sustained by external stimuli. So if something were just repeatedly causing visual stimuli and that were causing like sort of unaware movements, that would might be one category of phenomena, but what about going on a walk and remembering a five digit number by just chanting it to yourself? Is that sensory motor? How is that playing out? And when cognition is playing a functional role, seemingly uncoupled from the action perception loop, which is probably not exactly how Piaget framed it, but that's what that notion is. And so within the functional aspect, the FEP is leading one to ask, what functional roles do internal models play during free energy minimization? So just like the memorizing the number was like a cause and effect of a cognitive environment, is it the case that the FEP is featuring things that are also causes and effects in the cognitive environment? And does that resemble vicarious operations in the classical Piaget based account of representation? And again, it's gonna be the dot one, the dot two, when we go into the variational and the expected free energy, but that's like the big picture on the functional aspect is do these variables play functional roles in a way that's uncoupled from the immediacy of action and perception? I hope I represented that because I'm also not sure about that one. Okay, anything to add, Blue? So I think about it in a different way. Like you're walking down a path and remembering a five digit number, but like, I don't know, something that probably resonates with Sasha or like anybody else that does extensive what lab research, which you've done. So it surprises me that like, it doesn't bring it to mind for you is like thinking about your actions. Like it's like a dry run of your experiments the next day. Like do I have the tubes I need, the enzymes I need, the reagents I need, where are all these things located? Like when it's a really important experiment like hit or miss, it has to be done now or never, like which you know that there are some that are like that. Like it's important to go through and make sure that you've got like a cognitive represent like you build it. And so it's fresh in your mind for when you absolutely like execute the experiments. And so that's like, instead of walking down a path thinking of a five digit number, how about like planning? Like the sensory motor planning of executing a series of experiments, it brings that to mind for me. Yeah, great. And that makes me think like, let's just say it's a one hour experiment that you're thinking about. Now, does the motor pattern firing associated with pushing your thumb down on the pipette, does that get engaged during the prospective planning of that event? Who knows to what extent, but that's kind of what's at play here. If there's a totally disjoint neural phenomena associated with the prospective planning, then the inaction were in one camp of representationism. I don't even know which side of the line anymore. But then if you do have that thumb neural firing pattern, like it's just like sped up or just shortened or something, maybe we're in a different area. So let's return to these ideas. Cause again, it's like very nuanced and it's just great the authors laid it out as simply as they did. Cause this is clearly a lot of literature to go through. So that was the eight, the four times two, you know that I won't even go into it, but four times two. And that's the bulk of the paper. And then there was this addendum section on representation as an evolutionary function. So similar to other cognitive functions like working memory, planning, cognitive control of attention, or perhaps even to functions like flying or swimming representation here intended in the sense of affording vicarious operations and detachment from the current action perception cycle may be an evolutionary function. So it's kind of like when people argue that consciousness has an adaptive role and that the origination of consciousness could be scaffolded or nurtured or selected for once it arose. This is a little bit less phenomenological and a more cognizantist or computationalist with respect to saying how representation might play an evolutionary role. So let's just imagine that there was this detachment between the action perception role and planning like here's Pogonomirex ants. Imagine if they're able to perceive the polarization of light or the intensity of the light or the humidity and then have something like a representation that helps them assess whether it's appropriate forage on that day that is going to be a more adaptive nest mate for the colony. Does the colony have a representation? What level is the representation existing at? Is it the direct target of selection or is it arising from selection on other units? What do you think, Lou? Like we were just talking about this, right? So is the niche the internet, right? Is that like the meta representation of humanity? Like the web, like that's it. So I wrote that here in Things to Discuss and the dot one or dot two is external representation. Like what, how do you offload this representationalism into the niche? Awesome question. And I also, I think probably subconsciously was thinking about that, like the image on the right is a trail, a trunk trail that the Pogonamirmex use. And so it's like, it's not going in every direction. In this colony, it's only going in one direction. It's along a tree. So it's kind of accentuating this natural pattern in the generative process in the niche. But then now that is like an externalized prior for foragers that's based upon the clearing of grass. And then they're less likely to go like walk over the midden pile and forage in a different direction. But then it does happen. So the trail does move. So it's like interesting topics. Yes, thanks for writing down about the internet. Okay, let's continue through a few of these last ideas. And I'm glad that we're moving basically through this long paper. Okay, so let's keep thinking about that detachment of representation from the action perception loop. They write, in other words, full-fledged decoupled representational capacities might shade off, which I wasn't even sure what the origins were. Maybe it's used in God for Smith 96. Into other cognitive or minimal cognitive processes, the dynamics of which are increasingly more coupled to the environment through action sensory perception. So it's like being at a level of cognitive complexity where you can spin up other active entities or like the queen as a reproductive aunt is spinning off cognitive but not reproductive nest mates. Therefore, when taking functional role as contextualized by evolutionary function as a criterion for identifying when recourse to representation is warranted in explanation, which is a very complex linguistic clause. But we're finding out when representation is warranted, the criteria for that would be evolution shaping function. So it's a lot like saying nothing in biology makes sense except the light of evolution. And then under those settings, it is plausible to interpret at least some processes, the ones that involve vicarious variables related to minimizing free energy under that context. The author suggests that could drive the kind of self-organization that FEP would describe as representational. So it's layered, but it's very fascinating because it is just like you had said blue with our niche, but it's like just stacking rocks on top of each other. It's resisting disorder, it displays culture, but those rocks don't have a self-modeling capacity. It's like uni-directional multiscale integration, the other SIMS paper, whereas here we have like a human who as part of their niche has made another adaptive active inference entity. And now they're engaged in this reciprocal multiscale integration. And so I think the authors might be suggesting that there's aspects of this setting that might be described as or might be warranted to utilize representation in the explanation. What do you think? So I wonder if this is, so I always wonder whether we should talk about multiscale integration or like thinking through other minds in terms of translating into the niche.  I always, and this is, we were just talking about this like 10 minutes before we got here today. So this is something to me that's like this fundamental paradox like, I don't know how to distinguish these two things. Like we can never really, I mean, I guess that shared informational channel always comes through the niche environment, whether it's the internet or some knowledge artifacts like a scientific paper or a computer or something else. But like my relationship with you or any human is always through the niche environment. There's always that filtration and whether it's in real time like we are here now or sequentially. Even if it's so-called in-person, it's mediated by vibrating air molecules. Now it's intermediated through routers and such. It's a utilization of the niche. And I think this is just raising a super fascinating question. Well, yeah, thanks for raising this, we'll discuss that. And then this is like saying it's one thing to talk through the tin cans. That's like using the direct passive active inference agents, even if we could describe the tin can as perception and action. But now what if there's a chatbot that's intermediating between the two of us or it's translating between two different languages, then where does that put the status of that entire cognitive system? How does it influence thinking through other minds when the intermediaries are passive versus adaptive active inference entities? So nice questions. All right, this is the part which also will unpack more in the dot one and two. This is kind of the wormhole strange loop turning the mirror back on itself part. So the authors write in much the same manner as arriving at a representational or non-representational interpretation of FEP. So that's the whole sections that we just spent the whole time on, like everything within the realm of actually using the FEP, not taking it as an unknown, but taking the FEP as an instrument and then using it to ask whether it is representational or not on those different aspects. So now we're gonna put that behind us and consider arriving at FEP as a synthesis depends on which representational criteria are assumed when either considering FEP's central constructs or considering specific cognitive phenomena through the lens of a process theory under FEP. Hence in the end, the debate about FEP may reveal more about us, our criteria for representation and our interests in particular facets of cognition than it does about the representational status of the FEP. So, JFK is out there somewhere. Ask not what the FEP can do for you. It's saying, because you can be all over the map, maybe all of these sectors are in play and all the perspectives in each of those aspects, that means that somebody's posterior confidence in different claims is probably better reflecting of their priors and update process than some sort of objective stance or consensus reality about what the FEP is as if it could be such a thing independent of how it's specifically deployed as we talked about with model-based science and Majeed Benny. So this is a very nice point. Wanna add anything, Blue? Yeah, I mean, fundamentally the FEP is a representation. I mean, it is our representation, our model. I mean, it might be the one that we employ it might be an instrument or it might be a real thing, but still it's we represent the FEP like with equations and with ideas and memes and I don't know.  So whether it is a representation itself or we represent the FEP, but there's some like play there. It's integrated with representation all the time like linguistically or other or maybe not. Maybe I'm not real, a real inactivist enough or what was the radical, radical inactivist? Really radical, yeah. Well, I'm sure we'll talk more about it. So just the conclusion and then a few last points. So nine sentences in the conclusion. One, they looked at four different aspects of representation. Two, understanding which side of which line to come down on was complicated because the FEP appeals to multiple constructs that don't a priori seem to be strongly linked or naturally linked like it's unclear whether one begets the other or whether they co-instantiate or and that's the kind of work that we're really interested in the ontology project and in the Knowledge Corpus Engineering of course in the.edu organizational unit of Actinflab. So the FEP appeals to multiple constructs and those models can be constructed in various ways. So it's good to clear up representation into these four full distinctions. However, it's complex still because the FEP is kind of like a plurality in and of itself. Three, they argue that depending on how you think about things you're going to think about things differently. They then turn the mirror back and suggest that that's an opportunity to challenge but it's also an opportunity to reflect upon how we value representation and different features in our model selection related to the main part of this paper and then they sort of salvage the utility of FEP whether heads FEP wins, tails not FEP loses because the FEP can be heuristic. So like kind of good for functionally or pragmatically for philosophy in mind even if not so much to settle the dispute on internal representation but to unveil and dissect the hidden assumptions in the debate. So it's kind of like deploying FEP into the representation debate.  It's gonna be like some other role. What is the FEP in that setting? Six, another lesson learned is that some traditional polarizations might be attenuated or dissolved under the FEP. So here we're seeing multiple uses of the FEP which is why there's a bunch of different colors on here. It's a theoretical plurality. It's also a plurality of applied models. It's a mirror. It's a bet hedge. It's a unifier with traditional polarizations like cognivist versus inactivism. And then here's a really fascinating part that I know many people in the lab will be excited to talk about. The FEP advances a unified view where terms that traditionally belong to different ontologies can be harmonized. So it's an ontological unifier. For example, modeling and expectation is not used in some of the works that talk about auto-poesis and synchronization. Eight, how does the FEP do this? It begins with a strong inactivist flavor and a focus on action that's missing from traditional cognitive theories. So by starting with one foot squarely in action, it brings something that a lot of neurocognitive theories are missing from, and then extends the scope of an activist thinking to territories of, for example, counterfactual thinking and model selection and abductive logic like we talked about also with Benny. So it's kind of like coming from actionlandia and bringing in inference and then starting from inferencelandia and bringing in action almost like it's called active inference or that's like a related idea or something. And then the ninth sentence is just saying the space of the possible is big and we're going to have to reduce our uncertainty by making it happen. So it's a really great conclusion. Any other comments on that, Blue? Just pretty epic paper. Like I think it ties together a lot of stuff we've talked about, stuff we will talk about. Yep, okay. Final things and things to discuss in dot one and dot two. Okay, so here is a quote from the paper where they say given that FEP has been implemented in a family of computational models that are by definition fully observable, dot, dot, dot, dot, dot, dot, that's the first part to highlight. So in what sense are computational models for fully observable? Or what does observability mean for models? What does explainability mean or transparency mean? Is that reproducibility? Is that perturbability? Is the map fully observable? Is the territory fully observable? Are there settings where one or the other or neither or both are visible? So what is this visual metaphor and what are some of the nuances with like observability and visual perception? And then here is FEP as a unifier. So it's less surprising if one considers FEP United's notions that are generally considered antithetical. So meaning like contrary to each other. Most notably the notion of internal generative model which is usually associated with representationalist theories and auto-poesis which is usually associated with non-representational inactive approaches. So I think just who considers which notions antithetical? Some classic examples are provided here like to Helmholtz and Maturana and Varela but just who disagrees and why? And what can we learn by just hearing different perspectives on some of these debates? And then how is representation related to auto-poesis? So auto-poetic systems are those that are capable of producing and maintaining themselves by creating their own parts. It's kind of a classic complexity idea. And it made me think about poetic naturalism and then all these other proposals like the meta-poetic naturalism and stuff. And then there were zero Google hits for auto-poetic naturalism. But I think it's very related to what we spoke about with Majid Beni and science as modeling in the world and about, of course, the title of this paper and the representation's questions. So this is just a very provocative paragraph that brings a lot of ideas in. Blue? Well, it's also just the middle way, right? Like is it this or that or maybe some combination of these two things is the right thing? The depth perception as Dean says. So then one more sort of general comment and then we'll go to the specifics to discuss next time. So this is the FEP as mirror. So one can use the debate on representation and FEP the other way around, not as a way to resolve the issue at stake, but as a mirror to look at one's own implicit notions of representation. So here's a paper that I wrote with my colleague Eric Sovik in 2019 where we talked about scientific theories for consciousness. And so instead of using a model of consciousness for granted like integrated information theory or some other quantitative measure of consciousness we took the system as the precondition which was an ant colony and then reflected back on different scientific theories of consciousness what that said about what people value about, for example, anatomical versus functional linguistic behavioral components of systems. And so we talked about like forward tests where you're good with your tests you've got a calibrated instrument. And so this is like what the bulk of the literature review was in the first half of this paper which was like, we're just gonna go with the FEP as what our framework is and then we're gonna assess there's still a diversity of perspectives on representation even if you think the FEP is totally the go-to theory. So this does not mean that you eliminate ambiguity it just means that you're using your tool in a deployment oriented way versus the reverse test which is like taking things that are known in the world or some sort of internal reference data and then shining it back as a mirror on the test and comparing amongst tests which also does of course recurse because it's a test being applied to do so but that's where the real revolutionary science happens. And so this paper by Pazulo and Sims showed both modes in total harmony. And so I think it's an awesome contribution from philosophy of science perspective. So I look forward to talking about that and about forward and reverse tests and then here's a bunch of other stuff what are you excited about here, Blu? This is just stuff I wrote down to talk about like while I was just taking notes while we were talking today about what might be cool to discuss in the .1 and .2 a lot about like the sensory motor loop mental engagement, mental action like does that trigger the same kind of like physiological response as like an actual action and then the idea of thinking through other minds versus multi-scale integration what might be similar or different there and the independent existence of the FEP or is it just a mirror we hold up maybe for ourselves but I think that this paper was provocative and great. I have been a big fan of Pazulo for a long time more recently a Matt Sims fan but probably I've been reading Pazulo's papers for 10 years and excited to have the chance to really dissect a paper by him with more than just myself. Great. Well, Blu, thanks a ton for the awesome work on the .0. I think we were trepidatious to jump into this paper but then it was rewarding. You were trepidatious. I was like, oh, it's easy. No problem. I got it. No, I'm projecting. It's true. It's true. I was like, yeah, that's an easy. Yeah, we got it. One week, sure. Three days for .0. We got it. We got it. I read it a long time ago also, so. Yep, we just hope that anyone who wants to ask a question can even if it's long past the .1, .2 if you're listening to this in time, then congrats and you should definitely get involved in the conversation. And otherwise, we'll see you around the lab. So thanks again, Blu, and thanks everybody for watching. See you later. Thanks, bye.


Hi, I'm Rob Randall, Chief Executive Officer of Akara. This VOD cast is about Akara's achievements in 2013 and our plans for 2014. Over the last 12 months, the Akara staff have worked extremely hard to deliver the work program set for us by state and territory education ministers. This work has included the development of the Australian Curriculum, the Administration of the National Assessment Program and the collection and publication of school data. Our rigorous national approach is all about establishing higher standards for education in Australia through curriculum assessment reporting. This year we've consulted with thousands of teachers and education experts to develop Australian curriculum in six areas – geography, the arts, civics and citizenship, economics and business, health and physical education and technologies. I'd like to thank all of those who have been involved for their contribution and the difference they've made. It's very much appreciated. The geography and arts curriculum were endorsed by ministers earlier in the year and the other four were noted by the Standing Council in late November. We will finalise the arts, civics and citizenship, economics and business, health and physical education and technologies curriculum and make them available in the near future. States and territories can then work with their schools and teachers on implementation. The curriculum in English, Mathematics, Science and History is being taught across the country right now. For the first time, Australian school students and teachers are working with the same curriculum. We believe that setting high national standards for all Australians is important and it will make a difference as implementation continues. ACARA has worked with States and Territories to once again deliver NAPLAN tests to around one million school students and reports have been issued to students and their parents and carers. National and State and Territory results have been reported in the NAPLAN summary and national reports in September and December this year. NAPLAN data helps us understand the literacy and numeracy achievements of students. We know that this nationally comparable data is valued by parents and teachers, school leaders and education authorities. Through our reporting programs, including the annual update of data on the My School website, schools, parents and the wider community have a better understanding of what's happening within their school and in schools across the country. One of our key achievements this year was the online delivery of sample assessment in civics and citizenship. Approximately 12,000 students from 680 schools participated in this program. Its successful delivery gives us a first hand glimpse of what NAPLAN online will look like. Students and testing the computer paced delivery of NAPLAN is exciting work and it will continue in 2014. There are many good stories told about how the work of a carer is making a difference. We hear about teachers using NAPLAN results to improve student outcomes at a school level. We see examples of teachers developing and sharing curriculum resources to support the teaching of the Australian curriculum in their classrooms. If you have a story to tell about effective ways you are using the Australian curriculum and or NAPLAN results, please contact us at this address. A carer is focused on continuous improvement and ongoing pursuit of excellence in school education. We are committed to partnering with teachers, parents and education authorities as we go about our work. We believe our efforts are making a difference to the lives of young Australians. I and all those who work at a carer have enjoyed working with you this year and we look forward to your continuing support for our work in 2014. I wish you all the best for a happy and safe festive season. Thank you.