Okay, let's go ahead and get started. So there is a new lab That will help with the homework. Let's see what's published Right homework 13 is out there now, and there's this new lab Which Shows how to go through and Call-up machines Generate data from them using pythonic notation here to just print a hundred of the symbols And then there's some sort of wrapper helper code that you pass in the data The morph link the future distance you want to go and your tree depth And this is using what's called subtree merging reconstruction, which is the main way I introduced reconstruction methods There are others, but and we'll hear about those from Chris Returns a machine and Lo and behold, it's Very close to up to numerical fluctuations in the transition probably is the original so now there are many ways to break this or to get silly answers which is Generate a sample of link 3, right? So in these exercises hint just it doesn't hurt Just throw lots of data at it for now The point is to see the reconstruction process and go through And then and not really worry so much about data fluctuations The lecture that Chris is going to give Crystal laugh is going to give on Bayesian inference will bring us closer to dealing data size fluctuations Those techniques Process table. There's this handy little function in here that you pass it a machine or actually a list of machines And you say give me the entropy rate statistical collection E These are character strings that just identify those and it plots a nice little table so Here's an example of pseudo real data from the logistic map and Again, there's a little helper function you pass a logistic map parameter value in the amount of data you want Look at some iterates of that There's a way of taking the iterates on the interval and Partitioning it another helper function and this isn't deep sophisticated code Then we get our symbolic dynamics Sequence out now. It's just binary data. We can plug it back into that in for machine code Again has parameters here and there are ways of doing this so you get crazy wild things So stick close to the suggested things for now Again lots of iterates help and then in this particular case that was our equal for well That's where that we proved that the map is our covian. So surprise surprise we get the fair coin back out or fair coin up to statistical fluctuations and You can print out now very familiar properties For that and for model Okay, just to give you some idea and also maybe kind of hinting a bit about What might be components in a project a dynamical system? Look at some behavior It's partitioned and then we do some kind of informational or computation mechanics analysis. So that's of the architecture of straightforward project Well, it turns out that So let's get started here and today we have some real work to do A Most of that code certainly calculating that process table command gave all the information properties when you passed in an Epsilon machine there's a lot of Technology built in to the computation mechanics and Python library and Today's lecture and Thursday's lecture are going to be Give you some sense of how things go and I'll try to indicate some of the problems that confront you if you want to calculate These informational quantities from an Epsilon machine or just in general. How do you estimate them from a given? presentation of a process so so far way, we've been discussing things we've been talking about the Epsilon machines in particular focusing on the predictive Equivalence relation the causal state equivalence relation which gave us these partitions of the space of histories so-called causal states and As we emphasize we talk about the intrinsic semantics that a model like that gives these causal states were conditions of knowledge About the past that let you do optimal predictions of the future Well, that's just the tip of the iceberg in this computation mechanics setting so what I'm going to introduce today is actually attend them out to a hierarchy of states of optimal prediction Now the language will largely focus on different kinds of models or presentations different kinds of states But in fact, it's sort of a quite general idea in other words the the original predictive equivalence relation actually induces conditions of knowledge for optimal prediction, but it's sort of conditions of conditions of conditions of knowledge for prediction it Actually telescopes out. We're only going to go up one level. That's all that's really necessary for most of the things We're dealing with until we get to infinite state processes and then It kind of is unavoidable So so there's some mathematical heavy lifting to do to introduce this I'm hoping the gods of clarity will smile on me as I explain some of the technical difficulties, but there'll be examples And in fact just as kind of a heads up Think back to the Tahitian vacation example. We're talking about Reading the newspaper getting forecasts and trying to infer what the state of the weather was On Tahiti before we hopped on the plane and packed our bags It's in one way to think about this is this notion of synchronization. We've been talking about this It's like a key idea here helps organize a lot of the constructions We have some observations There can be a setting which we have a model, but we don't know what the current state is and we're trying to guess What that is so so that's kind of the overall Mathematical setting Do a little bit of review Today Mostly kind of notational things, but it's a little bit subtle I'm going to talk about conditional probabilities and also conditional random variables We need to condition on things like what is the current state distribution or what was the state distribution? When the process started so I have to be more explicit about that I hope it ends up being intuitive. We kind of dive down to a level of Notational detail that I hope will asymptotically be helpful Then with this sort of behind us we'll start talking about this new concept of state so called mixed states and the Induced model mixed state presentations and we'll go through some examples Then on Thursday We get to have more fun We actually get to see the benefit of using this mixed state Presentation so not only we're inducing this new concept of state and It has a number of direct consequences in particular How we can very efficiently calculate these various complexity measures and I'll talk in some detail about Fast ways of calculating block entropies And I'll do just a Revisit the synchronization information to rewrite things in a very efficient way And then this will give you some sense of what's inside the computation mechanics and Python package Particularly right. There's a problem here. You know if you have some kind of stochastic process You're looking at words of length L if it's Slightly positive entropy rate the number of sequences that you can see of length L grows exponentially in L So that's an exponential number of numbers you have to keep track of and makes estimating Where distributions quite Problematic, especially if you're trying to do it literally from data Take a window of length L and sweep it through and just counting things up It's in many ways that one of the punch lines here is going to be this is why we build models Because we need more efficient ways of Estimating quantities than the sort of literal frequency counting of words So we'll see how this mixtape presentation leads the very efficient way of Calculating block entropies and then other Quantities That depend on the block entropies next week. We're going to get back to this question of of We brought up last week. We were kind of we were having to talk about the processes in reverse We didn't really know how to think about it other than just state the intuitive idea. We're scanning the random variables in the opposite direction The question came up. Well, if I have an epsilon machine that produces a process Well, I can certainly produce the process and then scan it in the opposite direction and then build the epsilon machine But is there some way of just getting the reverse epsilon machine from the forward one directly and it turns out this mixtape presentation is key So next week we'll talk about using mixtape presentations to reverse a process And that turns out to be Interesting its own right and also leads to Efficient calculation of a whole mother batch of complexity measures including somewhat surprisingly this time symmetric quantity the excess entropy so anyway Giving sort of a heads up here because well, you'll see why I'm giving a heads up sleeves up. Okay, so review golden mean Process right no consecutive zeros if you see a one the next symbol is a fair coin flip zero one It's up to my machine has two states We have this binary alphabet all very familiar. We have our matrix that gives the transitions on Zero symbols the matrix that gives it trans there's all the transitions on one symbols That's one transition here from a to be with probably a half on symbol zero Here we have two transitions from a and B to a If I'm B with probably one I go to a If I'm in a probably half I come back to a Should all be very familiar by now if we're interested in the internal state process. We just sum over Component-wise sum these symbol label transition matrices and get the internal Markov chain transition matrix If we solve for this eigenvalue equation We're doing left multiplication here normalizing pi and probability. We get the asymptotic state probabilities. Okay, so that's all Very familiar. Okay Most of the time we spend in state a yeah, Chris Sure, yeah arbitrary. Oh, yeah. Yeah, I'll talk about some processes that have I'm gonna turn up the Volume here your speaker. Yeah, you can have I mean I'd say right now a finite measurement alphabet It's easy to handle We did talk about some infinite state processes But yeah, this can generalize a little bit Extending this all to say where the output was a continuous variable. That's the research frontier But yeah, Doug is trying to be concrete here with the golden mean and Then if we think of now the the golden mean epsilon machine as a generator Like you might have noticed every once in a while the edge labels sometimes I put the transition probability on the left side with the output symbol on the right or vice versa There are actually two modes of using These epsilon machines one is in this mode Transition probably output. We think of this as a generator. I have the model and I want to generate the Realizations and then once the other way around we think of it as a recognizer. It's reading in zeros and ones calculating path the machine is calculating path probabilities My minor difference here. So here we've got this and question is well what words does it produce and whether their probabilities and we calculate the word distribution this way so we start with Asymptotic invariant distribution. We have this product of the t zero one matrices Extended to words and then we sum things up with this column one vector and that'll give us the probability of A word simple case. What's what's probably of seeing a zero? So we have two-thirds one-thirds for the state probabilities times t zero And then we sum things up. Well, okay, so we're starting here with two-thirds one-third And then we see a zero Well, we're in state a with probability two-thirds and we're going to see a zero with probably half So that's a contribution of one-third and state B probably one-third, but we can't see a zero So the probability of seeing a zero is one-third Same thing here promising a one. It's just pi times t one I'm here with probably two-thirds. I can see a one with probability half. So that's one-third contribution I'm in state B with probability one-third, but I'm going to see one probably one So that means I have a third and a third contribution So probably seeing a one is two-thirds and so on Okay, I'm going a little sort of pedantically here and we calculate these things this way I mean, this is already sort of showing you what I said before If I wanted to calculate the probability of all the length ten words I'm gonna have two to the ten or a thousand of these calculations to do Oh Tv is okay So just notation for probability theory. We're going to have a very discrete alphabet now We're just thinking of processes. We have a random variable time t big x Sub t the instance of that some value in the alphabet time t lowercase means Particular value and the way we think about this is this random variable x of t Distributed according to this or in the Covert Thomas notation. It's just simply to say Tilda random variable is distributed as this distribution. We're going to use this a lot Okay, we have different types of random variables Quantitative or categorical age of voltage temperature, whatever Find that sort of makes sense I can calculate the average age of people in the room or the average voltage and circuit over an hour in my office Categorical things names colors that I don't quite know But we still talk about You know the probably being sunny, but does it make sense to calculate expectation value of the weather, you know Yeah Probably sunny and probably you know, it's sunny in California. It's rainy in Tokyo and therefore the expectation value is it's fog on earth You mean somehow doesn't for categorical variables Doesn't really make sense Expectation value of colors. Well if you make The categorical variable red and RGB triplet or HSV triplet then we can start talking about an average vector in in color space, but until you You make a quantitative expectation values a little bit Sort of puzzling for categorical random variables For processes we have our observed process right this giant joint distribution of the my infinite chain of random variables Typically, we assume that all the marginals of this are time independent the probabilities are time independent. They're for stationary At a minimum the epsilon machine some sort of convenient representation of the process, but that's just one There are alternatives so So we choose these alternatives based on how useful they are and Then given the epsilon machine we can at least calculate The word distributions using this simple formula vector matrix multiply Now we've been sort of focusing on just the observed process this way and we need to be more careful So really what's going on especially if we have imagine we have the model It's a little generator and it's generating zeros and ones that we observe but then the states are changing So really the observed process or zeros and ones or whatever alphabet the words over whatever alphabet It's really a marginal distribution from the machine process, which is pairs of internal state output symbol Internal state output symbol and so on And we project on to just the measurement symbols when we talk about the process but What the states are is actually important obviously and So it's it's been when we've been writing down something like like this. It's been implied that we use the asymptotic and very distribution and The benefit of that is that then these word probabilities are Stationary They're probably the same anywhere in time That doesn't mean We always have to do that we could we could use other state distributions and the only cost is that then maybe these word probabilities depend on time Or the observed process is non stationary But we certainly do that. So anyway punchline is We're going to be a little more careful when we start to write down the word distribution like this We're going to write out Explicitly that it is an explicit average over state probabilities Right. So what's the probability given that I started in a given state of Seeing a word so we got each state doesn't produce W next state doesn't produce W and then we add up those probabilities and that's what we mean by this That that the machine or process could have could have generated the word starting from any state Okay, so that this just review Some sort of computational things to note so let's just say we have our state set V here as I noted before The number of words we're having to deal with grows exponentially with the length So that's sort of burden some Is there a more efficient way to calculate these word distributions when we do this? Expression here and the answer is yes So because they're kind of straightforward and inefficient way is so here We're asking for what's the probability of seeing the word ABC and again just applying the formula That's pi ta TV TC and then we sum up with the unit vector and if you just sort of Write it out explicitly you have to sum over all possible paths that could have produced a B or C Okay, so that means the sum here is The number of terms we have each one of these variables goes over the number of states the longer the word We have another set of states. We have to Sum over and so the number of paths grows exponentially with this so that's bad. So so this first Method here just multiplying these things out. It's taking into account. It's calculating the probability this word over all possible paths and That's grows exponentially in the state size So that's not so great However, if you just a little bit of careful thought and probably if one was programming this up just the very fact It's so inefficient would lead you to think about grouping things in a different way So the second way which is completely equivalent to the first is that we every time we look at a new symbol from the word We update and since summarize what's happened in the past by just pushing the state distribution forward with that single matrix Well, that's a vector times a matrix. That's nice. And then I have now I have a new State distribution that I just go state distribution and I update it with in this case the B matrix new state distribution Okay, I have now Three matrix multiplies If it was length L, I have L matrix multiplies Therefore the second way of doing it is actually linear in the length We're actually using the states to carry what we need from the past. We don't just throw all the Pads out there and figure out which are The probability that they assigned to ABC we do this nested Updating of the internal state distribution Again, it's just like the synchronization problem. Oh, sunny rain and you're updating your distribution of the internal states of the Dehesion weather system Right, so now we have this vector Here and then the sigmouth component of that is the probability that you produce W and ended up in state sigma And then we just keep pushing that forward so Don't bad Good So rather than having your calculations are poop out on you. It's short word lengths. You can push this quite a lot further Okay, so now Really terrible colors Right so conditional probabilities the way we've been thinking about them Right, what's what's the weather on Tahiti if I read in the paper that it rained yesterday So we think of conditional probabilities been conditioning on events Well, we have to modify that a bit. Why because all I was just talking about is we're conditioning on Knowledge of the state and that's a distribution Actually, we're gonna think of that as a random variable So but that's that's okay, you know It's conditional distribution. There's still distributions. We know how to work with them But we're gonna eat some notation to deal with Conditional random variables. So what we mean by that and I hope the notation will bring this across so we have this two letter alphabet a b and random variable x and I'm going to define a new random variable that represents the distribution of namely the probabilities that x zero is a or x zero is b Okay, so So and what I mean here is that there's going to be this sort of hidden Variable, I'm wondering how a and b are being produced depending upon what the current state is here So this is going to be the probability that that x zero is a or b conditioned on a particular state so And so in a way this notation will let me sort of like occasionally sort of hide Hopefully not obscure the fact that we're depending on this condition Also, there's a sort of an ambiguity here in when we look at entropy notation So the entropy of this new random variable is It's conditioned on the value that that that This s state takes and it's not the same thing as the uncertainty in the variable x zero given The previous state because this entropy we average over all possible states Right, so so this is a random variable that is the value describes the probability of seeing x Given on a particular condition that is fixed So here's one example of this so here we have our our Machine process here state symbol state symbol state symbol so on Okay, going forward in time and I define a new random variable call it j zero That's distributed according to how the probability of x zero Is conditioned on s zero being a so so this random variable is The problem distributed according to the conditional probability of x zero given s zero is a particular value So imagine that we're asking this this this is produced by the even process so And I sort of change this here instead of zeros and ones we have triangles and squares. That's the even triangle Process so what's the probability that j zero is equal to a triangle? Well, what is that probability here? Well, just by the way, we've defined it probably that j zero the triangles probably that x zero is a triangle given that s zero was state a Okay, so given that We're in state a what's the probability of seeing a triangle a half and that's not the same thing is just asking for What the probability of x zero is when it's equal to a triangle? Right that is this product here. Yeah No, it's defined this way right I'm defining this I could I could make you know q zero b s zero is b And I have this new random variable Right Yeah, right so I'm kind of right I'm trying to describe right so this is a random variable that's described by not a distribution but a conditional distribution I'm calling it the conditional random variable and It's related to the event set x but now the event set x is being partitioned up by this other state variable here in this case Mmm. Yeah Right so so so this down here this probably it just when is x zero triangle well I'm here two-thirds of the time. I see a triangle half the time. I'm here one-third of the time You see triangle with probability one, so that's two-thirds times a half That's one-third one-third times one and I end up with two-thirds again just like before Okay, so that's straightforward And these are various constructions we'll use Maybe it'll be a little more intuitive when we get to the examples another example would be Defining this conditional random variable f2 that's the probability of being in state two given that back at time zero I started in sigma zero so so what's the probability of? That f2 is describing the probability of ending up here I should say my uncertainty in here given that I started over here in a particular state call it a or B Okay, so now I can condition on this Right so the point here is I need to be able to talk about sort of telescoping conditions. That's So what's the probability that? x2 is equal to a particular value you know triangle or square Given that f2 was sigma 2 in other words and what that means is we just unpack that I'm going to rewrite f2 here Explicitly it's this conditional random variable and now I'm saying that f2 is equal to sigma 2 that means this first variable here it takes on that value So now I have this conditional random variable. That's s2 is equal to sigma 2 Here I end up in sigma 2 when I started here in sigma 0 Well, that's fine We can just drop the conditioning here. These are just events Same thing as the joint event s2 Was sigma 2 and s0 was sigma 0? Okay? They just unpacked that there, but then we can simplify this of course because we're using these causal states and shielding means I only have to worry about them immediately preceding states. I can simplify that so this is just kind of example calculation I'm interested in this condition up here and later on these are going to turn into distributions Over states like this And in this particular case the uncertainty in x2 Given that f2 was sigma 2 This value up here It's same thing as asking about x2 given that we that that that state was actually sigma 2 So so this f2 variable sort of collapses down because of shielding to mean equivalent to asking about the state at time 2 Okay, so Just to draw a contrast here. So we just established we had this probability identity and then also down At the level of the information the uncertainty Condition either on f2 or s2 those are the same However, when we talk about without conditioning this way, we just talked about what's the uncertainty in x2 given f2 Without fixing it that means we're averaging over the realizations of f2 this conditional entropy That's just sort of the standard definition Of that right, but now I can sort of unpack this a little bit this is this conditional random variable Over s2 and s0 fixed at sigma 2 and sigma 0, but that's not the same thing as The uncertainty in x2 given s2 right this we only would condition over The value of s2 We would have suppressed this condition that was built into F2 So these two quantities needn't be the same Because f2 has built in this I guess for a hidden condition Okay, I guess it's sort of a final example here Right so g2 is the probability of Our uncertainty in s2 given the x2 had a particular value. Okay, so we're sort of Even that we saw This observed symbol we now have we induce a conditional distribution over the previous state We could have been in and now I'm going to ask a question about The probability of the next state I'm just kind of making these up to show the different instructions here so so okay So that's probably of s3 given g2 then these are fixed So then since g2 is now being fixed at sigma 2 that means that this first variable is being set to sigma 2 So I just rewrite this again Probably the s3 given now this condition Conditional random variable. I just break it out into the separate events. It's now a joint event Right and then you can even say something noted down here if if Given that s2 is fixed and x2 is fixed if this was an epsilon machine then the probability would be Zero or one whether I was going to sigma 3 At time 3 Depending on whether that was allowed or just allowed transition. Okay Same thing with these, you know, there's the entropic version of this the uncertainty in in s3 given that g2 This conditional random variable the sigma 2 again. That's just simply this Conditional distribution that would be zero if the machine was in the feeler I Generally again just applying the straight definition if I was interested in the uncertainty in s3 Given g2 without it being fixed then I'm averaging over the the conditions realizations This conditional entropy Right the uncertainty in s3 given the different Realizations or possible values of g2 Again this unpack this again. We have this conditional random variable. It's probability We got this above here this number condition on this joint event to sigma 2 x2 and that's generally not the same thing as in certainty in s3 given The state distribution s2 and that we fixed x2 to be a particular value Again, it's because of We have this this hidden condition here. Oh, so right so so these nested conditions I have a certain syntax and meaning to them But you just sort of unpack them till you just have everything be an event and then we're back into the realm of sort of normal probabilities So what does this generally look like if we have this conditional random variable a prime probably of a given that? B was little b then we can talk about the uncertainty in some third event c Given that a prime was equal to a and what we mean by that is now we fixed this conditional distribution so that the thing were That's being conditioned takes a particular value So this is just now a single number as it were and then it's then this We were conditioning of the random variable on this this conditional random variable turns out to be just the uncertainty in c giving a and b And that's different from if we don't fix the conditional random variable Right, so that's just rewriting the definition of a prime the uncertainty in c given and conditional event a given little b Which sort of write that out that's now we're averaging over this random variable although this One component is is fixed at B And then we average over the values that a could take in the conditional random variable And then that's waiting the conditional uncertainty in c given the conditional random variable Again sort of under third form of this is just looking at the uncertainty of Comparing we have this last Conditional entropy on c given a and b the sort of joint event Then that's that's different than if we haven't fixed a again, what we mean here in the definition of this conditional uncertainty is that the The the random variables that are not fixed Are the things we sum over that we use to weight the conditional entropy so so right so now getting back to But we're going to use this conditional random variable Notation we're going we're interested in the Word distribution and now we're being careful to be clear that it depends on the state distribution As we produce the word so so before we were just conditioning on events And now we are sort of conditioning on these state distributions when we calculate word probabilities and entropies And we have to make this dependence on the state explicit But I guess it's natural enough if we think of this as a generator And this this if you look at this this expression it sort of looks like well You're doing the state average of something it kind of looks like an expectation value so we could think of This is like instance of a random variable or if you like conflate it to think of it's like an event It's like a temperature well, it's a number and we're averaging this number over the states Okay, so this is I guess it's Yeah, it's sort of a this funny semantic shift here. I mean to make this explicit you could imagine we just come up with define this sort of Random variable, I should say distributed as the this conditional distribution, right and What so the values that this random variable takes are the probabilities that? You know the word is w if you started in a or you started in B Right could be two-thirds one-third and that would be the values of z then you know the probability of z taking a particular Value two-thirds or one-third well, it's just plug it probably is that z is actually equals that probability And that just depends on what state you visit Right there everything is driving it here is what state you're in if you're in state a I have this probability if I'm a state B I have this probability So in fact this does look like sort of An average if I average z over this over the its distribution So I'm z here Averaging over the different values it can take the probability that those values occur And you end up back with that original expression. So this is the way of thinking about how the Calculating these these word probabilities Condition on the state. It's it's as if we're averaging these numbers over these events over The state probabilities, but that's I don't know maybe this is over tedious or kind of flogging a dead horse We could just sort of by definition just to kind of agree to Start conditioning on the state distribution here so that these averages over these numbers that we're interested in these state probabilities, right? I want to know over which state I could produce the the word Probability and then we wait those by the state probabilities Okay, so the other thing we're going to do is think back to that Calculating updating the state problems that we're calculating The word Distributions We're going to think of the random variable as actually being a vector of probabilities over the states So for example for the word probabilities So now we can have we can ask about what what's what's the probably producing a word given that it stays just the states Starting at time t or distributed according to the S&P like stationary measure. That's just this formula here right and And now imagine we didn't sort of sum this up. This is actually a vector of Probabilities, or we can now think of this as the the random variable. We were just averaging over the states Okay, but we can also talk about you know other distributions besides pi right imagine It's a uniform distribution Then the probability of seeing these words starting with the uniform distribution is just simply the sum since all of this these States are equally likely just have the factor of one over the number of states And we just then sum up these conditional probabilities Having produced the word or just in general right we can Now start talking about producing probably producing words when the states are just given by some arbitrary Initial state distribution and then we just generalize our expression here Just left multiply by mu tw and then sum up So this notation is it's okay It's trying to make explicit what has been implicit before so Right, so this is Right, what's the probability of the x takes on value little x given this state now This is just things out of the random variable or we can also be clear how it's distributed we can put in the distribution there So these are probabilities right This is the probability that x 1 is equal x. That's a number. That's a number Okay, and then we can also work with distributions the same way Right now. We just have we can condition on both s 1 and s 1 given a particular distribution And then this is a set of numbers All the possible probabilities that x can take for its realizations It gets a little bit dicey though when we're working with entropies It's a little bit ambiguous. I mean typically what we mean by the uncertainty of the next symbol given the current state is we're going to do a state average of the Uncertainty in the next symbol for each state, right, so that's just state average in some sense the the branching uncertainty here from each state conditional entropy and or in simple lines simplified form It's just that you always put the joint distribution out in front of the log and then The argument that log is the particular kind of entropy. We're looking at in this case a symbol state conditional entropy But there's also sort of possible when we write this the same Notation down that we could have meant with think now thinking about these conditional random variables that that this is the Entropy over this conditioned random variable. So now I've got this p log p expression. I'm applying to this Condition random variable that x 1 is equal x condition on s 1 in both Places there, but if you work this through you see there's This ambiguity We could just sort of unpack this here Right, this probability is the probability that we're going to see so here. We're averaging over x That is x and then Also over the states here that's what this conditional probability is just the probability of of We're averaging over the states here whether we're conditioning on so we pull out the state probability and Multiply that weight that the conditional probability of x given sigma And then we do the same thing here same expression But notice that now this this just turns into the joint distribution in both places and this is a different expression than this one so there are ways that In this new notation that we have to be careful We can't unpack things certain ways in particular this way doesn't doesn't quite work So so the first thing is just the average entropy of this variable conditioned on The events all the state events x this one down here with the way we're thinking about this is the entropy of this variable For different s 1 distributions and it leads to the sort of confusing Alternative right in fact this this is just the marginal distribution over x marginal distribution over x some sense we've So we have to be careful with that So what we're going to do is when we write this down will mean the first thing the average entropy of x 1 conditioned on the state events and Then when we want to talk about Averaging over particular distributions then we're going to put in How the the conditioning random variable is distributed so Right so so this later thing like the last example just reduced to entropy in the in the first variable something Was not what we intended but now with this new notation we can it be explicit about what we're conditioning on and of course we recover When you is equal to pi the quantities we were using before namely the asymptotic invariant measure The important thing about this is now we can start looking at how uncertainty is changing if we start with different State distributions in particular we're going to be updating these distributions as we go along So we need to be very explicit about The state distributions we're conditioning on maybe that's kind of the main point of this So what tortured notational Description okay, so for example odd process. So this generates 11 or three ones and then a zero so just the odd analog of the even process The asymptotic distribution is two-fifths two-fifths one-fifth here ABC and We can ask about what's the probability at time three that we see a zero Given that at time three we were in state a and the initial state distribution was distributed according to pi And that's a question. Okay, so what does that mean given how we've developed this? Well first of all this again, this is Is this random variable is distributed according to the distribution that means we're going to average over it using its weights right Times zero what state probability we had those and then Well, of course, this is like a previous example because of causal shielding we can actually this this probability here conditional probability over here Seeing zero at time three doesn't depend on what the state Start state probability was it just depends on the immediately preceding state so we can drop that But now we're still sort of averaging over right we're carrying forward that that state distribution But notice now this probability doesn't depend on sigma what the start state was you pull that out and then we just we're just summing This distribution over sigma. Well, that's one so we end up basically showing that In this case we forget the initial distribution. It only depends on the previous state and that is right Time three. I'm an a what's the probability of seeing? Zero a half But we can choose a different state distribution and ask a similar question. So this Right, so imagine that we have mu just defined to be uniform probability over states ABC And we want to know what the probability of you know The next symbol of time three is given that say at time one that was the distribution of state probabilities. Okay So well, we know how to Calculate this we can just take mu push it forward Three time steps in the last step we use the symbol transition matrix that produces the symbol We're asking about and then sum that up Right remember and here we just can use t Because all we really need to do is to update the state distribution Nothing the first two steps. We're not asking anything about the the observed symbols right So that's the same thing as this probability here is the same thing as Instead of s1 at time one being distributed as mu we can look at s2 being distributed as mu t We just pushed it forward or at time three it was mu tt so we pushed it forward another step That's you know easier to answer here. I can go out to step three and say oh That's my current state distribution. I can go to the states and then just look one step ahead rather than sort of Think about this extend it over at three time steps in this the The only thing that's really important is the relative time difference. So here I was specifying mu at Time one and looking at two steps later at the observed symbol I could have specified mu at time two and looked up at time four for x so that we can shift that way But you can't just shift this random variable here forward When mu is not the asymptotic state distribution when mu is well then as I'm operating on it I just get me back. I mean get get pi back. So then that'll be stationary. So you can't just shift this This variable around why isn't that turning red odd? It must be missing colors. Okay, so Yeah So what are the shorthands we have here? So I write down the probability that At time t we see little x conditioned at being on the state the time t what this is is a set of numbers The size of which is the number of states And each of those numbers is the problem that you're going to see little x for each one of the states, right? whereas if I Don't fix one of the random variables, then this is now a larger set of numbers namely the probability that we see little x For the pairs see little x and see state sigma Right so now when we talk about What these numbers mean, right? We're thinking of this as The average number average likely we're going to see x but averaged over the state probabilities, right? So that would be the expected probability when we write this the expected probability, right? Or if we're not fixing the Variable that's being conditioned what we mean is the distribution over this. It's the expected distribution Right so up here. We had these numbers One for each state and down here we have a distribution that is now We have a distribution for each state we could be in So it's four different things and then we average over the states each one of those numbers and we end up with a distribution over x So hopefully as we go forward the context will help us Get rid of any ambiguity here Either we can think of sets of numbers sets of conditional probabilities Conditional probabilities or expected probability or expected distribution Okay, so enough of that Right, so here's an example process I should say this is a presentation that generates a process Happens to be the epsilon machine for that process and We have a fair coin flip from a and then no matter what we come from b or c back to a So it's almost kind of like a period two thing except When we go from C back to a we flip a coin and generate zero one coming back from B. We generate a zero with probability one so The way to think about the problem is that we know the model So we took our data in our lab, but then we left for lunch the experiment was still running We come back and we don't know where it is. So we have the model and we can for example calculate the Given the model So our expectation if we've been away for a while is kind of in statistic equilibrium So this is actually this this vector here is pi the asymptotic state distribution I have a quarter a quarter and then the state is colored in red here give the probability Magnitudes and so this is the state of affairs when you just walk back in the lab. We haven't seen anything yet okay, and this A half a quarter core are our expectations if we assume equilibrium so We got this one helpful way of thinking about this is looking at the time evolution of the state distributions so this particular state distribution is it's a you know normalized Over three states over three variables. Therefore. It's on a simplex and all of the probabilities that some to one and Are between zero and one lie in this triangle. So think of that a two-dimensional surface this initial state distribution is Over here. It's you know Not much of B. Not much of C and about half of a so Half a quarter quarter. I should should visualize this okay, so now what we'll do is read in the word and then Talk through how our expectations of what state the what hidden state the processes and get updated Okay, so the first step will be we see a one Okay, so then looking at the model. We know there's no way to get to be on a one So there's no probability flowing over there However, we started with probably two-thirds here and sorry probably one quarter one half here one quarter here So on a one we take the half probability We take half of that and move it over here So we now on the next step having seen a one we have one one quarter here We had one quarter probability before we saw anything and then we took seeing a one that takes a half of that Which is an eighth that moves it over here So we end up with this partial distribution of a quarter and an eighth Which when you normalize it? makes Probably state C two-thirds and probably state a one-third right so you have an eighth and a quarter That's three-eighths divide that vector distribution quarter Sorry an eighth and a quarter by three-eighths and you get one third two-thirds and then our our mixed state is updated Now the the mixed state lays along a subsymplex namely just the line the one-dimensional simplex between C and A Because there's no probability of being in B. So we're just along here So on the edge of the simplex so then we see so we update our mixed state in this simplex or we can think of it this way on Distribution on the states we see another one We have we have a new mixed state here So we had two-thirds here one-third here half of one-third is a six We had two-thirds we take half of that that's one-third so we have one-third one-six We normalize we get two-thirds one-third again Okay, then this The red is the current mixed state having seen one one see another one it just Happens to just swap these probabilities like this, but we have to go through the calculation again What's just what we did before and we come up and we can? Visit this same mixed state again Okay Now we'll see a zero So now what happened is we had whatever was here and a it moves over here We take just half of that probability mass and whatever was it see we move that over here Okay, so that was I get the phase right on this right so Two-thirds a half of that is a third ends up at a we had one-third here take a half of that's a six So we have a third into six and again it normalizes out having seen the zero to two-thirds one-third now we can see Another zero Now what happens is that in fact having seen that our expectation is now 50-50 for B and C you go through that calculation again And then now we're down here. We can't be in C. So now we're in the sub-simplex between a and B And exactly 50-50 like that and then on the next symbol I'm just choosing allowed symbols as I like to illustrate things next symbol is a one and what happens is that now We had a and B with positive probability, but there's nothing Leaving B on a one so that doesn't participate. We had this probability up here and whatever it was We take half of that down to here But the C is the only one that has probability when we normalize it's we get this call it delta function right on C The mixed state moves up to one of the vertices Okay, so we get the Basically the the kind of visual picture here of what it means to finally have synchronized now having seen that sequence starting from State ignorance we now know exactly What state we're in so we call this a? synchronizing word There are words that will take you to this if you have the right kind of presentation This is the property synchronization like this a property of the model itself I'll we'll talk about some examples that don't synchronize and Then because this particular presentation is unit feeler happens to be the epsilon machine. It's minimal unit feeler Every other as I read more symbols that are allowed. I Stay in The state of being synchronized. I never lose that again. That's one of the nice properties of unit feeler presentations it just kind of hops around now and The dynamic on the simplex is just hopping between the vertices Stochastically because I'm sort of choosing the allowed transitions to take So over to be after I see a zero Back to a if I see another zero and so on so we're kind of hopping around here stochastically on the simplex of state distributions Okay, so that's the main idea, right I Made an assumption we start in the asymptotic state distribution pie and we're just trying to answer the question How do we update our knowledge of this of the state? Okay, so I maybe that's more intuitive than all this conditional random variable stuff But actually that's you're having to calculate where these things. So so so what are these mixed states? Okay, so so in the simplex We had you know these various dots here now. We're thinking of the A it's a random variable or it's actually this point in a simplex that's hopping around So two different representations of this to describe the evolution of our knowledge or uncertainty about the internal state as we're making measurements So we have now some induced dynamic over this new kind of state space Well, it's a state distribution space the simplex So that's what we want to track with these mixed states. That's basically what they are So they're distributed state distributions that are induced by having seen a word So let's just look at words of length L and that our notation here will be at time t Having seen no words lambda in this case We'll be in this mixed state mu so we're going to come up with this more compact notation here of The mixed state at time t having seen some symbol or word Okay, so what we're going to do is this will be where we start at time t There'll be some state distribution you having seen nothing. That's what that one means. Okay, so then so again, so now these this is a Random variable well, it's a state distribution. Well, it's a random variable. Okay. I Think we're comfortable with it now, but there is some formal Trickery here. So so what's the probability of at time t plus L? being in state sigma given That we observed Word w well write this in more familiar notation and this is where all the previous formal rigmarole What we mean is the probability that the state at time t plus L is sigma given that we saw word w Going from time t to t plus L that block Having started with this initial distribution having seen nothing and in that mixed state Okay, so this is the general sort of way we're going to push distributions forward based on Observing sequences so then these mixed states really are random variables are hopping around they're being driven by a random variable Naming the word that you're observing They're conditioned on these two things So the word and and and and the and the mixed state Of course, and then typically what we've been doing is just time is zero and then this initial distribution We take to be the asymptotic distribution, but as we just saw There are other questions one Has where we use different mus and push them forward Okay, so the simplex picture is really based on thinking of now a different, you know Representation for the mixed states distributions as just vectors in some vector space Right if we have three states, it was a two-dimensional sheet and we can see how to calculate these State distributions we just simply write out what we had before right State that we're in at time t plus L give me saw a link that word and started with this distribution Well, that's a conditional distribution. I can write it as a joint distribution over a marginal That's just a probability identity and Then we know how to calculate both of these that's just given by our familiar formulas before so now This is the way we can directly calculate starting from a given Mixed state at time t and then going forward Basically, this is what I was talking through in the example and then that last normalization step is given by the denominator Just to make so this this is some kind of partial distribution I just push the state probabilities around on a model and then I just make it a normalized distribution after that and Then so now this this sort of dynamic. I now know how to push mixed states forward basically and what we've been doing of course is You know just taking the asymptotic distribution pi times zero we get this this simpler Expression just if we start with the asymptotic state distribution We can calculate the mixed state having seen a word of length L this this way So for the even process just to focus in a little bit We essentially did almost numerically the same example, but now we just have a two-state process over triangles and squares the even triangle process We'll start the initial mixed state off in the asymptotic state distribution two-thirds and a one-third in B and then the question is What's the mixed state at time step one having seen a triangle? Well, that's the state distribution Condition on having seen this past namely triangle and then we're now sort of denoting the the And being explicit about the initial state distribution that at time zero is distributed according to pi So then we just push pi forward using t delta and we normalize it So when you push it forward, right? We have two-thirds one-third Push it forward having seen a delta two-thirds half of that as a third We had a third here before but in that moves the probability one so we take all of it over to here So we get a third a third so this is this partial distribution vector and then we sum that up Well, that's two-thirds and then we use that to normalize and then we get half a half So initially we start out with this we've made this assumption. Oh, it's been running for a long time It's statistically equilibrium most likely in state a Soon as I see a delta I conclude that it's equally likely and to be in either of these So my state uncertainty can change over time Until in this case we hit a synchronizing word and then I would get the delta function and there'd be no more state uncertainty Sorry thinking about the this it's a new kind of dynamical system over these state spaces these Simplicial state spaces. These are just vector spaces The vectors are these probability distributions They're normalized and we think about them on some Simplex so if we just had if we had two states, there'd be a one-dimensional Simplex now probably a probability of B. There'd be this one-dimensional space along which those probabilities Between zero one and sum to one We have three states. That's what we were talking about before we have this surface And then over the surface they're sort of you know notable points the vertices are the what I've called the delta function distributions We know exactly what state we're in The center point is always the state of maximum uncertainty and then you know all the other points including the boundaries are allowed So if we're on one of the you can think of if I you know arbitrary Distributions over three states or just points here But as we saw before when we synchronized or even before we can synchronize to a subspace We have distributions where you know you're not in some state and that just collapses the dimension you're currently operating in So what what are these things? So they're just the uncertainty in the state given some starting distribution and a word you've observed We can look at the mixed state entropy as a way of Detecting whether or not we're in a state with probability one. So this would be our informational criterion for being synchronized Right. So we went when the state distribution is all zeros except for one one Then we know we've probably want what state we're in so we think of these these mixed states with zero entropy as the sort of points of the The vertices of the simplex. They're so-called pure states and then all the other Possible state distributions are spanned by those pure state vectors and they're hence they're called mixtures of the pure states right we can write an Arbitrary state distribution in terms of these these pure states So it's very handy. Just look at this geometric geometrically Also, and this is getting a little bit into the sort of the induced dynamic We're sort of talking about the state space now the induced dynamic Is actually many to one so in particular you can have the same words Lead to the same sorry different words lead to the same mixed state Right. So like we saw before here. We had two-thirds one-third and then after one step seeing a triangle we had Two-thirds one-third here and if I see two more it just permutes and permutes it again So either one triangle or three triangle words lead to that mixed state So this mapping on the simplex going forward I can have For a given mixed state any number of pre-images There should say any number find a number of pre-images, but Okay, so the basic idea is that there's a certain natural dynamic Over words right that's just concatenation. I go from a word and I add something on here to it to make a new word We have this equivalence relation between words now where they end up when we're looking on the simplex Two different words can end up in the same mixed state We think of you know the the mixed state is a state of state uncertainty It's the sort of hierarchical picture we give here and then then the dynamic that's induced over words We have concatenation and then for each one of these we can ask oh Given we specify the initial mixed state. What mixed state do I go to I? Have a word that induces another mixed state then and the way this diagram commutes Then there is a mapping from mixed state to mixed state on symbol so Interestingly this representation of mixed states mixed a dynamic as you a feeler Which means that again? Given the mixed state and the symbol I go to unique next state There may be many pre-images, but there's always I know exactly what state I'm going to given the previous one and the symbol Okay, so that was a lot of work. Yeah Yes, yes, in fact, I wasn't really distinguishing recurrent mixed state from transient mixed state which we will next time Yes, good leading question. Yeah, right Exactly, so so it's kind of Right, so so I mean yeah, so so what we've done here We've moved from and you know all the previous examples where I've been talking as if we had a probabilistic finite state machine and we were talking about oh, I'm in this state or this state or this state well, okay Sometimes we're not certain and that came up a bunch now We've shifted up to this other picture where we have this dynamic over these mixed states and we're tracking Dynamically how our uncertainty and states shifting based on what we've observed their analogs to being synchronized or to being in a the recurrent state of The epsilon machine at the at the vertices of the simplex when we have those delta function mixed states But they're their corresponding questions that we had before for the epsilon machine transient states recurrent states same thing Comes up here and we'll actually see that for example We can work with the transient states quite naturally and it leads us. I'll give you a nice simple expression Kind of closed form expression for the synchronization information The total uncertainty as we synchronize and that's working just where the transient states transient mixed states But along the way it turns out this is also Kind of harkening back to the when we're talking about the computational complexity of calculating word the word distribution there also lets us Deal very handily with an efficient way of calculating Block entropies and so on using the mixed states very efficient So Okay, so that was a lot or dense I should say So I'll finish unless there are questions and we'll come back and Thursday will be more Application-driven and you'll see some of this and why I had to bend over backwards to worry about some of the notation on Thursday


Ladies and gentlemen, boys and girls, welcome to Skip Dictation Live. In case you're new to the stream, my name is Sherman, welcome to Site 42. This live stream is for hanging out while I record the SCPs. You can get some behind-the-scenes stuff. You can hang out in the chat, which I will set up right now. The chat on YouTube has a slight delay. The chat on the Site 42 Discord server does not have a delay. So if you want to join the Site 42 Discord server and chat in there, I keep that window open as well. So let me type to them. Stream is live. Stream if life. That's what happens when I cover the typing bar with my camera slash cell phone. Whatever. So today we are doing the man parts of SDLock's proposal when day breaks. My girl squad nailed it. I listened to their footage to make sure I have exactly what I need to record what they didn't. And oh my god. Oh my god. It's crazy. So it's going to be awesome. I'm going to record the man parts, which is all the pros. And then the narration and computer and sound effects. So today is all about recording it. That is today's goal, is we got to record. And then we're going to work toward our editing later on. Because the girl sent me 24 minutes of material. And I've still got a lot of stuff to put into this. So it's going to take a while. This is going to be another long one. Another long one. But you know what? That's what we're here for. Doing the undoable. Stopping recording the uncor... Well, my epic speech is gone. Oh well. We're going to do the undoable. Record the unrecordable. Row row fight the power. Our drill pierces the heavens. And the top of the camera. So that being said, I've got all channels windows live. And it is time to start recording. So let us begin. By the way, if for those of you in the chat, I am mostly going to hang out in the YouTube chat. Just because that is easier to see from my desktop. But I'll swap back to the general now and again. Row row study the unstudable. That's what I'm talking about, Pingo. Get it done. Get it done. Okay, so we are set. Man parts. Time for some man lines. Oh no. We've got a YouTube very bad connection. That's not a good thing. I really hope you guys can still see me. I really hope this works. Hope you're still with me on this very poor connected Halloween live stream. Oh God. Oh God. Oh God. YouTube. Why? Why are you doing this to me? Because it's a holiday.  And I need to get new internet. Okay. It froze up for a sec, but it seems fine now. Good. Stay that way. YouTube. YouTube. Or not really YouTube. In my case, it's internet provider redacted. That internet provider is a total bad job doer and boo internet providers. So, yes. Done. Recording time. Let's do it. We're already four minutes in. All right. Round one. You find the access tunnel hidden within a natural cave a mile off the main road. You don't need the key card. The door is a jar. It smells here. It smells like them. Hopefully they've moved on. You've come so far already. You can't turn back now. There's a slick trail that leads from the cave entrance and into the depths of the site.  You make a point to avoid it. You're still receiving the distress signal. It only started broadcasting yesterday. Whoever it is, you pray they're still alive. Your footsteps echo through empty corridors. Each football sounds for all the world like a dozen, as if you're not treading through the dark alone. Elevator is down, so you take the stairs. Ending on floor B5. Keter holding.  The horrors they once held are long gone. If you're lucky. The trail takes you to an office branching off the main hall, the source of the signal. The doors cracked open, but stuck.  Something skitters out of one of the rooms to your left and around the corner before you can get a good look at it. Your first thought is, dog. It was on the ceiling though. You take refuge in the room, slam the door behind you. It's dark here. You're safe.   The sole operating emergency light rotates in its casing, casting a pale orange glow across the room every other second, as if the room itself had a pulse. Their shelving haphazardly placed behind the door, a barricade. You scan the room, soiled clothes, half eaten food. Despite the presence of an adjoining restroom, there is excrement in a bucket in the corner. A pneumatic chamber on the northern wall would have been delivering consumables to the occupant. The trail terminates in the corner of the room, forming a sick puddle. You spot three pharmacy bottles. Further inspection reveals them to be various opioids. They're all empty. There's a desk with a computer atop it. Approaching the terminal, you can clearly see the blinking light of the power button. You take a seat. You turn it on. You take a seat. Turn it on. Alright, we got a pretty good speed there. Oh, hey, Samma. This is Samma Says. Samma is one of the girls in the lock proposal and does like all the recordings for us. So, Samma is a Site 42 celebrity cast member. Hi. Glad you could join us today. And yes, Samma. One thing I've gotten good at is taking as little takes as I can and just being really careful with my words. It comes from doing over a hundred of these now. Oh, that was a good run. I just did a solid two and a half minutes nonstop. High five team. Yes. Okay, so we got through the first round of pros. Now it's time to do some computer voice. So, here we go. Oh, no, God. We've got to alternate between computer pro, computer voice and pros. We got to go back and forth. Oh, man, challenge mode engage. Let's do it. Two and a half minutes and no drats. A personal best. I think so. No drats whatsoever. Okay. So we're here. And round two. Emergency protocol activated. Clearance level safeguards removed. Full access granted. Secure. Contain. Protect. Loading. Loading. Loading. Loading. Loading. Loading. You hear footsteps. There's a drat. I didn't change voices. Arg. Arg. Continuing on. You hear footsteps just outside the door. Every first step comes down heavy. The second drags behind it. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. Loading. as the screen comes to life. Opening file. Automated secure system notification code 235. Just in time for a draft, Samma. Just in time. So, okay, in my research, I did not look this up and I have a problem. What does ASSN stand for? Because I have, oh, that's why I didn't look it up because I'm dumb. It's Automated Secure System Notification Code 235. ASSN 235. It's literally right there. Automated Secure System Notification Code. Ah!   Guess what movie that's from? Nobody saw that movie because it came out at the same time as the original Batman movie. So where was I? Automated Secure System Notification Code 235. Waiting 30 seconds to see if anyone else recognizes that quote. Stupid!  Code 235. Nope, it is not Kindergarten Cop. Although, you know, it might've, I've actually not, I haven't seen that movie in forever. The movie I'm quoting is, oh, hi mahogany donut. I don't recognize your username. Welcome to the chat. The movie I'm quoting is UHF, which is the weird Al Jankovich movie.   Later on during the Wheel of Fish sketch, it's the same thing when they trade for the wrong fish. Oh man, see? Now I wanna look it up and link it to you guys. I don't know if I can put links in a chat.  There we go, perfect! Copy link address. And can I drop that here? Can I drop that here? I'm gonna give you all something to look at. Maybe, go! Nope, can't post links.  It's the first thing that comes up. And the second and the third thing. It's all things. It's everything. It's all things. Okay, so continuing on with Automated Secure System Notification Code 235. ASSN-235. There has been an error in retrieving the current iteration of the SCP-001 file. You are currently viewing revision number three. Newer revisions can be accessed at the bottom of this page. Curses, I just thought of a really good idea for how to say that as a computer while I was saying it, so now I have to do it again. Girat, here we go. Making it better though. Not a mistake, an improvement. ASSN-235. There has been an error in retrieving the current iteration of the SCP-001 file. You are currently viewing revision number three. Newer revisions can be accessed at the bottom of this page. It's not a tumor. Someone wondered if it maybe it was a tumor. It's not a tumor. That is what I was referring to, live stream people who have no idea what the chat says. No, don't delete everything Sherman, you need everything. Okay, okay, we're back. And access file, SCP- Ooh, voice crack, bring it back. Take that and rewind back. Access file, SCP-001, revision number three slash 12. Audio file, access granted. Revision three dash 12, updated, 1,000, 3,000, and 12 days ago. And at that point, the girls come in. So I'm not going to do that yet. Instead, what I'm going to do is yell really loudly. That way, I think I saw the hide from me one. Yeah, super creepy. I'm going to, I haven't decided if I'm going to make that, what's the phrase I'm looking for? I haven't decided if I'm still gonna do the access granted or if I'm gonna change the access granted to your hide from me. That way it creeps out of nowhere like the computer's doing awful things. Because the computer's doing awful things. Okay, so audio file. And that's what I got, right? Computer typing sounds fit in there. Access granted, three dash 12, updated, 1,000, 3,000, and 12, and 1,000. Revision three dash 12, updated, 1,000, 3,000, and 12 days ago. It's not dash 12, it's slash 12. Access.  Three slash 12. Continuity, continuity. Revision three dash 12, updated, 1,000, 3,000. Revision three slash 12, updated, 1,000, 312 days ago. There we go. Did that just auto correct in real life to realize? I don't know, did it? Where did it do that? I am confused, I have missed this reference. Where is, any who? All right, so you guys recorded all of this, all of this, all of this. This is me, administrator. I'm gonna have to voice change this to make it creepy. O5. Oh wait, this isn't an O5, this is the administrator. Ooh, I have never voiced the administrator before. I have voiced the O5s, and I do them with voice changing technology, and I make it down and low and garbled. But I've never done the administrator. Oh, interesting. What voice does the administrator have? I wonder, I wonder. Gonna adjust my chair a little bit. There we go, that feels nicer. Cool, okay. There aren't any O5s in this one, so I think I'm just gonna treat them like the administrator and do a voice changer on him. To those of you with families, or God forbid, children, I'm deeply, deeply sorry. You must push on. Do not let their deaths be in vain. We do still have time. Humanity, wait. Man, man, man, man, man, man, man, man, man, man, man, man, man, man, man, man, man, man, man, man, man, man. To those of you with families, or God forbid, children, I'm deeply, deeply sorry. You must push on. Do not let their deaths be in vain. We do still have time. Humanity may still have a future. Come to site 19. We need all the hands we can get. Learn to embrace the darkness, friends. Fear the light, the administrator. Let me listen to that, how that sounds. To those of you with families, or God forbid, children, I'm deeply, deeply sorry. You must push on. Do not let their deaths be in vain. We do still have time. Humanity may still have a future. Come to site 19. We need all the hands we can get. Learn to embrace the darkness, friends. Fear the light, the administrator. Yeah, okay, I can go with that. I like how that turned out. So let's, we'll voice change him a little lower just so it's like because you hide the identities of the administrator in the O5s. Cool. All right, so now I've got a little computer error here. System error, data lost, EC172, contact system administrator. Nope, sysadmin. System error, data lost, EC172, contact sysadmin. Cool, cool. All right, a little bit of computer jargon, gotcha, feeling good. And moving on, moving on. Going on down, going on down. Not my problem, not my problem. Getting things done, going down. Red text, that's me. Open attached file, audio log, access granted. Okay, now we're gonna play a game called how often do I narrate versus how often can I solve it with sound effects instead? Cause sometimes some of these poses are narrations that you can hear and some of them are setting the tone that I ought to have them. So when it says a harsh static lashes out of the speakers when you open the file. So the static will come out. It disturbed the stillness of the room, catches you off guard and quickens your heart's pace. There's some handling noise as the recorder adjusts the microphone. A brief moment of silence passes and then. So I think the static will happen. I think I'll say that. A harsh static lashes out of the speakers when you open the file. It disturbs the stillness of the room, catches you off guard and quickens your heart's pace. There's some handling noise as a recorder. Drat! Try it again. I think I made a noise on the microphone too. A harsh static lashes out of the speakers when you open the file. It disturbed the stillness of the room, catches you off guard and quickens your heart's pace. There's some handling noise as the recorder adjusts their microphone. A brief moment of silence passes and then. There's a quiver in her voice that betrays her attempts at professionalism. She pauses, takes a deep breath and continues. Yeah, nothing like surprisingly loud static out of nowhere to terrify everybody, right? So she sighs. Obviously I'm just gonna let her sigh. So sighing is fair. We don't need she sighs. There's a quiver in her voice that betrays her attempts at professionalism. I like that one because it sets a mood. She stops again, mutters to herself incomprehensibly before you hear the unmistakable sound of a match strike. I think I'll say that one, but I'll leave. She exhales audibly out. I'll leave that to her. She stops again, mutters to herself incomprehensibly. She stops again, mutters to herself incomprehensibly before you hear the unmistakable sound of a match strike. She trails off for a moment before you hear the buzz of radio chatter. There's a clamor on the other end while the radio changes hands. A soft voice calls out, concerned. A creak, Logan shifts in her seat. There's a ruckus as Igata presumably attempts to snuff her cigarette. How does she say her name? Is it Igata? I think it's Igata. I just made that up right now, but I think that's what it sounds like to me. Thank you, Samma, for saving my hekeester. I'm gonna go back and record that in this big, nice blank spot that I left for myself for no reason, because I was puzzling over whether to include something or not. Here, Sherman, sit silently for 30 seconds, deep in thought. I'm doing just fine, Poopsie Kins. I want you to know that I love you bunches. Drap, there's no that. I was so close. Man, I'm doing just fine, Poopsie Kins. I want you to know I love you bunches. Lol, lol, presumably attempts to snuff her cigarette. Wait, she says her name earlier, right? I can just go back and look at that. This is Dr. Logan, Igata. Go into the other recording, the other recording, the other recording. I gotta move the camera, because it's in front of my dashboard, so I can't see all the way back to the beginning. Let's see what we got. Not that far, still got stuff to do. Did you hear me guess where it was correctly on the first try? What? What, how did I do that? I don't know, it's a Halloween miracle. I wasted my Halloween miracle, but it was still pretty cool. What are the odds out of a 25 minute recording that I would pick the exact moment that she said the line I needed her to say? Halloween miracle, booyah. Okay, anyways. Okay, Igata. I gotta what? I gotta pee. What? Crude, crude, crude. There's a ruckus as Igata presumably attempts to snuff her cigarette. Good, good, I rule, I did it, aha. Ari doesn't sound convinced. That is obviously you not sounding convinced. So that, I don't need to say that. You can practically hear Igata smiling as she jokes. I mean, I can hear you smiling in your voice, so that's fine. Ari responds with a feigned laugh, got it. Ari replies, duh. A moment of silence that a mat strike followed by an audible exhale. So exhale, exhale, exhale. Anyways. So mat strike, so that'll be sound. Pause, exhale.  I'm gonna say she waits a beat before ending transmission. I think that's a good idea.  Access file, SCP-001, revision number five slash 12. Incident report appended. Oh no, no, why? Why did I do this? I am dumb, now I have to go back and fix it. Drap. I've been saying three slash 12 and five slash 12.  It's obviously supposed to be revision number three of 12. Five of 12. Ah, why? Why? Sherman, think a little bit, think a little bit. Incident report slash 12. So let's mute that, we don't need that. I'm a larky. Revision number five of 12. Revision number five of 12. God, I am so smart. I am so smart. SMRT, I mean S-M-A-R-T. And gotta go back and find that three of 12 now. Good lordy. Going back a little farther. Humanity may still have a future. Nope, not far enough. Revision number three, newer revisions can be accessed at the bottom of this page. Access file, SCP-001, revision number three slash 12. Revision number three of 12. Revision number three of 12. Humanity may still have a future. Nope, friggin, God, you got me, Panko, you got me. I am a cynical monster who does not believe humanity has hope. Access granted in three slash 12 updated. Mute all revision three of 12 updated. Cool. Okay, thankfully I figured that out way sooner and I don't have to go back and fix all those things. All those things. So now we are incident report appended. Jesus, I'm only up to like section, I've only finished the first section of this and I've already got seven minutes of recording stuff. Oy, yai, yai. Okay, so we're gonna keep on rolling. That is revision three of 12, so now we're on to revision five of 12. Incident report appended. Incident report appended. By the way guys, I'm just warning you, this is probably gonna be a two-parter skip dictation life because I see so many things to record and I have to work eventually today. So I'll come back and do more recording of this later. So now access granted, access granted. Revision five of 12 updated, 1,200, two days ago. No changes submitted, information collapsed. No changes submitted, information collapsed. Open attached file, incident report 001.1. Access granted, access file, SCP-001 revision, eight of 12. Nope, I didn't have a space in that before. Drat, access file. Man, I like that section, I didn't have to do anything. That was amazing. Okay, continuing on. Access file, SCP-001 revision, number eight of 12. One attachment, access granted. Revision eight of 12 updated, 1,200 days ago. No changes submitted, information collapsed. No changes submitted, information collapsed. Open attached file, video file. Access granted, you see her for the first time. Dr. Agata is seated where you are right now.    That'll be a, that'll be the thousand subscriber bonus is a speed run session marathon where we go for like several hours and do, okay, so I'm gonna finish my statement which is speed running as many skips as we can in a certain amount of time recording and then I'll just edit them all later. But that'd be cool, like speed running skip readings. Also, Samma, ah, thank you. Thank you for finding my mistake where I was not paying attention.  Okay, so 1,200 is not 1,200. Ah, why Sherman, why? At least it was very close. At least it was very close. Access P001 revision number attachments. Nope, that's not the right section. Backing up, backing up, backing up, backing up. So I can find where I messed it up. Days ago, no changes submitted, lapsed, gained inst, open attached file, incident report 001.1, access granted. Access file, SCP001 revision number 8 of 12, one attachment. Access granted, revision 8 of 12 updated, 1200 days ago. Well, that was very close there. Thanks, thanks, thanks for that. All right, go to the end, make sure I'm not cutting anything by getting rid of this. Nope, I don't need to get rid of this. Mute, 1,200 days ago. Awesome. Thank you, Samma. Three days ago. Good work, Lieutenant. Good work. Don't forget to crash the ship. Okay, you see her for the first time.   She draws a shuddering breath, parts her lips as if to speak and stops herself.  After a minute, she manages to choke out. She reaches into her breast pocket and withdraws a finger. The glint of a wedding ring is visible above the severed portion. She holds it close in cupped hands and runs a thumb across the glimmering band. She sits like this for an eternity, whispering apology after apology, begging forgiveness, lost in the moment. She looks up after some time. There's a look of realization when she realized she's still recording. Nope, that's not the line. That's not the line. You are not cool yet. Make better art up after some time. She looks up after some time. There's a look of realization when she sees she's still recording. There's a look of realization when she sees she's still recording. I have to say that so hard that, there's a look of realization when she sees she's still recording before she places the digit back into her pocket. Man, that's a semi-colon. Drat, drat. Cool, okay, do it again. There's a look of realization. What, why did I do that? No. There's a look of realization when she sees she's still recording before she places the digit back in her pocket. She leans forward as if to turn off the camera when a radio crackles to life. It broadcasts white noise for a few seconds and then a voice that sets you on edge. It's Ari, almost. Her voice has taken on the disgusting, gurgling tone characteristic of the affected. Logan's jaw drops.  It speaks out again. Logan rummages behind. That's the sound you make when you try and say behind, but then it's actually the word is beneath. Yes, less back problems, it's right here. And the next goal is to get a swiveling chair so that I don't cripple myself anymore. Ah, back, stretches, stretching it out. Rawr, nine and a half minutes of recording. It speaks out again. Logan rummages beneath the desk for a moment and produces a handheld radio. Her hands are shaking. The thing implores her. It's inhuman speech curdles your stomach. Logan is in tears, her finger hovering just above the call button. The Ari thing draws a deep, wet breath and speaks. Logan withdraws a cigarette with her free hand followed by a pack of matches. Her shaking thwarts the first two attempts to light it. She swears silently. Third time's the charm and she inhales a quarter of it in a single drag. The Ari thing continues. Logan begins rocking back and forth. Logan hurls the radio across the room. It smashes somewhere off camera. It's still somewhat operational. You can still hear the things singing.  A few, a dozen, then more. They continue singing until the radio mercifully dies.  The video films the empty seat for several minutes before she returns to end the feed. All right, so I've recorded that and then I've recorded that but I know that Samma has the crazy freaking stacks of singing. So I'm gonna figure out exactly what fits better when it comes to that narration because we're gonna have like creepy voices singing and it's really disturbing. Bluh. So we'll go, we'll figure out how to cut that. Ooh, okay, full prose section.  I don't like that. I have to do more work. What am I talking about? All right, I'm up to 11 minutes of recording though so I'm no slouch, I still got stuff. Okay, here we go. That's what you get, that's what you get. No, Pinko, don't activate the cootie zone. The SCP fandom is like 10% girls maximum. We need as many as we can get. Something isn't right.  You're being watched. You defensively dart your eyes about though they take a second to adjust to the darkness beyond the monitor. The emergency light sweeps across the room stretching and twisting the shadows beyond recognition. That's when you spot it. There, in the corner, coming out of the puddle. Time slows to a halt.  Something inhuman. The head comes next rising from the muck. Madded hair conceals its face plastered over it by the mystery fluid. It turns in your direction. It stares at you from the corner which once again falls into darkness. The emergency light continues its journey across the room. It washes over the puddle again revealing nothing out of the ordinary. And by the way, when I mentioned demographically that the fandom is like 10% girls, that's only the viewership for my channel. So I don't know the actual SCP demographics. That was mainly a joke based on the fact that girls don't like my channel. All forever alone, oh no. Anywho, clarification of jokes.  Don't even know how I was a douchebag. Probably a douchebag.  Okay. Was that 106? Or was that like a hallucination to 106? Not sure. Access file, SCP-001 revision number 9 of 12, one attachment. Access granted. Revision 9 of 12 updated 986 days ago. No changes submitted, information collapsed. Open attachment. Access granted. Dr. Igata appears on the monitor. She's lost weight. Her eyes are bloodshot and wide. On the table before her lay a knife, a bowl, and a stack of Manila envelopes filled with yellowing pages. Atop this stack is a bloodstained parchment. She grabs the knife, contemplates it for a moment. With this, she slices into the palm of her left hand and winces.   Cool, we got that. We got that. We got that. We got that. We got that. We got that. Okay, so formatting, weird thing. This actually does not have no changes submitted on the containment procedures, and it doesn't have it on the description. The attachment does not say video file like the last video file did. I wonder if that's a formatting error that could be fixed, like a typo in the article. Either way, in my recording, I'm probably gonna fix it so that the video file is there the same way it was above. That way it's, because I think it's just omitted because now you're assuming it's a video file, but I think it should still be there. It's a video file. But anyways, oh God, oh God. Oh, I got a YouTube update, the terrible writing advice channel just uploaded a survival horror video. That guy's hilarious. It's terrible writing advice. Go check out his channel. He's like a million times more popular than me and he does not mean me like pumping him, but he's amazing. Like, it's great. It's funny because it's sarcastic, but also you learn things about writing that makes your writing better. Go team. It's like, as a creative writing community, the SCP people can probably play with that and it's fun. All right, moving on. Oh God, this is the data error. Everything's horrible. Let's do this. Access file, SCP-001, revision number 17. Oh God. Okay, I gotta figure out how to say this now. 17. Because this is a data error. This is not good.  Everything is wonderful. We are free now, monster gross. Ah, rah, rah. 001. All right, revision number, revision number. Is there a shorter way to say exclamation point? Like a one word version. I feel like there's a thesaurus thing for that. Like exclamation point has another name that's a little more like technical and that name like means, like for some reason I have a word like superlative but that's not the word. It's not declarative.   I can do layers like Samma did and then it'll glitch in data error. So let's start with the general. Revision number, one, seven, exclamation point, two, four, data error. And I'll, blitz, blitz, blitz, blitz, blitz, glitchy sounds. And then I'll do the computer typing sounds because every time I've said access granted, it's been like data access blah, blah, blah, access granted, blah, blah, blah, blah, tap, tap, tap, access granted. So this is gonna be data error, tap, tap, tap. Hide from me. Oh, it's gonna be gross. It's gonna be gross. Gross, gross, gross, gross. All right, let's leave that on a separate layer. That way I don't misplace it. So now, revision number 4,847 out of this. I don't know why I did that. That's not what I wanted to do. I just wanted to say the word error. All right, continuing on, continuing on, continuing on. Ah, this is so gross. This is so gross. You guys are gross.  So, moving on. There's a video file attached. There's a video file attached. Opening it, you see that it presents the room you're in. The feed seems to be coming from one of the security cameras up in the corner of the room. It's dark, but you can just make out Dr. Igata laying on a pile of laundry along the far wall. She's writhing in her sleep. She seems tormented, hurt. She's tossing and turning and mumbling nonsense words. The camera shakes. It lifts upwards for a moment before it focuses on her again. It starts moving closer, slowly. The speakers come to life, picking up an airy, breathy static. As the camera moves closer to the doctor, it becomes clearer, crisper. It's not merely white noise, but dozens, hundreds of voices whispering unintelligibly over each other. You lean in, press your ear almost against the speaker, trying to discern what it is that's being said. Something strange stands out amidst the discordance. You're not quite sure what to make of it, though. Looking back at the monitor, the camera has come to a halt inches away from the sleeping doctor. The voices stop. There is no sound. A hand, black and oily and skeletal, reaches out for her, brushes away a lock of hair. Her eyes shoot open. She recoils in shock. The feed cuts out. I see you take a breath. Woo! All right, that was a good hit. That was a good run. We did good there, kids. Tackin' it on, tackin' tackin' it on. We're up to 15 minutes of recording. Access SCP-001, revision number 12 of 12, one attachment. Access granted. File recovered from previous revision. Information collapsed. File recovered from previous revision. Information collapsed. Open attachment. Access granted. Dr. Agata, ba, ba, ba, ba, ba, ba, ba, ba, ba. That's all right. I didn't want to say words. Words are for suckers. Who uses words? Suckers, that's who. Dr. Agata appears before you on the screen, looking even worse for wear than she did previously. Her hair is thinning. I heard a gross sound. Put that back. But then she did before. Even worse for wear than she did before. Than she did previously. Her hair is thinning, with large swaps appearing absent from the middle of her head. If they weren't reflecting the soft glow of the monitor, you would have assumed she no longer had eyes for how deep they'd recessed into her skull. She stares ahead, unblinking. Her lips crack into a broken grin. She lets out a weak laugh and displays her trembling hands. What appears to be the mostly skeletal remains of a finger is embedded into the flesh of her left hand in the stump that would have supported her natural ring finger. In the stump that would have su- Muuh! In the stump, flesh of her left hand, of her left hand. In the stump that would have supported her natural ring finger. Two wedding bands, loosely encircled the digit. Drat, there's no space there. Why would I? Two wedding bands, son of a bee. Make better art. Two wedding bands, loosely encircled the digit, laying atop one another. Something catches her attention off-screen. She cocks her head, listening. She begins rubbing her temples, repeating herself over and over again. A minute passes. She snaps her head back up and addresses the camera. She brandishes a handgun. She opens the desk drawer and... I don't like how I said the word drawer. She opens the desk drawer. She opens the desk drawer and deposits the firearm. She raises her gaze, stares into the camera. She reaches forward and ends the recording. That's horrible. Did it have to end like that? You open the drawer and pull out the gun. You absentmindedly turn it over in your hands for a moment, wondering where you'll go from here. Site 17, 64? Surely you can't be all that's left. The computer dings. There's been an update to the file. Access SCP-001. Current iteration updated one minute ago. Access granted. Without your prompting, the page begins playing a video file. You freeze when the image loads. It's a live feed looking down on you from behind, about a foot away. A skeletal, inky left hand enters the frame, approaching you at a snail's pace. It's missing its ring finger.  Not turn, without a second thought. You turned in fire, turn and fire, not turned and fire. It's not past tense, Sherman. It's not past tense. Missing its ring finger. It's missing its ring finger.   Your bullet meets an empty wall. There's nothing there. A second passes before you hear it. Before you hear them. Sloshing, wet thuds coming down the corridor, accompanied by a chorus of screams. It slams into the door. Could there be a place to hide? It strikes a second time. What appears to be a face, part human, part something, dribbles in under the frame. Bits of flesh from God knows what oozes in through the sides and reconstitutes into fingers, eyes, feathers. A third, now it's pressing up against the wood, causing it to sag inwards. With a groan and a crash, the wood splinters. The door explodes open. Hands and arms stretch out of the mass, pulling you up, passing you from one to the next, on and on down the line. They drag you past the empty containment units, upwards and through the stairwell, through the halls and towards the tunnel. You're afforded a few precious moments in the darkness. And at the end of the tunnel, there's light. Holy cow, I didn't know we were gonna make it, but we made it. Woo, we made it to the end. We recorded all the man voices. And it only took a little over an hour. That's fantastic. Okay, we did it. That's amazing. Yes. Hello, Togam Septics. You joined in the conversation at the very last minute. So, welcome and glad you made it for this section. We just finished the man's part, the men's parts and the computer parts, or I guess the narration. It doesn't have to be a man part. It's a man part because I'm doing it, but it's the man part because I'm doing it. So we got the man part. We got the man part of SCP-001, SDLock's proposal, When Day Breaks. This has a lot of titles. And in 63 minutes, we recorded 19 minutes of stuff, which we're gonna blend with the 24 minutes of stuff that Sam and Courtney put together, meaning we have somewhere around 45 minutes for this show. And to be honest, one day, so right now, amazingly, Site 42 has like what, 500 something subscribers? Let me get that number real quick. Pull up my YouTube studio since I'm done recording. I'm done recording. Oh God, save it. Save it now, save as. Don't forget, 001, boy. So now I have 001 girls and 001 boy. So right now, Site 42 is sitting at 516 subscribers. And the audio recordings are going well. The video essays are going well, or I guess the podcast essays on a video platform. Eh, but this one, this one would make a riveting freaking movie. This would be a riveting episode of television. And I want to get my boys together out here in California. And I need two actresses, and I need Kronenberg-esque goo monsters. And I need whatever that inky black thing is. But really, this would be amazing as a film. This would be so cool. You have the protagonist in their full-like garb, so you don't need to see who they are the entire time, because that's you in your brain. I mean, yeah, they'd have a protagonist unless we did it like first person, and I don't really want to go first person. But like the logs, you'd have video logs of Agata, and you'd have her on the radio with Ari, and it would be gross and terrifying, and you'd see her descent into madness, and you'd see it. This is doable. It's just that I need way more of an actual budget for this channel to make something crazy like that. I have the plans, I need the means. So final mission statement. We're doing this audio recording. Get us to frickin' hundreds of thousands of subscribers, like Jim O'Don and Tats have, and we'll start making live-action movies of this. And it'll be amazing. Live-action SCPs, what? So build up the channel. We need to sell merch and get Patreon donors, and we will make this happen. So support the channel, do all those things. Help us make awesome SCP content things. We're gonna make all the things. It's gonna be amazing. It's gonna be huge, whatever. On that, check out the links below for Merch Store, Patreon, and blah blah blah Discord server. That way you can hang out more with Site 42 people. Thank you guys for tuning in, especially those of you who made it the entire time.  I'm gonna save this, and I'll probably start editing it later today after my first shift at work, because this is going to be amazing. So you guys, have a good afternoon, evening, wherever you are. See you next time, Foundation staff. Camera's got a giant hand. Giant hand.