Okay, thank you everyone for joining today. Today we're very excited to have Jonas Buckley and Federico Felici with us to talk about magnetic control of tokamak plasmas through deep reinforcement learning, where they replaced separate controllers with a single policy using reinforcement learning that is able to control a diverse set of plasma configurations. So a little bit about our speakers today. Jonas is a senior research scientist at DeepMind and he has been working at the intersection of machine learning and control for most of his career, as well as a wide range of interdisciplinary topics. And Federico is a research scientist at the Swiss Plasma Center at EPFL, where he leads the research activities in advanced plasma control and future fusion devices. So I'm very excited about today's topic. We will have questions and discussions at the end of the talk. So without further ado, let's start a seminar. Thank you very much for the introduction. It's my great great pleasure to to give the first part of this talk and my colleague Jonas Buckley will take the second part. First of all, let me say that it's really a pleasure to give this talk on behalf of this big team consisting of people both from EPFL Swiss Plasma Center, which is where I work, which is a center for research on plasma physics for fusion in particular. And the DeepMind team where all of the experience and the expertise with the machine learning, reinforcement learning in particular came from. So without further ado, let's begin the story. So first of all, introducing you to what is nuclear fusion and what are we trying to do and what are thought documents. Now, if I'll give a very brief introduction because of course covering the topic exhaustively would take much more time than we have today. But basically the idea is that we are trying to achieve the nuclear fusion on earth with the goal of in the renewable to use for electricity production. And the problem with nuclear fusion is that while it has many advantages from the energy generation point of view, it's quite complicated to achieve on earth because you need a high temperature, a high density, and a long confinement time. And these kind of temperatures, in particular, the, the, the matter you're trying to fuse is in the so called plasma state which means that the ions and the electrons are dissociated and they're flying around around freely and forming this complicated material which we call plasma which behaves in very complicated ways but can also be influenced by electromagnetic fields. So the idea of magnetic confinement fusion is to use magnetic fields to confine this hot high temperature plasma and keep it far away from the walls of your fusion of your fusion reactor that you were trying to make on earth from which you're trying to generate electricity in India. So typically we're talking about temperatures of more than 100 million Kelvin, relatively low densities compared to for example atmospheric densities of typically 10 to the power 20 particles per meter cube. And we're talking about confinement time so the amount of time that you keep these the heat and the inside the heat and the particles confined inside the plasma of the order of one second. So in a particular way to do magnetic control, there are many different ways of achieving this one particular way is a so called Tokamak configuration which is when the magnetic fields are arranged in an axisymmetric or in a toroidal shape, which look kind of like, like this so this is an example of a picture from the actually the biggest existing operating Tokamak which is in in Oxford pretty close to where you are as a European. Tokamak where you see here an example of on the left, what the inside of the Tokamak looks like when they are not making plasma and on the right you see what the actual plasma itself looks like and it's interesting to see that the actual core of the plasma which is the hot part which is around 100 million degrees. You cannot actually see because it's so hot is not emitting any lights in the visible radiation space spectrum. That was one example of a Tokamak there's also a Tokamak, a smaller Tokamak at the call TCV at the Swiss Plasma Center at the campus of EPFL in in Swiss Switzerland. We see some pictures of it here and if you look then at what the Tokamak looks like actually on the inside. When you're when we're doing our plasma experiment it looks like this so you can see this beautiful plasma with these beautiful purple colors here. Now looking again from the outside of the Tokamak it looks like this you see there's a lot of sorts of equipment also around it to take complicated measurements of the plasma or also to try to heat the plasma to increase the temperature but if we remove all of that and we focus on the magnetic coils used to generate the magnetic fields to confine the plasma and we have something like this we can see a combination of magnetic field coils. And if we remove the external coils and we look a bit in more detail of how the the the whole magnetic field structure looks, you can see that on the inside you have a representation of the actual plasma. And that's surrounded by this gray part which is the so called vacuum vessel, which, yeah, which is used to remove, you know, to keep have a vacuum within which the plasma can then be created to separate it from the outside atmosphere. Then around that are these red coils which are the so called poloidal field coils which are used for actual control of the where we want the where we want our black plasma to be. And then these outside bigger coils which are shown in the yellow are the so called toroidal the field coils and I'll explain in a minute what how all these magnetic fields interacting how they are used to generate the magnetic field that confines the plasma. So let's look in a bit more detail at this magnetic field structure. So to have a successful confinement of this of this very hot plasma, meaning confining minute keeping it away from the, from the outside wall of the reactor, you basically need a superposition of two kinds of magnetic fields. So I'm showing in this picture how these are generated the first one is generated by this big coil this yellow coil called the toroidal field coil. It's called that life because the current goes around like this which means that a toroidal magnetic field is generated going around the plasma in this toroidal direction. Unfortunately, that's not sufficient to actually confine the particles of the plasma but to have sufficient confinement, you need actually also to have a field in this direction which you call the poloidal direction. And that's actually generated by an electrical current running inside the plasma. So the combination of the current in the external coil which makes the field like that in the toroidal direction and the toroidal current in the plasma which makes the field in the poloidal direction make this kind of helical magnetic field lines which are successfully able to find the plasma and keep it at high temperature for some reasonable confinement time. Now, once you have have this this by itself is not enough you also need the external coils which I was showing earlier the so called control coils to make sure that the plasma is maintained in the position that you actually want. I'm just going to show you in a bit more detail here here's now again the talk about what now showing only these poloidal field coil so the coil that are used for the plasma control. And the in this case we're showing again the TCB talk about that we have at EPFL in Switzerland where there are many of such control coils, and they allow quite a lot of flexibility in how to actually position and control our talk about plasma. The reason we're interested in actually controlling the position and the and the shape shape is that this position and shape of the plasma has a very important effect on the quality of the confinement so the kind of temperatures you can reach in the kind of pressures you can reach. And this is very important, because the higher the temperature and the higher the pressure the more fusion reactions we're going to have. I'm going to clarify at this point that in the TCV. The TCV talk about is a reactor which we use for research. So we don't generate significant amount of fusion reactions and we're using it mostly to study and to understand how the plasma behaves under influence of magnetic fields and various heating systems. And there are other topics which do attempt to generate fusion energy. For example, the jet tokamak I was showing earlier in Oxford, quite recently you might have heard established the world fusion energy record, breaking the record of how much energy was actually generated in terms of fusion reactions during one, one single experiment. And this research, again, is going towards the producing electricity in the in the future so all these tokamaks are a stepping stone towards larger and more performant reactors which we will build in which we are building now which will operate in the future, which will push us more towards a regime where more fusion energy is being created by the fusion reaction with respect to the power you have to put in to drive the magnetic fields and to heat the actual plasma. Coming back to a bit more of the details of how this plasma shape actually looks and what we're trying to control. There's a number of things which we care about controlling again using the magnetic field coils which are on the outside you can influence in detail how the plasma looks as it is inside the vacuum vacuum vessel. So we care about the actual position in this case the position represented by the center of the plasma is here, but we might want to move it up or down for whatever reason to study the plasma in different, different ways. Another important aspect we might want to control is the location of the so called last close flux surface which is this black surface going around here which is kind of the surface which defines the boundary between the part which is hot and confined and the part on the outside where some of the plasma that escapes interacts with the wall material for example. And we also want to control how this looks in particular we're often interested in controlling how this location of the so called export point so you see this point here, this is a point of so called magnetic null. And this means that the field in the portal idol direction here is equal to zero and there's purely a field in the total idol direction. And it can be influenced by our polo idol field schools are control coils over here, these carry an electrical current, and they basically control where this plasma is and what kind of shape this last close flux surface is going to have and where these stress right points are going to be strike points are also important because they are the location where in the end the plasma that exits from from the last close flux surface, kind of follow these magnetic field lines and can end up over here and with the material of the wall. Now, to be able to get the plasma that we're looking for as we desire we need to actually control the currents in these polo idol field codes in these control coils in the real time. This is typically done by a controller by a feedback controller actually using a combination of feet forward and feedback control that I'll explain later in more in more detail. So for now let's just realize that this means taking on the order of 100 magnetic measurements so measuring 100 taking 100 measurements of magnetic fields and of magnetic fluxes and other quantities which we need, sending it to a controller, which typically in the case of DCV operates at 10 kilohertz so 10,000 times per second. In this sense, 19 commands to the 19 control coils in terms of the voltages that the power supplies are supposed to apply to these coils to influence their current and to steer the plasma ultimately where we want. Now let's just think a bit more in detail about what we need to control so there's a number of key parameters we need to control. The first one being just simply the total value of the of the toroidal plasma current. If you remember a part of the magnetic field the polo magnetic field was generated by the by this black plasma current and this has to be induced through these control through these control coils by a transformer effects. The other things you want to control are in particular the radial and the vertical position so where the plasma is in our vacuum vessel and these three total plasma current the radial and the vertical position together are the basic things which you need to control in every document just to be able to have a well controlled plasma you need to control these three. And then as I mentioned you might want me might be interested in controlling the actual plasma shape in the distribution of the last close flux surface and where it is. There's a further complication in terms of the vertical position control in particular is that actually most of the plasmas we're interested in are actually unstable in the vertical direction. This means usually you want to study plasmas for various reasons that I can discuss today but for various reasons, we want to control plasmas which have a so called positive. We have an elongation so called higher than one which means that they're higher in this direction than they are wide in the radial direction and like the one I'm showing here. And for these plasmas it turns out that they're unstable in their position meaning that if you only control the electrical currents in the control coils and don't look at what the plasma is doing. The plasmas will actually be unstable and will go like in this illustration here will fly up into the wall and interact with the wall, which means the plasma will cool down and loses energy and we're not going to have any fusion reactions anymore. So this is of course what we want to avoid which is why we need to actually feedback control the vertical position to suppress this instability in the first place while at the same time taking care of all these other control problems as well. So now I'll spend a few minutes describing how these kind of control problems are solved using traditional engineering techniques. So, since all talk max need this kind of control there's been a lot of efforts in the past to achieve magnetic control of talk max using existing control engineering technique and typically what we do is we saw solve a set of equations describing the evolution of our system and we use that to pre compute the coil currents that we want to have in the control coils and compute the voltages that we need to apply to these coils to these coils to achieve the coil currents that we want. This takes care of the feedforward part so the preparation of how we're going to make plasma during a given plasma experiment. And then as I said it's not enough because you also need to control the system in feedback for the suppressing the vertical instability, but also just to make sure that any, any, any, any small mistakes you might have made in the feedforward calculations, because the model you use for that is not is often not 100% perfect, you need to compensate for these using feedback control. And then there is a process of designing observers and controllers so observers meaning you need to somehow from the magnetic measurements that you have. Find out what is the, what are the quantities you what is the value of the quantities you want to control so what is the radio position the vertical position and the plasma current. This is a relatively complicated nonlinear partial differential equation in real time to find out what the plasma shape actually is so what the distribution is of the plasma where the last close flux surface is. So then you have the observers you have actual an estimate of the quantities you want to control. And then you need to actually design controllers to control each of these now the first step of that is to choose a combination of colloidal field coils or combination of the control coil these close labeled ABC, the E and F a combination of these coils, like a few coils here and a few close there to control a given quantity that you that you want to control. And then, once you've chosen that the actuators you want to use, you design individual independent, usually single input single output controllers for each of these quantities to design one controller for the radio position another for the vertical position, another for the plasma current and another for the plasma shape, and you need to be careful to make sure that there's no interaction or minimize the interaction between all of all of these. So I should say this approach has been has been successful in the sense that many talk about worldwide operate using controllers designed more or less along the lines that I have described here, and they're relatively successful in that we can make all sorts of varieties of different, different shapes and run talk about experiments to study and understand the behavior of the black plasmas under the influence of magnetic field but also other things like how we do plasma and how we fuel the, the, the, how we fuel the black black black plasma and do all sorts of details studies to understand how talk about work and how plasma confinement in talk about work. But still, I hope I've convinced you that these controllers, though they are effective. They're also quite complicated to tune because of the number of kind of manual decisions are partly manual decisions that the control engineer has to take to this design so this really requires a lot of control engineering expertise and a lot of understanding of how the different control actuators affect how the plasma actually actually be actually behaves and it is the job of the talk about control engineers to do this, and depending on what kind of shapes you're trying to control or how well you want to control the form. These can be a relatively complicated job job. What we wanted to do in the work that we're describing that we are describing today is to try a completely different approach of controlling talk, controlling plasmas in a talk about using the magnetic fields. So the idea is that we want to try to substitute entirely the conventional control which as I described has all these different components by a completely different architecture, where we substitute all these components by just one single control policy and we try to generate the entire control policy in one one go so without designing the separate controllers try to solve the problem at the same time of controlling all of these quantities. And at that point we will be able to specify directly the kind of targets that we want so what how we want our plasma to behave and how we want our plasma to look. So we will be able to obtain one single control policy, which does everything that we want without having to design the components, says, separately without having to do a separate feed forward generation, and without having to do a separate estimation prior step of estimating the, the, the errors in the variables that we want to control trying to do everything at the same time. So we will move it over to Jonas Buckley will explain how we solve this problem using reinforcement. Great. Thanks for the recalls yeah. So let's look a little bit how what reinforcement learning is and how it helped us basically achieving this goal that Federico has set out so throughout basically probably have heard about various forms of machine learning, there is this is very different flavors one is supervised learning where sort of it's a, you solve a static mapping problem you predict an output from input given variables, or there's unsupervised learning, for example, a clustering algorithms where you tried to find havens from a data set. Now reinforcement learning is quite a bit different. It's, it has to do with dynamic systems and dynamics of decision making. And in a nutshell it's literally the formalization of trial and error learning so just a little quite a bit how humans would learn it actually has been inspired quite a bit from psychology. But it has a very strong mathematical underpinning. So you basically what you do right so you would sort of explore and gather experience and then learn from this experience how to do a certain tasks better, and we often sort of formalize this with this little action, you know, observation loop that you see down here where an agent interactive environment and there's a reward so we will talk more about that through the reminder of the talk. So, but maybe briefly so what are advantages of reinforcement learning. Why would you want to put up with like the complexity that is learning algorithms bring. First of all, it makes very few assumptions or you can learn to control non linear stochastic dynamical systems in principle, you can handle like heterogeneous and very large observation spaces are combining times here isn't images for example, on different timescales, you can have it very heterogeneous action spaces. And you sort of have like one way to tell the agent or the algorithm what you want to do that's this reward function and let's do one and the only way to define your control objective sort of what a good reward is and this allows for a large flexibility. However, it also means that in these reward functions you really have to define all the specifics that define a good solution and it turns out that this can be a little bit of a tricky thing so humans are not very good actually in transferring what they know is a good solution into this kind of like scholar value which is reward functions we will talk a little bit more about that. But many of you might have seen right in the last decade they were like very big successes of, of RL in machine learning so here at DeepMind to work on, you know, solving sort of like many different really really difficult board games like shogi and go and chess with single algorithms by now or the very complex online game of Starcraft, but then also in the real world right there's successes are here in the middle just one example from our friends at OpenAI where they sort of solved Rubik's Cube solving with a real robot but maybe let's just quickly look a little bit what is a big difference between games and the real world when it comes to like controlling and doing reinforcement learning. So in games you have discrete states and actions it might be a very large but it's always a finite choice of actions that you have typically it's actually fairly small even and you can have a very large and but it's always a finite state space and also very importantly the simulations which are the game engines are perfect they're a perfect representations of the physics of the thing you really care about. Whereas in real world problems in particular when it comes to things like plasma physics. That's not true right so the states and the actions of the system are. I mean, depending how you want to look at it but you could say they're infinite choice of actions there's an infinite state space. And no matter how you slice it it's going to be like even larger than on the left side and very importantly also the simulations will always be approximations to the reality and very crude ones on top of that right so basically I mean. There's a lot of physicists in the audience obviously and you know what what it takes right you slice away a lot of the complexity in order to basically come up with models of the world and that's what basically is the basics of simulations. Here's another tricky business with reinforcement learning so this is best illustrated with this little critter that learns to try to run over really difficult terrains and here you see basically. How many trials and what the sort of outcome is and this is just a sort of a 2D problem if you will with with you know a few degrees of freedom. After 200 trials had barely I mean it cannot even stand yet after 2000 trials, it, you know, sort of knows that maybe how to get forward but it doesn't get very far. After 6000 trials you start to see some sophisticated behavior but it's still it still doesn't get very far. And you have to get all the way to basically 15,000 trials before that critter really learned proficiently to get over that terrain. This just sort of highlights that reinforcement learning is very data how so you have to usually have a lot of data a lot of trials a lot of experience that you gather from your environment in order to find a good solutions. So let's look a little bit how these different components look like in this action environment look, but this then basically means what we have seen. So, what is an environment well the environment is sort of the standing for your world or control engineers will sometimes call it a plant. Very basically, you put the actions in, then you can observe what is going on you have some measurements, and there's also reward being generated somewhere. We can discuss if that should be exactly the environment or, but there is a there's an Oracle that based on what happens in the world gives you a reward attached to it. In our case, the environment is the TCV talk amongst so basically we're asked to represent there's 19 control actions. And we use 992 observations which are mostly magnetic observations of locks loops magnetic probes, and then also the call currents in the console coils. And we can compute that reward that we talk about. Now, this is not a directly useful environment to learn directly against for the reason that, well, first of all, it's an unstable system as Federico pointed out so. And, you know, you don't want to just start from ground zero and mess around with it and then, more importantly, I would say here on that specific talk among the discharges are short. So they're last about two seconds, and you only get like an experiment maximally about every 10 to 15 minutes, and it's a shared facility so there's actually a lot of people from around the world that want to use this facility. So reasonably you can only get a handful of experiments that that's just not enough I mean it's far away from that those 15,000, you know, thousands and hundreds of experiments that you typically would want to have. So the solution usually that you can use to for this is basically train your solution against the simulator. So you have a stand in. As we said before but again so these are models, and what we're using is the FG simulator which has been developed the DPFL. It's a free boundary grudge a front of solver and has is augmented with circuit equations for the conductors, but in addition we had to augment the and this basic plasma physics model a little bit more. So we had to add a little bit of a model for the power supplies that's mostly to do with the delays but a little bit also with offsets. And just as a take home message the simulated environment has to expose the relevant dynamics to the reinforcement learning algorithms for your control problem doesn't have to be perfect. But it has to sort of have the relevant dynamics and again as control engineers in the audience might understand, for example delays are an important one. If you forget about those solutions will not transfer so what happens if you miss an important element, your solutions will not transfer onto the real plant. So what do we, what we did we try to achieve so basically sort of in an increasing order of difficulties was a little bit like how we went those are the experimental schedules the first goal is basically just want to keep the plasma life, and you can sort of as Federico said right on the plasma is in stable so if you don't do it well sort of fear it goes vertically down, you lose it after like only like 24 milliseconds, and then, oops, that's one too much. If you're learn how to control you're on the right side, you can keep it alive for you know 550 milliseconds which was at the time the full control window we had but you see it sort of wobbling around a little bit so that's not, it's not exactly a beautiful solution So then the next step is basically tell the plasma, where should it be so stabilize basically the sort of the, you know, the center of the way that center is and you can teach that to the algorithm saying well, you know, don't worry so much about the shape just make sure that the plasma is in a certain shape of this, and then the reinforcement learning algorithm will actually find sort of like a really small round plasma which, as we have been told by our friends at the infusion right that this is a nice and stable solution so the algorithm sort of exploits the inherent stability. But this is sort of not the shape that you necessarily want right as Federico indicated there's other shapes you might want to have you want to have a bigger, even have a bigger volume that they have more energy in the plasma. And ultimately there's many other things so this is the figure that Federico wanted indicated before so you might want to care about any of these things and tell the algorithm via the reward functions, where should that flux boundary be where should sort of basically x points be should they be active or passive where should the legs be right because that's important for energy deposition and so on. And then you want to typically have this with some precision so in our work we sort of set ourselves a requirement of about two centimeters for shape parameters and IP to within five kilo amps which is a realistic quantity as we have been told. There can all be time varying quantities so we sort of tell over time where the different quantities should be. So what is the agent that is working against and is supposed to learn this so that's sort of the mirror to the environment so it's a thing that takes the observations and three word and produces actions that supposed to solve the task, and in particular to make it a bit more formal to want to find an optimal policy which basically in our case and typically reinforcement learning maximize a discounted or an expected discounted sum of future rewards, and sort of to drive that point in a little bit more in more detail. So you're you're getting your reward. And so you can compute something that's called the state action value function which is really the expectation of that that some that future some discounted some of your rewards, and it's a function of the state you're in and the action, and in a nutshell what it is it sort of tells you if I'm in a given state, and for all the actions I can take and then follow the actions of the given policy pie here, what would be the reward that I would get. And now that is, if you think about it in a case like the talk about with this like really large state space is a huge mathematical very complex mathematical functions or it's not something can just enumerate that's exactly where neural networks come in so we represent that with a neural network. For smaller problems you can sometimes get away with like sort of doing table based or even express approaches but that's totally out of the question for this physics problem that we're looking at. Then there's different flavors of RL and sort of two important ones are the value based methods so we're basically you literally sort of learn this Q functions by having a candidate like policy use that to gather experience and this is to improve learn the Q function sort of an iterative fashion, converge towards an optimal Q function and an optimal policy, and there is sort of like, you can reason through that this procedure should should converge so this is not totally just like guesswork. And then there's like another important family which you haven't used here policy based methods so where you don't basically try to approximate the Q function you directly work with the policies. And you roll them out and you sort of directly find the gradient for the policies or the parameters of that policy, and they can also be very useful depending on the circumstances. So what we used is a value based functions or more specifically an actor critic method. So where the critic learns the Q functions from the data that is generated by the actors with the environment and then the actor basically learns a policy by optimizing against that learned function I explicitly say here but again what it is like Q of state and action so now what the policy needs to do is in a given state, what is the action that they should take so that they get the maximum and do is if you can do this for any state then basically have an optimal policy. And, as I said before so the informal learning basically means that we're using sort of deep more or less deep neural networks for the Q functions and for the policy and other than that. It's very close to quantities that we also see an optimal control. Certainly the actor critic method has an advantage it allows for the asymmetry so the networks that are in the critic can be very big because they learn against the simulator in the data center. They don't have to run on the real plan however the policy has to run in hard real time at 10 kilohertz on the on the real plan and so basically with this message we can really basically have a very big critic and the small and very fast policy for inference. For the algorithm to train that we use MPO which is sort of a trust region based formulation of the actor critic method, which adds stability to the learning. It's a fairly data efficient method which is important, because you have to be able to deal with varying degrees of off policy mess. And basically this algorithm is very good at that and it's sort of battle tested for continuous actions state action spaces. And it's sort of indicated right discretizing physical systems like the talk amongst are are difficult. This is not usually this gives you a combinatorial explosion that's not usually what you want to do so you need the method that works with continuous state action spaces. So, when we learn we have what we what is called the learning loop so we have we create typically many many instances of the environment, which interact with a candidate policy. We store this, the outcome of this in a in a on a data server, then the learning algorithm can pull down, basically use this to improve the learner Q function fit the policy and then periodically gets deployed into the policies. The data service indicated here with the replay buffer, and then it just basically you iterate over this procedure. Once this is sufficiently converged, you take an instance of the control policy, and then we have basically deployment pipeline that generates from the TensorFlow graph, a hard real time capable binary that we can then hand over to the people that run the operations framework and run this in hard real time on the plant. Okay, so maybe just a quick word about the importance of the asymmetry asymmetry in the in the message right so we looked at this a little bit and it turns out that this is critical I mean you can even make a very big feed forward network. I think the recurrence actually helps us make sense right because it gives memory. I mean the process which the physics also has.  But for many problems you can get away with a bit less. They sort of an asymptotic, but it's also is very much dependent on the difficulty of the problem you're trying to solve. This is also I think not a finished exploration I think we are convinced that in the in the mid long term we can bring this down to much less actors actually to point where people can run this on a fairly beefy machine desktop machine and don't be the data center to run all of that. And we then transferred our simulation agents to the Tokamak so the deployment actually to our positive surprise mostly just worked. There was a number of small environment variations that we had to introduce to robustify a little bit, which had to do with the measurement and some of the plasma parameters we had to randomize a little bit and the power supply actually models, some of the elements turned out to be a little critical. Mostly the delays but a few other things as well like offsets. And then we basically iterated with our colleagues at SPC to improve over the reward function to improve the performance and then also did some simulator upgrades. Good. I hand back to Federico who will talk us through the results that we were able to achieve. Thank you. Thank you. Yes, so I'll show you some of the results beginning from the one you're seeing. You're seeing right here which is an example of one of the reinforcement learning control experiments that we did. This was one that we did to actually demonstrate all the difference, the ability of the reinforcement learning algorithms to do a number of different things from the platform control point of view. So you see as a function of time at the beginning of this experiment, the plasma was created in a certain position kind of high up in the vessel. And then it was moved actively down to a lower position and then this X point was created with the so-called legs as I explained earlier. And so we actually prescribed what we want the plasma to do with us showing with the little blue dots there. And then the controller was trained as Jonas explained and then deployed on the actual tokamak and what you're seeing here is not a simulation is actually a result of a feedback controlled experiment with the machine learning trained controller for the plasma acting on our TCV tokamak and controlling the feedback control, the feedback control coils. This is just one example and I'm showing it here in a little bit more detail so you see the time evolution from left to right at the beginning with this relatively small plasma and then the formation of the X points and then bring it back to the original position and you see at the bottom you see the actual time traces of the references that we prescribed as to what we wanted the plasma to do what we wanted the various parameters of the shape to do and then overlaid what what it actually did and we see the match here is pretty, pretty good. So that was not that was just one demonstration discharge and then we actually tried to use the same approach to create many different configurations so many different plasma shapes many different shapes of the last close flux surface. And one case with a relatively high elongation shown here, one case again with an X point and a high elongation this is a shape which is similar to the one which is planned for the future tokamak called eater, which is actually being being being also studied at TCV. And here is an example of a plasma with a slightly different shape which is so called negative triangularity so if you want with respect to this one. It's like a D shape was flipped in the opposite direction. These are also a topic of very active study for a number of reasons to assess their whether they're viable and interesting for future fusion reactors. Here's another example where instead of having one x point we have two x points, which is interesting from the point of view of how the plasma interacts with the surrounding material with the surrounding wall. When the plasma particles exit from the last close flux surface. So again, this was all trained using exactly the same reinforcement learning procedure, just by changing the details of the reward function so how we reward the various degrees of target shape. And yeah and then running the same reinforcement learning procedure interacting with the simulator environment, and then deploying it on to the actual talk. So all of these were actual experiments done on the TCV talk. And then we actually moved on to do something which we had never done on TCV before, which is to actually make and maintain two plasmas completely separately in the vacuum. This is interesting for a number of different reasons in particular we're interested at TCV and studying in detail what happens when these two plasmas are being slowly merged. In this case we managed for the first time to actually stabilize two completely separate plasmas in the vacuum vessel as you see in the camera image here as well. And what's interesting here is because these two currents, these two plasmas have currents which are going in the toroidal direction in the same direction the naturally tend to attract so it's naturally an unstable system for that reason as well. So in order to control the magnetic fields to actually keep these plasmas separated from each other, and the reinforcement learning trained agent was able to do this successfully not only to stabilize them but also to ramp up the current in both of these kind of dropped plasmas individually, and maintain both of them at the desired position as we showed. Now having shown these results and having demonstrated that this reinforcement learning approach works for magnetic control of Tokamak plasmas, we also took a step back and thought so what did we actually learn and what are the advantages and disadvantages of using a reinforcement learning based approach to control for magnetic control of plasmas with respect to the traditional control engineering techniques which we can classify as multi input multi output, the ID controller like the techniques. Now, as I said at the beginning, one, one issue with the traditional methods is that you have to have an explicit step before where you compute the estimators for the quantities that you want to actually control. With the reinforcement learning implementation, the whole problem of estimation of the control variables and the feedback controllers handled all in one step, all based on the single reward function that that simplifies that aspect. Also, in the traditional controllers you need. So, first of all, again, have these separate state estimators, some of them which, which are very complex like the equilibrium reconstruction, and you need to tune all of these control, the control looks independently. So it's quite a large number of control parameters you need to do typically in the order of about 10 to 20 parameters, which you need to tune for which you need to control engineering expertise to figure out which parameters to change when something doesn't behave the way you did. And again in the reinforcement learning solution you have the joint solution to the entire stabilization and control problem in one go. Now, again, for the traditional controllers you need the engineer control engineering expertise to design the controllers in the reinforcement learning implementation you still need a lot of domain, not knowledge, but the domain knowledge goes mostly into the generation of the simulator and of the environment in which the reinforcement learning agent is to be trained. And so that also requires a lot of expertise and a lot of work in the physical modeling in plasma physics and physics understanding of the system you want to control but once you have that you are done and you don't need a separate step of the control engineering oriented expertise. And as I mentioned again in the traditional controllers, you need to tune several different control control parameters having a kind of idea of which parameter changes which aspect of the control. In the reinforcement learning implementation you also have to be tuning but that's mostly on the side of the reward function engineering. You have to say in some way have to weigh the different things which go into the reward function for example weigh the accuracy of the x point position control versus the accuracy of the last close flux surface distribution control. So you also you need to tune things in both cases but you're tuning slightly different, different things. So there are some things which are, which, which I would say are still an advantage in the more traditional ways of doing control. One of them is indeed this very clear relation between the parameters and various aspects of the control performance is usually a clear relationship between changing one of the parameters in the controllers, and what effect this is expected to have on the actual closed loop dynamics of the control the system. And if something goes wrong and if the system is not behaving the way you expect you usually know what to change and what to do. Well with the reinforcement learning implementation what you get out of the enforcement learning procedure is just a kind of a black black box controller, which you cannot really change in an easy way. So indeed one of the future avenues of where we want to go with future studies is to also be able to have tunable controllers coming out of these kind of reinforcement learning approaches. Another issue, which we encountered in this particular implementation of the reinforcement learning control is that there is fundamentally no guarantee that any of the controlled variables will actually go to a zero steady state error. So for example whether the plasma position will exactly be what you ask it to be, you know within the measurement accuracy. And that's fundamentally because the, the, the agent which was trained was a feed forward only feed forward only a agent so in traditional controllers we have something called an integral effect when you have integral controllers, which is the control error. And therefore, you can show that when these controllers work the way they should some control variables actually go exactly to zero in steady state and that's quite a big advantage from the control performance point of view. And it's also something which would be very interesting to introduce in reinforcement learning approaches as well. So we need to the outlook of this of this work work. So I already mentioned a few ways in which the reinforcement learning control implementations can be improved based on the on the work we did so far. So again using recurrent policies introducing dynamics into the actor network to get zero steady state errors or other desirable dynamic control behavior. So you see the more parameters as I mentioned, we by which you can affect the behavior of your controller after the trade training phase. And also, as mentioned the policies or the agents that we the used in this work relied 100% on training on the simulator and it didn't use the feedback of experimental data to improve the models or improve the agents in any way and that's of course would also be very interesting to try to somehow combine this approach with improving the model by experimental data. Also a future step for using reinforcement learning in fusion science in particular is to try to use it to actually optimize plasma performance, meaning it ultimately fusion power by controlling other aspects and only the magnetic field for example now we only control the details of the magnetic field, but in general for you want to study plasma performance you also need to evolve or to have a model that evolves the temperature and the density of the core of the plasma, plasma, in and the physics models you need for that are quite a bit more complex and more complicated and contain different kinds of physics with respect to the magnetic control that we showed today. So there's a lot more work to be done there, both on the side of the physics understanding and of actual fundamental talk about plasma science and also on the computational side on the machine learning side to accelerate the models we could use for such studies using computational machine learning techniques. And finally one possible future application of this work would be to do so called co design, which means to simultaneously optimize the design of a future tokamak fusion reactor, while designing the controller and solving the controllability problem at the same time. To just repeat the conclusions and the main results of this work, we demonstrated for the first time the application of a reinforcement learning controller for closed loop magnetic control of a tokamak plasma where the controller was trained entirely in simulation and tested on a real device now both from the reinforcement learning point of view. This is a big step towards applying reinforcement learning techniques on real world control engineering problems. This is one of the most complex or probably the most complex application of reinforcement learning in a real world engineering problem so so far. And we one of the things we take away from this is that physics model model so all the physics understanding you need to make high quality models of your systems are required for this kind of approaches to be able to learn from simulations. More, more generally speaking this also points towards more good and interesting future applications of reinforcement learning, both for accelerating fusion science along the lines as I said earlier improving plasma performance and potentially design new devices. And those are applications to more complex real world systems engineering systems which you want to feedback control using these approaches, particularly, in particular where good models exist. This leads me to the end of our of our present state station and we want to stress again how such a collaboration has really been a multidisciplinary collaboration where we merged physics knowledge physics understanding and simulation abilities with machine learning and reinforcement in particular so not only was this a tight integration of these various technologies, those are required a very tight integration of the two teams to to be able to to achieve this this this this result and bring these two worlds together. So with that I thank you also on behalf of Jonas and if we, if you have any questions we will be happy to answer them. Cool, thank you so much for this very very interesting talk. So now we move on to the discussion. Part of our seminar, any questions from our audience please just a mute and ask or raise your hand.


Hi you guys, Lindsay here. Welcome back to my channel Inside the Hymn. So we all know good scissors and good rotary cutters are freaking expensive and I think they're that expensive because quality matters when it comes to cutting and also they know that inevitably we are gonna have to repair or replace those things and so it's like a constant cycle of buying things. At least that's what I my cynical side is coming out. Well there is a trick out there that's supposed to lengthen the life of your cutting tools. Whether that be your rotary blade so you don't have to replace it as often or your scissors so that you don't have to take them somewhere and pay someone to sharpen your scissors for you. So we're gonna be trying this trick out today and seeing how it works. It involves a material that we all have in our kitchens Kenfoil. So let's give this one a go and see how it works. Okay, so I'm sure everybody their brother has heard of this trick before but does it really work? So I have my rotary cutter here. The blade is like totally dead. Like not cutting anything at all. It's completely useless. The scissors are okay. I'm trying to see if y'all can hear how they sound. Pretty good. Let me see if I have some that are in worse shape. So the theory is that you're supposed to be able to run your blades through tin foil, heavy-duty tin foil, and it should sharpen them because it's like metal against metal, I guess. So we're gonna give it a go. Okay, so we just cut that. Now let's see. I mean, it's not a very large sample, but oh, actually, okay, it's still not cutting through but actually no, it did nothing. It did nothing. Let's try it again. Maybe it needs some more juice. All right, now let's try. Maybe try one layer. Okay, still nothing. Again, this guy was like completely dead though. So who knows if it was like too far gone. Nope, nothing's happening. Yeah, it's not cutting any of the threads at all. How about our scissors? We don't have much tin foil left. That actually sounds worse. Right? Doesn't that sound worse? Okay, this is going to be a trick, I'm sure. Okay, that sounds a little bit better. I'm trying to go the whole length of the blade too. I don't know, guys. I'm thinking, well, I don't think it sounds better. That's for sure. I don't know. I'm not totally sold. I think that finding a scissor sharpener, whether that be like a kitchen store or like, I know that there are some people that just do it on the side. Yeah, I think that's actually making it worse. Like, I feel resistance now. Let me clean it. Yeah, I don't know. My verdict is trick, not a treat. Womp, womp, what a bummer. I actually feel like using that tin foil made my scissors worse, which is definitely not good and not the point. It also did nothing for my rotary blade at all either.  And as frustrating as it is, I'm going to continue to repurchase my rotary blades, just wait for them to be on sale. And I've got to find somebody who's good at scissor sharpening. There's this kitchen store here who does it every now and again, like as charity, if you bring in like canned goods or something, but it's for knives. But I know you can bring scissors too, but it's like, are they going to look at me weird if I bring in like, I don't know, five pairs of scissors and like here, sharpen these for my cans of food. I don't know how I feel about that. I need to find somebody that actually does it.  So I mean, I guess if you're in the Charleston area and you know somebody who sharpen scissors, let me know in the comments below. Or if you have another trick that you can try or that I could try at home for sharpening cutting tools, let me know. But unfortunately, I think this one is a no go. So also unfortunately, that means that this is the end of our trick retreat series. This is the last of the videos that I had planned for this, but I had so much fun doing it. I definitely want to do it again. So let me know in the comments below any of the tricks that you've heard about that you've either tried and you know they work or that you've wanted to try but have been too afraid that you would make a big massive fail or whatever. I'll be your guinea pig and I'll try it out. We could do like a part two of this series in the next couple of months. But check the description box. It has all the videos with links in case you missed one for some reason. Or you want to come back and check on this series in the future. All the information about the series is in the description box below, so be sure to check that out. And that is going to do it for me and this trick or treat series. I hope you guys enjoyed it and I will see you all next time. Bye.


We've got a special guest in the studio joining us.  I feel so short, like shorter than normal, you know? Yeah, yeah. How tall are you? Really tall, 5'5", 5'3". 5'3", really tall. Honestly, I'm... He has hair taller than you. That's so true. I actually identify much taller than I am in real life, so it's a struggle for me. Our boy Dave made this happen. Dave, who we have in the studio. Ronion is here with us, and he has a song with us right now. It's playing on 93.1 to the age of 10-2's. That's right. And he's joining us this morning to talk about his song. It's good to be here. We appreciate it. Thanks for coming. Beautiful studio. Oh, thanks. Beautiful city. We think so, too. An unbelievable drive up the side of the mountain to get here. True it. That, ladies and gentlemen, was sarcasm. No, no, no. In fact, I almost got myself in trouble because we're driving up the side, and we kept saying, oh my god, just look at that. If you look off to the side, so finally I stopped. I was like, I stopped. I'm like, hey, hold on, give me a second. I get out, start taking pictures. Like, you know, Shane, we have a radio thing. But it was beautiful, I thought, before the sun rises. I mean, it's Pikeville's where it's at. It is. It really is. We think so, too. Thank you. This is just a great place to be. So where are you from? Well, I was born and spent the first half of my life in Charleston, West Virginia. It's where all my family's from. And I spent the second half of my life from middle school on in Portsmouth, Ohio, in the greater Portsmouth area. So like Dave. The red light capital of the world. Yeah, that's right. Now, wait, define red light. Well, you know, you got a good role going, cruise control sets. So red light, you know? Start up again. Those are the ones I was hoping you were talking about. That's it. We mean, now, there are some different things we could say about Portsmouth. We'll just leave it at that. What's the shortcut? Was it Rosemont Garden? It goes over there. Yeah, Rosemont Hill. Yeah, you go over the hill and you can kind of bypass it. Awesome. But well, actually, now, this is sad. I don't know how to feel about it, right? This is getting borderline political. But what's kind of sad is they are putting a bypass in from one highway to the next. So we are literally about to be. 52 to 23. Yeah, yeah, we're about to be wiped off the map. So for everybody here in Pikeville, you know, when you're making your travels, you're no longer ever going to see Portsmouth. You're not going to be required to go to Portsmouth. That's right. That's right. But hey, interesting. But we have some great things, a good community, wonderful people. So tell us about your current travels. I mean, obviously, you're doing a little tour here with radio stations and promoting the song. And tell us about the song. Yeah, well, we're promoting a song called Tattoos. It's a song that's really, really dear to my heart. It's this last album we put out is very much like a me album. So I used to be a middle school teacher. Very cool. Yeah, yeah. I used to teach history and and I did that actually in Greenup County, Kentucky, right across the river from. OK. And so I taught for a long time and and, you know, once I got a little bit of a break and was able to play music for a living. The realization hit me. You actually have to play these songs night after night. After night. Yes.  So the next album we made, which is called Eastwood, which is what Tattoos is from. I was like, you know what? Let's just selfishly put the kind of songs that I want to sing night after night. And Tattoos is very much a me song. I never expected anybody to latch to it and I'll be dag on if that ain't the one. Everybody. Very cool. That's just the way it works, right? They get, you know, it's like nobody want to hear this. But yes, we're promoting it. We are right in the middle. Again, me wanting to give back to young folks. We're doing a 25 stop, 38 school district drug free tour. Cool. Tell me about that. That sounds very interesting. That's very cool. Very different. So what is a drug free tour? Well, good question. So what it is is, you know, I never thought that the drug free movement was something that I would be involved with in this way just because never thought it was something that I could personally have an impact in. Yeah. But again, I do love high school students and young folks are obviously where it's at. They are a future as cliche as that is. And so I was invited to play a rally, a drug free rally. And then I thought, oh, man, this is going to be a long day. Right, right. And I got there and I immediately was like, oh my god, I was so moved by seeing these young people because the skeptic in me was like, they're just skipping class. But then I saw how sincere they were. And like the high school quarterback was there hand in hand. And literally every type of student you could imagine was there supporting each other. And they were giving their testimonies about how the drug epidemic has affected their life. So nonetheless, I saw how sincere and wonderful the drug free clubs of America was. You kind of get ahold of the fact it was a real deal. Yeah. And they're based out of Cincinnati, again, Ohio guy. So I knew that we were going to have kind of this little open slot in the month of March beginning of April. And I knew it was going to be there. And we were talking about radio and, God willing, if tattoos would catch on, which again, thank you guys. It is. You guys have given me the platform to do this. So it all kind of the stars aligned. And I said to the drug free clubs of America, I said, hey, I'm going to have some time. I would love to go to these schools, put on a full production show for them. We bring in a stage. We bring in a stage and risers. Yeah, yeah. And we put on a full show for them. And before I play the song, Tattoos, we kind of take them to church a little bit. Sure, sure, sure. And I just tell them, hey, we're here to have a good time. But there is a message I also want to share with them. And so you're asking, what's this about? So it's number one, a good time. And number two, it's my opinion, my humble opinion on what our solution is. Because you can't just tell people not to do something. True. You have to tell them a solution. There's this awesome Jack Nicholson movie, Good as It Gets, right? Yeah, I love that movie. Yeah, well, there's this line where he's down and out. And what was me? And this guy's explaining it to him, like, oh, you know. And there's this great movie line where he says, look, man. He goes, I'm drowning here. And all you're doing is describing the water. Yes. He says, I'm drowning. That's real good. All you're doing is describing the water. So we try to give them the solution. So what I tell them, because in my life with the ups and downs, right, the only common denominator I have found where the dots connect and what's made me happy through good times, bad times is my relationships with people, my spiritual relationship with the man upstairs, and focusing on serving people, having a connection with people. And so that's what we tell them. We go in and we say, hey, focus on your relationships. Don't hit like on social media. Be there for them. Talk to them. And I tell them, hey, we have a purpose.  And in my opinion, our purpose, each one of us, is to serve each other. And so that's what we're encouraging the kids to do is to not wait to be served, but to serve others and be there for each other. And I think if they do that, once we start connecting with our purpose, I think we stop reaching for things to fill that void. Sure. And it probably would remedy a number of things, not just maybe even drug abuse, maybe even some bullying and things like that. Oh, my gosh, man. For sure. And it's so cool that you said that, because that's been brought up is what you said. There's more things than just drug use and self-harm, bullying. You name it, and you nailed it. I mean, there's just so many things that I think comes out of people not feeling connected to each other. Exactly. Once you don't feel that other people are human and there's not a connection, I mean, it's just bad for you. It's bad for everyone. Absolutely. Every now and then put phone down. Yeah, put the phone down. Pick a guitar up, right? By the way, did you bring a guitar? We did, bro. All right. Where is it at? That's right, yeah. I'm ready to hear this. I feel like Ron Burgundy. Oh, I'm not prepared. Oh, here we go. There you go. Oh, here's my guitar.  Who brings a trident? Right, right, right. Actually, my flute player is right in the hall. Oh, come on out, no. Come on down. Right, yeah. That's all we got. What are you going to sing for us? So if we're playing a song, well, Dave, would you like us to play tattoos? Yeah, go ahead. We can play something different. We can do tattoos. Tattoos? Yeah. Well, here is the song that we're promoting. And again, I want to thank y'all and Country Radio for giving us the platform to do this school tour. And the kids, they don't want to hear somebody via their basement. No. They're excited to have somebody with a little sun going. Anyway, this song is very special to me. It's called Tattoos, a song about second chances. Walking through the parking lot to the grocery store. I saw a woman walking up. I smiled and grabbed the door. But she won't look at me in the eye. And that don't come as no surprise today.  We think I picked up on the road. And a couple of that I got done in the pen. And I see the way they look away when I come walking through. You wouldn't think I'd feel a thing, but sometimes I still do. But I promise that these old tattoos haunt me more than they scare you. But I'll still wear them proud every day. These old tattoos remind me of the sins of the good Lord washed away, good Lord washed away. This one here's the very first. I got it just 14. I got it when my name had passed. The only one that cared about me. And after that, all I had was the bottle and cocaine to feel love. So on that day, I hit the road. Just a lost and wondering soul. And painted that whole journey on my skin. And I see the way they look away when I come walking through. You wouldn't think I'd feel a thing, but sometimes I still do. But I promise that these old tattoos haunt me more than they scare you. But I'll still wear them proud every day. These old tattoos remind me of the sins of the good Lord washed away. Most were done with the smell of whiskey on my breath. And even though I was numb and sad, I could feel it on my flesh. Most I can't remember. But the one thing I can't seem to forget is when I see the way they look away when I come walking through. You wouldn't think I'd feel a thing, but sometimes I still do. But I promise that these old tattoos haunt me more than they scare you. But I'll still wear them proud every day. These old tattoos remind me of the sins of the good Lord washed away. Lord washed away. I loved it. Awesome. It was even better in person. Yes, very sweet of you. I appreciate it. Honestly, it was great. Yes. I think that at least here, I know at Daybreak Morning Show, first of all, we love our teachers. And so I think it's so cool that you are a former teacher and that you've got this connection with the kids anyway. And what a great, great, great message that you're getting out there for them. We look forward to seeing you just soar. I'm sure you think. Well, thank you. Positive that you will. That's sweet. I appreciate that. That's way better than the alternative. I appreciate that so much. And it's a joy to be here. And yeah, I feel, I guess I still feel like a teacher at heart. So that's very sweet of you guys to express your support of teachers. They need it. They need it. All the people in the classroom need it. We know what West Virginia has went through. And I tell you starting to go through it now. We're doing it here now. And I tell you, man, teachers, I've always said you don't go to school that long to make what you do because you don't love kids. No, that's right. They love what they do. It's a God bless them. Yes, absolutely. After that performance, we forgive you for the whole Ohio thing. Yeah, yeah, yeah, yeah. We'll overlook it. Thank you. Shane, if someone wants to get your song or learn more about everything that's going on with you, where do they need to go? You know, you can find me about anywhere by looking up Shane Runyon. And my last name is spelled like Union with an R. R-U-N-I-O-N. So you can find me, Shanerunyon.com. Everything is at Shane Runyon Facebook, Instagram, Twitter. But my MySpace is at, no, no, no, no, no, no, no. We want to hear about your MySpace. You know, I've forgotten what that handle is. Did you go through a golf phase that we can, like, find some, like, pictures of you, like, on MySpace, you know? You know, I actually, believe it or not, right before I started teaching, I had hair down to my shoulders. Was it? So I didn't have a golf stage, but I definitely had my, like, hippie. We, like, spent a summer in the Outer Banks playing music, starving to death, you know? So that was my weird thing. No, you did it right. Yeah. No, I didn't do that. You didn't do that? It's one of my favorite places. Some John Mayer.  No, what? No. Did we just lose the thing? Yeah, we did. We had a thing. Oh, man.  Oh, no, he's done. This is my favorite part. Well, we're so glad that you came today. Thank you so much. By the way, this thing doesn't work out. You've got a killer set of pipes. I think he's got a future in radio. I know. Thanks, man. I've been thinking that the whole time. He was on a roll there for a half a second. Well, thanks, man. Yeah. I'll be a guest part of the team any day. Anytime we're rolling through Pikeville. Perfect. You're welcome back any time. Absolutely. Thanks, brother. Anytime. It's 7.36, and we need to take a break and a caller. Give us a call right now if you'd like to play trivia with us. 437-1240-star-931 on your Appalachian wireless phone. Bye.


Hello everyone this is Ahmet Don of AhmetDon.com Today I will have another episode of Easy Cooking video and I'll talk about how to cook kale in 10 minutes. If this is your first time or a repeat visit thank you for your support. On this channel I'm always trying new and different ideas if that is something you're interested in please visit for more. If you're only interested in cooking videos there'll be links in the description box below. So today I'm going to show you how to cook kale which is a very good food and a super food and I have my grocery shopping right here so I'm going to take them out one by one. So the ingredients are very simple. So the first thing I have is obviously the kale which we have right here and then I have one onion and the last thing I have is a red pepper but you don't have to actually use the red pepper I'll be just using it for kind of decoration purposes but you only need kale, onion these are the main two ingredients and then you need some other small ingredients which I'm going to show you very soon so let's just wash the kale and then cut the onion and gather the other ingredients you need and then I'll start the cooking in here I have all my ingredients ready right here and I'm just going to go over them quickly so the two basic main ingredients are kale and then we have the onions and then in order to make it tastier you can use a bit of turmeric and then I have salt and then I have red pepper and I have a little bit of black pepper and then we have red pepper right here which is just for decoration purposes but you don't have to actually use the red pepper and the obvious olive oil if you have extra virgin olive oil that would be best but if you're not then any olive oil would do so in terms of quantity I have here about two teaspoons of turmeric and then one half teaspoon of red pepper right here and even quarter teaspoon of black pepper and then I would say about slightly lesser than one teaspoon of salt now you don't have to use actually turmeric you can just even cook kale with onion and black pepper salt but I always add turmeric for everything I cook it's a very healthy spice and it's one of the best spices you can have so I really like it and then it gives lots of taste and it's very healthy and then in terms of onion although I cut the whole onion but I'm going to be using only about half of it and then that's how we're going to start cooking and then let's start the cooking and I'm targeting to finish everything in 10 minutes from after the preparation so you can actually cook kale in 10 minutes and this is one of the best superfoods out there and this is a very healthy food which I attempt to eat at least once a week or once a few times every other week so let's start and then we'll see how it comes out so just before start I would like to mention that you have the option to use a non-stick pan or you can just use a regular stainless steel cookware for today's demonstration I'm going to use a non-stick because it's going to make it faster so I'm just going to remove the stainless steel cookware right here so I preheated the pan a little bit and I'm going to start with the oil so I've never actually measured oil so I just like you know put it according to my common sense and this is not difficult you have to just like you know make sure that you're not putting too much or not putting too little and that should okay that should be okay but if you would like to absolutely know the measurement then I would say about two tablespoon or one and a half tablespoons should be good enough so I'm just going to set it aside here and then the oil should be good to go so I'm just going to you know put some onion first and I'm going to just put about half of the whole onion I don't need a lot of onion because you know this is just a vegetable so you don't have to actually use a lot of onions and I'm just going to increase the heat a little bit once it gets warmed up a little bit then I'm just going to start putting the spices and then after that I would like you know leave it to mix the spices with onions about one minute and then I'm going to start putting kale and then at the end the red pepper but again the red pepper is just optional so I'm going to be turning on the ventilation fan just for just in a low heat so I'm in a low speed so it doesn't get you know it doesn't turn on the fire alarm so you can see that you know this is coming very good here and you can hear the cooking sound the sizzling sound of the onion cooking in the oil and I can start to get the smell which I really like the onion smell when you just put in onion so right now I'm going to just you know start putting in the spices and the first thing I'm going to be doing is just turmeric and then I'm going to be putting the little bit of red pepper and black pepper and I'm just going to put salt and so I put everything in here and I'm just going to you know take a few more seconds to mix them together and then I'm going to be just putting in kale in here so you can see it's kind of getting you know dry which is okay because we have water inside kale so ideally I really don't need to put in a lot of water and once I put in kale I'm going to have to cover it if it's like in a spatter too much water outside and I'm just going to wait here a few more seconds so the onions when the onion turns a little brown not too much then I'm just going to start putting in the kale in here and you can see the slightly little bit of smoke because a little bit dry which is okay but if you think that it's started to burn then you can just add a little bit of water but right now I'm just going to be putting in the kale cover it for a few minutes so I forgot to take the big cover but this should be okay for now and we'll just wait a few minutes and then we'll wait at the pepper we passed another five minutes and I'm going to just you know take a look how it looks like so you can see that the kale is coming a very nice green color so one thing about kale that is that you know when you cook it gets really small although the kale looked a big kale at first but you know after finishing cooking it's going to be very tiny so right now it looks like it's you know very nice green color and it's in green shape so I'm just going to add the red pepper and then I'll wait another like you know three four minutes and then we'll just you know turn off the stove and then I'm going to show you the final product so I'll just leave this on and then the next time I'll just add the final product once I finish the cooking so basically that's all you have to do and here I'm just going to cover this up and wait another I would say about three minutes but I'm going to turn off the camera from here and so this is our final product and you can see that you know the kale looks very dark green right now and then the pepper is done and then we have the leftover onion which I didn't use so just a few things to mention about kale is that you can buy kale frozen or you can buy kale cut in pieces and washed you don't have to even you know wash it and usually when I cook kale I cut it into more smaller pieces but just to show you guys you know I didn't cut a lot this time just to show how it came out and then another thing about kale is that you have to you know wash it very good because it attracts lots of soil so if you don't wash it good then you know definitely you're going to get the soil when you are eating it so you can also avoid that if you buy frozen or cut kale because those are washed you know in machines and definitely machines you know wash much better than the human so that's how you can cook kale in 10 to 15 minutes if you're using a non-stick you can basically cook in 10 to 15 minutes if you're using a stainless steel cookware then I would say you know give it like 20 to 25 minutes so thank you for watching this video there will be more videos coming up so I'll see you shortly thank you


The use of global navigation satellite systems, GNSS, signals for remote sensing applications is gaining increasing interest among the scientific community as a remote sensing tool for land applications. This paper describes a long-term experimental campaign in which an extensive data set of GNSSR polarimetric measurements was acquired over a crop field. This article was authored by Alejandro Egito, Marco Capparini, Giulio Ruffini, and others.


And nice to see you, everyone, here. And first of all, I want to explain about tandem MOOC and how we did here this project with Open University of Catalonia. Basically, what does it mean? The project is let's learn, let's practice, let's have fun with practicing native languages. Then, first of all, she should be here with me, Christine Appel, but she can make it. But I introduce herself. She's a senior lecturer in the Center of Modern Languages of Catalonia, Open University of Catalonia. Open University of Catalonia is full online university here on Catalonia. And it was the first online with more than 6,000 students currently, and they are growing up. They create their own LMS at the beginning, and we help them also to integrate model inside their own LMS. And Christine Appel, she is very focused on the practice of learning languages. And she helped us to create a suite of tools named speak apps that allows the students and the users to improve their skills in languages. Then I present myself. I'm Antoni Bertan, city of Tresipun. Also, I am European LTI co-chair. This is a work that named before IMS. The typical thing in model when you go to the activities side external tool, this is LTI. And we are working together to do standard things to connect things. And for tomorrow, I have a presentation about that. And here are my details. And let's go review tandem MOOC. Tandem MOOC, what is more? Tandem MOOC allows the students to improve the opportunities to practice languages, English and Spanish in this case, this edition. We have different editions, and we can do with different languages. Also, the learning principle that is behind the tandem MOOC is practice with native. Not only I am alone, or I have a teacher. No, I have some people that, more like me, has the similar skills, but native languages in English. And I have native languages in Spanish. And for the reason it's easy for them to support, to explore things. Also, one of the things we are analyzing with that is the identity of the users that you can see because they just started, and they have some issues at the beginning. They are shine. But later on, they practice, practice, and improve a lot. And this is one of the research we are doing right now. And as I say here, it tends to decrease, the learning practice, and so on. How does it work? Each week, we have some tasks to do. The tasks are in a platform that name is tandem that allows to connect two students to share or to do that task. Each task is in its languages. Then at the beginning, it was in one in Spanish. Then we practice Spanish, and then we change to the next task that is in English. We prepare materials and video tutorials. That material and video tutorials are in Moodle, or part of Moodle. Later on, I will explain a little bit of the architecture more detail, but because we will have some ecosystem of application here interconnected. Then the users can select. I know you because I did some tandem with you in the past, and I arranged a meeting with you. Today at 11, 4, I will be here, and I will invite you to do a tandem. Then the other partner receives the invitation and access to the tandem, and they start the task. But also, I don't know, I can go like a red tandem. I start, I go there, and then I am waiting for one person from the other languages to join to the conversation. There is an algorithm behind that if there is nobody available, because sometimes we have difficulties, because we have some users from the states, some users from Spain, and then the time hours is quite difficult sometimes to find partners. Then if you don't have partners, we do this special tandem between the same languages, but they have to do the task. And also, all the tasks are recorded. And when the tasks are recorded, then later on, they can review that task. And also, they give us self-assessment. Today, I feel comfortable. I feel that you evaluate yourself and also evaluate the other side. Also, you receive some points and budgets, and later on, you receive your certificate from the course. Let's review how it's currently the project. This is the website. The website is a WordPress that the user can register, automatically generates a role to the model course. When they use access to the model course, they can see some tasks and help them to reflect about languages, practice. We give them some tasks to review some aspects of each language. And you, as a student, get some information. Sorry, as an English student, you receive some information, and the user in Spanish receives other information. For the reason I made the question about the content, because we are using the current filter. The main tools are the red tandem. The you choose is when I can select with, I can connect with. Also, we have the video recording and feedback. By using Open Source Platform Big Blue button, the user has their own portfolio that can review all the sessions with all the recording, review the feedback that has been received, and also, I always did that mistake that the other student told me. And I'll review. Yes, that's right. Oh, I have a problem with that. Because sometimes there is interesting chats because they start probably with the task, but sometimes they continue and talk during more than one hour talking about other things. One of the aims of chatting them is not only talking about where you're from, where you live. No, you put a task with some tasks to do. But later on, if you want to continue talking about, do you want my children, and so on, you can do it. Also, we have a video forum using Moodle, and in this case, the teacher, or the facilitators of the course, provides some information or some task to do. And the user has two response, and we create a conversation, but recorded to review everything, adding some quiz activities, and gamification with ranks, points, and prices. Each week, we renew the ranking. And you have the winner for the week. The winner gets an extra class with one of the teachers that help them to fix some things, and it's an interesting way. And this is the task. In this case, we have four tasks. And you have one thing, the other part, have another thing, probably which are the difference between two images. And then you have to describe, I don't know. As I said, we have the blue button that has been integrated, and all is auto-recorded. After each task, we have our thermometer accident. And you can see here, you can click. I'm very anxious or not. Then, when I finish, I give my self-assessment, and the other assess my partner. I only see their assessment after I submit my, because I don't want to be manipulated about the answer of him or her. Also here, I have my portfolio with my badges I win, the time I spend with all the sessions that I can review. I'm the administrator, the users can delete anything. Also, I get the ranking for each week that gives us, with completing the first course questionnaire, it's integrated with Moodle. That tool that I was playing right now, but it's integrated with Moodle using LTI, the speaking time, when you complete all the activities, and so on. And let's go deep on the architecture. The architecture, it's based on WordPress. There is our platform to register the user to show the information about the course. Then, Moodle, as a course, when I have all the activities, all the users, and all the information about some resources that we provide to them. Also, we have a big blue button to record all the sessions. And then, this is a course on development that has been that you can find one version here, open-source launch set based on PHP. And here, more or less, is the schema. You have the landing organization. You go to Moodle using one of our plugins that has been integrated Moodle and WordPress. And then, using LTI launch, you access to the tandem platform. And also, you get all the information about tandem ranking portfolio, so on. And integrated on tandem, we have big blue button. And more or less, that I want to explain today for you. And if anyone have any questions, sorry, I missed one slide that, because I forgot to upload. But the URL of the site is mooc.specups.org, because I uploaded it yesterday, and we can check it. Thanks. No, that was really good. Thank you. Thank you. OK, we do have time for some questions if you'd like to raise your hand and then wait for a microphone to come to you. And I'll let you stand by the microphone. And if you'd like to come up, is it, Martin? If you'd like to come up and get your presentation. Any questions? I've got a question, but I'll wait until anyone else asks theirs first. Hi. You talked about video recording, but you also said something about video forum. How do you use that? Yeah, the video forum, we are using currently the forum, the model forum, using the options to record the video. We have two minutes video, it's enough for the task we suggest to the user, because this is a small task. But during the tandem task, you have probably one hour of video recording. For the reason, we are using external tool like Big Blue Button to record that. And all the students that has been participated in that conversation can review the video and review if they made some mistakes or not. OK, thank you. You're welcome. Then if you've not, join us, mooc.specups.org. Thank you very much. Thank you.