This film is part of a feature in the journal British Art Studies that looks at Victorian anatomical atlases in relation to examples illustrated and authored by the surgeon, anatomist and artist, Joseph McLeese. In this film, William Schupbach, lead librarian and curator of the Welcome Library in London, and LaMilla Giordanova, an expert in the visual and material cultures of science and medicine, discuss McLeese's intellectual influences and the broad cultural, political, theological and scientific environments in which 19th century anatomical texts disseminated knowledge about the human body. The broader context in which this is happening is one of considerable political turbulence. It was not uncontroversial to found University College, which was set up expressly not to be religious. And Jeremy Bentham was the leading utilitarian thinker of the time. Political reform is in the air. There are artisans forming groups to read and think about science and medicine. So the wider environment of anatomical production is really vital and it's not stable and secure and self-evidently respectable at all. Do you think an element of that was popularization and democratization of knowledge? Yes, absolutely. This is a very, very important part of the early 19th century. If we think about the kind of books that are being produced or even the original project of the Encyclopedia Britannica, it is to disseminate knowledge and this is to give working people, especially I think artisans, a much better hold on the natural world, which of course includes the body of man. Man is how this would have been understood in the period. That is the human race as an object of scientific and medical scrutiny. So this is work that Joseph MacLeese produced three years after his Anatomy of the Artes and this is on comparative osteology, being morphological studies to demonstrate the archetype skeleton of vertebrated animals produced by Taylor and Walton in North Gower Street, 1847. I'm very interested in several things here. One is the whole notion of comparison. So he's comparing bones. He's drawing on well-established comparative anatomy traditions by this point. We might think of someone like Cuvier in France who claimed that from a fragment of bone he could reconstruct the whole animal. The idea of laying out the whole of created nature so that we really understand the differences between animals that may for example look quite similar but not at all with an evolutionary mindset and I think we know that because he uses the notion archetype which is very characteristic of a particular type of comparative anatomy of the early 19th century and actually you find it in George Cuvier, the great French anatomist. So I think we're seeing something here which we might think, oh we know what this is about but I suspect we don't really know what it's about at all. It's a very different mindset than the one that comes in much later in the century in the wake of people such as Darwin. In the preface he names some of these people who he claims to be influenced by. Here is McLeese acknowledging his intellectual lineage and what's so interesting is that initially the names he mentions are French and German thinkers and he's also acknowledging of course other people who are important in comparative anatomy in England such as Richard Owen, the great comparative anatomist of his time. He mentions Baron Cuvier and Goethe and Joffre Saint-Hilaire, Lawrence Oaken, Carl Gustav Karras these are all big names in France and Germany. Filtered through William Sharpie, who is professor of physiology at University College London. Mr. Quain, so that would be Richard Quain and Richard Owen. So these people are philosophers, they're thinkers as well as being naturalists. Yes and in the last sentence he acknowledges Robert Grant, the founder of the Grant Museum at University College London but he's indebted to them because they point full to the theme of philosophical unity so he's looking at the anatomy of the body as a whole throughout the animal kingdom. So one of the larger contexts for this is what's called natural theology the idea that we can infer the presence of God from created works which is absolutely current in this period especially through what are called the Bridgewater Treatises which aim to demonstrate that claim that by looking at the created world we can see the hand of God one of which was written by the great surgeon and anatomist Charles Bell. So I think what we're actually doing here is trying to suggest the broad world in which anatomical publications exist and that world is not just about the techniques of printing and so on important though those are, it's not just about the world of medicine important though that is, it's also about much broader discussions about the place of human beings in the universe and the role of religion. It seems to me that there are a lot of questions that people are struggling with in this period and one is how to explain the variety of human beings that are now known to exist in the world it might be worth remembering that by this period all the main continents have been discovered given that Australia is now part of people's imaginary in the second half of the 18th century so people are struggling to explain human difference. Here's one pretty striking comparison with a man and a woman side by side we haven't seen that many women. This is about surgery of the axilla or the armpit a lot of Macleese's work was with surgery of the groin particularly because a lot of surgeons had to do operations for hernia and so that was how that was involved. He seems to have only shown a woman where there was some necessary difference like the breast makes the innervation different so if he's carrying out an operation for some form of extirpation of some tumor or cancer or something like that the surgeon would need to know how the arteries and veins enter and leave the breast. I think people would be quite familiar with the idea that you make comparisons all the time between the bodies of babies, children, men, women, people of different races as well as comparing humans with animals that look similar to them but are possibly not related in the mindset of people in the early 19th century. Macleese hasn't tried to produce a kind of gender neutral figure as some even contemporary with us contemporary anatomical illustrators do he's definitely showing the men as men and the women as women. Yes, with very obvious musculature as well. So I think this is a period when there's a lot of medical interest between men and women. A lot of medical writing about what is it that makes women different and certainly in the late 18th, early 19th centuries a lot of interest in that as a whole body problem if you like it's not just about the anatomy, it's about the entire physiology about the nature of the nervous system. So it's a way of exploring the natural dimensions of differences that we tend to see as much more social and constructed. This is art historically interesting because it's art because it's made by artists, because it's made by people who are in constant interaction with people that we think of as important players in the art world. There's no point at which there's a separation I think. William Hunter collected paintings by Sharda. He knew Alan Ramsey, the great Scottish 18th century artist. The art world of the 18th and 19th centuries brought artists, medical people, natural philosophers, engravers, sculptors, printers, publishers and so on together. The anatomists drew what they wanted from the art world. They wanted engravers, they wanted draftsmen, they wanted colorists, they wanted publishers, they wanted bookbinders. All these people are artists and the anatomists are artists too. They're doing a kind of sculpture. They're exposing what they want to expose and concealing what they want to conceal. I prefer to talk about the arts rather than art to the capital A. So that there are the arts of engraving, the arts of lithography, the arts of limning, the arts of drawing and so on. All these arts are displayed in abundance in all these magnificent anatomical works.


Good afternoon. Welcome, everyone. My name is John Garbert and today I'm here to talk to you about live migration. Hopefully you're here to hear about live migration. So before I start like talking about live migration all that kind of fun stuff, I wanted to like introduce myself quickly for those of you don't know me. My Twitter handle is JohntheTuberGuy and my ISE handles JohntheTuberGuy. Just to clear things up, I do actually play the Tuber. It's not just a randomly picked out of the air name. One day we'll have a summit where I can actually bring a Tuber, but we'll see. So I just wanted to quickly go through like my OpenStack journey just to give you context on where I'm coming from talking about live migration. I started working on OpenStack in December 2010. At the time, I was working at packaging OpenStack with Citrix Zen server and making that all work together. So that's sort of doing the packaging and we're working with Puppet and various things to get that going. Soon after I started to look more closely at things like how does Citrix Zen server work with the whole OpenStack ecosystem? How do we get it working with Nova, with Cinder, with Neutron, all these different bits? That was my introduction to the upstream community. So I got more involved, came to design summit sessions and really enjoyed that. After that, I got talking with Rackspace and it turns out they were running the code I was working on, a massive scale in their data centers. So I thought that'd be absolutely awesome to get involved with. So I moved over to the Rackspace public cloud working on that. Most recently, I've been sort of been stepping up with some of the upstream leadership. So I became Nova Ptl for the Liberty and Metacor Cycles. I guess that's not recently so much anymore, but I've been sort of Nova Core recently doing lots of reviews on these things and the latest thing I was helping being the tech lead for the OSIC group working on Nova and as part of that, we did some interesting work at looking at live migration and that's why I'm here today. So with any good talk, you start with like a cute picture you found on Wikipedia. So like why live migration, why is it important? You may know that if you're in here, but the particular use cases I was interested in was at Rackspace public cloud, you know, at some point you actually do have to upgrade the hypervisor and it turns out there's a whole mix of workloads on these kind of clouds. An awful lot of them really don't want any downtime in the VM. So the basic idea is like let's upgrade the host in a way that doesn't affect the VMs running on it. So as you might expect, the general idea was you move around the VMs from one host, so you get a free host, you patch the host, reboot the host and then you can sort of repeat the process because you've got somewhere to move your VMs and keep shuffling. We actually did that to quite an extent to sort of try and update bits of the clouds. That was my original introduction to live migration. Some people are using live migrate to help with the rolling upgrade of clouds, so you can actually keep you got your nnnnnn plus one nodes and you can switch between them. If you want to upgrade the hypervisor at the same time as all the code, you can sort of use live migration to do that kind of shuffle as well. There's been many work, many sort of use cases around workload rebalancing as well. So on one side, there's people who want to make sure that they're minimizing their power usage. They've got sort of bursty workloads.  That's a use case some people like. The other one is there's a particularly busy, noisy neighbor and you try and get other people out of the way. So live migration, kind of interesting. So how does live migration work? I wanted to sort of delve into this. And the picture here is just a little bit of a joke towards nova configuration options. This sort of reminded me of that when I was trying to look for a picture for how does stuff work. I'm going to start with a sort of look at what makes up a virtual machine. This is totally obvious, but I just want to make sure we're all using the same words for the same things. So the virtual machine, you've got a networking connection to the virtual machine. You've got CPU and memory on the virtual machine. And you've got disks on the virtual machine. Some of the disks may be locally on your hypervisor. And some of the disks are remotely connected. So that's a place we're starting from with the virtual machine. So now let's look at live migration and its different phases. And the idea of me looking at this live migration is if we understand a bit more about how the live migration works, it'll be way more interesting when I start talking about the results and how to change live migration. So simply speaking, if you look at the virtual machine during live migration, there's kind of three key phases. So we have a source host over here. And we have a destination host over here. So the key phases for me are the VM is running on the source host. There's a point in time where the VM is paused and it's not really running anywhere. And there's a point in time when the VM is running on the destination host. So those are the key three phases I'm thinking about. So what happens when we start the live migration process and NOVA? So going back to the previous diagram about the virtual machine, what we need for the endpoint is that all of those things, the disk, the network, the CPU and memory, have moved from the source node to the destination node so that it can be running on the destination node. That's our aim. So one of the first things we do is we have to think about the networking. So the networking, we need to have the VIF set up on the source and destination node so that when we move, the networking can change between the source and the destination node. So there's a setup on the neutron side. NOVA has to go talk to Neutron to get the destination set up. The other part is you then need to think about the disks. If you've got remote disks through Cinder or other things, you need to make sure that you have the remote disk set up on both sides on the source and the destination. So we've got that sorted. And that was for remote disks. The second piece we need to think about is what we call block migration, where there's a local disk on the source host. And we need to get that local disk to the destination host. The rough idea of how this works is that we can make sure that any writes on the source host get mirrored to the destination host. So effectively, it's kind of the same. And in the background, we copy the rest of the disk, be that downloading from Glans or copying across the network. We get the disk synced in the two places. So we now have all writes going to both places. So effectively, we have the remote disks. The network connected. And the local disks are all moved across. So we're getting there. We're almost there. The next piece, which is where a lot of the fun happens, shall we say? Yeah, you can see seasoned operators sort of giggling at me from the front. The next piece is the memory. So what happens is we try and copy the memory from the source to the destination using iterations through the whole memory, effectively. Well, bear with me. So the first thing is, let's try copy all the memory from the source host to the destination host. So we get the first copy. Now clearly, if that VM is running, there will be more memory being dirtied at the source host that we then need to get over to the destination host. So now we just copy what's changed since we did that initial copy. So we do the next memory iteration.  So there'll be a bit left that we try and copy, right? This is the memory iteration process. We're slowly copying more and more memory. At some point in time, we need to decide to stop doing this, because we can copy memory for the rest of our lives, and it's not very interesting. At some point, we need to calculate how long it's taking to copy the memory between the source and destination host. So we know that there's only a small amount of memory left to copy. So we pause the VM to make sure it's not going to dirty any more memory. Copy the final piece. So this is a decision point, right? We have to decide how much downtime we allow for that VM, i.e. how long we're going to pause the VM for it not to be dirtying the memory for that final copy. Once that's done, let's think through the destination node. We've got the CPU state we just copied at the end. We've got the memory state. We've got the disks local and remote. We've got the network connected. So we can now start it at the destination host and do some tidy up. So we've got the VM running from the source host to the destination host. And the key point to take about that is because of that memory, the way we iterate through the memory as we copy it from the source to the destination, we have a decision point based on how much downtime we allow on the VM. How long do we pause the VM in that phase? So at this point, I wanted to dig a bit deeper into that point. Like there's some trade-offs during live migration. Like the most extreme form of live migration, if you want it to complete quickly is you just pause the VM so you know it's not dirtying any memory. It's going to move pretty quickly, but you have quite a long downtime. So that's like the extreme case. The other extreme case is that you just try copying the memory forever and you never bother finishing, which this process, there's a decision point to cause it to finish. So let's talk through what are the things you can do to minimize the VM downtime. And these are the things that, so Nova's current preference in this trade-off is very towards the minimize downtime rather than the complete quickly, always complete kind of side. So one of the things we actually do is we actually ramp up the allowed downtime. So there's a configuration that says, this is the maximum allowed downtime for the whole migration, be that, I think, the default is about 500 milliseconds. Many operators find that they want to increase that to 1,000 to get a better completion rate. But what Nova is doing is rather than starting with, oh, if it's just going, you know, how long do we want to wait to start with 500? We slowly ramp that up. So if we go back to that memory copying piece, Nova's trying to say, like, you know, we have to decide, given how much memory you need to copy, how long is it going to take, and you're comparing it to that value, right? So that's what's happening with the ramp up, as we just do that over time so that there's more chance of the VM completing with a very small pause. One of the gotchas here is that it's very normal for people to say, oh, live migrate always works, and there's a lot of complaints about in Nova it's possible to have a timeout exception where it just says it's given up. The trade-off we're making here is we could just pause the VM and force it to move, but what we're actually saying is we're not, you know, we don't want to disrupt the VM for a certain amount of time, so that's the choice being made. Now let's talk about how do we make live migrate complete more quickly. There's some interesting features that's been added recently to help with this. One of them is the auto converge. We throttle down the CPU and memory usage, QMU throttles that down so that there's less dirtying to make the move quicker, and it does that basically, you know, over time it sort of throttles it more. That's one option. Again, this is a trade-off between, you know, there's a lowering in the guest performance to allow that move to happen. One other feature we've added recently is the exposed post copy. The idea of post copy is we can, if we go back to the copying of memory approach, is instead of, at some point you can basically say, let's now run the VM at the destination node, but instead of waiting to copy all of the memory so that you can run the memory locally, we just start requests whenever there's a memory request, we just fetch it from the source host. Up until the point where in the background we slowly copied all the memory, so rather than having iterations, you're taking a performance impact when you want to access the memory. So basically, post copy is where you're running it on the destination host, and you're pulling the memory from the source host. Now, if you've got this picture in your head of the VMs running over here on the destination host, and the memory is over here on the source host, no, clearly there's some latency here, but if someone comes along with a big pair of comedy scissors in the middle and cuts the link, like they sometimes do at previous keynotes it seems, but if you come in the middle of here and cut the wire with like a comedy pair of scissors, things go bad and that there is a risk there is that if you can't get to the source host, basically the only option you have is to reboot the VM. So there's a risk on network outages that you have to reboot the VM. Hopefully there aren't people with big comedy pairs of scissors walking around your DC, otherwise you've got bigger issues. Or, well, that's the QA guy, chaos monkey with scissors. Anyway, got distracted. So I've been through auto conversion post copy as features. There are some API things we added. The advertisement here is that there's also, down on the first floor, there's lots of interactive sessions where me as a developer gets to talk a lot and argue with lots of the operators about the features they need, how best we do it. And lots of these API features have come from those fruitful conversations. When the live migrate is going long, sometimes you know that you're gonna have to reboot the host. Like, if it doesn't move now, I'm gonna reboot the host. So you've got the option of actually now calling an API to force the live migration. What force does is it just pauses the VM to make sure that it copies now. So you take extra downtime on the particular VM when it's happening, so that if your automation can choose, right, just taking forever, let's force it to move so that you can make that move. In a similar way, if you decide that it's taking too long but I don't want the VM to have that level of downtime, you can kind of do the opposite, which is just abort the live migration and go back to what you were and decide to move some other VM if that's what you want to do. So those options are now available in the API. Another interesting myth, should we say that a lot of people say, is live migrate can't possibly work if you have a local disk. Some people have said that to me. It turns out if you use the Nova API, it was very easy to get confused about this. So before the Nova API, the early versions, you had to say, is it a block migration? I.e., is there a local disk to move? Or is it not a block migration? It's all remote disks. There's no need to do that. And very helpfully, the Nova API knew exactly what was needed to do. It just told you if you were wrong.  So that was a failure. Or the probably more common one is, you go please live migrate me, now I can't because you've got local disk. So what we actually meant was, please pass true into the special parameter to make that work. So we thought after discussing with the operators, it was probably bad to be like that. So we've got a new API which by default, we actually work out what we already know and do the right thing for you. We thought that would be nice. Hopefully that's good for you. It's an interesting journey because when people go, oh, I just need, there's local disks, I just need to turn this flag on in libvert. So we go, oh, okay. So you can just pass that in the API and turn the flag on in libvert. That sounds great in isolation but rubbish user experience. So feedback is really welcome and you can see the operator feedback evolving Nova here quite directly. One of the other recent things in Nova has been an awful lot of work on the scheduler. I'm not gonna deep dive in that now but when you pick live migration, the destination host has to be somewhere. One of the options is the scheduler picks that for you and until recently, Nova had a really bad memory on what you asked the scheduler to do when you first boot the VM. So right now, like all new boots of Nova VMs, we record what the scheduler hints were so that when we do live migration, we can actually use the same scheduler hints to try and get you to a good place. Not all the scheduler hints are good when you live migrate. If you have the special force to a particular host scheduler hint, that's not so good when you're trying to find another host, right? But in general, we try to remember the scheduler hints so that we move you to the right place. When looking back at this, when looking back at live migration, preparing this talk, I also discovered it's surprisingly recent that you can decide which network your live migration traffic happens on. There's a lot of network traffic as we're doing all these copies. You can now choose where that goes so that it doesn't interrupt any of the other traffic. You can put it in the place that you want it to be. So there's a lot of feedback on live migration. Recently, the feedback from operators has been, hey, it's working for me in my particular situation or my particular situation, it's not working for me. But there's a lot of people using it in production right now and it really does work. Although there's a lot of talk about a small number of errors that are happening and what's happening. So what do we do? We did some testing. So wow, we didn't get the test tubes out. We got rally out, but same difference. I'm told to look clever. I have to put a graph in my slides. This one actually means something but it's a little bit boring but I'm going to go through it anyway. Let's first of all concentrate on the bottom red line, the line at the bottom. What we did for this testing is we basically ran an awful lot of live migrations. This particular test run that generated these six points did about a thousand live migrations to actually get the green and red lines. I think it says min max. I believe they're actually like one sigma lines if I remember the graph rightly. The raw data is hopefully going to become available after the talk. We're going to try and get a blog post out that links to all the raw data and all the scripts we used for this. So you can actually go have a look at it and maybe even reproduce it if you want to do that. So we had a 20 node cloud. That's not particularly interesting. We were really just live migrating between hosts lots of times. There were six VMs on the host. So for the small case, there were six small VMs, six medium VMs or six large VMs depending on the run. And we were moving that between the hosts. Generally speaking, 40 times all six VMs were moved from A to B. That's how we got all the repeats in. So the key issue is if you have more memory, you're a larger VM, surprise, surprise, it takes longer to copy that memory across the network to the other place. So small VMs move faster than large VMs. It works exactly how you expect. That's good. Tick. The other piece to note here is that there's a red line and a green line. The red line is all about when you've got remote storage. So again, as you would expect, when you've got remote storage, it's a lot quicker to move between the source and destination because you're not copying all the disk. So in the green line, we're copying the disk. As you can see, the green line is effectively dominated by the disk copy because you can see the green line going up. When I go into the specifics of actually what sizes we used, basically half the disk was full in each of the flavors. So there's like, the flavors stepped up in size. So you can just see that it's proportional to the size of the disk, basically the time taken. Back to my original point, the green line is there, it did work. So you can move local disks, but it does take a significantly longer amount of time because there's more data to copy between the two places.  I'm in the Brit, I should probably say that, right? So I didn't put on there the failure rate. That particular run had zero failures for all of the thousand live migrates. Admittedly, it being a artificial-ish environment, the workload was such that we knew it would move and it reliably moved within the infrastructure. If I stopped there, I would be lying. We found some problems, which we've now got fixed upstream. The first one was about a progress timeout. The problem that we had was the top right point on that graph, i.e., the large VM with local disk, had a couple of failures during the runs. When we looked in the logs, it was failing with a progress timeout error. What we happened to see was that when we dug into the code, we were actually checking to see if the live migrate was progressing by checking to see if the memory copy was progressing. That seems all well and good. It turns out the memory copy isn't progressing if you're busy copying the disk. Oops. So, yeah, what we've done is we've disabled this progress timeoutting. So, yeah, my big fix was to default to zero rather than 100, and we backported that and put release notes in. So, if you're having problems with local disk migrations, I'd look at this configuration value for the progress timeout. Talking with some of the people much closer to QMU than myself, when we dug into this code, people were a bit worried about the checking here anyway, so I need to sort of have a think about it. It turns out what we were doing was we were sampling a sawtooth by which I mean we spoke about memory iterations. If you look at the memory progress, it's a bit like this, right? So, each iteration, it goes down. Now, if you're sampling this at random, not knowing when the memory iterations are, you can actually get a straight line even in the sawtooth, and you still think there's no progress, or you can actually get the line going the wrong way if you sample really badly. So, we need to work with the upstream QMU community and work out how to get better information out of that, or how to better use their APIs to do progress. But right now, we've just turned it off because dragons. Another thing was I was talking with the ops team doing the testing. They said, oh, yeah, it's working great, but there's a couple of them that seem to get stuck and not go anywhere. Like, they still seem to be live migrating now. That was bad. So, we dug into this. It turns out there was one particular bug hitting them here, which was, we called libvert to undefine the domain, and libvert said, no, you can't undefine the domain, it's not defined. So, there was certainly some race in there that the error handling wasn't quite right, so we got rid of that bug. But looking deeper, if we go back to the live migrate process, it's running on the saw, it goes to the destination, and then we do the tidy up thing. Any errors during doing the tidy up thing were actually not being handled correctly by Nova, and just leaving the live migrate in a migrating state. So, I fixed that too. We actually now correctly turn it to the error state so that you can see something bad happen with this VM. A lot of the time during errors in live migration, we do our best to try and roll back, but if we spent an awful long time trying to move your VM and then fail, the rollback would involve like, then moving the VM again back to the other place, and that seems like a terrible thing to do. So, for now, we're just going to error, but at least it doesn't get stuck in the migrating state. I know lots of people are complaining about it getting stuck in the migrating state, but we managed to actually get this test suite reliably reproducing these bugs. So, it turns out if you do a thousand live migrates across all of these different flavors, you can actually get this reproducing. So, with these patches in hand, we applied them to the cloud and over, we did a new test run, and we got rid of all the failures. It wasn't quite that simple. We thought the first one was all of the fixes. We did a test run and we still had the other bug, and we got rid of that one, and we were happy place. So, we've got some real stability improvements. Just to set the context here, the error rate we were seeing was well under 1%-ish anyway. So, what we're doing is we'll go from a 1% error rate to the theoretical zero. Like, it's not really zero, right? It's just that within our environment, with our test we saw zero failures, which is great. Outside of the OSIC testing, one of the things I've seen as an operator, like the Rackspace public cloud, was that Nova's using user tokens to talk to other services. So, we get the token through the API, and then we use that token to talk to Cinder, talk to Neutron, and other places. There's problems if that token expires between hitting the API and you hitting some other API. So, one of the things we've done is to use service tokens to expand the... So, when you have the user token with a service token, that user token isn't going to expire because we basically trust that the service token means that it's already previously been validated. Anyway, lots of waffle, waffle, waffle. There were token expiry areas that meant you got live migrates stuck in the migrating state. So, we've stopped that error happening by using service tokens. So, if you configure service tokens, it goes away. And if something else bad happened, you wouldn't go to the migrating state anymore. You would go back correctly to the error state. This next graph, I don't really understand. But I'm going to show you through anyway because it's got an interesting fact behind it. Going back to the use cases about evacuating a host, purposely use the wrong word there. That's a different NOVA operation. Don't use that for evacuating a host. That's a different thing. There's a great blog post on that. When you're trying to empty the hosts of all the VMs, in this case, we're using 12 medium VMs on the same hosts we were doing before, I wanted to work out how many of these should we do in parallel to be as fast as possible to move all 12 VMs? So, this graph is like, how long did it take on average to move all 12 VMs? We did about, I think, about 40 repeats of this test. Sort of like, well, back and forward 40 times. So, you know, 20 move from A to B and back again. When discussing these results with the operators doing it, I said, you know that sort of flippant comment I said that NOVA has this config value that says you can only do one live migration at once by default. Did you tweak that? It was the response I got. Turns out this test was done with the default configuration which says only do one live migration at once. So, if you want to do parallel live migrations, you might wanna tweak that config. Because with that config as one, are you only doing one at once? If you ask it to live migrate to at once, there's no API failure, it just gets queued up and overcomputed silently. You're welcome. Serialized, yeah. It's just the bit that gets serialized is actually the bit where we activate the live migration. All the setup for it actually happens in parallel, but yeah, it turns out doing two when they're getting serialized and overcomputed at that point takes longer. It looks like we're tending towards four and a half minutes. Like I'm guessing it's just going up there. There's some overhead we hit. It could have been in our benchmarking tool for all I know, but yeah, that was weird. I put lots of things here. There's gonna be a blog post describing all the details and basically we use the small, medium and large VMs. This is the point I was trying to make is the disks were 40, 80 and 160. So the actual amount of being copied between that was like 20, 40 and 80 between those things. For the workload on the VM, we actually were using like a Apache Spark just to generate memory dirtying during the process just to make sure that it didn't move really quickly because that would be really boring. During the testing, we did ping tests and had a TCP stream open with a VM just to try and make sure to see if the networking was interrupted at all. I don't have any results on that because we didn't see any TCP drops or any ping test drops. Admittedly, we were using regular provider networks. Lots of interesting information, but I'm not gonna go into that right now. So future things, like what's happening, Pyke, Queen, Rocky. We spoke about the problems I found with the progress monitoring during live migration. At the PTG, we had some great discussions about ways we can replace that with some interesting APIs. We've got some specs up for that right now. That works happening. I would love for people that want to dig into live migration to spend a bit more time with very busy workloads and how they move. Clearly that's a different problem that we haven't really addressed here. And we'd love to like dig into that and see if the APIs we have work well for those kind of use cases. There's some ideas about tracking progress using memory iterations. So we might be able to actually use memory iterations rather than time values for the default how long we wait to give up. Because that's naturally hedged between the size of the VM and the bandwidth that's available within your system in interesting ways. So some interesting thoughts to dig down there. The other heads up is, I was in a session earlier in the week and I promised to put this point in the slide deck because this is sort of me promising to go review a patch. We have some issues if you start pinning resources. The live migrate will work great but you don't necessarily have things pinned where you would hope they would be. As in we pin it in exactly the same place it was in the source node even if there's something already there on the destination node. Oopsie daisies. My final slide is about takeaways. In the UK fast food like this is called a takeaway. This is like fish and chips. The other thing is this is chips. Not those things they had downstairs for lunch by the way. They're crisps where I come from. I just thought I'd say that. Anyway, maybe we call it fish and fries and then it would translate better. I don't know. Anywho, sorry, British rant, finished. Live migration works. There's caveats but it does work. People are using it in production. Give it a whirl. Give us feedback. Shared storage. When you've got remote storage, shared storage, it's quicker but local is definitely possible. It does work, particularly when you turn off the progress thing. Whoops. And generally I just wanted to like try and give you an interesting look inside the tin so that you can better understand the trade-offs involved. The analogy I thought about this is if you've got one of the new raspberry pies with like the official case it's a bit like when you take the case off and have a look at the chips inside and go, ooh. It doesn't actually help you but I've given you a guided tour inside the little box to try and help you with the live migrate hopefully. Okay. Questions. I'd love to go to questions. I see one waiting. John, thanks for... John, John, John. John, thanks for the presentation. It was great. As an operator I've got a share thing and a question. Absolutely. We've actually had compute hosts that have lost their root disk. It's usually a controller issue. We use both root disks. They're a rated pair. But we're able to live migrate off of them. Everything except the post commit. Kind of the tidying up I think you called it. Got you. Because Libvert can't write to that local disk. So what we do is we basically monitor with an Ansible command to make sure it's really running on the new node, not really running on the old node. And then I go do a database cleanup manually. Is there anything that audits NOVA where instances are actually running? Because we've written tools to do that because I don't think there's anything that exists. Am I out in the field here? So there is a periodic task that runs that has a configuration option about what it does. If I remember rightly the default behavior is just to moan at you in the logs. Yeah, you can set it to reap and just delete things. I'm not sure I like reap because it seems a bit sort of whack-a-mole. But there's definitely information in there. Should we have more interesting tooling so you can make a more informed choice? Yes, there was a really interesting PTG discussion, forum discussion this morning about health APIs and like the health of the compute node. That would be a really interesting thing to put in there. How many foreign bodies have you currently detected in this place? We call it ghost detection. Oh, right, ghosts, yeah. That makes sense, or orphans, but that seems a bit Annie. Yeah, that's a good question. The other thing was is that now we fix some of the error handling. The instance should go to the error state even though just that little bit of tidy up failed. I think we do that bit last, but I can't remember. And you'd actually be able to use reset state to put it back to active. So it might actually help you. Hey, Chet. Hey, I got a question. So Chet's question for the video was, hey, you say you're saying it to error. You're not killing the VM and hurting me, are you? No, we're not killing the VM. It's literally just the API state goes to error. Previously, the problem was the API state just got stuck in the migrating and it looked a bit limbo-y. Yeah, so for the video, like when you do the cleanup, you can fix it. Cool, any more questions from people? Well, for the more shy people, like I certainly was when I came to the summit, feel free to come and talk to me afterwards. But yeah, thank you very much for listening. Thanks very much.


Alright time to do this video real quick What's up everyone welcome back to realistic gaming this is Mikey and today guess what we gonna react to you guys I never don't guess I promise you choo-choo Charles versus Thomas CXC Yes, we are going to milk it to his character dry We're gonna ride Chris Thomas till the wheels fall off Right because we keep finding new stuff people keep making stuff. It's not our fault. Okay, but today We're gonna watch choo-choo Charles versus Thomas CXC cartoon animation by game tunes. They've been making some good videos So, you know what I'm gonna watch it. So here we go. Let's start it off choo-choo Charles was Thomas CXC Okay Oh, Thomas CXC having that though Dude so I thought Thomas was saving the guy to be a hero, but no he was just saving him because he wanted him I have all the eggs I need now. I'm sure I can sell them for a pretty penny. That's Samuel Jackson live first It sounds like Samuel Jackson. Charles freak my show up next Okay, sounds like I'm in the clear for now, but I can't stop here Tell me that doesn't sound like Samuel Jackson Oh my god, it's choo-choo Charles. Oh, it's your job got beat up, bro I say week what happened to him? Why isn't trying to eviscerate me?   We got to move now Yeah, hey, yo, he really got beat up this time though He heard everything though, man. He just takes a little bit to recover. That's it. Okay now. I see you choo-choo What's going on here? It was I don't even know how to describe it. I heard it coming I Knew the sound of a train whistle like that around these parts meant instant destruction Yeah, choo-choo Charles was out on another one of his horrible rampages, but I've learned how to go in slow motion too If choo-choo Charles doesn't see any prey, he'll go right past you So I've created something of a little bunker in my house, you know for my safe I don't think that's enough locks. It wasn't a usual choo-choo Charles attack And it wasn't even choo-choo Charles, whatever it was Like him, but it was something different. It was something people forget cursed Thomas came first and I barely made it out Curse Thomas is the original I lived but it destroyed my home. I think I'm one of the lucky ones though See a lucky screaming out there felt like it went on forever I don't want to think about what it did to the rest of the town It managed to do this much just to my own house. Yo, they gotta make a movie out of this already Like for real like a real movie. I'm so down to watch it. You're about to see it quick That's impossible choo-choo Charles is out of commission. There's no way that to be him Believe it or don't but I recommend you get out of the way I don't know. I don't know what we know. We know everything about Chris Thomas Yeah, look at him See, he knows they're in there too. It's true. You see now I wouldn't lie about this kind of thing one spider train monster hybrid was enough But this guy's even more powerful if this creature is indeed even worse than choo-choo Charles Then everyone is in danger. Yep. Take it down now I'm getting worried cuz I feel like this is like real Like I feel it in my in my bones I don't sound like the Warren Charles the third I know since when do you care about the people of this town? I don't yeah, he never cared people means no minors no minors means no money Figured out how to deal with choo-choo Charles all about the money But this is another beast entirely. I need to get rid of him before he ruins my business model Yeah, are you planning to do that if you couldn't even defeat choo-choo Charles and choo-choo Charles couldn't defeat that thing But chance to we got it's simple You have to restore choo-choo Charles by performing a secret dark ritual and unleashing his final form There it is, you'll see but to get to that final form. It's pretty strong guys. It's pretty strong Perfect Don't freak out. I've got a bag full of these what on earth are those it looks like some kind of alien All we have to do is find a way to get these to how he stuffed those eggs in that in that backpack They're gonna crack in there bro come on man It's the last eggs working. He's bulletproof If we blind him, he won't be able to track us. Oh, yeah, go to the eye, bro Right there.  Bam Could you pull the trigger hurry up, bro? Oh? It's like he got his splinter in his eye, bro. I make this thing go faster. We're going as fast as we can Okay, I see you bro. Oh, he's pissed.   We can't take this thing down alone. It was fake He didn't tell him we're gonna have to fight fire with fire But now we only have one egg left Even if what you say is true and those freaky alien eggs can turn choo-choo Charles into this so-called final form Mm-hmm. Surely one isn't enough to complete the ritual Correct in order to end this we need to find enough eggs to make choo-choo strong enough to survive Yeah, do that we need to get to the mines. So follow me. I got a bad feeling about this I do too, bro. I don't think it's gonna work Quickly we're almost there. They better hurry up. Oh choo-choo Bro, that's his house The doesn't choo-choo live in there. Look at them. This is where they're literally on the train track. Oh Here we go, let's go square up.  Hey, look at them, bro get on that's one get up choo-choo Nobody screams is on like a train. I like it's no use. It's another dead end. Wait. I know these mines look Wait, this is it the shrine room quick. Hold me up. Hold me up.  Ah, I don't know. Well, there's only Well, just give him some ibuprofen or a Tylenol. He'll be good Give me yours and I'll put it in They got him this ultra instinct choo-choo. Oh, oh now he's going after it. Now. I don't think he's gonna kill him He's saying thank you right there. That's good. Oh That was it. All right. Hey, there we go. Well, that's game tunes for y'all Hey, that was pretty dope, but like man, like one thing I gotta tell you is This train-on-train crime has to stop. It's been going on for too long and Honestly, if it keeps going I'm gonna just keep watching these videos, you know, so Hopefully all this train-on-train crime stops. Okay, that's it for today. Hopefully you guys enjoyed that Please click like subscribe comment hit the notification bell really helps us out. We really appreciate it It'll be all see y'all next time


I want to inform you that Estonia is two hours ahead of us, so we're running late. Accordingly, I would first and foremost like to welcome you, sir, to this institute. But on housekeeping, could I ask all of you who have telephones on to turn them off, or take them out? You will know that by these rules, this engagement of the ambassador with us is under Europe House rules, which is you can use all the information that you hear, but can't see who said it or where you heard it. And we are going to have, I think, because of other time restrictions, just time for two questions. Is that correct? No. Thank you very much indeed. Over to you, sir. This way. Daple, well, whichever you're more comfortable with. Chair members of the institute, excellences, ladies and gentlemen, first of all, I apologise that we're late. More than six or seven minutes. Sorry about that. The second thing that we are really glad to be here in Ireland today in Dublin, and it means for us quite a lot. It is quite interesting that last meeting, this kind of collateral meeting with two Prime Ministers. Prime Minister from Ireland and Prime Minister from Estonia was more than 14 years ago. And today we tried to correct or to make this mistake better way. In the world of the great Irish poet Seamus Heaney, this could be a once in a lifetime moment when hope and history rhyme. At the beginning of the Estonian presidency of the Council of the European Union, I expressed my hope that our presidency would be remembered as one that allowed Europe to put the crisis behind us. And once again look optimistically towards the future. My own country, Estonia, and our people have been very lucky because our hope and history have rhymed twice in a century. In the aftermath of the World War I when we established our statehood. And after the Cold War when we restored our independence. Therefore Estonia have twice had that special moment in time. And twice we have turned it into a reality. Now we are happy to celebrate our 100th anniversary in three weeks time on the 24th of February. Our aspirations were realized again when we joined the EU in 2004. This was achieved during the Irish presidency of the Council of the European Union. Our European aspirations date back to the beginning of the 20th century when young Estonian intellectuals set their motor. Let us be Estonians, but let us also become Europeans. The European values of partnership and solidarity have helped Estonia transform from a force fully poor and underdeveloped country to remember of the family of innovative and successful European countries. But that transformation would not have happened without hard work and the goodwill of Estonian people. The time is right again for Europe to make big things happen on big issues, to make history. After the Brexit referendum and before key elections in Europe the year was full of pessimism. There was fear that after several blows the European Union would not entirely recover. Populist, protectionist seemed too strong. This would have been a disaster, not only for the European Union, but also for Estonia, for our country. As our security is based on the western alliance and larger amounts of jobs depend on trade. In my opinion the European Union member states have come together again and shown the world that we are strong. We are united that we can deliver the political corset in Bratislava, Malta, Rome and also in Thailand during the digital summit last September has allowed us to overcome this rough patch. Reclaim control over migration and restore economic growth. The Irish economic recovery is a good example, showing that European Union is moving in the right direction. As a result Europe is now back on track. The European Union has turned a new page and focuses on global challenges that significantly affect the lives of our citizens. In my view also pays attention to the details to make their minds. Perhaps this change was also facilitated to our agenda, optimism and hard work as a council presidency. When preparing the priorities we decided not to concentrate on daily crisis management but look at a bigger picture and longer perspective. What is actually taking place in the world? What should we do in Europe to be ready and not lag behind? So we decided to bring the digital transformation on to the attention of all European leaders. Our intention was to highlight that the digital dimension and smart IT solutions are an internal part of all EU policy areas from fisheries to space and they cannot be neglected. We drew attention to the past that our future is digital. We have to be well prepared for that, starting from improving the digital skills for our citizens and addressing some emerging trends such as artificial intelligence. We search for ways to make the European Union the ideal home for enterprises and innovators in the digital age. As the digitalization transforms sectors we must ensure that the EU's freedom are sustainable for the digital age. What I mean is that we have to make the most of the re-movement of theta. Ireland gave us a lot of support in all these debates. We share this common knowledge that technological innovation makes the lives of people, companies and our governments much more easier. I would like to thank my coach colleague Tishok for his leadership and full support. Honourable ladies and gentlemen, the development of cross-border services and e-commerce as real benefits for EU citizens and our businesses. With common effort from member states and institutions, we managed the complete vital parts of legislation on e-commerce. Agreement was reached on ending job-locking. We endured the transparency of prices of cross-border parcel delivery and modernized value-added tax for cross-border e-commerce. We also decided that international tax rules have to be updated in a way that would ensure a fair taxation of digital economy enterprises. We took a huge step forward in creating a true theta economy, introducing online e-services and ensuring connectivity and cyber security. To common understanding of member states on making e-government an efficient functioning reality in Europe was confirmed in October, when the declaration of e-government was signed in Thailand. The 5G declaration signed by the ministers of 28 member states, plus Norway, will definitely provide the necessary boost for development of super-fast internet connections. An ambitious spectrum brand policy makes super-fast 5G communication, self-driving transport, the internet of things and many other reality. This digital single market is far from being completed, but I'm convinced that thanks to good cooperation we achieved a lot during the past six months. And that we will be able to complete most of the work before the next European Parliament elections. Honourable audience, Europe did not only progress in digital affairs. During Estonian presidency landmark decisions were made in defence cooperation as well, climate policy and social dimension. They all have significant structural and long-term effects. The joint declaration of the member states for the creative of the permanent structured cooperation is a significant step in enduring Europe's safety. 25 member states total have decided to improve defence cooperation, increase their defence expenditures and carried out several joint projects, such as simplifying and speeding up military transport in Europe of military shengen, as it has become known. I'm proud that the European Union has demonstrated its determination to implement the Paris Agreement. Climate change will influence the freedoms and quality of life of future generations. After the spoting of TOHA and amendment ratification instruments at the end of the year, European Union has shown its global leadership. In practice it means that the member states have made forward-looking decisions that served the common good. We have agreed a reducing greenhouse gas emission by 43% by 2030 in energy intensive industries. We have taken binding national greenhouse gas emission reduction targets for each member states collectively amounting to 30% cut in emissions by 2030 in other sectors like transport or agriculture. Furthermore, we have agreed that accounted emission from land use and forestry are entirely compensated by an equivalent removal of CO2 from the atmosphere through action in the sector. We have also set clear targets for the reduction of waste and established and ambitious long-term plan for waste management and recycling. Ladies and gentlemen, by signing the Bill of Social Rights in the name of all 28 member states in Gothenburg in Sweden, we made a promise to reduce unemployment, poverty and inequality together. We believe in Europe that offers equal opportunities and access to the labour markets, fear working conditions as well as social protection and social inclusion. In the coming years, another important decision will be made that will affect our future in Europe, that is EU budget, starting from 2021. Estonian believes in a strong and stable European Union. For us, less Europe is not an option. Therefore, the EU budget must have the capacity to address the issues all member states pledge to work towards in the Rome declaration, reducing the budget would mean for going to commitments we have made to our citizens. Just as Tishok advocated a strong and stable EU in his speech in the European Parliament, I also do not see any room for reducing the common budget. New priorities need financing but traditional policies also remain important. The EU budget must have a strong focus on investments promoting productivity, competitiveness and connectivity of the EU and its member states in a globalized world. So, there are a lot of important topics we all have to openly discuss with our citizens in order to build a better future for Europe. I also know that Ireland is already doing that. I would like to congratulate you for successfully launching citizens dialogue on the future of Europe. There is one more topic that I would like to address before I conclude and this topic name is Brexit. Brexit, this kind of small topic. U.Estonians are sad, really sad to see the United Kingdom withdrawn from the EU. I'm pleased to see that negotiations progress in a constructive spirit tackling first the citizens rights, the financial settlement and of course the border in Ireland. We strongly support Ireland in their position that there can be no return to a hard border between Republic of Ireland and Northern Ireland. No coasts of the past should return as a result of this process. I'm sure that detailed agreements giving effects to this promise will be found during the second phase of negotiations. In conclusion I see determination and opportunities coming across again in Europe. I see that now is the time when Europe makes our history. Although Estonia and Ireland are situated quite far from each other, we are quite similar in how we see the world. We have many things in common. For example, both of us have prominent authors who are similar in era and name. Wild and wilder respectively. One is world famous, the other is just famous. But in addition to that, both of us have a forward looking, constructive and innovative way of shaping our lives. I'm sure that our bilateral, regional and multilateral cooperation will become even stronger. Thank you for your attention.


Alright, you are still watching Waze, National Wine and Cheese Day is a day that celebrates the ultimate pairing of cheese and wine. For a lot of people, there's nothing that goes together better than a great glass of wine and some premium quality cheese. Tell this to my brother-in-law. And then they chop cheese. If you see some kind of cheese, Waze, you can bring it. The extent that we eat it, you can tell that this is the quality. The French have a unique perspective and love for cheese. So I always loved the good, very mature cheddar or Leicester. But when I started to work with a lot of Europeans, that's when I expanded my range of cheese. I don't think there are a few things for me, food-wise in life, that's better than a good quality. Brie, Camembert, Gouda, the Leicesters goes on. So first of all, I like cheese with fruit, so I like cheese with grapes. And then of course, wine comes from grapes, it's just a step up. But their flavor profiles are really just worth to get there. And again, when you're talking about having cheese on its own, with a bit of a culture like crackers or fruits or wine, you're doing a good quality cheese. I'm not talking about a baguette-based cheddar that's the kind that you use for macaroni and cheese. I'm talking about good cheese. Cheese is stinky, real good. When my brother will bring some kind of cheese out like this, he will say, try it, this is really nice. He will say, uncle, keep it, I'm not chopped. But I've tried some really nice ones because my sister has, sometimes she will just try it. Me, I'm actually open to trying, but I've really tried some really beautiful ones. But it's just that those ones that are very old and stinky, I can't taste anything. It's a really nice umami. It's just a gorgeous flavor. It is with you. We will take you back to Europe. The crumbly stinky blue cheese. I mean, come on, it's just amazing. I can go on. I can see. It's funny, let me go. I can see that Uti was having a ball. I'm telling you. She was. The story is a feel good story. And it is about the Chibok girl who actually escaped when they were being transported to the forest. So it's such a wonderful story to read. And I just had to bring it on air. And it says a feel good. It says one of the Chibok girls who escaped Boko Haram adoption gets engaged to her man in the U.S. And one of these girls, her name, the girl's name is Joy Bishara. She actually did this in 2014. If you recall, that was when the girls were actually adopted. It's such an amazing thing that it's years has gone by since this thing happened. And she did this in America. She is actually engaged to her Caucasian lover in the U.S. Recall that in April 2014, Boko Haram members invaded the school and adopted a tool of 276 female students aged from 16 to 18, 57 of those girls immediately escaped following the incident by jumping from the trucks on the way to the forest. Ms. Bishara is one of these ladies or young girls that escaped. And afterwards she actually relocated to the U.S. Now imagine if she was not able to, you know, escape. She would have been just like any other Boko Haram. One of the girls that were actually adopted, yes. And the state of those girls today, some of them were able to come back home. Some of them, we don't want to go into the details of what they had encountered. But still we still have some people or some girls that are still missing and have not found their way back home. And it's appalling and sad that again, Nigeria has filled those goals. But it's also interesting to understand that this young girl that actually escaped and the other girls that escaped were able to change their fate. So again, we have the right to teach our children to learn how to survive or have some survival skills when they find themselves in an environment such as what the young lady found herself. So I think happy that she was able to actually escape and find something good about her life afterwards after the Boko Haram incident. Okay. Happy for her. Congratulations to her on her engagement. And it's really sad that we still have some girls that are still in captivity. Still in captivity. Very sad. All right, so Jella, what did you find for us quickly? Okay, so headline is artificially ripened fruits may cause cancer, heart failure by NAFDAQ. So this is like a public service announcement to say that we should be very wary of the artificially ripened fruits that we take. Examples are mango, bananas, plantain, guava, orange grapes. This then is actually forcefully ripened with calcium carbide, which is very dangerous to health. NAFDAQ says that it has put in measures in place to do a sensitization around the country so that people are aware of the detriment of eating or even the people selling it. Again, because I know that in Nigeria we really don't have, we're not big on storage. So most of these items are perishable. So when they come, people want to quickly make sales. Again, people won't buy what is not ripe. And then when you first fully ripen these fruits, they're actually sweeter. They are softer, yes. I don't think so. I've had experience with plantains, most especially. I bought plantain from the market and I've gotten plantain from the farm. The plantain that I've gotten from the farm, actually I love the process because if I have a bunch of plantain, let's say we have maybe 20 or 35 pieces on the bunch. It ripens very progressively. You see maybe today two ripens. It doesn't ripen all at once. But once you buy from the market, I struggle to buy in bulk because as you are just dumping it there, the whole thing just ripens. But I have seen that progression with the ones that is directly from the farm that was nothing like the carbide and all of that was applied to it. And I think that those ones are even sweeter in my own opinion than the ones that I buy from the market. I think that's because you are very health-conscious and you have fought your palae to acquire. Some people are really sweet too. They want things really sweet. So those artificially ripened ones are the ones. This is what it is because I was just going to say that from the time that I learnt about this carbide thing, I prefer to buy plantain. So very rarely will I buy the ripened bunches because you just hit the nail on the head. If you buy a huge big green bunch, it won't all ripen at once. But when you see these plantain on the road, they look really pretty, yellow, and they are actually very sweet. So if you take the taste of what you have ripened yourself, it never gets to that sickly sweetness. So that's where the difference is. Because when you buy a green bunch, it will ripen a little bit at a time. It's not all at once. So it's not to say that every seller does it, but it's a normal practice because, again, we all want nice looking, bright, colourful fruits and vegetables. My story is interesting. When I helped me, let me first of all do the screen graph. There are about 660 staff at the Cardinal Refinery and Petroleum Company, 506 staff at the Potacot Refinery Company, 437 staff at Worry Refinery and Petroleum Company. All of them earn about 136 billion Naira in salaries without refining a drop of crude oil. This report was done by the Guardian. And if you go to that report, it is sickening, Uti. Honestly, it's very sickening. Now, there are prospects that some allocation was done for the refining of the Potacot Refinery. But according to what the community and the eye witnesses around there say, they say that at the rate that it is going, they are not sure that they will be able to meet the deadline of completion for that project. We should hire a project manager. No, we have to tell them. But what was really sad for me in this report was the losses that have been experienced have been incurred. Now, in 2020, total loss incurred by the refineries was over 7 billion Naira. September, right? It was over 7 billion and 43 million. In October, it was about 5.4 billion. In November, it went up to 5.9 billion. In December, it went up to 5.8 billion, all in 2020. What is the basis for that loss? I never knew it. They never tell me yet, but they say they kept a total of 1,701 staff.  Even whilst these rehabilitation, especially in Potacot Refinery, was ongoing. Now, in 2021, about 5.7 billion. So in total, the losses that have been incurred is 136 billion Naira. Is this no madness in this country? You see all these people that are busy going up and down, saying they are protected, they should go to NNPC and what evacuated those staff there because they don't get what they work on and what they do. Now, they put us alongside Saudi Arabia, I think, or is it Qatar now? They put us alongside those ones. Whilst we are recording losses, those companies are recording extreme, what's it called? Profits. Profits. Why would they not record profits? Because those people, they know to the last drop of the crude oil, they can trace it and they know where the crude oil is going. Like, are we jokers in this country? We are jokers. So now what has happened is that all these staff that have been retained in NNPC, you see this increment of all these things that we are suffering as Nigerians, we are the ones subsidizing their lifestyle because I don't understand why you are a business person. You are suffering your incurring losses and this is not small losses.  But I am struggling with the annoyance that you are experiencing. This thing you are seeing is in the entire public sector. We heard a whole show about it now. Aunty, the public sector, they say they see small losses they do. They clarify. What is NNPC they do? They are machinery. They are machinery and things that they... At the refineries. They will tell you that they have work that they are doing. So my point is, if you are going to be this upset, don't stop at the refineries. I love the way Kunle put it, where he says the entire public service is Nigeria's welfare system. So the fact is, there are certain states where you don't understand why they have the number of staff that they have. At the federal level, there are some ministries that I would like to know what the ministry of special duties does. I would like to understand. Senior Special Advisor on Domestic. No, I would like to understand what's between ESCC, NFIU. We still have financial crime. There are still people getting scammed every day. So really and truly, if you are going to expel this energy to be upset, just go clean across the board. Don't stop at the refineries, that means. No, the one way they are knowing me, because I don't want to be concerned. Refineries are the ones that cause the suffering. They buy petrol at that much. I get you. I get you, but I just wanted to vent. That's what I said, if you are going to vent across the board. If you are going to expel the energy, do it a little wiser than the government is doing it. If you are going to complain across the board, because all of these people, they are on our bill. You are paying the money that should come into the infrastructure, the money that should come into SMEs to drive the economy. All of that money is being used to pay these people salaries. So that's why I said, be angry across the board. Don't stop at the refineries. State by state. What do they have so many state ministries? What are they doing? So the truth of it is, we are at Sherry Park at state level where local governments are collecting money. Everybody got a slice of the cake. So if you are going to be angry, let it be holistic. Hi. Nigeria. It's so bad rather than crying. Just laugh. No, Nigeria cannot happen to me. Are we forced to straight Nigeria? No, you can't. Let me question you. You will get an experience. A Saudi oil giant, in his second quarter, they sold to 48.4 billion dollars. Let me shock you. That's how much they are making. Up to 25, up from 25.5 billion dollars earlier in the year. Other countries that have brains that are using the brains.  This report was 2020, right? It's not 2020, it was today. Okay, today. Remember that the past, the ex-president was the minister for so there is that. Leave it to me. On that note. Like Uti said, this is a cross-bord. Exactly. Exactly. Let's go and break.


Hello and welcome to the session. Let us discuss the following question. It says an equilateral triangle is inscribed in the parabola y square is equal to 4ax where one vertex is at the vertex of the parabola. Find the length of the side of the triangle. So we are given an equilateral triangle inscribed in the parabola. Now since OPQ is an equilateral triangle angle each angle of this triangle is 60 degrees. So angle P is equal to angle Q is equal to angle O is equal to 60 degrees. Now we see that the line joining PQ is perpendicular to the x axis. So PQ is perpendicular to O x. So PBO is the right triangle. Now let the coordinates of the point be x1, y1. So the point P x1, y1 lies on the parabola. Therefore this point satisfies the equation of the parabola. Therefore y1 square is equal to 4ax1 and this implies x1 is equal to y1 square upon 4a. Now considering the triangle P OB or OPB it is a right triangle angle, right angle at B and angle P is 60 degrees. So tan 60 degrees is equal to perpendicular upon base that is OB upon PB. Now OB is x1, PB is y1. So tan 60 degrees is equal to x1 upon y1. Now we know that tan 60 degrees is root 3. So root 3 is equal to x1 upon y1 and this implies x1 is equal to root 3, y1. Now we know that x1 is y1 square upon 4a. In A we have y1 square upon 4a is equal to root 3, y1 and this implies y1 is equal to 4 root 3a which is equal to PB. Now similarly considering the triangle OBQ, angle Q is 60 degrees and this is a right triangle angle, right angle at B. So you will find that BQ is equal to 4 root 3a. Let's call this as 1 and this as 2. So PQ is equal to PB plus BQ. Now PB is 4 root 3a, BQ is also 4 root 3a. So the sum is 8 root 3a. Now since this is an equilateral triangle all the sides equal. So PQ is equal to OP is equal to OQ is equal to 8 root 3a. Hence length of each side of triangle is 8 root 3a. And this completes the question and the session. Bye for now. Take care. Have a good day.


Zanfarah State Governor Mohammed Bellou Metawali will on Tuesday, June 29, 2021 defect from the People's Democratic Party PDP to the ruling All Progressives Congress, APC, and an invitation letter addressed to chief chief of the party states that Metawali, alongside his teaming supporters, will be formally received into the APC at the Zanfarah State Government House in Gussel, the state capital, by 2 p.m. on Tuesday. The invitation letter was signed by the U.S. state governor and chairman, APC Extraordinary Convention Planning Committee, Mahmala Bhuni.


The Adventures of Frank Race, starring Tom Collins. The war changed many things, the face of the earth and the people on it. Before the war, Frank Race worked as an attorney. But he traded his law books for the Cloak and Dagger of the OSS. And when it was over, his former life was over too. Adventure had become his business. The Adventures of Frank Race, or the Adventure of Seventeen Black. Saratoga, city of sport and health. Where you can watch the thoroughbreds come thundering into the stretch, or increase your physical efficiency with its spring water and sunshine. But my sport at the moment wasn't taking place in the sunshine. And I'm afraid the healthful effect of its atmosphere was rather dubious. Number Seventeen Black. And now you're coming up, Mr. Race. Yeah, it's about time after what I've dropped here tonight. I'll let that ride again. At last I find you, sir. Oh, hello, Mark. Thought you were in New York. Place your bets, please. I was sent up here to find you. We've got to get going. Come on. Won't you hurry? I'm busy. You're going to be busy. You've got a hasty test for universal indemnity. The embezzlement job that they want is right now. Number Seventeen Black. Looks like you're in the groove, Mr. Race. I've got luck on my shoulder. Leave it right there, Eddie. We're letting it ride. Oh, no, we ain't. Eddie, push it this way. We are heading for New York. How about, Mark, I'm just beginning to win. You ain't going to win by leaving it there. Let's blow. This is important. Place your bets, please. Yeah, well, of course you're right. Come on. Sight me, I'm right. Nobody can keep playing one number on that thing. It just ain't in the force. Yeah, hold on a second. Seventeen Black. You see, what did I tell you? Hey, you want to get? Yeah, what a one. You hadn't picked up the bet. Look, maybe we want to go back and play that thing for a while, huh? Here, you're hot. Come on, Mark. We're heading for New York. Who talked to you from the insurance company, Reid? Yeah, Chesapeake Reid.  He told me all about it, see, so I could brief you. What's the story? Some guy keeping books for a construction offer took 70 Gs of the company's money. He was bonded with Universal. Reid wants me to go after him, huh? No, no, no. Not the guy. He's dead. Suicide. Reid wants you should see if he can find a doll. At the Universal indemnity, I ain't got the details. The allegedly embezzler had been a man named O'Connor with a home in Yonkers. I had Mark drive me over there to see his wife. What's the use of talking about it? Johnny's dead. After a while, I suppose I'll be able to tell myself I still got a baby. He's a year old. How do you fix the money? I've got the rent for another month. I've got some ground meat for supper. I guess I'll have to get a job pretty soon. Didn't your husband have insurance? $8,000 worth. But we'll never get any of it. Not if they call him suicide. That should have occurred to me. How did he die, Mrs. O'Connor? He was found in the garage, shot in the car, carbon monoxide. I see. They'll never convince me that he committed suicide. Not Johnny. He enjoyed life too much. He was right in the middle of making a crib for the baby. And if he stole that money, where is it? I understand there was a confession. A fake. Even if it is in Johnny's handwriting, here it is. I'm taking the only way out. When they audit my records, they'll find I've misappropriated $70,000. Try to forgive me, Johnny. He never took that money. Possibly not, but it's missing.  If we're going to prove him innocent, you'll have to help me. I'll do anything. Did your husband have any friends in the company or particular enemies? Irving Dalton, the chief accountant. He always treated Johnny like a laborer. See, Johnny used to carry a hard. But when the baby was coming, he took a night school course in bookkeeping to better himself. Did Dalton hire your husband? No, no. T.J. Thomas does the hiring. He's general manager. Does Thomas have a financial interest in the company? I think he owns a third. The rest of it belongs to Mr. and Mrs. Maynard. Well, possibly Mr. Thomas can help a little. I'll see him tomorrow. In the meantime, take this. No, no. I couldn't. We'll call it a loan. You've got that youngster to think about. And for the time being, stay with your baby and forget about getting a job. Taking him back to the city, Mark. What's cooking? Known to think about a family name Maynard? Oh, so you need a hard punch to get along with. The old man's retired cement finishers. See, the boys, they don't believe in labor of any kind. No, you're working the wrong neighborhood in there. Maynard's I refer to as the big-time contractors. Oh, big shots. No, no, I... What is it? That's the dam behind us. What's that? They're waving out the wind. It's a Tommy gun. Right. You better do some twisting. They're waving at us. You got a gun? In my hand. Well, against that firepower... He's gunning on me, Rice. We're gonna get it. Rice, you okay? Let me get my arm free. He's coming up with that machine gun. He's lying to self-race. He's got it. You got him. You got him. Watch out.  Just hit him in the leg. Yeah, but he lost that chatterbox. We're okay. Let me help you out. Easy, Mark. Take it easy. Yeah. What kind of a deal is this anyway? Looks like a lethal deal, Mark. Somebody's playing for big keeps. You didn't go to an ordinary lumberyard to find the offices of the main construction company. That took up half the 14th floor of a skyscraper. I was impressed by the handsome paneling, the ancestral portraits, and the cocktail party that was going on. That place was rocking. It was only after quite a bit of elbow fencing I was able to force my way to a waiter. He promised to locate T.J. Thomas for me, but it was at least 15 minutes before I got a reaction. Mr. Rice? That's right. I'm Irving Giles. I'm Irving Giles. That's right. I'm Irving Dalton, chief accountant of the firm. You have been moving around for a little days. You didn't come here on business, I hope, not this afternoon. What are you celebrating, lifting up a mortgage? Just a little part in honor of State Senator Humphries. All this for a State Senator? What would you do for a governor? I understand you want to see Mr. Thomas. Yes, T.J. Thomas. General Manager, isn't he? And it says General Manager on this door. It also says Private, Mr. Rice, if you don't mind. That's a long elevator ride of him. I'd like to conclude my business this time. So, if you ask me, I don't think it's a good idea. Really, darling, no one asks you. Hold a second. You don't mind, this is rather private. Sort of board meeting. No, I don't mind at all. I'm most anxious to talk to the board. Now, wait a minute. My name's Rice. We're concerning the claim on your bookkeeper, O'Connor. Oh, well, in that case... Come right in, Mr. Rice. I'm Sandra Maynard. This is Mr. Thomas, our General Manager, and my husband, Arthur Maynard. What do you want? No, Rice. Several things. But first, I'd like to express a personal opinion.  He was murdered. Dear me, headlines. Sandra, my darling, your welfare league group will buzz about this one.  This is very interesting. Are you ready to prove that someone else misappropriated the money, Mr. Rice? Not yet, but that much money doesn't just disappear. There's an outright case of embezzlement. The books fake for themselves. I should think so. Oh, of course. You know all about the records, don't you, darling?  And I'm warning you, Arthur, if you don't stop... The witnessing marathon of Donna Brooks has never been to my liking, so I'm eased out of the room. My hand bumped into his delectable a bit of fabric as I'd encountered in several days. A tawny blonde with a benign eye. You look sort of brandy. You know those people in there? Sandra and Arthur Maynard? I'm sure I know them. What's the pitch on their relationship? You sound like someone sent out to watch the silver. And I've run into a defendant of the family honor. Oh, not me. I know them, but I don't play in their yard. And never will. They don't get along. It's embarrassing. That's because they're going to be divorced. He used to be her teacher at college. I guess they never straightened it out. Make quite a clatter out of it, don't they? This whole party has turned into a clatter. I think I'll go home. You care to come along? Most encouraging invitation I've had in weeks. Lead on, fair lady. Lead on. What's the matter with that cab driver back there? Sounded like he was putting up quite a squawk.  Just because he waited half an hour for me felt he should drive us to your apartment. When I've got my own car, he must be nuts. Well, it's a night to send anybody by me, don't it? Full moon, sky full of stars. Perfect night for romance. Or wedding. What makes you say that? Just a thought. Do you always carry so much luggage in your car? I'm a nightclub singer. I'm going away for engagement. Oh, too bad. You'll come with me. What I do, push your piano around? Ray. You should come along and push your piano around. Come inside. But first, let's have a little light. What are you doing? I'm building this pistol from your purse. What is it, part of the new look? Oh, Ray, don't be like that. I'll go for you if you let me. I might even postpone going away. How would you like to talk about a man named Johnny O'Connor and $70,000? I might. There's something that might interest you in the bottom drawer of that bureau. You're stuck. So are you, sucker! Nice work, Doris. Now we can get rid of this chump for good. We'll return to the Adventures of Frank Race in just about one minute. Hello, back to the Adventures of Frank Race. When I came alive regretfully, the hazy conviction to my head had grown at least double and was still trying to expand. I told myself irritably this was no procedure for establishing Johnny O'Connor's innocence. Or securing his insurance for his wife and child. Then I caught voices and I knew my best bet would be to play dead. Any sign of life back there, Rocky? Nah, he's out cold. Better take a look and see if he's coming, too. Relax, will you? When I slug him, they stay out for hours. Flash the light on him and make sure. Okay, okay. Out cold is a mackerel. Want him up front, don't you? Yeah, right behind the wheel here. Give me a hand. This guy's big. He's hard to lift, all right? Let's give another heave. It's good now. Now pour the liquor over. This ain't no new idea, you know. It's got to be done right until the cops get hip. That's good enough. Now put the car in high. Aw, I want to stay. Why don't you go through that guardrail on the curb? Nothing doing. We're getting out of here. I'll set. Okay, then. Let it go. I learned that the car fooled me. Threw me sideways in the seat. I tried heating up, but the reflexes were off. That curve. I had to get control. If I didn't, I would never do that to yourself. I just sat there for a few seconds, and I staggered to a phone booth and asked Mark to come out and meet me. All I can say is it was your own fault. If I'd have been tagging along, it probably never would have even happened. I warn you about that thing. He's very attractive, Mark. Despite what occurred, I should continue to think about it. Whistler. She had a look. You know me. I never miss on things. I agree. You're the most dangerous species. Most dangerous of the species, Mark. You take it for me. It ain't of anything. When it comes to working angles, dames are all by themselves. What are we going to do with this car? Take it back. It ain't cracked up as much as my cab was. Ain't a bad car at all. What is it? Registration says it belongs to townals and humpries. Used car sales. That's where we're taking it, at midnight? The join will be shut tight in Atlantic City in December. Now some... they could call his break in and enter. You mind? Not so long as the cause is just... they need a new door here. You want my flashlight? No, street lights enough. You take that filing card and see if you can find any papers on the car. I'll try the desk. How do they file these things? By license number, make a car. I ain't having no luck. Never mind. Take a look at this. What do you got? It's like a... made out in my name. According to this, I own it. Then unload it as soon as you can. It needs no rings and a rainbow. A tight little arrangement. Look, I don't get it. I do. If I'd been killed and I'd marked this slip, it would have been mailed to the Motor Vehicle Bureau in the morning. It would have covered my accident very nicely. Looks like you're up against a tough pigeon, right? There's more to this than just the missing 70,000. I wonder if I could squeeze any information out of Sandra Maynard. Squeeze another time? In this case, Chum, that ain't good. Well, you're wrong, Marcus. In this case, it ain't bad. The home of Sandra Maynard turned out to be one of those structures that a locksmith and a couple of carpenters could turn into a hotel over a weekend. The lady of the house greeted me in a sequence, something that gave almost as much flash as she did. I instantly recognized one quality in her that I tabbed as dynamite. While you were with her, she'd make you forget all the other women you'd ever known. After our scrambled meeting last night, this was rather unexpected. But it's nice. Cigarette? Thanks. You'll be drinks along in a moment. Manhattan's and Martinez. I'm sure you must like one or the other. There have been occasions when I've gone for both to my eventual distress.  But then I suppose you already know that. You're, um, rather direct, Mrs. Maynard. And I'm sure you make good use of the trade. It saves time.  Call me Sandra, everyone does. Even my chauffeur. I'm flattered. I wonder, have I stepped off on the wrong foot? With your facade, why worry? Suddenly I do find myself worrying. Do you mind if I try to impress you, race? I think I'd enjoy it. Why did you come to see me? To talk business. Stand it way. I don't think it should. Race, I have a feeling that you might be crusading. Did you know Johnny O'Connor? Do I look the type to know anything about a construction company? I inherited the thing from my father. I care so little about it, I've given my husband a quarter interest. To get rid of him. What about your Johnny O'Connor? He was the bookkeeper who was supposed to have committed suicide. After embezzling $70,000. And you don't think he did? Either one. It seems that he handled the expense accounts for the firm. Entertainment bills, items like that. I don't get the significance. The state's attorney general has been asking for funds from the legislature to investigate contracted bids for public works. Been complaints that your company's had inside information on supposedly sealed bids. So a lot of expense vouchers in your office became too hot to hold. Expense vouchers that might have been linked with the bribing of public officials. What does all this have to do with that bookkeeper? Shall we say that with all those vouchers missing, say, $70,000 worth, O'Connor would be the patsy with nothing to back up the entries in his books. Especially if he weren't around to offer excuses. I'm afraid you've lost me, Race. I let Thomas run the company. And you know nothing about this? Nothing. But I do know one thing. What's that? I'm glad you came into the picture. Thanks. I'm gratified. Oh, stop looking at your watch. You don't have to rush off, Race. That's getting late, and I have another call to make. On another woman? On your chief accountant, Irving Dalton. I want to see you again. If you'd care for my case history, I'm 26 and rather wealthy. In about 60 days, I shall no longer be encumbered with husband. Nesting deposition. Don't worry. You'll never be lonely. There's nobody home, Race. There should be. This hour. Yeah, why don't you try to nab? Nothing like the direct approach. I should have blend that earlier this evening. It's under a minute. There's going to be a light switch here somewhere. Yes, Billy. Now, we... Oh, Race. Yes. It's Dalton. Look at his droid. Somebody must have chalked a wand at him. He must have been showing signs of weakening. Let's get going, then. No, no, let's look around. Oh, open the door to keep it. Okay. Didn't know if it finds you wake, Dalton. Take it better, like Thomas. You'll notice he isn't awake. Say, what is this? Well, I know some inquisitive gentlemen who'd call it homicide. What do you think you're going? I'm getting out of here. Not yet. I had nothing to do with this. Possibly not. But I have a hunch we can tie you in with Johnny O'Connor's murder. I had nothing to do with it. Oh, then you know it wasn't suicide. No. No, I... Mark, dial the homicide bureau. Now, now, wait a minute. Why can't we sort of talk this over? We can. Why don't you start in? The first place. Grace, look outside the window. Well, I'd still on the home of Sandra Maynard. I told Mark to drift around the grounds, keep his eyes open, and then I rang the bell. The butler appearing in a robe insisted that his mistress had retired. I had him take me to her bedroom suite where we found her still up. She dismissed the butler. You mind if I go on brushing my hair, Grace? Not at all. Doesn't disconcert you? You know very well it disconcerts me, but at the moment there's something else. What else, Grace? I just came from Dalton's apartment. He's dead. Wait. And so is T.J. Thomas, your general manager. Yeah. Dalton was strangled. Thomas was shot. Grace, Grace, you're not serious. Who could have done it? The police might think you did. I? Grace, you're kidding. You don't think I did it, do you? The person who killed Dalton had the strength of a man. Do you have a pistol? Pistol? Have you ever had one? Yes. Yes, of course, but my husband's had it for some time. You can prove that? Well, I think so. The butler knows that Arthur has had it. But the permit was issued in your name? Yes, it was, but... There's a bullet in Dalton's apartment. The bullet that killed Thomas. The police are going to find it. When they check it in ballistics, your butler's testimony isn't going to be much good if they find that gun here in your room. But I told you I don't have the gun. I have a feeling that your husband is going to plant it here. Oh, Grace, I'm all upset. Why would he do that? First, to cover himself. When he gave him that interest in the firm, he decided to make it pay off in a big way. He got Thomas and Dalton on the hook and they started the bribery pattern for big profits. But you're the principal owner. So he's going to try to tag you with the guilt. Another thing. If you were to be executed for murdering, he'd get another big chunk of your estate since he's still your husband. Grace, what am I going to do? No, we can wait for him. Then, when he gets here... I'm already here with Grace. What's the matter, my darling? Last your poise, emulate Mr. Race. He's quite controlled. That's your gun he's holding, Sandra? Yes, yes, that's it. You've caused me a great deal of trouble, Mr. Race. The obvious suicide of O'Connor satisfied the police. Why didn't it satisfy you? Johnny O'Connor didn't have your educational background. He'd never have used a word such as misappropriated. Not even in a suicide note. He used the same word when I interrupted that office meeting. Even Thomas was satisfied with him best. You smelled murder in one word? In two words. That was a simpler one. O'Connor would have said books. Thomas called them books. You used records. The note said records. I admire superior intelligence, Mr. Race, but I'm afraid I'm going to have to dispose of you. You'll be a bit involved, won't you? Not at all. You came here to charge Sandra with crimes.  Her gun, as you pointed out. She then commits suicide. Mr. Race, stop looking behind me as though there was someone there. Ah, but there is. Mr. Race, won't you pay back?  All you need is the right guy to flip it. Marcus, never have I been so happy to see your ugly face. The Adventures of Frank Race, starring Tom Collins with Tony Barrett as Mark Donovan, came to you from Hollywood. The series is written and directed by Joel Murcott and Buckley Angel. The music is composed and played by Ivan Dittmarz. Be sure to be with us again this time one week from today for another dramatic chapter in The Adventures of Frank Race. Art Gilmore speaking. This is a Brucells production.


A global project to track the journeys of specific rain drops is harnessing the power of big data to monitor water supplies for our thirsty planet. Every month, for over 50 years, researchers have gathered rainwater from stations like this in Vienna and hundreds of other sites around the world. The unique isotopic signatures or fingerprints of each rain sample are recorded, and this information is entered into a large online database where it's compared to similar data from surface water to see which rain drops end up in which rivers. This large amount of data allows researchers to better understand the water cycle, for example, how, when and where water is recharged. This information is key for managing water resources, especially in the light of climate change. The datasets and maps are available to download for free and can be used in many ways. For example, in Costa Rica, where they're helping the government identify key locations to protect groundwater so they can target conservation measures and avoid drought. We now know which areas need special attention. We know how to protect them to ensure water supply for now and the coming decades.