So let me introduce today's speaker. So the webinar is provided by Greg Willis. Greg is responsible for the outreach and he is co-lead of the hotel project. A project I think mainly supported by NSF for several years now. The hotel makes it possible to have your science reproducible and therefore transparent. And having reproducible science is the pillar of science. I think if somebody else cannot reproduce your science then your outcome might be questionable. So I think this hotel project is a very important element. So I'm pleased that you can join for this presentation. Hotel developers have created a wonderful gateway. So please visit that and I'm sure Greg will point you at some point to it. But the gateway is there for you. You can post your workflow basically there and others can follow the steps you have taken to get to the findings you present, for example, in the paper. Some logistics regarding this webinar. So we're recording the webinar. So please keep your microphone muted, your mic muted as well as your camera for now. If you have questions during the presentations feel free to put them in the chat. And after the presentation, me or Lynn will read them out and hopefully Greg can answer some of those. So after the webinar, the recordings will be posted on the CSDMS website. It will take a couple of hours, but we will keep it there for you to review or if you want to point colleagues to it or something. So with that, Greg will present today, publishing transparent and reproducible computational research with hotel and with that crack the floor is yours. Great. Thank you. Thank you, Albert. And good afternoon for me. Good morning for those of you putting in your time zone. That's not shared here. So, as Albert said, I'm Greg Willis and so present about whole tail. University of Illinois at Urbana champagne and school information sciences. I've worked on whole tail now, the projects in that seventh year. I've been on it I think for five or six and so quite a while.  And I'm good because I'm going to be looking at another monitor I'm going to stop my video if that's okay. So whole tail is as Albert mentioned, as I've funded the old data infrastructure building blocks blocks program now CSSI. And as such, the goal of the project was intended to rebuild usable reusable infrastructure. What we've developed and continuing develop as an open source platform for computational transparency and reproducibility. I'll talk about our definition of that in just a second. And the platform is intended to help researchers create publish and enable review like assessment verification of computational research artifacts. And in the platform we call these artifacts tails, you'll see them called capsules by other similar platforms. And the project websites there and the dashboard. So we operate an instance of whole tail hosted on NSF's jet stream to cloud. And I'll use during the demonstration what I will say is that very sadly about an hour before this presentation. Jetstream had a network outage. So hopefully the demonstration will go well I may flip over to another instance that we have for another project if needed. So it was a unfortunate but typical incident so this it's a public dashboard and I'll walk you through using it. So what do we mean by computational reproducibility and transparency. It really takes this narrow view of computational reproducibility that's from the National Academy's definition, which is really getting the same results using the same data, the same computational steps methods code conditions analysis so some people would use reproducibility. So the broader ideas of reproducibility and replicability were whole tail platform is in support of these, but as a technical solution it's really about enabling people to re execute. You're now a computational workflow or an analysis from a point in time, trying to retain as much as we can about the environment, the information about the software that was installed the software used et cetera and the data that was used. So transparency as providing enough information so that others can assess your results without necessarily repeating them. And I think what we like to recognize that the notion of repeatability for reproducibility isn't always feasible or even desirable. You know there's a lot of good reasons why someone may not be able to simply re execute your published code. So if you have proprietary data or sensitive data you might have long running or large scale computation so we see transparency is equally as important even if someone were not to actually re execute. Oh, thank you. I'm sorry I was just checking the chat so one of the drum motivating use cases for whole tail is actually as the project evolves is the kind of increasing adoption of reproducibility policies. This is part of the peer review process and I understand this isn't really a widespread in the geosciences, but in some of the fields that we work with. We see journals not only requiring that authors share computational research artifacts, including the data and the code, but in some cases those artifacts are subject to review to confirm that they actually reproduce reported results. So two groups that we work with closely is the Odom Institute that implements the verification policy for the American Journal of Political Science and the American, the data editor for the American Economic Association where they have a fairly strict code of data and code availability policy across the eight or nine journals that publish empirical research. All right, so what is a tail is kind of one of the core concepts of whole tail. So it is a research object and if you don't know that concept and it's really intended to capture information about all of the artifacts involved in the research process beyond just publication or just a data set. Technically speaking, a whole tail tail is like a could be a zip archive of a particular format that's got data it's got code it has documentation. The results of the computation information about the environment. Tails are intended to be executable so they're designed for someone to what underlies this is Docker, so that's designed for somebody to re-instantiate that environment that image to be able to explore, assess, re-execute, publish research. And whole tail itself doesn't is not an archive so the platform tails can be stored there shared use there interactively. But we rely on third party research repositories are actually minting DOIs and preserving artifacts for the long run so tails are intended to be publishable objects that can be put into external repositories that have archival guarantees. And then, in addition to transparent the notion of verifiable I guess we've got kind of two definitions of verifiable in this context one is that the resulting tail object that can be moved around the zip file that can be published is verifiable it has technical metadata. And hash is what not to ensure that the files are that we're in there are the ones that were originally there so we use a standard called bag it for that and that verify will also in the sense of the journal verification policies that it's really intended for these things to be able to be assessed and verified in the sense of re-executing workflow and confirming reported results. See, I'm just going to show you a couple of examples here to highlight. So this is not a tail. This is for the American Journal of Political Science. They have this policy that researchers have to share all of the code all the data and sufficient information for a third party in this case the Odom Institute to reproduce those results and confirm that any analytical results figures tables etc are reproducible. This is put into Dataverse which is a fairly commonly used research data repository at least in the social sciences, link back to a peer review publication. So a tail built on this just to show you the difference this one's been published as a no no contains all of that information plus information about installed packages in the environment a reference to a container image hosted in whole tails. Image registry and in this case. So concept I'll go over in the second year called a recorded run, which is an independent execution of that workflow that produced the figures you know any of the results that would have been reported in the manuscript so the notion of the recorded run in this case is kind of to that end of transparency where if you use that feature of whole tail someone doesn't actually need to re execute, which you've done because they can trust that the run of this code with this version of the code is actually what produced the results. I guess the other side of that is that this can be easily re imported back into whole tail and re executed so I would pull up the environment that the author selected with their code with their data and have access to that executed run. The idea of a recorded run so you have a workspace and whole tail which I'll go over in a second that's just a directory that's got your code, you can reference data externally or your data can be in there. So the recorded run would create a version of your artifacts. I'm sure that it's got the correct version of a container image if you've made any changes to say packages, execute a workflow that specified by you, and it captures an immutable copy of all of the outputs from that. It'll capture system and runtime information. So folks can know downstream what types of resources were used as a part of the process to what kind of resources that they would require to rerun. So whole tails approach to computational reproducibility and transparency is to allow researchers to run their code on an external system. Well capturing information about the computational environment so through the container image we get the operating system version of software that was used specifically for an execution and produce results and then to put you know easily publishes artifacts long term research archives. It's a web based platform. So we'll authenticate using an institutional identity access commonly used environments and then we're very happy to add new environments so primary ones are Jupiter. We've got support for MATLAB's data, Julia also through the binder's infrastructure and this is the environment customization is based on project Jupiter's binder so the underlying configuration of which packages are installed. It uses binder as component, we have extended that for MATLAB and STATA, which are not supported there because they require commercial licenses. So and then you can reference data in the system by pulling it in from external repositories and then you can publish out to archival repositories to get an identifier. Yeah, we've got, you know, at this point, thousands of people have used the system for various purposes either research exploration tutorials assignments we've got classes that have used it as well across a variety of domains. So we're, we've this is a thing we did a tutorial last May for CSDMS. This is our second time talking to the CSDMS community. All right, I'm just gonna I'm going to jump into kind of a demonstration that's based on that 2022 tutorial. And I guess I can drop a link to this slide deck if it into the chat if anybody is interested and I can share this I'll but that get a repository has got a fairly detailed tutorial that you can walk through. I guess I'll actually, if anybody's got, I guess you're not opening the questions yet right Albert, because it's a breaking point if anybody had any specific questions for this part of the presentation. Yeah, I mean, if you're, if you're fine with it. It's fine with me if people ask questions. One other thing, I clicked on the link and it asks for access, you need access. Let me fix that then. It should have been within our. Yep, you try again it should be shared with everybody. Yeah, I can get to it now. Thank you. Without further ado, I'll give a quick look at whole tail, the whole tail dashboard and I'm going to do this and screen sharing still correct. Can you see my screen. Yes, yes, we can. Why do I don't know why I'm not saying that. For an incognito window just so you see the first time user experience dashboard hotel.org. And I'm going to also look at an example that's been published. There's a change that we implemented after actually some feedback, including some feedback for the last tutorial, when you come into hotel now you don't it doesn't require authentication. Initially, so you can view anything that's been shared with you, or that's been made public within our system. Just directly, I see if my. I didn't make my land lab, this is Bertram CSTS of land lab tutorials so you can view metadata you can view files etc without needing to log in. But most other actions require you to actually sign in. This is Globis's authentication service. It's convenient because it allows us to use your institutional login to get in. Some people get concerned about the privacy, the consent and privacy policies. The other reason we use it if you're familiar with Globis is we can transfer data. From Globis endpoints into whole tail on your behalf it granted permission. If you've never used the system before there will be a consent form there. So you can use Orchid, you can use Google account here's the consent form, I cleared my consent so you can see this. So it's allowing us to initiate transfers for you and for users of Dereva services, which is a specific integration that we have. So you can use typical identity information use your email address. Your email address to show information about your system. So we have the notion of public tales. Tales that have been shared with you within the system so you can collaboratively work on the same, the same tail. And then your personal tales are things that you own. You can create a new tail and three mechanisms for that so one it'll just be an empty tail I'll show you that one we can create one based on the get repository. And whole tail doesn't require use of get but it also doesn't preclude it.  You cannot use get from within the interactive environments but part of whole tails design is intended for people who aren't regular get users to also be able to publish things like binders. And then you can also create a tail from a digital object identifier so if it's one of the supported integrations. We can pull that in either as a reference data set or something that you're going to act on. So I'll just create a blank webinars tail. You can pick from a variety of environments. I'm going to pick Jupiter live because I feel like CSDMS is predominantly maybe Python based community. I will note for MATLAB and you're not stated users for MATLAB users were leveraging the network license at JetStream which is at Indiana University so you can use MATLAB using institutional license that, but images from whole tail require you to have your own license if you use them locally. So here, just tell metadata pages your default. You know, typical stuff that we would add this gets translated at publication time publish time to your repository. We can add files folders to that what's called the tail workspace this is your primary directory. I'm not going to cover this today but it's in our documentation you if you use external data and you don't want to include it like it's a published data set that you're analyzing. We do it by reference so your tail will always be connected to that and it can be pulled in we cash it for you during analysis, but it's not something that you republish. You know, the main thing here is the interactive environment. So what's going to happen is we're going to spin up a this case of Jupiter lab instance. It's running on whole tails infrastructure and just present to you that interface. And if you're familiar with Jupiter Jupiter lab, it's the basic interface all actions are still usable here so you can upload and manage files directly. I'm trying to not going to recreate the land lab example here so once you have your tail, you, you know, you can run commands in the terminal you can create notebooks you can execute anything interactively that you can do in Jupiter lab. You can do via whole tail. And the operations that we now have on our tail menu allow you to do a few things. Administratively you can look at the logs of that running container in case you have issues like code that creates errors that don't. They're on apparent within the interactive development environment. If you make changes to configuration, adding packages, you can rebuild that container image which is what the rebuild tail does and restart the tail using that rebuild container image. You can save a version of your work. So that'll show up in the version panel here. You can initiate a recorded run. So this would allow you to initiate a some master script that executes and I'll demonstrate that here with the land lab example in a second. We can publish an export. So publishing would publish a to Zenodo we have to connect to Zenodo to do so, and export would give you a zip file that you can operate on locally. We also had the ability to share with other users within the system so I think if Albert. Albert is here here we go I can share a tail with Albert I can give him permission to view it, which case he would be able to make a copy of that to edit, he can view my tail but he can't run and modify files within it. So he wants to run it and execute say notebook steps or execute code that produce help but he'll make a copy, or I can, he can co owner co edit this with me. We don't share container instances but he would be able to modify the files as I can. Here is a publish tail that published as a sandbox yesterday that's got a land lab tutorial on it. And this is just a demonstration of how that tail can be brought back into whole tail. There we go sorry for the Salonis. So you can, you know, once you publish to archival repository, you can delete that object from whole tail and it can always be re imported it can be re imported by somebody else. That should have taken me to that should have taken me into that interface so. So here we see my land lab example. It was published to Zenoto and brought back into our system on March 8. It's got a simple Python script that generates some very simple figures based on a tutorial. There was one version of this at the point in time that I published, and it had a recorded run, which means that that run dot sh was executed and generated the figures that were in the sub directory. So I can bring up this tail that was published to Zenoto. It was it's a Jupiter lab tail. So, in addition to so it's a very simple master script that just runs a simple Python script that was taken directly from the land lab tutorial materials that just produces a couple of figures. So it's interesting this environment YAML. So this is one of the, the, you want to configure your environment whole tail requires you to use the convention that reported Docker. These are typically common package manager format so environment YAML for conda. So this is installed a set of dependencies into the container image. Allow me to run land lab. So this built image could have any package that you want in it as long as it as long as it installs under Linux because these are assumed to be, I should have said that up front these are a bunch of based images. So as long as you can run within a Linux environment, you can declare the dependencies for your workflow. What's that images built anybody who brings that back into the system. What's that environment either as a recipe that the image can be rebuilt or via the image that was actually hosted in whole tail. So I can get again from within. Here I've got a full interactive terminal I can run that land lab example myself. It will generate some figures that are viewable by me in the interactive space I could just publish this right now independent of a recorded run. And it's, you know, it's still reproducible it's still useful, but no one knows that I actually ran the code to produce those figures. In this context, I could have uploaded them from another source. So back to the idea of a run so the run the run script. It's really just going to do that same command I did. There'll be some notifications that come up. So this is now running in an isolated container using the image that would be associated with that runs the container image. And once I have that run. So there's one from yesterday one who today they're also identical. I can go back through the process of publishing. So I would publish. This is a sandbox. And it would actually in this case update that same instance of that same record in Zenodo just with a new version. Since this already had one, and that obviously wouldn't work for someone who isn't me since it's me I'm allowed to update and create a separate version. I'm not going to go through the publish process right now. So let's see. I think one of the issues with jet stream running locally was not convenient, but I can take my code out of full tail as a zip file. So I've downloaded that local and I'll get it just going to get a terminal up here. And there's a script in here that just says run local I'm on a Mac so you have to have Docker in order to do this. The script doesn't seem a Linux based system right now so that's window support is something we per week on. So what this is going to do is do verification on the downloaded package using the bag it formats this is just making sure everything is as it should be going to check some standpoint. And it's going to pull the image from whole tail. That is the built environment that I ran to create this package. And it will start that locally. I'm not going to do that because it the downloading from this registry was not working for me this morning with their network problems so this is just to show that you have it's it's sort of a weak point with whole tail, the publisher, the repositories that we publish to tend not to want us to deposit images into their records so we maintain a registry. But whole tail is a non archival system right now. That's a step we're moving towards is actually having some archival guarantees behind the images, but for right now I mean that's going to support them as best we can the built images but you can they can always be rebuilt from the recipe later. I guess I can go through a went faster than I expected so I'll go ahead and look at the registered data external data case. So, if you rely on externally published data, something that already has an identifier. So I'm going to go take an example identifier from that tutorial. Oh, just apparently not working at the moment one moment. Not something I tested earlier. Okay, I'm not going to do this at this point. Sorry about that. I, the issues with jet train this is one area that I didn't test prior to sign getting on for the white mark today. So I'm just going to go into a few plan features. What we're working towards as a part of the platform right now. There's been actually a number of requests for visual visual studio code support, which is something it should be added. I was in there today but it's not implemented yet. As part of a collaboration with, I guess with Albert and with the commsus community, we've got proposal with proposal and right now for an SF to expand whole tail. And a few key areas. So one is the ability to create tails locally so toolkit that you can run on your laptop or on your own server to create these objects that don't require you to use our cloud interface. Integration with GitHub through GitHub webhooks where you're not. If you're a GitHub centric user where you can benefit from some of the features of whole tail without necessarily having to go again into the IDE. Since our interfaces required for all of you to use all the features right now. Support for increased resources in terms of memories and cores and specialized resources GPU access which we have now in just room to all the support for HPC and HTC workflows. So the ability to create tail like objects and things like recorded runs through batch clusters, while recognizing some of the special requirements for large scale computational work. So things like building singularity images, allowing users to selectively include or exclude intermediate data, etc. The whole tails and open source project and increasingly we're moving towards community, a lot of the development occurred based on primary NSF funding but we're moving much more to community based model. If anybody's, if you're ever interested in joining our slack is open invitation link here it's also on the whole tail website. And members of the whole tail organization are not just whole tail project members it's a lot of people are very interested in reproducibility transparency replicability and research across a number of domains. So it's got it's a it's a good group. And then there's our GitHub, which you've got, you know, probably 30 member contributors and growing. That's the end of my presentation I'm early, but I will open it up for you and a I guess. Yeah. Yeah, thank you Greg. That was very cool. There we have a question from Anna. So Anna indicated, you know, what are the terms of use for whole tail. And can it be used for classes or workshops, even in a in a non academic setting. There we go. Yeah, I should have gone over this at the very beginning. Thank you. Great question so it's yeah it is and for academic use only. That's also the policy of jet stream and our access to the mat the mat lab and state of licenses. So it can be used for classes and workshops. I'd have to understand the context of a non academic one. So yeah if it's a anything within kind of a commercial context it would be not allowed within the terms of use. But if it's outreach education related that's in kind of a gray area it's not specifically an academic class but it's a outreach to research community, etc, then I think that would be reasonable. Compute resources for a tail. So by default so it's kind of a right now we're a laptop in the cloud. We've got some limitations on the underlying VM size at jet stream. I think the, there's a soft cap of like it's eight gigs of RAM for a tail but that can be extended. I think that probably a remembering it should be 16 gigs of RAM right now so these are not this is not for large, and that's not even very large these are not for larger work but that's an area if you want to use wholesale for that please reach out to me, because that will motivate us to actually increase some of those caps, those caps can be. Increased. Then we have a question from Katie. Katie, can you. Yes. Yeah, thank you so I'm. Thanks so much for the presentation. I have a couple of questions I've written down. I'm at the USGS in golden Colorado where I do a lot of work on computational computational work in landslide hazards. And I am. I'm going to give a little bit of a preamble, which is that I'm often working in a situation in which I am developing the software that is being used. And then on top of that there's some workflow that is being used to run a set of jobs. And I'm also in this category of people who, you know, I may be doing a set of runs. There are, you know, like hundreds of, say, two day well time 40 no job runs on a slurm cluster and then there's a post processing phase. And so I'm curious about what and I think this big business your prior answers. You know, some of these are like in the future of whole tail, sort of what the vision is on supporting of multi phase analysis of sort of the runs and then the post processing and so forth. And sort of where what the current capabilities are and sort of what the vision for where that's going is. All right, and I'll say, is very nice to meet you because we used one of your GitHub repositories as an example and some of our work for the premise proposal because it's exactly. It's like transparent work that's extremely well documented. It's obviously not automated because you've got a lot of steps that are in there so I'm familiar at least with one of your publications where I think it's some of this stuff. This is the one that has to do with predicting erosion of the nuclear waste repository maybe was it nuclear was like a multi article publication. Yeah, yeah, I mean and that's that's the kind of thing that I mean it's like I think it's a little tenuous to say what that is or isn't something is demonstrated. And, you know, we ran into a lot of issues with data archiving there it was very hard you know we ended up having to make sort of like a pointer into a global this anyway, sort of. Yeah, so this is so these are cases that there's a long running thing and whole tail is something we call tails at scale, and the two pieces of tails at scale or that a lot of researchers, we've had with astro community that do massive simulations they can't put their data anywhere. Unfortunately they're not as concerned about reproducibility I mean fortunately for them and not for us. Economics even you know it's a much smaller percentage for the American Economic Association but obviously work gets done on campus clusters and exceed resources. And they can't verify that stuff that's one problem right there's no journal policy of going through and rerunning the code and can happen. But often they don't have the confidence that stuff was run as it was stated right because it's if it's multi phase where there's human steps involved and multiple people there's a lot of risk of potential error I guess right like and in the reproducibility context so we're very interested in this this is actually one of the key points for the proposal that we put in for CSSI. We have a secondary project right now that's coming out of economics so they have the added bonus of private data using census data census resources that are access controlled so if you want to be transparent running on census resources where you can't share the data. You know compute infrastructure that gets kind of tenuous so trace is not, I guess one piece of that is there's a component will be implementing for slurm to help, not instrument slurm in a deep way but to help like it's would be like an isolated place where we can trace stuff that happened and report and provide information from a transparency standpoint this really happened on this cluster, and you know these are the outputs. But again, you know, long running compute and enormous data doesn't have a home remain big challenges for everybody, but for us as well. But yeah this is like it's something we're eager to work on. Yeah, it's a part of it's like cloud based whole tail does you know good, but using some of the tooling to create a provenance trace with some guarantee that people can know that you ran something and they, you know, increasing kind of trust in what your outputs are is kind of where we're headed. Does that make sense. Okay. Yeah. I don't know that this is a feasible thing but you know it makes me think I recently started to use snake make a lot because it is flexible enough for what I, my reality. I can sort of but you know it. Unless you specify every single input and output file that is being made you're sort of not necessarily, you're not truly archiving like that this was run on this platform but I can imagine maybe the sort of like snake make generating. You know, sort of interrelated tales could be a very valuable. And that's I'm sorry that's the other. That's Lars Wilhuber who's the data editor for a long pushing us for, and this is part of the trace project as well. The chaining of these things right outputs of one becoming the inputs to another step but they might have other dependencies they might be completely isolated jobs that get. So yes that's, again that's part of trace trace is going to be a lot more lightweight, I think. Yeah, I'd say you do this, if you're ever interested in talking about it, you know, as a case like if you've got research that could inform what we're doing I think we'd be very interested so. Yeah, yeah, I may I may follow up on that because I think you know I'm sorry I'm dominating this conversation but hopefully people find this interesting but that you know the kind of thing that I'm facing is you know running. Hazard assessments for postfire debris flows for every large fire on public land in the western US every year and I thought you know that's a thing that takes substantial computational resources. And I think it's important as a government employee doing science to demonstrate that that you know what it is and where it's going and what went into it and what came out of it. But you know how that. But, you know, it's a real. It's a real lift. Learn the tools to do that well. And, and, you know, so I want to make sure I'm on top of that because I think at the US just you know we have a lot of requirements in terms of archiving our data and increasingly archiving our code and they're sort of internal discussions about what it is and it's a sort of archive something that isn't really data and isn't really code but is like a data and a code that all go together. Yeah. So anyway, thank you so much. Thank you. That was a great question. And I'm glad I ended by demo early then. We have another question in the chat from Steve. I'm Steve. I'm wondering, do you want to elaborate a little bit on this or shall I read it out. I see you're a muted but I cannot. I can answer it. I see it here so. Okay. Yeah, Steve has problems. Yeah, so I mean provenance computational provenance is at least two folks on the hotel project that have been deeply engaged with that. So we would think there's the different notions of provenance like just the, the artifact chain of custody provenance in terms of handing off something that was produced on one system to another system, versus provenance in terms like what files were accessed, which code was responsible for producing which outputs. And let's see. So yes, that's a thing, not as much of it as we wanted is actually in the primary whole tail system. I think we moved. So the question we moved away from the S trace methods, S and P trace methods of tracking stuff within the system because that was just too risky and too intensive. But Tim McPhillips who let a lot of the provenance work is looking at EVP of trace methods for tracing stuff internally that should be more performant, all technical stuff, but we're still working in this area or he is certainly. So can I point you to a link that summarizes our current approach to recording provenance information. In terms of whole tail. Do we have a good and I. You can answer this question Steve in the chat. Are you talking about computational provenance like the sort of S trace, represent EVP of trace model or are you talking about something else. Okay. So the short answer to your first question is no, but the follow on answer is that I can ensure that we can provide you with that information and get our docs in the state to answer the question so I want to make sure I know which side. So, I don't think we have a good summary right now. That's something I'll take away from this session. Most people aren't interested point of the system. And I guess you can absolutely feel free to reach out to me. Yeah, the problem implementation so I think what he had implemented was used reposit as the data collection mechanism, and then he post processed the, what was pulled out of the kind of the S trace output there to generate triples from actual like the graph kind of model, which he's the expert at, but in the end the reposit implementation was pulled because of both security and performance concerns. And so now what we do is not really provenance it's very from the computational standpoint it's really just resource like resource usage information and then the notion of the recorded run where we know that something was run independently. There's a kind of assertion so we can make but we don't have. What was a part of that, some of the design and some of the work that he's done there in the system yet. Thank you then there is one last follow up from Anna regarding computer resources is wondering. Yeah, if there are how many course are available if you want to run something. I have to look at the underlying. We migrated to Jets ring to so I don't know I can pull up there. If I can get into the horizon interface, I can get the specific course we don't. I don't know that we put a cap on course so you get what's on the underlying VM, which I want to say, it's going to be probably for a camera member with migration so I can answer that in a second. Jets. And I'll say, I'm sorry I'll just just a quick follow up. So we're trying to be good stewards of jets trains resources so we don't want to provision machines that aren't used and resources that aren't you know we're consuming stuff so that's a the more demand we have for stuff that is bigger. So we're going to provision larger DMs and utilize those as part of whole tail. And I know that's the, you know, we're asking people to demand it for us to do it which is problematic but the more feedback we get like this is good so I guess the follow on to you, Anna, and is what would you like to see what kind of resources would be useful in your context. Yeah, actually so. I have to say so the underlying VM is actually six that we went larger with this deployment so it's a 16 core for an individual. So your tail instance can go up to 16 and actual Ram on that then is 60 so there's ways for us there's actually a limit that can be increased via an advanced setting and hold tail that like can let you go there so that's if a cast for provision these I think so we're 1660 or the numbers of the actual absolute maximum. I have one last question. And this is maybe a little bit technical but if you are. You have published a manuscript and you you made a repository in hotel on the through the whole hotel gateway with, you know, people can rerun your stuff or go through the code and kind of see where, you know how you came to your findings. Publication is published link is there. And, you know, a few months later somebody points out that might be a book in your code, you know, revisit and it, it doesn't change anything to the results but yes indeed there's you know small book in the workflow or something. Can you still change your, your, your instance that you created and save it so the link in the paper still points to the, you know, to kind of the updated repository or, or are there other ways to guide people to to the newer version that's where the book or, or some. Yeah, some type of is correct. Yeah, so I'll just show you quickly here so publishing this is where hotel itself is not you don't want to give our URL out right to publication you want to deposit somewhere and rely on Zenota's infrastructure to, you know, to post it for long run. So here's an example this is just a test in fact here's here's one of my like key ugly use case tests where I test every new release that we have. I own it. It's my key to Zenota. I produced it. The tail is in whole tail. I've never deleted it. But that's my working environment. And each time I republish. This is the nice thing about some of the research data infrastructure is that as long as that relationship is maintained in the tail of the original objects like I'll republish I'll get a new version. So so no no has this idea of the called it like the context do I, this is the top level do I that references the latest version, and then they give identifiers for each subsequent version so I think classically you'd give one to your, you know, that's attached to the manuscript and then later you go and change it. You would still link to that but they would know that there were newer versions in the, in the Zenota record. Very nice. Thank you. Let's see, I see a few things in the in the chat. The more thank yous and comments and questions. If there are no other questions we are about to do the hour. Then I think this is it. Thank you very much for for your presentation for walking us through a whole tail and yeah, thank you the recording will be provided in the coming two or three hours or something on the CC message page, maybe Lynn can send out the link to the recording. So it can be shared with your colleagues. Thank you. Just one follow up here for Anna and anybody else who's interested in using the system for a class. Please feel free to reach out to me directly if you want to talk about like class size and some of the resource issues it's good for us to know, you know, particularly if it's a lot of students. So your experience is good so if you intend to use it or you want to talk more about it we're totally open for it and just feel free to reach out to me. That goes for anybody. Thank you. This was great. Thank you, Albert. Thank you, Lynn, for the opportunity and this was great.


Greetings, friends. This is Survival Doc. Today, I want to talk about communications, in particular, Helm radios. Now, I briefly discussed this topic in one of my recent videos where I talked about networking because Helm radios, of course, are going to be the primary way you're going to network with your group when the grid goes down, when there's no electricity. Alright, in this video, I'm going to go a little bit further into Helm radios and a few things that I recommend that you do. Alright, first of all, realize that when the grid goes down, alright, and there's no electricity. Now, if there is an EMP, it has been estimated that we may be without electricity for 10 years or longer before they can get all of the transformers that are going to be blown out with an EMP replaced. Alright, we don't even make these transformers in this country anymore. The waiting list is about six months when they order a transformer. Now, they have a few in stock, of course, when they're all blown, there aren't going to be nearly enough to replace them, and you can imagine how long it's going to take to get them back. Like I said, it's been estimated that we may be without electricity for 10 years. But regardless, if we're without electricity for 10 years, a year, a month, whatever, when we're without electricity, that means that our normal methods of communication are going to be down. Alright, phones are not going to work. Your cell phone probably isn't going to work. Your computer, excuse me, your computer isn't going to work. There isn't going to be any internet. Alright, the only communications you're going to get are going to be emergency communications from the government. And as you know, you can't believe anything that the government tells you. It is all lies, especially in an emergency that they probably created through a false flag in the first place. You think you're going to get the truth from them? Everything that we do after an emergency is going to depend on our ability to communicate with like-minded people or communicate with other people in our network. And Helm Radio is going to be the method of choice. According to John Moore, who is a big prepper expert, he makes his living by advising people in prepping. He has a radio show in the Republic that broadcasts the network every weekday at 6 o'clock in the morning. Alright, one thing that John Moore says is that when the crowd puts the fan, the two skills that are going to be most important, most in demand, are going to be Helm Radio skills and medical skills. Alright, I'll add a third to that and that's going to be networking skills. Alright, but Helm Radio certainly ranks up there. It's going to be very important. Now, I used to think it costs a lot of money to get into Helm Radio's. As I've gotten into it, I've learned that that is not the case. You can get an excellent radio. This is the Ball Fing Radio. You can order this at MemoZone.com for about $30. These are excellent radios. Now, one thing I learned in my Helm Radio class is that what's more important than the radio is your feed line and your antenna. You can unscrew the antenna. You can plug a cable in here. This is a little magnetic antenna that you can put on top of your vehicle, but you can also use it in your house. You can also plug in an antenna into this thing that you have on the roof of your house. It also doesn't cost a lot of money for antennas because most of the antennas that Helm Radio people use, they make themselves just by using wire and a few other accessories. Here's a good book. The antenna book has a lot of information in there about how to make your own antenna depending on what use that you want. Now, if you notice, I've got two Helm radios here. The reason for that is I have one extra one that is going to be put in storage. I'll put this in a Faraday bag, put this away in storage so that it won't be damaged by an EMP. Now, I don't know exactly what damage an EMP might do to our radios. It might not cause any damage to them at all. If it's attached to an outdoor antenna, it probably will. But regardless, these radios only cost $30. And of all the things that us Preppers are putting into storage, I think an extra $30 for an extra radio, not a bad idea. Now another thing is if we're without electricity, you want to be able to operate this thing. You want to be able to charge it. Now the chargers are AC chargers generally, plug into your normal outlet. But you can get DC chargers. These are designed, this plugs right into this charger here. This is an adapter that allows you to charge your Helm radios with a 12 volt battery like in your car. Essential item because if you're without electricity you want to be able to charge your Helm radios. I believe unless you have a very expensive electronic system with expensive thousands of dollars of batteries and thousands of dollars of solar array, which a lot of us do not have the money to go completely off grid in that fan this fashion, but it doesn't cost a lot of money just to have a simple 12 volt system. I put a couple of solar panels on my roof. Solar panels cost about $80 a piece, $10 for a charge controller, about $100 for a battery. I'd like to get a better battery, but for a starter battery, spend about $100. And I have a system that will allow me to continue using 12 volt items. I got a 12 volt charger like this for my laptop computer. Of course, the internet is likely to be down. I won't be using my laptop computer for internet if that's the case, but I might be using it for other things. I have a lot of DVDs that I can watch instructional DVDs, but it'll be nice to be able to use your laptop computer. If you have a 12 volt system, there's a lot of things you can do. You can't keep your freezer running or refrigerator running with a small system like that, but you can use it to charge up your rechargeable items like your laptop, and in particular your ham radio. Now, you have to have a license to operate a ham radio. The good news is ham radio clubs everywhere have free classes. Take a weekend class or so, do a little bit of studying, then you can take the exam and get the license. Total cost about $15, which is what it calls to take the exam and get your license. That's it. $15 for your license, $30 or so for a radio, another five or so for a few accessories, some wire for an antenna, $100 can get you into ham radio. Then if you want a simple solar system, another hundred bucks or so, or a couple of hundred bucks can get you a solar system that will allow you to keep all these batteries charged up. This is a Faraday bag. A Faraday bag protects items from EMP. This is a little charge controller. I have two of these. I have one of these in operation right now. Then I have a spare. This thing costs about $10 and it's good for a 7-amp charge controller. What you do is you take your solar panel, connect it to this, and then connect that to your batteries. What it does is it keeps your batteries charged up and it will not overcharge your battery. Once your battery is charged up, then it shuts off so you don't overcharge your battery. Another simple device costs about the same amount as a device which prevents you from over-discharging your batteries. A few simple things that you need for your solar system. It doesn't cost thousands of dollars to have a small solar system that will allow you to keep your items charged up. Lanterns, LED lights, flashlights, rechargeable flashlights, all sorts of items, rechargeable items that you can charge from a simple 12-volt system. Now I know that some preppers buy Helm radio like this. They put it in storage and then they think that when the crowd picks the fan, they're going to pull this out and they're going to start using it to communicate. Well guess what? As I found out, it takes a lot of skill and know-how to operate one of these things. It's not just a matter of turning it on and talking. Don't think that when the crowd picks the fan, you're going to pull this out and know what to do with it. You need to start using it now. That's the reason you need to take the class, you need to get a license, and then you need to start communicating with other Helm people. Then you need to get your network. Other preppers, the people who you are prepping with, people involved in your network, you need to work out a Helm network among yourselves. Now one thing that you can do with these little handheld radios is you can communicate with people at a fair distance using repeaters. What that means is rather than going from radio to radio, you just have to contact a repeater which is a tall tower somewhere and bounce off that repeater. That repeater repeats your message and sends it broadcasted out so you can communicate with someone at quite a distance. Well the problem with repeaters is they may have a battery backup which will keep them running for maybe a day or so after they lose electricity but eventually they will run out of electricity as well if they're not knocked out by the EMP. I don't think you can count on repeaters. What you need to do is you need to communicate with other Helm radio people in your group radio to radio. Now working radio to radio you are limited in the distance. That's the reason that you all need to get your Helm radios and you need to start working with them. You can put an antenna on the roof of your house. You can put all kinds of antennas including directional antennas but you need to work out a system with other preppers where you have perhaps a relay system where if you cannot communicate with everybody in your group maybe you can communicate with a person who can communicate with another person in your group and you can work out a relay system. But when the crowd hits the fan it is going to be absolutely essential that you're able to communicate with other people in your network and you're going to need some type of a phone tree type system. So you need to get all of your people involved with Helm radios. You all need to get a license and you need to work out the details right now. Don't wait until the crowd hits the fan. If you do you're going to be totally lost. What I did with my solar system I purchased a 30 watt solar panel. It's a 12 volt solar panel 30 watt to charge my 12 volt battery. You need to get a deep cycle battery. One that's designed to be drained safely. Say 50% or so. Most batteries like the ones in your car are designed to be topped off at all times. A deep cycle battery allows you to discharge or you still don't want to discharge it more than 50%. If you completely discharge a lead acid battery what you're going to do is you're going to ruin the battery. Just one complete discharge can drastically decrease the life of a battery. Now if you have the money, the batteries you want to, if you have a large solar array for your house, the batteries that you want to use are zap work batteries and what those are is they're nickel alkaline batteries.  You can discharge it completely without ruining the battery. But they are very expensive to get a full system will cost you maybe a couple of thousand dollars. For our use on a limited budget we're just stuck with the lead acid batteries. But you do want to get a deep cycle battery. You still don't want to discharge it beyond 50%. That's the reason that you want an over discharge protector. And what an over discharge protector does is it allows you to discharge the battery just to a certain point and then it shuts it off. And then you cannot use the battery until it's charged back up again through your solar panels. Now like I said a 12 volt 30 watt solar panel, I hooked it up to my charge controller, to my battery. Alright I like the system so well I said and the solar panels were so affordable that I got another 30 watt solar panel. And in the picture that I'll show you, here these are 230 watt solar panels hooked up in parallel. And the solar panels are to make the frame to hold my solar panels. I use metal shelving pieces. These are reused legs from a metal shelf unit that I put together with stainless steel nuts and bolts. These are the two panels side by side on my roof. These are 12 volt panels. They're connected in parallel, which keeps the voltage at 12 volts connected in parallel. For a total of 60 watts, very, very effectively very quickly keep a 12 volt battery or a couple of 12 volt batteries connected in parallel charged up. What I did once I got this system completely worked out. Then I completely disassembled it. I took the solar panels, I boxed them back up and I put them away because I have these just for an emergency and I'm waiting until we're without electricity and then I can pull these out in a matter of an hour so I can have this system back up. But by taking it off the roof it's protected from hell storms or other type of storms or for EMPs. As a matter of fact the boxes that I have that the solar panels came in, I lined with aluminum foil and made my own Faraday boxes to protect these panels from an EMP. Here's the box that one of my solar panels came in. I used glue and glued aluminum foil to the inside of the box. You don't want the solar panel to come in contact with the foil so you use the padding or plastic bag around your solar panel. Alright so if an EMP occurs I've got everything ready to put up. Alright now what about my batteries? You have to keep the batteries topped off. So what I did was I had the charge controller that I used on my solar panel I connected to a simple 12 volt transformer. So in other words a transformer that plugs into the AC outlet takes the place of my solar panels that I had on the roof and the transformer keeps the batteries topped off. The batteries are ready to go. So if we lose electricity I've got my 12 volt batteries ready to go. I can charge all of my devices until I get the solar panels back up. Take me an hour to get the solar panels back up because I've got everything I need already in place. Hour the panels are back up the battery is operational and I'm back in business again. Like I said with this simple system I'm not going to run a refrigerator. I'm not going to run my freezer but I'm just going to have a power supply to where I won't rely on kerosene lanterns. I won't have to rely on candles. I have several LED lanterns. I have a whole storage rechargeable nickel cadmium. Not nickel cadmium but metal hydride. The newer type of rechargeable batteries. I've got a bunch of those and I keep them in my refrigerator. I take them out. Make sure they're topped off every six months or so. I take them out and charge them up. Make sure they're topped off and put them back in the refrigerator to keep the storage life. Here is a nice battery charger. Put your battery charge for batteries at one time. Any size DC AA AAA batteries. This has an adapter that plugs into it that you can plug into your AC outlet. However this is 12 volt. I got this one for reason and that is it is 12 volt. I do have the wiring that I can plug from my 12 volt battery into this and I can keep all of my nickel. Not my nickel but my metal hydride batteries. I can keep them all charged up with this charger right here. Before the crowd fits the fan I can use AC to keep them topped off. When the crowd fits the fan and I no longer have AC I can operate this thing with my 12 volt battery. With my rechargeable batteries I have LED lanterns that I can keep operational. I can keep my radios operational. I can keep my computer operational. There are a lot of things I can't eat in my house with it. I've got wood burning stove for that. I can't keep my food refrigerated. I've got food preservation techniques like dehydration and stuff like that that I use to preserve my food that don't require electricity. But it does allow me to keep my electronic devices including my flashlights, my lanterns and my radios operational for an indefinite amount of time once the grid goes down. No matter how long the grid is down. This is Survival Doc reminding you to be prepared or be prepared to be pleased.


It's DK and I'm back today with another video. She'll talk to you if you're not subscribed. Go ahead and subscribe when. Give me a thumbs up. Hey, one more thing. Do not skip those ads if you wanna see me get to this bag. In today's video, we are gonna do some Amazon fresh, fresh, fresh from Whole Foods.  We are picking up seven stops, 32 packages, and we'll receive a payment between $56 and $84. Guess what? We a holla, let's go. I can't get over you. So we're doing our first load right now because guess what? We got to go back in, because we got 32 packages if you want to have it. So we're gonna put the smaller ones in the backseat, and we're gonna put this in the trunk. Traumium. It's like one, I don't know, it don't even feel like a pack of gum. There's somebody getting these beautiful roses. And just like that, we about to hit the road, get our pockets on the floor, let's go. We are here at the first location for those who hate them. We gonna keep on skating. Gotta hit them with a scan ski so we can get these bands, G. This one only has two packages, so it should be nice and smooth. I don't even need to pull up that, I don't even need to be bragging right now. I don't even need to be bragging. I don't even need to pull up that wagon. I'm getting so much money in my pants sagging. Now I'm down about, honestly, guys, I like doing Amazon Fresh and the whole full. When that doorbell, it's at the front, leave it at the front though. Hit it with the photo, smack, let's go. And just like that, we are here to drop our order number two. I don't know what else he was going on, babe. We about to drop off these flowers. We're about to let this money shower. I'm gonna see if somebody gonna come to the door if not be dropping in, and then we go to get it on. My nickname wrong on my phone. Hello. Here you go. Thank you. You're welcome. We have a great one. Just like that, we are here at stop number three to get busy. Look, I think I gotta put it in their garage. This here is a garage. This one got a little weight to it too. I gotta pull out that wagon. I won't even brag about pulling out that wagon. It says garage, and I think it's gonna unlock when I slide it. When I slide. Let's see. Let's see what happens. Slide. Oh, that joint went a lot. I ain't never seen like that. So, this is before. This will take up to one minute. Don't enter the garage, even if it's open already. I'm gonna put it by the door. It's open at the corner of the garage, but I'm putting it by the door. Sorry, I'm getting it in. Guess what? We on order number four. We're here to get this done. Y'all here to see us go. So, we need seven packages. I don't, we gotta hit them with a scan ski so we can get these bands. Gee, I don't know if it's this one or the other one. Let's see. Let's see, baby. Nope. Yep, this one right here, baby. Yes, sir. How you doing this morning? Is it morning or afternoon? After... Morning. Okay, it's still morning. Thank you. If you want to talk a bit close to the door to make it easier for you. Yeah, this is fine. Okay. No problem. Thank you. You're welcome. Man, I was hoping it was getting close to the spring and I woke up and it was snowing and everything. I'm like... Yes, it could have been. We had a mild winter, so it ain't that bad. Thank you very much. You have a great day, sir. Order number five. We're here to drop off the prize, baby. We got to hit him with the scan sheet so we can get these bands. Y'all was tweaking last order. We got to hit him with the scan sheet. We got to put these brits at the side because that's brit when I want to sniff that joint. Hit him with the scan sheet. This one has seven packages too. The one thing about this, this is not the greatest hits. I have to go up some stairs and I don't know if I would be able to take them. The wagon up there, we're going to see them when it's time to get busy. And I'm glad y'all went me. Oh, I can't nip see. Right here. What was that? Let's go. Let's see, let's see. Let's see what I can do. Put that first one up. Hello, how you doing? I'm living a dream. I can't complain. Besides the weather. I know, how are you, how are you making your mind up? How do you take some of those? Okay, thank you. I thought it was supposed to be spring, but I guess not. Yes, we had a very mild winter so we can't complain that much. It could always be worse. That was kind of heavy. You got it? Thank you. You're welcome. This is the last one. Thank you guys very much. You guys have a good one. For the number six, we are here in the mix. We about to move quick. We're trying to get this grip. You know what I'm talking about? We're trying to get a grip.  The game is over, baby. After this next order, we about to get a go-do. There was a scan, Steve. This one said, leave it at the front, though. Then we're going to hit them with the go-do. Didn't get a go-do. You know I'm from the go-do. Right there. That's that. They said leave it at the front door. I'm going to the door. I just said if you want to come out and get busy, I'm about to move kind of swiftly. Or I can get some hustle. You want to come up? Right here. That's some glass. I'm glad. I didn't drop that joint hard. See what it means. What a go-do. I just want to know what's going to get this go-do. That. Leave it at the front, though. You know what the photo is. Let's go. Just like that, we are here to draw or I just hit them with the scan ski. So we can get these bands, G. This was only three items, baby. So we're going to drop this off and we're done and we had some fun.   And we're going to get on the run. Drop it on the side. Drop it on the top of the other side. And the doorbell. Don't get me, doggy doggy. It's okay. It's okay. Stay back and up the photo. Smack! And just like that, it is the end of the video. I hope you guys enjoyed the content. Guess what, baby? We drove six, went up there and popped our car. I know you're wondering if that's not good. 63 miles, $95 gas flows. We're going towards home. So we went out there and got it on. I hope you guys enjoyed the video. Again, if you're not subscribed, go and subscribe. But give me a thumbs up and do not skip those ads. And lock in some markers to get messages back. Why we get messages back? It's 233. It's a big bad season. We okay if I give them a reason. I'll see you guys on the next one. We going, we going, we flowing. You already know the DDK. And I'm on my way.


NATO gets its strength through the unity of its member countries, but the Alliance also cooperates with many non-NATO countries through specific partnership programs and initiatives, and also on a more ad hoc basis. The Partnership for Peace was launched in 1994 and involves bilateral cooperation between individual Euro-Atlantic partner countries and NATO. Under Partnership for Peace, some countries opt to deepen their cooperation with NATO by developing individual partnership action plans. And many countries that have participated in Partnership for Peace have subsequently become full members of the Alliance. There are currently 21 PFP program members. Established in 1994, the Mediterranean Dialogue involves political dialogue and cooperation between NATO and states of North Africa and the Levant with the aim of contributing to regional security and stability, facilitating mutual understanding and to dispel misconceptions about NATO amongst dialogue countries. Algeria, Egypt, Israel, Jordan, Mauritania, Morocco, and Tunisia are currently members of the Dialogue. The Istanbul Cooperation Initiative was launched in June 2004 to contribute to long-term global and regional security by offering countries of the Arab Gulf region practical bilateral security cooperation with NATO. Bahrain, Qatar, Kuwait, and the UAE are currently members of this initiative. NATO also cooperates with many other countries on an ad hoc and tailored basis, for example by taking part in NATO missions. Various far-flung countries have collaborated with NATO, including Afghanistan, Australia, Colombia, Iraq, Japan, and the Republic of Korea, Mongolia, New Zealand, and Pakistan. Collaboration with the European Union has been addressed through various agreements since 2001. The 2016 Joint Declaration has been the most significant, which resulted in a cooperative agreement comprising both military, mobility, cyber defence, countering hybrid warfare and counter-terrorism. The ultimate form of cooperation with NATO would obviously entail formally joining the Alliance. Joining the Alliance, however, is in the gift of the existing members which have to reach a consensus on the admission of new countries to the Alliance. NATO's Open Door Policy is a policy to welcome applications from countries across the Euro-Atlantic area who may wish to join the Alliance since the end of the Cold War. The Alliance has grown now to 29 members and shortly we look forward to welcoming North Macedonia as the 30th member, and I think this is a significant indication of the value that these countries apply to the provision of the security umbrella that comes with membership of the Alliance. While Georgia, Bosnia-Herzegovina, and Ukraine have all sought to join NATO, they all remain outside the Alliance. NATO has a wide range of partners. NATO is also a particularly important category of what are called enhanced opportunity partners. That includes countries such as Georgia and Jordan and Finland and Sweden. Those are countries that have the highest level of interoperability with NATO allies which makes it easiest for their forces to serve together, for example, in Afghanistan. But overall NATO has over 40 partners including institutions such as the EU, the UN and the OSCE. And all of these partners have different levels of relationship and engagement with the Alliance as a whole. The position of Georgia and Ukraine in particular is complicated by Russia's vehement opposition to their accession to NATO. Beyond cooperating with non-NATO countries, the Alliance also runs several internal programs and activities to address specific issues and challenges affecting NATO. One major initiative relates to ballistic missile defence. NATO has two principal missile defence programmes. Theatre ballistic missile defence is designed to protect deployed NATO forces against short and medium-range ballistic missile threats. NATO BMD is for the protection of NATO European territory, populations and forces. It has been in development since 2010 and was declared initially operational in 2016. Another major initiative is the Readiness Action Plan launched in 2014 to reinforce NATO's collective defence posture following Russia's seizure of Crimea. The plan includes assurance measures for NATO allies in Central and Eastern Europe to reassure their populations, reinforce their defence and deter potential aggression. Assurance measures include a series of land, sea and air activities in, on and around the eastern part of the Alliance territory, reinforced by exercises focused on collective defence and crisis management. The plan also includes adaptation measures, which are longer-term changes to NATO's force and command structure so that the Alliance will be better able to react swiftly and decisively to sudden crises. The Alliance has deployed military forces on missions in different contexts several times since the end of the Cold War. There are several current missions NATO is involved in. NATO intervened in Kosovo in 1999 to end widespread violence and halt a major humanitarian disaster. NATO's Kosovo force, or K-4, remains deployed and since Kosovo's declaration of independence in February 2008, the Alliance agreed to maintain a presence and has subsequently helped to establish a professional and multi-ethnic Kosovo security force. Operation Seaguarding in the Mediterranean focuses on maritime situational awareness, counterterrorism at sea, and support to capacity-building. NATO continues to cooperate in natural disaster relief and assistance operations. NATO assists in the African Union mission in Somalia by providing airlift support for the African Union peacekeepers, capacity-building support and expert training support to the African standby force. Since 2014, NATO has deployed aircraft to reinforce missions over Albania and Slovenia as well as the Baltic region where NATO F-16s have intercepted Russian aircraft repeatedly violating Allied airspace. Under resolute support, NATO has been involved since January 2015 in a non-combat mission which provides training, advice, and assistance to Afghan security forces and institutions. NATO has also provided assistance for the refugee crisis in the Aegean Sea and has since February 2016 following a request from Germany, Greece, and Turkey. To prepare for various contingencies, NATO also engages in a constant program of exercises and training designed to test operational readiness and to maintain interoperability amongst both Allies and NATO partners. These can be live exercises, command post exercises, or exercise studies. Individual NATO countries also organize multinational exercises called Allied National Exercises which reinforce NATO objectives. Since Russia's intervention in Crimea, NATO and national exercises have had a clearer focus on Article 5, that is collective defense contingencies. NATO's biggest exercise since 2002 was held in October 2018. Exercise Trident Juncture was hosted by Norway and evolved approximately 40,000 personnel, 250 aircraft, 65 maritime vessels, and 10,000 land vehicles drawn from 30 NATO Allies and partners. It was designed to test the deployment of NATO's very high readiness Joint Task Force and focused on major land, amphibious, and maritime combat scenarios in and around Norway. The maritime component also embraced Poland, Denmark, Germany, and NATO partner Sweden.


Here we are We are in this Land steel soul run when I don't know I'm definitely gonna be playing more of this afterwards like first I'm gonna beat it then make then take a break on it and then figure out that skin mod that I've been working on with some help And then I might do a 100% run some sometime later 100% or 112% as people are calling it as well as a I don't know what steel soul run is But I assume it makes it harder. It's like hard mode. No death. No I guess I could attempt one, but um Yeah, no promises that sounds rough, but I guess it would be easier once I know the game now You know all the enemies because this game is really really fair The the boss design is amazingly done in the fact that everything is telegraphed even the the soul boss No, no the dreamer boss. I guess that I was fighting not the dreamer But the boss that I went into the dream with the dream now, you know the one like even that one It was really hard But like I could tell like all of the damage that I was taking was my own fault really So I kept making mistakes and it's not like Dark Souls where it's like like I love Dark Souls And they're really good at making fair bosses, but sometimes it's a blurry line with some bosses in Dark Souls But with this one like I really I feel really confident in saying That this is oh hello Sorry, let me finish that thought I feel really confident saying that all of the bosses so far are very very fair And I'm not just saying that just because I first tried a few of them Oh, what are you doing out in this miserable downpour? Impressive fountain, isn't it? I'm sure we'd be able to protect it more if we weren't both getting drenched the night up there was an important one The plaque here mentioned its sacrifice, which carries something of an ominous tone Probably meet some sort of horrible end though It sounds like the night's goal may have been achieved in the process in all the relics. I've collected I've yet to find a clue as to what that was I will be getting back to the shop soon if I stay out here for too long I'll get washed into the waterways come and visit if you like if you have relics. I mean I'm not much for chatter That's right.  Oh, yeah I noticed that it wasn't the same my tribe closed it long ago and forbade it's open But as far as I can tell I'm the only member of my tribe still breathing That means I didn't feel bad about breaking a taboo as proof of my belief in you. I'll open the door There the door is open I used my mind powers to do it and you can enter the glade beyond it Listen closely in there and you may hear the uttering of bugs long gone The old kingdom are starting to cling to you very encouraging You've clearly made my dreary work here more exciting being the caretaker the care the cake taker The caretaker of this place hasn't been very stimulating. There's not even any cake. How can I care for cake if there's no cake? I shouldn't complain though tending these graves and guiding the wielder all penitence for old crimes Certain things have to be kept in balance. Take this trinket for your efforts and return with 500 assets Keep up your tireless work pale ore. Oh, nice. I can upgrade.  I was a bear to charge the dream nail faster and collect more soul and striking foes neat Spirits glade Hello the bugs within this glade are under my watch Treat them with respect and you may remain a razor nail and you could tend contend with me Buy my cookies there. I'm so tasty beware your own mind little one Twisted minds breed docked deets and mine was more twisted than most I thought it would be my end, but instead I found this glade With it a sort of peace So all of these people are people that I can kill with my a dream nail, but I'm not gonna I used to help others They brought to me sick and dying What difference does it make any victory against death will always be temporary don't fear little creature though a violent rage Once possessed me a peaceful air in this place seems to keep it at bay or you a warrior little one a true warrior Is one who can stand strong in the midst of a storm?  Okay, so these are all warriors of some kind and a cookie seller You seem to now have some kind of peace in a strange after life We're always left with Reminders of the errors we've made let your mistakes not burden you But serve as guide posts on where not to travel Do you like my nail little wander? I only carry three far less than legends may suggest still each is sharper than the last and I'd require only one to Cut you down. Oh, I like this one.  I'm of the distinguished species you see though. I've not seen another like myself for the longest time Oh, it's a mock. I like them.  I'd offer advice though to have made it here.  Oh Don't fear my rotting form my body sheds Changes my core remains the same all of life's problems can be solved by crushing the force Such a simple mantra and one I've always lived by if you weren't so scrawny I'd suggest you follow my example is really testing the limits of my voice acting Don't judge me by my appearance though my stature is ma a bear a dark soul and a tendency to go berserk in battle Hark fellow adventurer. Are you heading out into the world? I'd join you But it's been a long time my fear.   I'll see you soon. She said that was long ago I wonder where she went. I like the designs of all that. Oh, that's cool I've been many places Many things But I suspect you will undo me by far out to do me. Sorry I've long ceased traveling the caverns of hollowness, and I suspect they're now far more dangerous than in my journeys Though with your capable heir, I'm sure you'll do the same. You'll do fine. I can't read. Good luck It's a fast world out there. I came from here far away to reach this place Though my shell may seem foreign beneath it. I'm a bug the same as you got so many This is cool. So I can fight all of these guys Interesting, and they're all unique fights. I assume maybe one day maybe one playthrough, but not this one. I know what I'll do Well, that's a wall Fast travel use a tram pass. All right Hmm. I see Press the glowing button. Why not? Hey, and we're back here. We're at the crossroads. Nice All right, and we can get to the crystal place from here. Myla, right? No, myla's up there Okay, she's picking away.  It made me sad. I hate it.  Nobody likes this game Nobody likes Hollow Knight Sorry about that shaman crystallized mound It's over here. Oh It's a shaman. Hello descending dark while holding down straight Spelled to pleats soul replenish. Oh So this is like a more powerful one I think you're all cool just because you could shoot lasers. So could Jesus. You're not as big a deal as you think Bible spoilers Sorry in Leviticus 1114 Jesus shoots lasers out of his eyeballs. Oh Hollow Nests crown. Oh, this is like the highest place. Hey another pale ore It's down here Okay, just back down. All right Hmm, and I can't go up there. So this place is pretty much fully explored. I think let me just double-check really fast like Yeah, so these are all messages things carved in left behind for people to read I can't read them seems remember light This is either a mass of mass or a mass of nail or just a statue There is down here. I'm charted territory friend. Oh, I hear friend. Oh friend oh friend. Oh, hey friend. Oh, yeah Oh You're not a friend. Oh Yikes real friend. Oh, okay. Oh my gosh.  All right. Oh That was freaky. All right. Good to good to know that that's not what a friend. Oh turns into it was just a mimic of some kind We see if there's anybody new here or anything new to buy Potomastio more health, please Ray Findo or friend. Oh, hello elderbug Circuitous roots beyond the cliff beside us. It's a hard trek now But in the kingdom's prime things were far simpler. There's an old pass in the cliff that once allowed easy access I bridge up to it has long since crumbled away and even without it a huge door bars entry I can't complain. Mind you. It's meant we It's meant we've only ever had to accommodate a trickle of travelers even during the busiest times I wouldn't want hordes of bugs to descend on dirt mouth. I like the quiet that noise the old lift Where does it go up to the old mines? They carved into the peak? I suppose have you been up there? Is it drew the crystals glow grow everywhere you set a villager brought some of those crystals back to the village once? I don't quite understand the allure myself. You can't eat them and they don't make very good pillows They hardly seem worth any trouble to me.  Let's go to fungal wastes over there perfect or soul, please What is my favorite enemy been so far I don't know. I really like the little crawlies the creepy crawlies the various flavors of that They're very cute. I like the fluffy white ones one little figure of it or like a plushie I also like The little green the green one the green bushy ones. I like those the most actually I also really like them. They're not really enemies because they don't attack you But the little mushrooms with no face that just run into the wall and run away from you I love those. They're in a where are they? They're in green path. They just run around.  He was pretty satisfying to fight Also hornet I always like dual fights where it's like you fight someone of kind of equal abilities Or similar.  This is just this game's just a rip off a maple story with all the mushrooms and the jumping and slashing in the 2d ranges are good in divinity 2 they get both. Oh these guys. I love these guys. Look at them go And they keep bumping into the wall too. I love them Look at them go Okay, he's gonna fall down there. You like what? God, they're so dumb Say I could be like manuela save a line.  Oh This is Down here. Ah, I've been trying to figure out how to get up there this whole time neat Well, that explains a deep nest the rest of deep nest I still don't know what that random like other me was in here There was another like bug night that was down here that looked just like me that was just standing there menacingly looming He's just standing there Menacingly I tried to follow him just kind of disappeared. So that means I mapped out Yeah, I mapped out the rest of that. All right, cool. So there's a way in Mantis Village down there So that's our next stop. Yeah, I have my own website. Oh They bow to me now. That's really cool. Hello. Oh, that's neat because they respect me. That's so cool Hey, remember that time I beat the man just lords on my first try at rich farm remembers They're making raisin bread like grandma made wait, but that that just goes fog Canyon, which I can't go to yet All right, I think I'm pretty lost now because I'm thinking every every way I've gone there's so yeah Help me out chat. Where do I need to go next? I said the magic words help me out chat the tram in the ancient basin Okay, I guess I haven't done the tram in the ancient basin. So I'll go there. It sounds like a good idea All right, I'll go to the tram This is where I broke the stream last time because I was doing this And then the stream happened to end All right, just take the tram This one's clean the hive whoa I've not seen this ever. I mean, I've not seen a lot of these this is like totally different.  Oh Whoa You like jazz We've awoken the hive. This place is pretty very different from the other environments. I like it I've not seen anything of this area. So this is like totally new to me not even like in like screenshots and stuff Bench Cornifer Kingdom's Edge Hey, Cornifer Isn't this a cozy hole have been venturing about the wilderness beside here and thought a moment break was well called before The landscapes all rather serene this side of the city of the inhabitants are as ferocious as ever and I'm out Right sweet. Okay. That's a new icon Colosseum of fools This bench down there too Oh Hello Okay, I see there's a Colosseum up there.  It's very cheeky. Wow We've never found that that's hidden. That's like old-school secret. It looks like shedding First I thought it was like salt, but I'm pretty sure all these things would be dead and it's falling I can hit it. We are bugs Friend time new friend Hello I love him. Um, tiny thing you climb high seek then knowledge of these lands This ashen places grave of worm once told it it came to die But what is death for that ancient being more transformation me thinks this failed kingdom is Product of the being spawned from that event this falling ash is malt the worms corpse decaying endless Serene sad with it's like gone the world is smaller Okay, so the worm is apparently some big ancient important thing Don't mistake. I am not a worm or too small I am too many limbs no foresight like those old beings for quiet retreat Did I climb up here away from spitting creatures or yes high up away from simple minds lost to light There's is a different kind of unity reject of the worms attempted order I resist the lights allure union it may offer but also a mind bereft of thought to instinct alone a bug is reduced Okay, so yes, this confirms my theory that light is bad beyond your way Then it's rest I'll return to though in these times sleep off proves uneasy What are you dream of? One prefers its mind not be pride. It's rather unsettling rather invasive. Oh, he knows. Oh Sorry, sorry about that. That's rude of me. I mean, it's technically right I shouldn't go reading people's thoughts like that willy-nilly a breach of privacy How about you don't please I don't come into your dreams Hey, is this us shortcut City of Tears. I remember this area. Okay, sweet Bench on the map bench Wanderer's journal sweet. It's a tent. So there's a worm up above us somewhere Hey, what's up? Hello. Is it daytime? So you pursue the deeper truth. It isn't one the weak could bear All right round two Prove yourself ready to face it. I'm not hold back My noodle is lethal and I'd feel no sadness in a weaklings demise. Show me you can accept this kingdom's past and claim responsibility for its future faster Heal That's a counter. Okay, that's not fair. I don't get to lay traps. Okay more traps. All right. Oh Oh Geez It's getting getting there Almost first try baby So strong you could do it if you had the will but could you raise your nail once knowing it's tragic conception and knowing yourself And do it goes to Polo nest head on wood burn that mark upon your shell and claim yourself as king. Oh Crap is this it? Shit, I don't know if I'm ready yet. Hold on. Let me go heal up. I can't be I'm I'm guessing there's more I don't I don't know that I'm that close to the end But I'm gonna go here regardless.  Oh Okay, let's get out of here All right My night has been shining armor. She saved me where to now I guess Well, I have two directions I can go I can go further into this hive nest or I could go open that door I'm gonna since I'm already here. I'm gonna go through the hive This is oh It's the third one. Yeah, I think you'll find me down here where the world ends Yes, I know why you're here You came to learn nail art from the legendary nail master Oro It is the law of the great nail sage that I must pass down my teachings to those who are worthy But no law forbid me from exacting a payment for my time if you truly wish to train under me and prove it with Geo. All right. Yeah, sure Dash slash concentrate energy into the nail release the button while dashing to perform a dash slash Hmm, I must say you're an excellent pupil your skill with a nail and your thirst to become stronger You remind me of my brothers. I met your brothers.  No, he doesn't in the future if you will listen I will tell you why I chose to tread this path. Oh, I want to reconcile Seems like some kind of superstures Waterways royal waterways, okay New friend of new NPC. Oh, hello. Ah, what a surprise. It's not often I receive visitors. It's been so long ages Even I hope my manners haven't left me. You've no doubt sensed my affluence. You're right to guess I'm renowned amongst the upper cast of hollowness. Well, I was once until those cretins cast me out Have you met them my former fellows?  I'm just so happy. It can be a wonderful thing. What up? Wow. All right Oh Could it be you returned at last? No. No. Oh, pardon me. Just for a moment. I mistook a certain quality about you You seemed almost recall. Well, I am the new king silly. I know it's clear. You're not of high birth wandering all dirt and tattered like that Okay, isn't life just wonderful. Geez She's kind of a Doubt this one will meet its demise at the nails of the city's guards I will love you too little grub as I did all the others. Wow, okay Geez, she is In need of some manners Well, since we're here might as well go get an upgrade. She is bigamini head. Seriously. Wow How cold can you be towards these like husks of dead former residents? He says killing in drool.  I don't I don't feel joy from what these what happened to these creatures. I pity them She doesn't she's all like Boy being alive is great. Oh being alive, man. I'm glad I still have my sanity unlike those husk like Monstrosities outside. What losers am I right? All right, nail upgrade. Let's go as you wish. I'll work on them There we are forging is complete I modified the nail to spiral form very tricky task It was to find it stronger than ever before off you go now cut your way forward pretty be careful Let's see this. Whoa a powerful weapon of hollowness refined beyond all others. Ah I see out. Okay Hello, is there a new friend here? All right, I'm following your voice. Hello boss time. Okay boss time probably Hey, can we can we chat for a little bit first you talk you seem like a cool guy I love this guy. I like his music too. Oh Look at him go Swimming through I Love this guy. Oh He's falling over. Oh, he's having such a good time The happiest dung beetle I've ever met. Oh He's angry now. He's getting aggressive. Oh Love that guy. Oh No I'm so far away. It happened again. It's time to do a little bit of hoofing This is this is my favorite boss so far just the personality Mr. Defender Don't get too close. You can apparently hit you with his hand while he's throwing those He'll up. Oh, he's having such a good time Yeah, I like jovial characters too You're just the best. Oh, hello. Oh, no, don't die. No. Oh, there it goes. Oh No, he's fine. He's fine. He just scrounged into the dong Yeah, favorite boss so far Fenders crass unique charm bestowed by the king of the hollowness to his most loyal knight Scratched and dirty but still cared for causes the bear to admit a heroic odor. Oh, I love it Okay, we've been putting off the hive for a while now. Let's let's go to the hive. Let's go back to the hive Hey bouncy one. I like how fluffy they are to bouncy beat. Oh my god, they can break those They're cracked. I was wondering why they're some of them were cracked. I came in like a wreck in me Here we go. Kingdom's Edge. Yeah, all right secret passage Queen all right Hello Hi Like that, there's a little rendition of flight of the bumblebee in there How long have you had those in you hate those things? Oh, man Right. Oh, I'm a snipe to the ads Queen I am am I your new night now. I have the yellow robes man So this whole area was optional interesting. Hello my night at last you are freed Small thing. I know you're kind if you attempt to resolve your past then no I'm not the queen you seek it is the pale being that bear blame for your nature though this hive exists within Holonest We play no part in its attempt at Perpetuation to rail against nature is folly all things must accept an end. Okay, so there's a cycle That's going of some kind does that mean she's dead. I guess so I guess that's just like her bloated husk So all that was an optional area interesting so now I can head to there now that I have the king's mark Let's try this though hit me Does it keep going? Okay? Does that one come back? No, all right? I see so if I get hit if I keep waiting it'll come back Okay, I think this is the way. Yeah, there we go. Oh, that's a lot of shells. Oh It's literally the of this aha Hello good sir Indelibly oh Nope Happen to have any geo on you. Would you I didn't think so. I hope porno for never comes here I would love a map, but I hate to think that he traverses kind of place Hey souls. Oh my gosh. That's so bright Geez, oh the bright light is shining on these this black goop. It's making it so I can traverse Yeah, hello There's a Samoth the Metroid statue. Oh Boy shade cloak dashboard cloaked in shadow use the cloak to dash through enemies and their attacks without taking damage This is what I need. This is what I need to get through that thing. Yes Yeah, this is definitely this is straight up a Metroid reference. I appreciate it Ba ba ba ba ba ba ba ba ba ba ba ba ba. Let's see. Oh, yeah We dark souls now Al. Oh Hey, Hornet ghost. I see you face the place of your birth and now drape yourself in the substance of its shadow Though our strength is born of similar source that part of you that crucial emptiness I do not share funny then that such darkness gives me hope within it I see the chance of change a difficult journey you would face but that choice it can create prolonged world Stasis will face the heart of its infection. Mmm.  He's completely off the mark I'm guessing Attitude to take that harder path, but what end may come the decision rests with you I'm guessing whatever infection comes back and the new Hollow Knight has to seal it away I don't know their links There's some kind of cycle and they're linked where it's up for you alone I just don't know how they're linked because if I'm causing the infection by killing the dreamers Then that doesn't make sense But if it's happening anyway, and it's just represented by me Killing the dreamers. It's just representing the passage of time. Then yeah, that makes sense. All right Well time to go back to the it's called The jellyfish place and also down there. Oh As odd as much of holoness can be there's a whole new level of strangeness about these cabins Did you see the dark gate below? It was quite unsettling to be near it did my best to avoid it fortunate for me I found another route in though. I did end up a little singed after waiting through some acid. Yeah Quirrell, what's up, dude? Doesn't this kingdom just abound with surprises? I building atop an acid lake despite the side I can't help but feel familiarity something stares in my mind though I can't yet tell what I thought it my lust for discovery that led me here But now there seems to be something else this building beckons me. I can feel it calling dare. I had in A lot to explore is this a rapture. It really does look like rapture Hello there Boss time Moomoo, okay, I can't hit it We Quirrell Yeah, thanks, man. Whoo, dude. Quirrell's the best Quirrell to the rescue Quirrell, please help me out, but Nice Dude, it's nice to see him in action.  I've been a bad influence on you. I blame myself Something close within the tank Hello, Quirrell. Hey bud. Thanks for the help. Did she call you too then? I realized it's no coincidence. We arrived together Now much of my memory is blank this place I recall within these chambers the teachers saw to restore to store the kingdom's Knowledge and at its core she stored herself to save hollowness the teacher willingly became a seal but upon herself She enacted an additional protection. No, I cannot recall. It's happening I played a part in the feet.  She knows what you would do and seems to welcome it Well, maybe I am the good guy a figure sleeps within the tank. Oh, there we go. Oh, she's a dreamer Hello For diversity the seal world forever unchanging seals must break forever She said it's okay Achievement unlocked teacher. All right. Here goes another one One more I don't like that I Her seals break.  I begin to feel my age. Oh Coral, you're so cool.  I almost have this whole place mapped out All right. Now that we're at a station. I'm uh I'm gonna call it here for now. I'll be back in the next video. Yeah, I'll be back