Okay. Good morning, everyone. Welcome to the research track here at the OpenSim Community Conference of 2003. I would like to introduce our speaker today, Austin Tate. Austin Tate is Director of the Artificial Intelligence Applications Institute and holds the personal chair of Knowledge-Faced Systems at the University of Edinburgh. He is coordinator for the Virtual University of Edinburgh and runs the OpenView OpenSimulator grid. I, Austin, is Professor Tate's avatar representing the Virtual University of Edinburgh. This presentation explores support in a training-orientated eye zone augmented by Intelligent Systems Technology with the aim of providing a virtual space for intelligent scenario-based learning. I has provided online resources to accompany the presentation and to assist if there are any technical problems in seeing his slides. They are accessible via http-ashtate.org-oscc13. I will also put that down in text. If you have any questions during the presentation, I am them to me. I will speak them in the stream to Austin and he will answer. Okay. So over to you, Austin. Thank you, Shirley. And thanks for joining us in this session. As Shirley explained, there is a URL available for resources to do with this talk. That will be persistently available after the session as well. So for those of you watching on a recorded stream, you can also use the URL that Shirley just mentioned. It will be on the next slide too for those who want to see that. There is a little poster to the right-hand side of the main screen showing and for those of you in-world, if you click that, it will take you to the URL.  So I became a student last year. I did the MSc in e-learning delivered via distance education methods at the University of Edinburgh in our own School of Education. I did that really to improve my own experience of distance education and methods for distance education because I am the coordinator of that for our own School of Informatics. But this dissertation gave me an opportunity to look through a number of things that have been interesting me over the years in my own work, which is mostly in artificial intelligence. And I'm going to give you a bit of a context of what we're working on and why and the application areas in this talk. The talk itself principally follows the work I did in my MSc dissertation. And this let me organize a number of threads and put together a number of resources which we're now using with our own PhD and MSc students at Edinburgh. So it's partly an exercise in collecting materials and partly an exercise in trying to do a specific project within this space of interest to me. You'll see why the title is there, this Activity in Context. And I'll explain what I mean by that as we go along. But officially this see this as a report on my own MSc work in the dissertation for that. The URL is on there, http colon slash slash atate.org slash oscc13. As I said, I'll leave that persistently available as a short URL to get access to the materials. It also gives access to the dissertation itself. I'll remind you of that at the end of the talk. So let's make a start. My own area of interest is really in mixed initiative approaches to education. That's where the tutor and the student work together, each taking initiative at appropriate times. I want to see that supported by intelligent systems in all sorts of tutorial modes. And some of the particular areas I've been working in are not in higher education. They're in training for virtual for emergency responders and other people who are involved in professional training situations. So by mixed initiative, what I mean is the various agents can take the lead on the initiative in interaction at appropriate times. So this is in contrast to tutor guided learning or student discovery based learning. It's intended to be that rich mix that lets people work together in a learning environment. So I'm interested in our scenario based training and learning works. What's the most effective way to support learners in some of these professional learning contexts? My research work has mostly been funded from US sources working in a range of areas with civilian and military emergency responders, especially where they're working together, civilian and military teams.  If you can't see the slide, the resource link I gave you lets you bring up a copy and you can follow along in a browser outside of the window if you want to. But I will read out what the key elements of what this flow diagram is on it. So it's a flow diagram of areas I explored during my thesis work. And I'm just going to bring up an overlay to give you an idea where the areas marked in red are the parts I'm mostly going to discuss in this talk and the ones that were of most interest to me from an AI perspective, in the artificial intelligence perspective, in the work that I was doing. So what I did was really look at what I wanted to have a driver for this, which was the need for more effective ways of supporting community-oriented training sessions. We've got a community of people who are meant to be exploring a space for something they're going to do either professionally or in their work lives and we're trying to help them through scenarios explore this space and understand how some of the procedures work in the space. I'm just bringing up my own copy of that. So what I was looking at was some of the cognitive psychology routes that underpins situated learning, social learning and learning in areas where you've got a rich scenario, a rich environment for... I'll thank Beth for bringing that link up there. So some of these cognitive psychology routes I was exploring. Now this work has been going on for quite some time. Of course, there's a lot to do with situated learning, social learning, discovery-based learning. And I actually had studied some of this 40 years ago when I did my own undergraduate degree where I did a little bit of education psychology work in that. For as many years, even though I would do work in artificial intelligence, it was many years since I really had read more up-to-date readings and more up-to-date texts on this area. So this gave me an opportunity to come up to speed on that. It helps my own students now with being able to interact with them. But it let me come up to date with some of the terminology in this area and in particular to start to see that people have been using all sorts of interesting observations of how you can explore joint activity. And activity fits closely to my own area of artificial intelligence. And I'm going to draw that out in a moment. But there's quite interesting work on how the world itself in a training environment or a learning environment can constrain what you can do. Knowledge in the world or affordances, which allow you to constrain what's possible in the learning environment that you're working in. So I was exploring that. So what I was trying to do was understand how people model learning objectives and how they use those in designing their educational programs and their training programs. How you can use community knowledge in a social learning context and how you can use a model of the world scenario, the world state of the scenario, to give you a constrained set of choices so that the learning is directed in some way. What I wanted to do was try to show that there could be an underlying representation of those that you could actually do some reasoning about while you were doing this kind of joint learning to start to get the idea that intelligence systems could be brought to bear in this learning environment. And in particular, because of my own background interests and research interests in AI planning and plan representations in particular and shared plan representations for human and system agents. I wanted to see that many of those objectives, community knowledge and state information could be represented using the sorts of plan representations that we're familiar with in artificial intelligence. So that's the first of these red marked the shaded box. The representation of agents, plans, activity and state was a requirement that was driven by the psychological background that let me explore what I was already doing in a more technical sense with AI plan representations, but being able to draw that back and link it back to terminology now in use in the educational cognitive psychology area. What I then wanted to do was show that you could bring that to bear on designing scenarios for training in this mixed initiative fashion. And for that, I use roadmaps and I'm going to come back to a slide or two on these to explain a little bit more detail. So I wanted to use roadmaps that let you map learning objectives to possible ways you could constrain the world situation in order to give people challenges within that constrained world to give them a learning environment where they could explore, use procedures, use their background training and explore an environment where they had to make choices inside the training area, inside the training facility or inside the training tutorial room. So I wanted to have learner activities where we wanted to drive and events which were occurring that were giving them some sort of constrained set of choices. And this became the core of the dissertation work, this making of choices in a constrained fashion, hence the term activity in context. I wanted the learners to discover the activities they could take in the context they were in and the constrained context that we put them in, through injecting appropriate events into that domain. And this is, as you'll see, a typical way that learning and training groups do work when they're training people for these kind of professional environments. But then the back end of this and we'll come on to this towards the end of the talk is that I wanted to then experiment with a facility inside a virtual world, inside OpenSim, that allowed us to create one of these training environments, which was more like an operations center for people to take decisions in an emergency response context. And we'll come on to that shortly. So I'm going to just move off that flowchart slide now and move on. So mixed initiative training is what really is the focus of the work. And I wanted to bring a number of threads together, as I said, of work that I've been doing over the years. And this gave me an opportunity to sit down, explore some of this and do quite a lot of background reading that I've not really had the chance to do before I concentrated on doing this dissertation. I wanted to study, as I said, the cognitive psychological foundation for situated social learning. I wanted to identify effective learning methods relevant to the mixed initiative interaction between agents that interest in me and to discover the relationship between those cognitive psychological activity models. And the more research AI research oriented conceptual models activity that I've been working on, especially in some of the standards activities for representing plans and processes. And then to look at a methodology for how you might use these to design training scenarios and training environments, where you could use some of this background to give a more effective training oriented zone of work. And we call this an eye zone. And you'll see that that's this links to previous work I've done on things called eye rooms, which are intelligent rooms for interaction. So we're trying to create this virtual space for intelligent scenario based interaction that I call an eye zone for the purpose of this of this dissertation work. And what I wanted to do, as I mentioned at the start of the talk, was create document and demonstrate a resource base for experimentation potential reuse in this area. So that other students, other people could pick up the resources. And the URL we've given you before, just point to the places where a lot of the resources and demonstrations and videos are available. And the relevant psychological relevant educational psychology itself, I aren't really covering in this talk at all. If you're interested in this, the dissertation itself has a couple of chapters, which do go into this in a bit more detail and draw out why certain themes are interesting to me. But it is to do with communities, it's to do with action and changing communities and how you can use the power of a scenario or a story inside a scenario to give really good motivation to learners and give them an understandable and constrained environment with which they can learn. And then I just wanted to touch on the fact that there has been, of course, a lot of artificial intelligence in educational learning systems to date, indeed going right back to the beginnings of AI. There were attempts to create intelligent learning environments using artificial intelligence technology. And again, the thesis goes into details of this in a chapter. And it gives kind of summaries and literature reviews that give an overview of why this stuff's important. And now the last 20 years of work in this area has updated what was in some of the early textbooks of the 1970s. So I would just point you at the dissertation. It's a PDF of the dissertation online, if you're interested in that aspect yourself. But I wanted to use AI-inspired models of activity. And in particular, we use an ontology we call INCA to underpin all of the representations we have of plans, activities, processes, agent capabilities, and agent interactions. And this ontology is a very simple one. And it underpins some of the standards available now, available through National Institute Standard Technology in the US, for instance, and things which have become international standards. There's a core ontology of some of those international standards, which is itself inspired by some of the work that's gone on in a range of communities, but including the AI community. And I've been involved in some of the activities like the MIT Process Handbook, the Process Interchange Format that's most part of that. And then the later work where all those groups came together with people from industry to work on the National Institute for Standards and Technology process specification standards. And they themselves led to one of the ISO standards. But this core ontology is a simpler thing. It's an abstractly simple description of activity. And the INCA stands for issues, nodes, constraints, and annotations. It's meant to be a very simple underlying ontology on which you can base many of these representations. So plans, processes, capability models can be represented as a set of issues, a set of activity nodes, a set of constraints on those activity nodes, a set of annotations that underlie what the process or the model or the plan is about. And typically there we might catch a rationale behind it and its purposes and its links to objectives and agents. So this underlying ontology has been around for a long time. It's something I've worked on for many years, but a number of other communities have perhaps differently phrased versions of this. But these core ontologies have been around in planners for decades, planners for decades. And I wanted to use the abstract models that underlie these representations to see if we could map it across into these themes that were coming out of the mixed initiative learning environment work. So in particular I want to find ways to map learning objectives to appropriate learner activities. That's where the road mapping can come in. But I want to do it in such a way that you could have partial reasoning about that. And that's why these underlying properly ontologically based plans are important to the way I operate. And then as I said relate the educational plans and what you're trying to achieve in a learning sense on behalf of the learners, you want to map that to the plans of the domain, the description of what's happening in the scenario itself. So it makes sense in scenario terms. And that's what the roadmaps offer in the dissertation approach and the methodology that I was trying to develop here. And that will summarize as we go along in a minute. But then I wanted to use AI planning methods to actually compose some of these learning episodes. So you could have partial creation of learning episodes in an intelligent learning space done semi-automatically rather than having teams of people write those scenarios and drive those scenarios. So the roadmaps are something that typically do occur. You find them in professional businesses and government agencies, many of the large-scale programs in DARPA, for instance, in military research in the US all have these roadmaps of what they're trying to achieve. And typically what you find in a roadmap is that you've got a set of requirements coming in and you've got a set of proposed experiments and proposed research projects or things you're going to do. What you're trying to do is relate those and show how if you work on certain aspects of demonstrations or feasibility demonstrations and things of that kind, if you work on those, they achieve both your objective and demonstrate a technology. And typically the aim is for the people proposing technical experiments and technical projects and seeking funding for that to try to relate that to the objectives of the overall program. And I've been on programs where I've been a program manager alongside other program managers where we use the roadmap to drive what we try to get out of the different projects that people are proposing. So we encourage them to try to write nodes of these roadmaps. So they do show that their meeting requirement that feeds back to the potential future requirements and future opportunities of using their technology, but they're also showing their work well. They're demonstrating their work well by finding an appropriate node on the roadmap and appropriate thread in a particular demonstration we're doing. And now we're trying to use this in relating learner objectives to some of the situated actions that we want to try to encourage in the learning zone. So all of this is grounded in the fact that I'm interested in emergency response and in particular operation centers for controlling events during an emergency. So remember here we're not trying to simulate what's going on out in the field where people are in police cars or in ambulances or fire or they're landing in boats or they're dealing with the tsunami on the ground and you're looking at the layout of the land. You saw some of that in Christus talk yesterday for instance where they're very interested in the terrain and how you simulate elements of the terrain itself because there you're trying to put the simulation onto the agents or the avatars representing agents or onto the vehicles involved and onto the physical infrastructure. Here it's different. We're in a closed building. Typically it could just be a set of walls that we've got and we're not even seeing outside. Everything that's coming in is coming in via video feeds or radio messages, messaging and TV and so on internet. And typically we're in a closed room. Often it could be in a secure closed room. It could be a bunker in a facility that's meant to survive earthquakes or tsunamis or whatever. And I've got some pictures here. These are pictures taken in the emergency response centre for the Tokyo Metropolitan Government which I was able to visit and talk about that some of the work we're doing and look at the way their response centre works. And this has multiple levels. It has every level from dealing with the public through telephone calls through a command centre where the more technical people sit and watch what's going on with their sensor grids and watch what's happening with tsunami water levels and so on. Right up to an area where the mayor of Tokyo can sit with military advisors and can take decisions and is briefed. And there's a few pictures just in the slide set here showing what's going on with the emergency response centre at Tokyo. There are even mobile versions of these operation centres. Titan Corporation in America, for instance, make a truck typically bought by people like FEMA in America, the Federal Emergency Management Agency. And these can be sent out into areas which have been devastated with a natural or manmade disaster and can become mobile emergency response centres, setting up temporary communications traffic and so on. And you typically will turn them up with a truck like that and it'll act as the emergency response centre and coordination centre for the core in the field emergency responder. And we see these in Britain for our fibre gates, for instance, all our fibre gates of a control truck for emergency response coordinators, which is something like that. That's a picture of myself, my colleague Gerd Vickler, who sat inside the Titan truck. So you can see it's a closed environment again. We're taking video feeds, we're doing briefings, we're taking decisions and we're trying to do the best in an area we have. And the picture on the right shows a future emergency response operation centre concept that was worked on the DARPA programme that I was involved in to do with the planning initiatives. So these sort of operation centres are meant to be what we do. Now what I'm interested in is training these centres. So these are pictures of something which is the Personnel Recovery and Education Training Centre, PRETC, at Fredericksburg in Virginia, USA. And this is a training centre where people are going to become emergency responders or are going to be coordinators in real emergency response and search and rescue situations that typically train before they're deployed. And what's typically going on here is that someone's acting as a main search and rescue coordinator and they're dealing with all sorts of distributed centres, which in real life in the training centre are just along the corridor, but are meant to be potentially distributed across the world or across different agencies or in different centres and at different levels of authority. And then typically at the end of the corridor you've got a bunch of guys and a bunch of women who are sitting in something called the white cell where they drive the simulation, they drive the scenario, they have maps, they know what's going on, search and rescue people don't, they know where they're going to have accidents or emergencies or problems or where an airman is going to ditch an aircraft and they're working on this and trying their best to generate this dynamic scenario in order that the people inside the search and rescue training coordination room and the distributed rooms are driven to try out their procedures, understand what to do and work well to the situation that's dynamically unfolding. Now of course sometimes the people in the training centres work on it very easily and solve it all nicely easily so they don't really get much out of the learning experience. So the white cell is there to dynamically adapt the situation to make it awkward to deliberately cause realistic confusion for instance where there may be mistakes over things like call signs of the pilots involved so that you kind of get to the point where you think it might be the case that only one airman has been ditched in the water when reality it was because of a confusion of a call signs and some confusion of reporting and this sort of thing typically happens. So they've got this environment where they're basically a white cell, a main coordinator and the main people being trained and they all typically take a turn in that room when well being trained and then you've got these other distributed coordination centres so people see the problems of being underneath the control of someone and seeing problems of procedures either being followed or not followed. So this is the kind of context and we've worked for a few years with groups like the PRETC and Fredericksburg deploying some of our systems in experimental fashion. So what I wanted to do was bring all that together and then try to create a virtual space for this kind of intelligent training where you could actually try out that same sort of training you could have the white cell partially automated and you could try to generate dynamic learning episodes for people who are going to work in this sort of training situation and it's a multi-level experiment environment and I'd direct you at the MSC dissertation if you want a bit more detail, a bit more explanation of why I've got these levels but what I'm dealing with is the people involved, the agents involved and the environmental objects involved, the things which are actually let's say sensor grids in the field or things they could be things like water level sensors in a tsunami situation or things that you're getting reports from. So I wanted to both have a level of that that was inside a virtual space that's been simulated but also to link up with real external training people and this is typically what happens in these environments. You have some people who are outside the training environment who are operating in a physical environment and some people who are in the training environment and being given the opportunity to interact with the people outside in order that they can get that realism of feedback and some sort of realism about what's going on and it means it constrains the kind of actions they can take because there is this physical tie back to it. It's not all something that just can be stopped and restarted, time really flows, you can't just say stop now I need to think about this for an hour, something will happen during that hour in the environment which means if you're too late then that situation's changed and you've got to appreciate that. So this eye zone that was working on is based on some work we've already done on eye rooms as we call them which are virtual spaces for intelligent interaction. These are pictures of eye rooms inside OpenSim and we have similar things in Second Life and we can deploy these within a few seconds out of inventory that can be connected up to intelligent systems of various kinds including AI planning systems which can support stand operating procedures and suggest courses of action that can be connected up to external reasoning and argumentation systems and there's been quite a bit of work on this and we've reported on it in journals such as IEEE Intelligent Systems and IEEE Internet Computing so I'd direct you at some of the papers they're referenced in the paper for this session if you're interested but this is typically where people are coming together they're brainstorming and they're working through problems and they're trying to come up with courses of action and so we're typically looking at the issues involved with our methodology looking at the events occurring trying to make sense of that and then generating options for courses of action that we'd like to carry out and having argumentation and discussions on the pros and cons of looking at taking one of those particular courses of action and then we're kind of doing briefings on the sensible courses of actions to typically people in authority to try to get their approval but also to explain what their options are and then we're often actually enacting that either in a simulated training situation or in real life and these control centers are meant to be for where you have distributed teams rather than all in one location and you're trying to bring them together and you're trying to use the centers so as I said I'll point you at other work on these iZones for the papers that have been written to give you a flavor of what's going on there. Just to let you know that we've not just used these in-emergence response situations these same iRooms have been used with companies who for instance do multimedia game production. We've worked with SLAM Games in Glasgow and what is really an iRoom for creating games over a long period of time say three four months where people are talking about multimedia products and other things and meeting up with people in different countries who are doing artwork and music but they have this persistent space where they can discuss the game and it's evolving design and the materials around them and one of the other more fun uses of this was to create something called the virtual world of whiskey it's a scotch whiskey chewed tasting room where you can go in and interact with people who are doing chewed tastings in real life and interact with them in the virtual world to have chewed tastings and some of the automated systems behind this can control the screens can show clips of videos can bring up pictures of the processes of making whiskey can can use all sorts of other things and there's a youtube video if you want to look up on youtube virtual world of whiskey you can see a youtube video of us doing a burns night chewed tasting using our iRoom where we're interacting in a mixed initiative fashion between a real tutor who was was giving a tutor tasting down in London who was a director of a whiskey company and he was working with people then watching him and interacting with him in second life and the systems behind the scene are using a knowledge base of 15 000 facts that they could use a semantic web knowledge base of facts about whiskey and it was volunteering that information at appropriate times it had a natural language generation system that could let the assistants in the room do paragraph length composition of information that they could offer to the tutor to give to the audience and it also had the standard operating procedure support and tutor support and explain explanation of other processes by using the what we call the IX AI planning system so all that kind of technology existed and I was bringing it together for some of the work that you're now seeing in the iZone and we wanted to bring this together by embodying it in someone that could look like a tutor so if you see one iAustin in front of you this is four iAustins that we add here and these are all npc bots inside open sim cloned off my own appearance but all with they're all holding a little tablet as an attachment and the little thing that looks like an ipad or android tablet is actually an attachment that lets it can the the npc of the bot connect up to these external knowledge based systems intelligent agent systems so it can connect up to our IX planning systems but it could also connect up to chatbot systems like pandora bot alice bots in particular we connected this to the my cyber twin chatbot technology and what we had there is an ability both to chat and to use the intelligent agent to decide what to inject into the area so this gave us an embodiment and a framework for delivering some of the ideas that i've been showing you during this during this talk so remember that i was really trying to create resources here for students to be able to take and use and move forward with these same chatbots now with that little attachment can control the artifacts in this room as well as chatting into the room and chatting to the people who are being trained and injecting things into the scenario and acting like a colleague or an assistant however you want to see it inside this training space they're really becoming the equivalent of that white cell of train as i mentioned this this avatar could be thought of as one of the team members but deliberately trying to constrain and cajole and inject events into the training environment to make sure we're achieving our learning environments our learning objectives and this same bot can through chat to various devices in the room control things like the screens and the incoming messaging and other things so they can be a bit more like the staship enterprise sort of a computer where you can ask it to do things for you or ask it how you might do things or ask it to generate a plan of action or call up a standard procedure that you may have forgotten so it becomes a kind of a colleague in the room so this was part of the experimentation we were doing with the on the dissertation so overall the methodology that i wanted to uh to explain in this and that was meant to be a flow of it is that we we had this embodiment of this target training situation this was this eye zone and think of it as an operation center a virtual world operations center but to give an immersive and engaging user experience i wanted to have natural constraints from the scenario itself for what you can can't do so the interaction with this environment really gave you a realistic situation that gave you just those choices open to you that put you in this high quality learning point where you were in the zone as we might say for what you can learn and what you can do and how we want to push you and then we want to set up appropriate realistic challenging and motivational taster objective that make it fun and make it engaging exciting even uh for the trainers involved making it realistic and making it challenging really challenges the sorts of people we're wanting to do they're usually highly motivated emergency responders we've worked with real emergency responders in these training exercises and in these in some of the simulations we've done and they're driven by really having to make tough decisions because they realize it's good training and they realize it's it's it's exercising them in areas where in real life they wouldn't they would hope uh get to take some of the hard decisions that we force them into into taking so we want to then carefully select and inject scenario events into this environment so that we keep learners in this really highly motivated effective in the zone of learning uh for effective learning so it's about inducing context specific activity to get the learners to respond so i'm just going to summarize this and this is the methodology i want to that i want to uh treat as the outcome of my msc dissertation work the idea is to constrain the will situation and the activities which are possible in this in this environment and then select or generate perhaps semi-automatically relevant tasks and event events and then eject these into the learning situation to keep learners in this learning zone of highly effective highly motivated hard learning where they're learning most and getting most out of the training that we're trying to give them so we want to induce appropriate learner activity in context to do this so i'll just repeat the url for you hopefully that's even viewable on the ustream to people watching live and on the later recordings it's http call on slash slash eight eight dot dog slash os cc 13 and we're going to make sure that the full msc dissertation and resources continue to be available that url so thanks very much and thank you so so very much uh i i asked him uh at this time uh do we have any questions from the audience okay it looks like we have nothing i just thank uh everyone here for coming to the session and thank you again to our presenter austin tate for an excellent presentation right thank you and thanks surely thank you for coming whoops we have a question after all uh go ahead uh tom i'll repeat your question tom if you just want to give it put it in chat okay thanks surely but we need to tom christa do you want to uh all right okay i've got christa's question shall i read that out surely how many of these learning scenarios did you do so far so i'll come back to tom's in a minute but how many of these learning scenarios did you do so far so the the the work that preceded this was on the open virtual collaboration environment project open vce um we'd like to some of the uh of the assets and the the open sim archive files for instance the open source ones were created with clever zebra um and made those available in open source that work was done with us joint forces command and originally and the us army research labs their human resources experimentation division and that was done with a community of emergency responders um two sets and we did two week long scenario experiments for that and that's fully documented resources available uh the data was made available you know in a public way and it's been written up and and published in a number of journals including itriple intelligent systems so that was two week long exercises and that's the main of the actual experimentation we've done with humans involved with people who we're trying it out with um i explained that we'd worked on two of the projects we had two three man month projects which were funded by eu grants european union grants uh one with slam games in glasgo which took place over a three month period and one of these areas scenario based areas was created that way uh and the virtual world of whiskey now in terms of my own dissertation i didn't do any actual experiment further experimentation with other people we drew on that previous work as a community uh since this has taken place we've worked with a on a further project with the us army um which has been for the dismounted infantry collaboration environment work that's that works done with jeff handsburger um over in the us army research labs h red division and that again has not actually had an experiment involved with it it was it was a the development of the resources in order that they could be used our role on the project has been to create the virtual world and intelligent systems and web portal elements that then could be used by the experimenters themselves for their experiments okay thanks krister and let's go back to tom's question how does the system cope with emotional responses of the participants well i don't think i've got an answer to that the emotional responses so i think i'm going to need tom to explain a little bit more about what he's looking for in terms of that if if you're meaning in terms of uh trying to respond to whether the stress and things of that kind is that what you mean and whether we're putting them under stress indeed i see tom typing away yeah so if it's to do with that i don't think i have a good answer for you um we're we're effectively trying to ensure that the folks the folks are given interesting challenging and highly motivational tasks i've not looked at all about the the issues of of stress and levels of of attention levels of of excitement and in in our work at all uh i should say the work the way we're related back to krister's question the work we've done that i'm not a human experimenter or social scientist so in my work i've tended to provide an underpinning a technology a platform a framework that can be used in these experiments and then i team up with other people who are the human experimental psychologists who are doing the actual experimentation so when we did the world the whole of the the whole of society crisis response community work wasca project work that was funded by the u.s joint forces command and u.s army the h red people themselves at the u.s army research laboratory their human psychologists did actually did the experimentation and actually did all of the analysis of that and did the publications on that okay we have another question coming from krister i think just to comment on something that tom's saying about the white room or the white cell it's sometimes called in military training this is important this this this idea that you've got they call it white cell i think because they typically in a military situation they might have red forces and blue forces you know friendly and and enemy forces and they they're often kind of kind of create scenarios and the white the white cell is there to to to be the the people trying to keep people in this learning environment and trying to drive the simulation forward they typically inject events and they have a master scenario events list it's typically called uh where they they take things off the list and put it in at appropriate times to keep people driving along and this my approach is very much motivated by that idea of trying to put things in at appropriate times that are correct and seemingly right i've been involved in in something many years ago uh where with re-diffusion simulators on a on a project in the uk on the albu program in the uk where we were dealing with uh people who've been trained for navigation of of ships in the english channel off the the south coast of the of the uk and the idea was to put them into a situation where they had to respond as other boats came around them and if the if the people being trained typically got out of the situation too quickly you tried to put them back in it by by forcing them into situations where it was becoming more of an emergency more dangerous and they had to properly learn how to control their boats now along they took to turn and in in that case the people have been trained typically there'd only be one person who was who was commanding the boat and you might have had 20 or 30 other people controlling all of the various craft around them and this idea that you can use ai systems and automated partially automated systems to generate a plausible set of of behaviors of these other agents is something that i'm really trying to emulate in this next work okay i've got a question question from krister i'll just read it out in your msc studies did you compare any of this to mooks or is that even comparable with mook because mooks have zero awareness well i actually do do myself do a mook on ai planning with the on the coserra platform that we started last year any of you are welcome to join in that if you're interested because we're repeating it again coming up in january 2014 so i'm i didn't i didn't do any relationship at all between the msc studies and the mooks but i do an observation i don't think mooks have zero awareness mooks aren't something that i just posted online mooks do have people behind them they have the tutors behind them and a lot of us who are interested in in social learning and and collaborative learning and community oriented learning through mooks you know see mooks rather than the the sort of publish and let it go kind of mooks really treat it as a social event so they don't have zero awareness in my view because we're we're there as tutors we're there as as as professors and we're there as teaching assistants trying to keep it interesting and on our own mook for instance we definitely are the community of 20 or 30 people from from the research community in ai planning we're all heavily involved and heavily engaged with our students so i don't think i would directly compare it christa but uh i certainly wouldn't say mooks typically would have zero awareness either okay thank you again uh professor tate and uh okay thanks at at this point we have to wrap up thank you everybody for coming and uh you know we hope you enjoy your rest of the day at the oscc thank you thanks jolly


Okay, so here we are in Melbourne, Victoria at the front of Diamond Valley pork This is a disgusting murder factory where they gas chamber innocent pigs We've got a bunch of activists here already police have already arrived and today we have a non-vegan arriving who hasn't seen pigs bore witness to pigs hasn't even seen gas chamber footage yet So we're hoping maybe he can give us a little reaction and see what happens and I haven't bore witness for a little while now so for me this is going to be an emotional day and Let's go and meet the other activists Just walking past this slaughterhouse.   It's disgusting Okay, so we've got Denny here Denny's already a vegan and this is her partner Andy and Andy's not yet vegan and Andy's gonna bear witness to the pigs today, and you've never bore witness either. Have you? Okay? They got their um, that's their pool over their faces and So they live in confinement It's one over here. Hey, sweetie. Hello. Look at them all through here, dude. They've crammed them into these trucks and Like What's that on the floor there?  They hate being Together with pigs that I don't really know This is exhausted this one just looks tired and exhausted.  It's terrified They just get so exhausted some of them just give up hope Listen up here Absolutely horrible. Oh my god. That was really bad I don't know what to say about that.  That was really bad one. I know that was Yeah, it was vomiting Yeah, you've seen the pigs there stuff of felt what you expected to see that That's pretty good The smell because we're in the farm. It's just they're all in their own feces.   All right, and down the bottom is this the gas See these ones have already been stunned. They come back up. It's like a big ferris wheel They're getting closer now. They're trying to struggle See The channel escape here and then they hit it so they can hear them screaming the next They're freaking out a bit What happens is they go down get stunned and they come out the other side and then they get stabbed To in the jugular to drain them of their blood These ones have been stunned. This is actually from this place here this one here And that's how they process all the pigs so they come in Life of suffering misery come and cover their own feces and get dropped down into gas and then stabbed and that's how they That's where it comes from Yeah This would be from any government and then hidden from the public the public So it's a legal standard practice RSPC a like sanctioned They show you the farm pick nice pretty pictures from the farm It's all load of shit. So what that's when when I see bacon when I see a pork drop That's what I see.  So don't lose hope and just keep fighting Thanks for coming out bro. Appreciate that a lot You know takes a lot to come out to these things a lot of vegans still haven't come out to these things so Good on you mate So, you know now know more about the pork industry than 99% of people in the world That's nothing when you're brought up in like Especially where I'm from You don't actually link what you're eating to an animal That part's like not there like You're eating chicken, but you don't look at it think of a chicken now because of the way you're like hypnotized Otherwise, oh, you just think they fall asleep and go and when they're very old and they wanted to die anyway or some bullshit like that, you know Yeah You've been programmed The TV's programmed us the advertising's programmed us they're selling us a product and then when when I come and say no This is actually the truth. They go no No way, you're not right. I haven't been lied to you and they start getting angry with me, but like Hey, I'm just I'm just telling you the truth.  But this is actually the majority. This is this is the real life The majority of life. It's yeah It's the thing I'm pretending to you know, even now, right? I think I still pretend like kind of in a way that I don't have to engage with it Hey, because I don't invest in it I just hope people understand from activist perspective why we are angry about this, you know And like don't get it you mixed up like, you know that we're just Hating on meat eaters who don't know about this. It's more it's more that I hate this happening to animals Yeah, and there's no other real way to defend this for me Like I'm gonna defend it aggressively and offensively and I'm gonna attack the industry and that's how I'm gonna defend animals That's how I defend animals because that's how I want to be defended


What do you think is the best degree to have? What's the best degree to have? I love geophysics degree. It allowed me to mess around with high tech equipment and go into the field. That's one of the reasons I did get a geophysics degree because I couldn't sit behind the computer all the time and I didn't want to be in the field all the time. It really depends. Trades is amazing to go into, to be able to build things yourself, for yourself. STEM degree, a birdie here says STEM degree is good, is always good. It really depends. Computer science, computer science could be, but there's gonna be a lot of programmers that are gonna be out of work soon. A lot of people that are working in the tech industry that are gonna be fired soon, right? Because of AI taking over, right? And that's gonna be the case for many things, right? But AI doesn't have the capacity and capability to build a home from scratch, unless you get the fabricated homes and put it all together, but that's not gonna be everywhere, right? That's not gonna, and you need major investment to have those fabricated homes, right? So hands-on skills are extremely important to acquire, right? You don't have to self-educate, for sure self-educate. You don't have to go become an apprentice and stuff like this. You just need to experiment, try different things. Like for me, I worked in construction for a long time. I came from a construction family. So I'm comfortable around construction sites. I'm comfortable around small and large because I did geophysics, geotechnical. I think it's important to physically be able to do physical labor. I think that is extremely important. Being able to grow food, knowing how to grow food is important. I would say, do not go into financials. Like why would you go into financials?  So I wouldn't join a military. Do not join any military police force in forcing. Do not go into politics. So I would say acquire skills that allow you to think properly. I wouldn't get any sociology degrees or philosophy degrees or anything like this. I think they're useless in the coming years. Okay, they're not gonna be well-paying jobs, that's for sure. And you're gonna be in major debt getting those degrees, those pieces of paper that allow you to be a slave. So there's a lot of choices. It really depends on where you are and who you are. Oh my God, I'm waiting for the holy war against thinking machines. Frank Herbert saw a lot, Frank Herbert saw a lot. But I don't think, I don't fear AI because we don't have true AI. It's technocrats that are in danger to humanity, not the programs themselves, right? It's who controls the programs, who's writing those programs, right? Go see mocha. Would you recommend law school? Not if you wanna be, if you wanna work as a lawyer for social justice and for what's right and stuff like this. Sure, that's a noble cause. But there are many lawyers out there that can barely make rent and they're working 14 hours a day, lugging around paperwork like 24 hours a day, like 14 hours a day, lugging around paper, reading a lot. It's not a healthy life. It's not a calm, peaceful life. I personally wouldn't become a lawyer, but that's me, right? And when I was younger, I thought I would, but no, I don't like the system. I detest the system. But for some people, yeah. I can honestly tell you, if I had a law degree right now, I put the time in to get a law degree, I'd be a superpower lawyer, right? I would have filed cases against so many people just taking on centralized power that they would probably have to take me out, assassinate me to be able to shut me up, right? But is that a life that I really want to be in? No, I decided that a long time ago because I don't want to pick a fight on their terms. I'm picking the fight on my terms. So education is one. Gozi mocha, right? So for me, I can tell you for me personally, I went down the path of education, right? Because that to me brought me peace. That to me, I saw the positive effect I was having with my students and sending that into the world to have a ripple effect of positive things being done to me is amazing, right? Maybe it's not as grand as being able to, for example, in BC, suing Bonnie Henry charging her, making sure she's committed, tried for war crimes and convicted for, not war crimes, crimes against humanity, genocide and competence and all this jazz and making sure she doesn't have any savings left that she has put in jail for life. That would be an amazing noble cause for me as far as I'm concerned, but I don't want to put that time in to bring that kind of justice to that person. I think that kind of justice for that type of person will come in time, right? For me, I rather have a constructive effect. Even though getting rid of monsters like that in our society is a constructive endeavor, really.


Town Hall quoted you today saying the president, you said complementary things about President Trump, needs to tell Kevin McCarthy that, sir, you do not have the votes, it's time to withdraw. Let me turn the tables, Congresswoman. Kevin McCarthy has 202, 3 votes. Your side has 20. So if I'm going to use your words and your methodology and your math, isn't it time for you to pack it in, in your side to pack it in, considering he has over 200 and you have 20? Sean, I understand the frustration. I promise you, but he does not have the votes, and we are hearing for many people who are still voting with Kevin McCarthy who are very supportive of what we're doing and they're cheering us on. So there are more for us than are against us, and they are waiting for Kevin to cave. The American people are certainly frustrated by it. I'm frustrated by you not answering a direct question. You said to President Trump, you said earlier today that President Trump needs to tell Kevin McCarthy, you don't have the votes, hold up, can I finish? Can I finish? You don't have the votes and it's time to withdraw. He has 203, your side has 20. Why is it time for him to withdraw and not you when he has so many more votes? Well, Sean, he needs 218 and he does not have 218. We've been trying to work this out. You just watched Sean Hannity grill Lauren Boebert and he pulled no punches. The gloves came off and it's really interesting to see this Republican on Republican violence on Fox News because they are the PR unit of the Republican Party. So for them to viciously go after one of their own is pretty interesting. But what's also fascinating to me is the response from Fox News's audience because they did not take kindly to Sean Hannity grilling Lauren Boebert. And when you look at the response that Marjorie Taylor Greene is getting, Charlie Kirk is getting, it's evident that most of the GOP base, at least online anyways, is siding with the 20 Republicans who don't want to support Kevin McCarthy under any circumstances. So we'll talk about that element of the story. But first, more from this interview because believe it or not, it got even uglier. If by Friday, you and your group of 20 don't have a name with 30 votes, is it time for you to withdraw? And if not, why do you support a double standard? Last question. Kevin McCarthy does not have 218 votes. Kevin McCarthy will not be speaker. And you have 20. I asked you a very specific question. If by Friday, you don't have 30. I will not, Sean. I will not withdraw. Our asks were not petty of Kevin McCarthy. They were not self-serving. We simply were asking for commitments on what the American people want to see. They want to see a vote on term limits, a vote on the Texas border plan to secure the Southern border. Congress will not do with all due respect. We asked for a vote on a budget that actually balances. Imagine a Congress that stops spending money that we don't have. We are going to get this right and we are going to get the right speaker, Sean. If you only have 30 to be clear, you will not withdraw. But you are telling Kevin McCarthy and the 203 people that support him to withdraw because they don't have 218. That's what you are saying. Look, it's obvious by tonight's motion to adjourn that Kevin McCarthy and his supporters are already getting voter fatigue. I asked you a simple question, Congresswoman. I feel like I am getting an answer from a liberal. I am not going to support Kevin McCarthy, Sean. Okay, so even if you only have 30 votes. I am not going to support Kevin McCarthy. You will not abide by what you told President Trump to abide by. I feel like we've made progress. Look, I love President Trump. You're not going to turn me on him. You're not going to pit him against me. Not trying to pit him against you. That's what you said to him. And I am standing. I have seen him. You're the one that said it to him. Look, Sean, you can ask her tough questions. You can push back against her. You can grill her. But to say that she's acting like a liberal, that's just the bridge too far. Completely unacceptable. I love how that's like a gotcha. You're acting like a liberal because you're not answering questions, as if that's like uncharacteristic of any politician, regardless of their party affiliation. But there is a different point in the interview where Sean Hannity says, look, you want all of these things from Kevin McCarthy, and you don't believe that he's going to deliver when it comes to your policy priorities, even if this is about policy. But I don't think it is an actuality. But either way, Sean Hannity points out that Kevin McCarthy has given you an insurance policy. Just five members can recall him as speaker. So if you don't like what he's doing, if you think that he's lying to you currently, you can easily recall him because he agreed to that. But she's still not agreeing, and it just makes her make her look really unreasonable. And it gets worse for the 20 Republicans to just normal people who are watching, because Kevin McCarthy caved, it's even more demands. CNN's Manu Raju reports McCarthy proposes key concessions allow just one member to call for a vote to oust a speaker per two sources, more members of Freedom Caucus to serve on Powerful House Rules Committee, and promises to vote on some bills like term limits and border security. So he's given them everything that they wanted, but at the time that I record this video, he lost for the eighth time. So at this point, there is literally nothing that McCarthy can do to appease them. That's why normal people see this, and they view these Republicans as unreasonable. But the base, at least the online portion of the GOP base, is in lockstep with folks like Matt Gaetz and Lauren Boebert, and they are against individuals like Sean Hannity and Marjorie Taylor-Green. Let's take a look at the like-to-dislike ratio on that particular video. It was absolute insanity. So it got 22,000 dislikes and less than 7,000 likes, and Fox's audience voiced their displeasure with Hannity, and I've got a couple of examples here. So she wiped the floor with him, and he desperately tried to get control but lost. It looked pathetic. Sean also showed contempt for anyone not on board with the globalists. I'm not surprised Hannity did this interview this way. Hannity, we conservatives, don't want McCarthy. Hannity is showing his true colors right in step with the rhinos. I've been a Fox viewer for almost 20 years, and I can't believe Sean Hannity still has a job. And that seems to be the overall sentiment by the right, at least online. I don't know what normie Republicans would have to say about this, but at least the ones online, the most Kool-Aid drinking, mouth-breathing psychopaths who are far right, they absolutely do not want Kevin McCarthy under any circumstance. So no matter how much he buckles, no matter how many concessions he offers, they simply just don't want him as speaker. And there's another example of the base turning against anyone who endorses McCarthy. Take Marjorie Taylor Greene, for example. On January 4th, she tweeted, we are on day two, and the same NeverKevin group is now on their third speaker candidate.  Now, I'll show you some responses to that, but I just want to pause. I hate to say this again, but Marjorie Taylor Greene is correct because after the seventh vote or maybe the eighth vote at this point in time, Matt Gaetz nominated Trump to be speaker. I mean, Trump is not going to be speaker of the House. So at this point in time, they're throwing in the faces of all of their GOP colleagues that they don't care that they're holding up the party and making all of them look childish.  And it doesn't matter, the base seems to be with them. So let's see some responses from Marjorie Taylor Greene supporters. You've reached Dan Crenshaw levels of disappointing. Folks in your corner took arrows sticking up for you for years and in record time, you've undone all that goodwill been real. Wrong. People are proud that 20 reps don't want the same tiring status quo in Congress of which you seem to have morphed into. You should notice you've lost a lot of support, MTG. A lot. Cheers to the 20 and I've always liked you, but this doesn't look good on you. You sold out Marjorie and probably my favorite here. What happened to you rep MTG? Did you get bought off? You are not the person I came to know and love. You're supporting a World Economic Forum candidate. I thought you represented the US Oops. I guess someone found your quote price point dot, dot, dot. This whole debacle is tearing the Republican Party apart. And I just, I can't state enough how much I am loving every second of this. Even right wing propagandists who have brainwashed these people are learning real quickly that if they're not in lockstep with the 20 Republicans who are objecting to McCarthy's speakership, they're going to get flamed. Let's listen to Charlie Kirk read one of his viewers' messages because this was amazing. Now, someone says here, Charlie, lots of swear words in this email.  You support Kevin McCarthy. You're part of the problem. Kevin McCarthy is a lying. Rhino SOB, stop supporting this scumbag. Sincerely, Mike Francis. Understand the energy. I understand the vim and vigor there. However, let's be accurate about what I support. I support concessions to make the most conservative Congress in American history. Lots of swearing in that email. I love it so much. So if you dare to try to be reasonable here and just go with the flow and support McCarthy after he's given you everything that you wanted, not just concessions with regard to policies and votes on policies, but rule changes, powerful committee assignments, then you are going to get flamed by the base. But I would be remiss to point out that even if this has led to increased GOP in fighting, there has been some new potential friendships that have maybe began to grow along the way. Look at how Ben Shapiro talked about Marjorie Taylor-Green. This led to a very weird sort of political realignment that's been happening right now. And that political realignment is between people like Marjorie Taylor-Green, who's actually siding with McCarthy because she says, listen, we have to have a speaker of the... I mean, she actually sounds like the reasonable person now, Marjorie Taylor-Green. She's chiding McCarthy's opponents and saying, you guys don't have a plan. Like, who is it that you're putting up there? So he said that she sounds like a reasonable person. Marjorie Taylor-Green, the bulls in your court. Will you apologize for saying that a Jewish space laser causes to wildfires in California? I mean, maybe we could see a new alliance form here. Either way, this is incredibly embarrassing for the GOP because we are on day three and there's still no speaker. The House of Representatives cannot function without a speaker. Members aren't even sworn in without a speaker. On the first day, we saw kids bored out of their minds sitting in the house chairs because they were waiting for their parents to get sworn in, but that could never happen because there wasn't a speaker. So either way, I've made this point before I'm going to make it again. I hope that they just go as long as possible without a speaker because even if they choose someone who they all agree on, it doesn't matter because Republicans only control the House of Representatives. Anything that they pass that Democrats don't like can be rejected by the Senate or ultimately Joe Biden. So they're not going to accomplish anything. The main priority for these Republicans is to do all of these frivolous investigations into Democrats and possibly impeach Joe Biden, but Kevin McCarthy is already saying he's going to do those things. So I just, I don't know what the end game is, but regardless, the outcome is going to be the same here. So, so long as they continue to delay and make the Republican Party look foolish and childish and completely just unreasonable, I'm all for it. So I hope that this drags on even longer. I'm here for it and I'm loving it.


Militarily, a life-firing exercise is always the highlight of every training cycle. So you're trained to conduct a life-firing exercise. And part of the reassurance, but also of deterrence, is also always to be credible. So credibility from my perspective means that you have to show your capabilities, to have to underline the capability that they are effective and they can be used if they are needed. And that's why from our perspective militarily the life-firing exercise is very important. In a wartime scenario and also in exercises, we need to be ready to support the Lithuanians with our indirect fire means and obviously also the other way around. So in order to improve the interoperability of the howitzers, but also the maintenance, the supply of ammunition, of fuel and so on, this needs to be trained, this needs to be coordinated and this is what we are going to do here. I think the Enhance Forward Presence Battle Group initiative, so the intention of NATO to reassure the Baltics and the Eastern Allies, has been taken seriously all the time. But since the war in Ukraine started, you can feel that there's a huge effect on the population or the populace here in the Baltics and also in our home countries from the Allies that are part of the Enhance Forward Presence Battle Group here in Lithuania. The thankfulness from my perspective of the Lithuanian military and also the Lithuanian population is very high and we feel also thankful to be part of that community and to support and reassure the population by our presence.


Hello, I picked up a Chocolate bar and some gummies from the chum store in Niagara Falls It cost $20.99 tax in for these two items I'm going to Unbox them. I got a trailblazer Sativa vape cartridge When they first that they came in these came in last week these And they edibles sold out within six hours. I was told by the staff and then I Went in and picked up these two on Tuesday January 14th, I think it was and By the time I finished talking to the staff person The brownies had sold out. So they are going very quickly the THC The trailblazer Sativa is quite nice quite nice, but it It was hard to get into so I may have to go get a knife to get into these packages. We will see So this first is um And it's called Aurora drift it is a sea salt and Caramel milk chocolate it has two milligrams of THC per square I'm told and for a total in the package of 10 milligrams, which is the maximum that any individual package can have at this point in time. I Understand why they're doing it. They don't want people to scare themselves It says click How do I click this is interesting click There's me clicking I'm going to get a knife This is silly. I don't know how to click. I'm just going to tear it apart. Oh, there we go. Click Maybe that's what they meant by click. Oh my goodness You have to squeeze the side with your thumb to let it free out This is the problem. I had with the vape pen. Oh both sides To let it slide To let it slide in the box, but if you squeeze it really hard it will let it slide freely and There are 10 little squares in this giant piece of plastic So there's your chocolate bar My chocolate bar. I'll let you know how it tastes Later, so that's what the chocolate looks like five little pieces two milligrams each and that cost 799 it looks like they're reusing their packaging This is the San Rafael pineapple express gummies or pineapple gummies It's a sativa and it says there are five units. I hope you can see that Seems kind of bright on the label Maybe Shadow it Anyway, probably see that on a website Do the press down turn that's got the Duty seal on it and then peel and lift and there are five five little gummy pieces in this little jar Which was probably a medicine jar. They'll probably have something prettier next time, but so There's an unboxing of San Rafael gummies and an Aurora drift chocolate bar Have a great day


What is going on guys welcome back to the channel critical overlord here, so in this video I want to discuss some the possibility of Stu Mocker coming back in the Future of the screen franchise now. This is going to be negating the fact that Let's say Stu Mocker did somehow managed to survive the events of the first original screen film Now if we all if those of those of you who are a fan of the screen series go ahead and just give this video a thumbs up For everyone who is a fan and who knows about the original intent for screen three You know that Stu was originally intended to be the mastermind in that film You kind of just tie everything back to the beginning bring everything full circle We were supposed to find out that he ended up surviving the television to the face and all the other stuff He endured from the first movie and he's been in jail or prison this whole time And he was orchestrating these Events in the third film that would have just been spearheaded by or just would have been like a a prank of sorts from a group of staff fans I personally don't really like the the staff fans part, but As far as I could be in a prank anyway, I don't like it being a prank But getting into what I would do if Stu were to come back. Let's say they did go with that idea and they brought him back Kevin Williamson originally had plans to bring him bring him back in screen three Matthew Lillard Matthew Lillard, I've been Lillard I believe would love to reprise that character And if they were to bring him back, I would kind of do it like this So let's say in the events of screen five Stu isn't in this one though let's say at the very end of screen five after the killers revealed and after Sydney and Whoever else is with her possibly Kirby or let's say let's say even that maybe it's just Sydney and Kirby and Dewey and Gale, they don't make it.  Let's say it's just Sydney and Kirby. Dewey and Gale have died in this film Whoever the killer was they've beaten the they've beaten the most recent Ghostface killing spree They've survived yet another killing spree. This means Sydney's fifth go around Kirby second Then the very end they're like just walking and talking and then here's a plot twist. Here's a plot twist that comes in They say to each other Sydney can make the situation or make the comment saying This person was just as crazy as Jill was and then Kirby could be like, yeah, I wonder how she's doing That's the plot twist right there. That's the plot twist nowhere in screen five or anywhere throughout the film Do they talk about or mention Jill up until the very end and then you find out that Jill ended up surviving that gunshot It of course if she survived, I mean, Sydney did not shoot her in the heart she missed the heart and Jill survived that gunshot. We find out that Jill is alive She's been in prison Right along with who I'm about to get to She's been in prison this whole time and that's the plot twist. That's the ending of screen five We're gonna end up on a cliffhanger now Now after Kirby says I wonder how she's doing that's when screen five is gonna go into the prison We're gonna see Jill and it's gonna be a big dramatic sequence of us seeing the back of her head and then we see an officer or somebody in The prison area walking up to her saying Jill Roberts and then she turns around saying And then she turns around with a smile on her face or something or just turns around in general and There's some dramatic music in the background kind of just to make the audience go. Oh my goodness Jill's alive Because I know originally I believe Jill was supposed to survive and she was supposed to be the killer in screen five again and Whatever that was gonna end up being I would love to see how that would have turned out But we end up finding out at the end of screen five that Jill is alive And then what I would like to see is we see Jill interact with an unseen figure She goes to this unseen figure and she says it's time This unseen figure is never shown to the audience. We're saving this for screen six now Going into screen six, we know that Jill is going to be we know Jill is going to be the killer We know she's gonna have something to do with the next those face killings brief and Then in screen six what I would like to see is we the audience know that Jill is one of the killers But we have not yet to see who she was talking to when she said it's time and then comes the big reveal At the very end like halfway through screen six It's by the time screen six is reaching is in Sydney and Kirby, they're well aware of that Jill is involved But Jill is teasing the arrival of someone from Sydney's past or someone that Sydney probably shouldn't have forgotten about And then we find out that Jill's partner is none other than Stu Mocker who survived Who survived his wounds or survived the TV to the face of the end the screen and him and Jill are teaming up to Take out Sydney once and for all That would be a perfect cap off to the series in my opinion in terms of just just fan fiction just fan fiction at this point We have Jill from screen four who survived and then we have Stu who survived and has been in prison this whole amount of time Jill and Stu met in the same prison Been conspiring to get back at Sydney And of course Jill Jill would break break out And then also what I would do is I would I would basically have Jill break out the only thing that's gonna be an issue here making this work is if they both break out of prison How is it gonna look if Jill is the only one who gets exposed as being broken out? I would imagine it would also say that Stu Mocker broke out So I don't know how that would go, but just kind of throwing that out there I kind of like or would like to see a dynamic duo between Stu and Jill turning out that they both survive and now they're conspiring against Sydney to take her out once and for all That's just my mind going into places that I would that I think I would like to see if it's done Effectively and written properly, and I think Kevin Williamson can make some sense out of it Let me know what you guys think about that down in the comment section below if you haven't already make sure you subscribe It's on a post notification. So you never miss a video In the description, I'll have links on my social media accounts on my Facebook Twitter and Instagram You can message me there to let me know if there's any movies news or reviews You like gonna cover in the future down in the description or down in the comment section rather I'm gonna have a link to the Facebook group join that Facebook group and stay up to date on the channel Get some Jeepers creepers for updates and anything regarding of the Jeepers creepers franchise without any mind guys I will see you in the next video


Hey, welcome folks. My name is Bart. I'll be talking about the legacy or AES-400. IBM ISystem, whatever you call it, the guys at IBM get I think pretty nice bonuses for changing the names every few years. I'll call it AES-400 for now on. Short introduction. I'm Google so you can check my LinkedIn profile, you can check my Twitter. I'm Polish national living in the Netherlands and whatever I present here is my personal views and not always or not necessarily those of my employee. So why should we care about legacy or AES-400? It's legacy, but it's hard to get rid of. Usually if you're working in a finance institution you'll see you have a lot of data, a lot of customer data, a lot of old programs and it's very difficult with all that history. For example if you have insurance policies or bank accounts it's very difficult to migrate it to new environments. So what you see very often is that you have new shiny front ends and at the very back end you have still mainframe systems running because they are just good for what they do. So many times we do care about the front ends, we don't care about the back ends and that leads to the situation that the back ends are somewhat less secure than the front ends. So to my surprise a lot of AES-400 systems are accessible even via internet, SMTP servers for example, or sometimes if you go to retailer you can see a 50 to 50 screen somewhere. You can really find them everywhere I mean all banks, insurance institutions, if you just Google that you'll find a lot of AES-400 systems. And there was a great talk at Black Hat back in 2006 by Shalom Carmel talking about security of AES-400 systems and to be honest with you not much change from IBM perspective. I haven't seen too much changes in new measures or new implementations. There are still like this 1990s mentality, we have a green screen and it's secure enough. There is not too much new developments from IBM itself. There is some patching but I would say not too much from my perspective. So if you want to start your, well, some joy with AES-400, you can either buy one. I recently bought one on eBay for just 60 bucks. I couldn't find that cheap one now but every now and then you can find a cheap AES-400 system just to start. Or you can just hack one. If you go to Shod and IO you'll find a lot of AES-400 systems open. It's just an example from last week. I was able to get access to an Italian coffee maker AES-400 which was just fully exposed to the internet with default password for one of the system profiles. You could just log in and enjoy the system. And funny enough, most of the systems exposed to the web are like version 5 released which is outdated for years. But then somehow they keep it. They just put it on the web and forget it. All right. So again, going to the security of the AES-400 systems, there was a talk from Shalom about the 523 security. I want to talk about something else. I want to focus on Java. Why? Because it comes together with the AES-400 client access. And it gives you pretty much a lot of access to the system. If you look at the IBM toolbox for Java, it allows for remote system API calls or usage of comments. So you can basically compile your programs in Java externally. You don't have to write your programs in CL or RPG on a system. So you can basically, yeah, try whatever you wish, run it via Java, use the toolbox for Java, connect and make use of the system remotely. It bypasses some of the 50 to 50 limitations like the limited capability. So you basically get access to the command line or to the CL commands. It also bypasses the I-Series navigator restrictions. For example, if you have set up an I-Series navigator that the users cannot log in via 50 to 50 or they cannot download files or they cannot access LDBC, yeah, you can bypass that with Java, with your own Java functions. Again, it gives you the flexibility of working with AES-400 outside the system. So no need to access any development tools on the box itself. If you decompile the JT-400 given by IBM, it's generally poorly written. It's quite inconsistent. So sometimes they use API calls, sometimes they just use silly CL commands in the background. So I found some bugs in that. So basically I had to circumvent it by writing my own functions. So really, I encourage you to decompile and check. And what's most important, somehow Java handles the authorization on the server side differently than you would expect from a usual program. I will give you a short demo about the visibility. So first we're going to connect to the system. Okay, so that user does not have access to the commands. I have four profiles, four hot chicks. And then on the system, okay, that one has sign off. So you cannot even log in. And many admins I talk to, they say, hey, if you have sign off, you cannot connect interactivity to the system.  Okay, so this one gives you already some more rights. We have access to the command line. So you can see basically that's all the profiles I can see with that system, with that user profile. I'll also go to, okay, so these are the libraries. We can see it's mostly the system libraries. Okay, so now let's switch to Java tool. So I'll connect with, it takes a while. All right, connect it. So I'm going to connect the system. When we go now to work with objects, and we say we want to see all objects from Q-SYS. And they are user profiles. You can see already more profiles than via 50 to 50. So basically the Java handles the authorizations in a different way. And although you're not directly authorized to some object, you can still enumerate them for further use. Also, if you try to enumerate libraries, you will also see that there are some additional libraries which were not visible via 50 to 50. So as you already can see, there is a difference in authorization handling between Java and 50 to 50. Okay, if I connect with the sign of profile, I can also get access to the system, even though it's sign of. So don't believe your admins if they say sign of means you cannot use the profile to access the system. All right, but that's only visibility. But we want to do something more. Namely, we want to escalate the privileges. And say, in the old times, you had to have a prof, you had to have a program that was compiled with adopted authority, or you had to use the APIs and still compile on the system to be able to escalate privileges. Now we can use Java. The thing is that if you use group profiles, which is typical for every larger application, you usually have like one common profile, which is just for all the business accounts, so to say. And many times you add privileges by just having supplemental group profiles. That's the setup I've seen in most business applications, both banking and insurance applications. Not sure about wholesale retail applications, but probably it will be the same. Many times what you see is that the ownership for the user is set to group profile. For one simple reason, you don't want to have the situation that if one user leaves and their account is deleted, all the objects will belong to that user, because that will mean a lot of problems. So many times you see a default setup that the ownership is within the group profile and the scripts from business applications, they also create profiles with the ownership of the group profile. So if you use that setup and you have a lot of users, it's likely that you will also have some admin users. It's also likely that you will have some users that switch between departments and they might have some extra rights you would not expect. And it's also likely that you not closely monitor the profile handle of swapping, why it's quite challenging to monitor. So again, using Java, there is no need to create and compile a program on age 400, so you can just jump remotely, you can just use the profile handle, API's, grab the profile handle, switch to the profile and then repeat until you're happy with your access level. The setup of this system for the presentation is as follows, we have one common group which is DEF CON 23. We have one group for hot chicks and one group for fat boys. We have a couple of hot chicks and we have a couple of fat boys which are the admins on the system. So what we're going to do, sorry, we also have hot chicks 69, which is an old admin, so migrated from the fat boys group. So let's try to escalate the privileges and since I like one-click solutions, I made some extra implementation. So let me log in with, say, hot chick 01, perhaps just to show you that there is no fake hot chicks here. That's a hot chick 01, so it has only the group profile DEF CON 23 and supplemental group hot chicks, no special authorities and hot chick user profiles cannot create any other profiles. So if I just log in with any of the hot chicks like hot chick 03, if I do create user profile, I'll get your message on. So let's log in with perhaps the same hot chick 03. Sorry, we already connected. All right, connected. So let's generate the user lists we can see and that's the list of users we can actually jump to. Not really to this queue profiles. That's locked by the system but we can switch to some of the other profiles. Let me switch to the hot chick 69, which is the admin profile that moved to the hot chick group. Okay, so I just click in hot chick 69 and click in escalate privileges and as you can see I actually escalated privileges. So if I go now to the system and I'll search for the job. Let me escalate from hot chick 69 now or since I escalated let me generate the user list once again. So you can already see that I have access to a much longer list of users and as you could expect, we love this one. So let's just click once again and as you can see we escalated now to Qsik offer. Okay, that's not handy. Can you see the whole screen now or no? I'll just reach. So I just run a comment and now using the Qsik offer I created the user profile. You cannot just see the, there is one button run. So it's on the right side. So if I go now back to the system, you can see the newly created user profile. So that's something you can do with Java. You don't need to have any extra program. All right. Okay, what's also interesting, I don't have a demo for that, but surely you can try on your systems. By the way, this tool link is already available online at the end of the presentation. There will be a link. Basically hack the legacy.org and there you can find a link to GitHub where the tooling is uploaded. I'll make some updates in the coming weeks, but you can always contact me if you have any questions. For part two, the nested comment use, again, using Java gives you a lot of, you know, a lot of possible options. You can run CO comments. You can run JDBC queries. You can also use the system APIs. And what's most fun is you can combine all of those. So many times what you see is you use commercial programs to like block access to all the BC via using exit points. Or you use your own exit points to limit accessibility to some system functions. Usually there is a lot of focus for external connections. But if you connect via Java and if you try, say, run a query from the system, it will not detect that there is any outgoing traffic outside the system because it will be basically rerouted internally from the system to the GVM and then outside. So in that way you can circumvent, for example, your ODBC limitation on connections. I put here a small example of what you do.  In that you go to Q shell. So you insert Q shell comment. And then inside that you do DB2 and then select. And then you put our file just to get some output on your printer device. And in that way basically the DB2 will connect to local host. Meaning the exit point that will be triggered will check, okay, is there any external connection from a host to DB2? No, there isn't. There is only one on local host. So okay. Go. So in that way you can nest the comments. And again you can circumvent some of the exit points if they are poorly written. And to be honest I checked a number of exit points, sorry, exit program software. And like Rosalie, for example, if that's, if it's known for you. And this program many times have some unknown vulnerabilities like their case sensitive, for example, for JDBC. So I would say use the tools to try the nested comments use and then depending on what protection use for exit points you might be able to circumvent or test whether you can circumvent the exit points. Okay. The next, and I think the perhaps most interesting part is the password security and hash grabbing. That's something which I was not known before. There was one API offered by IBM called QSirip Pwadi to grab the hashes. It's used for synchronizing hashes between or passwords between the systems. Basically using that API but also using from version six the comment to dump user profile. You can get hashes from a particular user. Well, the output format was proprietary and it was never published. I contacted IBM and what they said IBM was the best and IBM does not document the format of QSirip Pwadi nor do we plan to document the output format, obviously. So after a long exchange of emails with Rochester, well, there was no deny from their site to publish it. But so no, no word on whether they will fix it or they will change anything. If you go to the API, depending on your QS password level system value, you may be able to retrieve different hashes from the system. If you look at the security guide from IBM, somehow they still don't enforce the usage of QS password level three. So if you use QS password level zero, one or two, you'll still be able to get the dash hashes or the LIM hashes. You have to be second and all object though. So yeah, take the lesson and escalate the privileges first. But then afterwards you can grab the hashes using the QSirip Pwadi. Basically, if you look at the IBM documentation, the only state, what you get as output is the encrypted user password data. That's it. I looked closer into that format. And actually what you can see is the first eight bytes is the desk, 56 bits password substitute. So you can look at RFC 2877 to see how it's actually created. Then the third position is LIM hash, which is quite a bit of a problem, but interesting for us.  So based on that format, what you can do, again, use Java, use the API and grab some hashes and we'll try to do it now. Let me just, for the sake of time saving, I'll just use the FAT Boy O3 or O2. It makes no difference. Normally we could just escalate the privileges to FAT Boy or to use a cover. Okay, so let's generate the user list. And let's say, let's pick one profile. For example, Nioh's profile. And let's say, let's say, let's say, let's see. Since that guy is sitting here in the audience, he will know whether he has to change the password afterward. And, again, one click solution, grab the hash. So here you can see all of the hashes I was talking about. And, unfortunately, I cannot move the screen, move the screen. So what I can do is just with that LM hash, I just save it. And I run my favorite John 400. So the password is Paris 2015. Just to make the proof. Paris 2015. And locked. I just finished the demo. All right. So again, we talked to IBM on that and IBM was reactive. So I hope if there is any IBM representatives here, perhaps you want to talk after the talk. Okay. So I also have some other research based, well, focusing on the Java isolation. There was some change. Okay. Now stop talking. Okay. No, I'm kidding. Go back. All right. You guys know the drill. What are we going to do? Shot. This is called shot the noob. He's a noob. It's tough to be a speaker at Defcon. Was it tough? Oh, no.  Beginners luck. All right. Well, listen, anyway, we want to thank you for making it as a speaker. And we have our little tradition. So to Defcon. Now let's see you talk. Yeah. Thanks. I was already getting thirsty. When I came in here, he did not have an accent. My accent is getting better with every shot. So, right. So I still have some research going on. Looking at Java isolation. There is some changes in version seven. Basically, IBM decided to put the GVM elsewhere. So I run some tests with the same tooling on version seven release and I could see the same box. So there is not too much lessons learned on the Java isolation. So I still want to look inside and at the moment I'm also analyzing the server side of the GVM to look whether there is still possibility for getting more access to the system. What I also created is a common shell for Ace 400 via WebSphere. So if you happen to have unsecured IBM WebSphere admin console, you can upload that war file and you will get a common line allowing you for again running some comments on Ace 400 and for example creating an account or escalating the privileges. I'm also doing some work on MI security. So the assembler level and the isolation between the more virtual part of the system and the hardware layer, so to say. The last research is 50 to 50 via FTP where they found sometimes I'm pentesting environments that are behind the firewall. And so you only get access via FTP. Still, FTP does allow you for running CO comments and for some other fancy stuff. So what I was thinking would be handy to make a kind of 50 to 50 proxy or Java proxy via FTP so that you can also access firewall environments via the open FTP hall. So that's something I'm working on and probably in few months you'll see some tooling on the website. All right, just a short summary. Don't trust the 50 to 50 security measures only. So there is a lot of information on the hardening of, say, green screen. You can also look at the book of Shalom Carmel. But don't trust this measures only. Look also on Java and be skeptical of IBM red books. Many times what you see is like, yeah, they promote QPAS for the level of zero one and two. So take it with common sense and say after this presentation, look on whether you need to improve your security measures. And visit hackthelegacy.org. Yesterday I uploaded the latest version of the tool. It's GPO version three license. You're free to change it. The whole Java project, NetBeans project is included there so you can freely use it. I also included already compiled jar so you can just click and open and enjoy. All right, you can find me on Twitter and you can also approach me via the hackthelegacy.org website. And now it's time for questions. Can you repeat the question? The public authority is excluded. The only thing is that the group profile, if you use the ownership, if you use one common profile and if you use, I'll just show you. The question is what's the object authority of the profile I was swapping to? So the problem is if you use the ownership for the profile as a star group profile, it will still have access via the stop group profile. And as long as you don't have access to the profile, you can exclude on the list to the profile object, you're not able to mitigate it. No, it's not an emulator, it's port forwarding. The question was whether I'm running an emulator. It's just port forwarding to the Netherlands. Sorry? Okay, the question was whether Java is installed by default? Yes, it is. It's a standard, if you install client access, you get the JT400 jar you can use. And the problem is all the tooling used by IBM, so the whole client access pack, including iSeries navigator, is Java based. So it has to be enabled because otherwise you wouldn't be able to use iSeries navigator. I tried only Java, so. Okay, guys, if there are any other questions, I'm sorry? Okay, the question was what ports is Java using? There is a number of ports. There's like two or three ports used. So please refer to the IBM website. I don't know them by heart. There are like three ports starting with 2000 and then depending on whether you use SSL or not, there are also different ports. The question was where I found any mitigations for that kind of hacks. It's difficult. Either you have to have good object security with a lot of excludes. To be honest, if you have a legacy environment with this group profiles, usually you should just limit access to the Java ports. Because most of the times the regular users don't need to have access to iSeries navigator. So you can pretty much limit the access to 50 to 50. And then depending on whether you use the IBM tooling, which is like extra ports for this initial, for the signed on server, or you use external tooling, like just simple telnet 50 to 50, you could pretty much limit the ports to 992 for secure connection. Okay. I'm available at the whole conference. So if you have any questions, feel free to approach me. I'll be somewhere around here. And anyway, you can just send me an e-mail or Twitter or just look on the website. All right. Thanks a lot.