So, for the benefit of the audience, whoever may someday watch this video, we're here primarily to explore the circumstances surrounding Operation Spanner and your involvement within that. So, before we get into any of the specifics around that, would you give us a general idea about Operation Spanner? Well, it was a few days after the big British storm, where famously the weatherman said, I can assure Mrs So-and-so that it's not going to be any storm tonight. And then it was a huge storm. That was in, like, November 77. Then about a week or so after that, there was a, you wouldn't call it a knock, more like a battering at the door at around 7 o'clock in the morning. We were both still in bed, went down to see what it was. It was policemen, seven or eight of them. The first thing I knew about it was this strange bloody policeman turned up in my bedroom telling me to get out of bed and so on.  You just thought, my God, there's someone in the house. Well, it was made fairly clear they were police. And I had to come down immediately and talk to them. And I remember one phrase that was something like, right, do you want to get dressed? I said, no, I didn't invite you in here. I'll get dressed when I want to. And so I didn't, I stayed in my dressing-gill. I didn't know what they were going to do. I mean, almost straight away, they said, oh, I expect you know what we're here for. And I said I didn't because in detail, I didn't really know. I knew there'd been some raids going on. I thought they were vaguely SME. But still, I had no real idea that anything I'd been doing would be of interest to the police. So we got down here and they started, it was a sort of interview. It wasn't under caution, it wasn't cautioned or anything. There were, as I say, seven of them. Three of them were in charge, pretty much. Inspector Baker was the sort of main man that came. And then we had, I can't remember what the actual police titles were at the time, but Inspector, did a set of inspectors or detective constables. Robert Langley, I think, and something, Yeo.  So anyway, Baker started explaining what they were here for. We're here in connection with obscene material and assaults on people and all this sort of... And even then it didn't click. It took a bit of time to click what they were talking about.  So that was definitely a bit of a shock. They were here for over two hours. They said effectively that, you know, if I wasn't going to answer their questions, they'd just take me down the police station and question me there. The three main ones were to do really with the questioning side of life. And the other four were going on a search of the house because they had their search warrant looking for obscene materials, this, that, and the other. So they were rummaging through all the drawers and wardrobes and anything else, and I had a look in the loft or attic, would you prefer, or garrick? And out in the garage and the workshop and the summer house, anywhere they thought I might have had a dungeon or whatever, and which I didn't too much effort, honest. And so while they were rummaging around, the three main ones were asking me all sorts of questions. And when I'm under pressure, my mind goes a complete fog. That sort of pressure. I mean, this is authority figures, you realise, I turned up into my life of which I've always had a sort of certain dread. Not basically only real event, to be honest, because I never had been in trouble with the police before, but just the thought of authority, like, you know, the religious figures and the police, of course, always sort of terrified me. And so he started on at me, they started going through, they wanted to know where the tapes were and whom the contacts were. They looked at the tape, at dress books and the stolen that they found out there. They rummaged through the doors and took all the household financial and other documents the way that they could find.  And so they took all the financial stuff away. The only thing is, plugged being plugged, they took all the financial stuff away, and none of mine, so they couldn't even get that right, you know. And then at one point they found some children's games in one of the drawers, which was like Snakes and Ladders and Ludo and these sort of draft sets and things. And one of them said, and maybe they say these things to offend and see how you react. I don't know.  You know, and that sort of really got to me. I said, no, I don't.  So they sort of dropped that bit of it. And then I, at one stage I told them, I said, oh, I was, what did you do? They wanted a brief history. They said, we don't want your life story. Anyway, it's like in a brief history. And then they talked about work and where it previously worked. And then they said, oh, I see you had a connection here with the Boys Brigade. They're putting two and two together already making five like they tend to. And I said, I've never been involved in anything untoward whatsoever within the Boys Brigade. I said, not only that, I didn't volunteer to join. Someone at work said, if you've got nothing to do this summer, would you like to come and help out with a camp? Well, as I said previously, I was relatively lonely. This was before I met gay people. So I hadn't got anything. So I went out and stayed with them for a few years. That gave up for two reasons. One is I met my partner and then I hadn't got any time for the Boys Brigade because I was too busy. And the other thing was, which we got around, they said, oh, well, would you like to join the staff if you like? I said, what does that involve? Well, you have to do this, swear allegiance to God and so on. I said, no, I can't do that. I said, I'm sorry. They said, oh, it doesn't matter. Just say it. It matters to me. I said, if I say it, I have to mean it. I said, and I don't mean it. So I can't say it. So I didn't do it. So I left. Anyway, that was that. And then they done the financial stuff. They wanted to know where the tapes were. And at that time, the tapes were all in the front of the room in drawers that I'd made up. I had about 15, 16 tapes per drawer because I had over 300 of tapes. And then they started asking about names and addresses of people. And I couldn't remember virtually anybody's name at that moment. But they eventually sort of weadled out of me the names that they obviously had in advance and wished to know a bit about. So that was it. And, oh, and they came from upstairs with stuff. And one of the things they came from upstairs was a toy billiard cue that I'd had since I was about 11 or 12. Oh, my God. What do you use this for? Beating people. I said, no, I use it as a remote control for the telly in the bedroom because it had a little, I put a little sort of cup on the end and you could work with little knobs on the telly with it without getting out of bed. So I said, that's what that for. And then my mate said, we told you that as well already. He told him that already. So reluctantly this baker ships away and then give it back to him. You know, because they were looking for anything that they considered like fetish wear because they took fetish wear off lots of other people. They call it fetish wear. We call it leather gear.  And then after two and a half, two and a half hours or so, they left. Oh, one of them said, do you mind? Oh, baker, I think. Do you mind if I make a phone call? Do you mind if I make a phone call? I said, only if you give us the money for it. I said, I'm not going to pay for your phone calls. You come here uninvited. So reluctantly hand over 20 people. I didn't see that annoyed him. And then we were in a state of shell shock, really, because it just wasn't being expected. This was a Monday morning. Fortuitously, I'd actually got the day off work because I'd already booked it as a days holiday. And that was because I'd been off down the West Country for a weekend SM session with a couple of the other defendants it turned out. And that's the fortunate bit, so I didn't have to go to work that day. And then the unfortunate bit was the video equipment and everything was all sitting out in the hall, all the way. So they took that all the way. They took all the video equipment and stuff, which I'd brought originally to film with my parents who were aging, and their holidays and things like this, you know. So that was the day of the raid. It's hard, because although we'd been warned that loads were going on, it didn't actually occur to me that they'd come here. That's naivety, I think. It's not going to happen to me syndrome. A lot of people have. And as I said, we left shell shocked and we didn't know quite what to do then. We drove down to the countryside somewhere and we just sat in the car in the countryside talking. Of all the people that must have been on these tapes that they found, how were you identified? Well, first of course they were able to question everybody. I mean, we're not talking about, it's not like the telly where you have a ten minute question session and everybody fesses up in a few minutes. There's the interrogations of over 300 people questioned about Spanner. Wow. And those investigations and question sessions with the police, they obviously joined up lots of dots and so on. So I think they'd worked out pretty much from people's statements and so on, who it was, was where, at what time. So that wasn't too difficult. But when it actually got to court, the first court, this is just a brief one, it's only a magistrate court, the magistrate said, how did you know it was Jagad doing the filming? And I think it was Langley said, I recognised his voice on the tape. And I thought, yeah, of course you did. Because I didn't think it was that. It wasn't any different really to anybody else's. So that's more or less how that happened. So that's how I got identified. I hadn't told him anything. I had said no comment throughout because I knew that I didn't have to say a thing. And I wasn't going to. I mean, I was a bit silly a couple of occasions. I could have said something that would have been to my advantage, but I thought, well, start on the answering one question and we end up answering loads. So I didn't say anything. I mean solicitor advice, say nothing, so that's what I said. What do you know about the other people who were raided, anything at all? Well, at the time of the raid, I didn't know who had been raided, obviously. Because they don't tell you who else they've raided. You only find that out in retrospect once you get your chargeshoots and so on board. The people that I knew were a friend of a friend sort of thing. That sort of string of people that somehow I described earlier for how you make people originally in clubs and pubs and things. Sure. It's just people you get to know. So I got to know quite a few people. And some of them, it turned out, were involved. Some of them, I mean, when we've actually got to the court, the main court, the Central Criminal Justice Court, which are probably named and known colloquially as the Old Bailey. Okay. I have to say I've never seen half the people there before. So they made a lot of the connections between us all whereas actually they're pretty tenuous, a lot of them. So in terms of no, I wouldn't say any of them were really what you'd call close friends at all. They were all acquaintances.  Sure.  So very naughty because again, as I mentioned previously, heterosexuals just don't do it like that. You know, they're the wine and dynam.  Yeah. Yeah. And so I didn't really know anybody. Someone were acquaintances. I actually got to know a lot of them a lot better during and after the case because that's when we spent more time together obviously.  The police took, I think you said, your video camera, personal photos, mementos, videotapes, they were all confiscated and you had to go to court to recover your things. Well, even now I never got them all back. But some of the tapes they took, they took all the tapes and as I said before, the vast majority were nothing to do with or could be to do with the case. A lot of them were stuffed, filmed off television programmes, home movies on holidays and things, day trips out. There was, I treated to a special, a wayday steam day on one of his favourite locos. They took that one as well. That's one of the ones I applied to have back. And the reason for that was my camera at the time, which was an Olympus one of the early, full-sized VHS. It was a twin-pack thing where you had the power pack down at your side and the camera up here. And that was a jolly good system for this day. They took that, that's been filmed on that. And that allowed you to put text into the picture. Oh, God. A little menu. So I put some text in on the railway trip. But similarly, another tape they found, it said, naked youths in the same text. And that was me doing compilations of, I suppose you call them naked youths really, from various videos that I'd got and shops in books and things. Just sort of soft-porn, pin-up type stuff. You know, and that just signaled you to youths. So that was that. That did cause an embarrassing story, but I won't bother you with that at the moment. Suffice it to say. It wasn't pleased. Anyway, they took all those. And the reason we had to get them back, they wouldn't let us have anything directly connected with the prosecution, which as I said was very little, because it's evidence that could be used in court against you. But they still were terribly reluctant to give the rest back. They were all swage of stuff, back all the home general of the telly and stuff. But they didn't give, for instance, this home movie of the railway trip, and one or two similar ones. They wouldn't give them back. And so I applied to the court. As did Colin. I must bring in Colin Lasky and Tony Brown here as well. Colin Lasky also had his video cameras confiscated. He had two video cameras. So he got them both back, because they didn't know which one was doing the filming, so they couldn't confiscate either. As poor old Muggins here only had one, so they knew that must have been the one, so they kept that, which pissed me off a bit. But in that, even though the court had said they should be returned, they weren't. Things returned. So we applied through a magistrates' court to get them returned on the basis that the police are not above the law, and if the courts say return property, that's what they should do. And it's a fairly well-known tactic by all accounts. They assume that people that have been sort of raided and similar things aren't going to have the naus to do what they would just roll over and accept whatever the police say and do to them almost. And even in that early stage, I thought, no, sort this. This was one of our favourite days out.  I'm not going to let them keep that. Obviously, at those times, it was the only copy we had. And even I had some stuff with my parents, and that was part of the same thing. We also had a couple of personal photograph albums that we'd done. This was the day when Polaroids had just started life. What a release that was. Yeah. And so we had a little album of Polaroids that we'd done over the years, and I had to get them back through the court as well. The only other thing I didn't... The thing I never got back was I had a friend of mine. I mentioned CHE at the beginning, for a group there. The guy in charge of that where I stayed for two nights, he took some pictures of me when I was, well, almost the first week I'd met. And I didn't get them back, which was a shame, because I had them taken with the view that went on the age I am now. I'd barely looked back on a young me and think, oh, look at that long head, because it used to be down here and hippie style, shoulder length, only youth sort of thing. But anyway, there you go. What possible youths did they have from photographs of a day out? They don't have any youths. It's just bloody-mindedness. The whole attitude is bloody-mindedness, sort of, you know, we're in charge of this. We'll say what you can and can't do and so on. That was their attitude more or less throughout in all dealings with them. When we were preparing for this, you told me that the raid upon your home and your person and your things really affected both your physical and your psychological health, and it also affected your professional work. Tell us about that. Well, on the day of the raid, as I'd said, we'd disappeared off, he'd driven me out to the country, so I would just sit in the car and talk. And initially, understandably so, he was very angry that the raid had happened. He was angry with me for having bought it upon him, and, you know, he knew that this would be somewhat chaotic from here on. And he also knew that mentally he wasn't sure whether I would survive, because I'd never been very strong either physically. I know it belies looks, but either physically or mentally. But he was very angry with me initially, but that very soon wore off, and in a quick time, he was very angry with them, everything around them and the way they were dealing with things. And then I went into work the following day and one of the guys said, you look really ill. I said, I'm not great. I had had merit rises and so on prior to this, and as I said, doing well at work I never got another merit rise. Subsequently, I also got, if you like, shifted sideways. That's always a bad sign in any big organisation. The police never said that they'd visited work, but they must have. I had security clearance and they would have found that out quite quickly, so I don't doubt for a second that they'd been to work through me work stuff, be filing cabinets at my desk and stuff, because I understand from some of the other people in the case that they'd had their workplaces visited. Okay. And one of the peripheral guys, he was a teacher in the nearby private prep school, private in this country, he was public, he was a teacher there.  They took all his leather gear and stuff. Your private life is private, it's nothing really to do with us. So he didn't get sacked, but the police then decided, having heard that he hadn't got sacked, to contact the governors. All about it and they sacked him. So, you know, that's nothing to do with fairness and justice, that's to do with vindictiveness and so on. So this started having a bad effect me work, performance obviously declined. There was no timescale given, you had no idea whether they were going to turn up again the following day, week, month. In the event, it took them the best part two years to summons me for another interview. Oh no, I tell you like, we did have an interview down New Scotland Yard but the first one had to be abandoned because I more or less fell apart in the interview and I can remember one of them saying I don't know how this bloke keeps a job. Well, amazingly enough in my job, you very rarely get interrogated in that style of police use. I mean, there were no there was no violence involved or anything but it was obviously designed to where you're out and where you're down. So, they abandoned the first interview and the second one was done with tape recording available, you know, like the usage tape machines and actually that made me feel happier because I knew that they couldn't then bugger about with what they said they'd said. So, because I didn't trust them quite quickly and even in Solista when we took a a brief fresh air break I noticed he didn't leave his briefcase or anything in the interview or me talking with him and I commented on it and he said, no, I never leave anything or anything like that, I don't know what they're going to do. So, it had a detrimental effect, shall we say work performance went down. I had to keep going because I still had meetings to attend and projects to run and all the rest of it but I did get shuffled sideways I mean it was a bit demeaning, initially I moved from the office I had into a smaller office slightly further away and then another smaller office even further and eventually I was put back in amongst the guys in general, which was a more open plan place. So, that's all pretty horrible, especially when you enjoyed your job and you were good at it. And of course once we got to the being charged well, that's another story bit later on. So, they moved you from a larger office, they basically shuffled you sideways into another office. This obviously affected your work performance. Oh, yes. Well, what was the point of really making a big effort when you knew that it's certainly going to turn out badly? Sadly. And I wouldn't say it was a leaf at the end of ten years, two years when they finally decided to bring charges but you can't work under that sort of mental strain for ages wondering what's happening.  So, we were looking for a spiral staircase and we have reason to believe that people may have been murdered. So, what they were doing, they were fishing. They were putting sort of I don't think what the phrase for it is now. They were trying basically to sort of put in things that were shocking to try and bring out anybody who was a bit peripheral to say yes, we remember this or so and so happened and it turned out one of my videos was done in the place of the spiral staircase which I'm sure was what they were trying to get at they were trying to get some more dirt on anybody that might really vault in that. But nothing really shocking happened at that venue. That was really just some bondages and beatings and things like this. I did crack up under the strain and went down to see a psychiatrist. I went to see a doctor first and he prescribed anti-depressants and so on. And then it I was at a sort of stable level then up until I brought charges. So that sort of covers the two years with everything going pretty badly. There's a great strain on our relationship. He has said he would never have left but it's not going to be nice living with someone and that sort of stress. And also being a psychiatrist is a very private person and just a few things that have been very little written in the press originally because of course they had no names because they don't release names until you're charged. So worse was yet to come so to say.


Natus level 24 showcases another example of basic PHP type juggling, and this is probably the most common one that I've seen practically ever in the capture-to-flag scene. So this is, and again, this function itself is what you're going to see as an immediate telltale as to how you can get around this. So the PHP code that's testing the source code in Natus level 24, there's the same password for mentoring and text input as we've seen in the previous level, and they're testing, okay, again, if you've submitted this form, if the array key exists in the request, what it does is it tests, does the password match something, whatever it may be. And this is going to be whoever knows the flag or the password, and again, in this case, so it's censored because we don't want to know, or the game doesn't want us to know what the password is, but that's our objective to find out. So string compare is an interesting PHP function because it returns a zero if it's an identical string. It returns whether or not they are identical, and the way that it does that is determining whether or not there are differences. So returns less than zero if string one is less than string two, greater than string one if it's greater than, and zero if they are equal. So the way that some people test, okay, these things are identical is by nodding, or using the exclamation point here to say if these things not return zero as in this condition evaluates to true, then these passwords are the same. This input is the same as maybe the flag or whatever you're trying to get out here. So this is an interesting example of the password type juggling though, or the PHP type juggling, because we have control over this as a request variable, that we pass through HTTP, what's to say we don't make this a string anymore? What's to say we make that an array? So let's go over to the code and I'll show you how this is done. If I go ahead and request this page simply with the get request, we have, okay, there's the view source. Let's go ahead and make a post request. Let's just post this data can be the password, and we'll set it to anything here because we don't know what it's supposed to be. We'll call it like please sub. And that will return wrong in this case. I forgot the comma. Okay, I do this way too often. Sorry, guys. We will know, okay, that's going to be interpreted as a string. We don't know what it is. We actually need it to equal, so it's going to return wrong. But because we're passing this in as an HTTP post variable and we're passing it in raw, we're able to modify it. And let's say the password variable is no longer a string. We can denote it to be an array by adding these square braces kind of at the very end of the variable name. Now, if I run this, the response that we'll get back is a PHP warning. It'll spit up on us. It'll say, hey, string compare expect parameter one to be a string, but we gave it an array. And this will fall out. All of a sudden the string compare will return zero because I guess that's just what it knows to do on that point. You can see that in the documentation. And it says the credentials for the next level are natus 25 and we've got the password. So just like that, interesting gimmick in PHP type juggling that SCR CMP the string compare function is notorious for having that. And you'll see it time and time again in some kind of low level, you know, capture the flag web exploit stuff. So let's save this as natus 25 and let's keep moving. So thank you guys for watching. I hope you are enjoying these videos. If you are, please do leave a like, maybe comment. Let me know what you think what you'd like to see what I suck at what how you're solving the stuff, etc, etc. If you're willing to subscribe. And if you really want to help me out, please support me on Patreon. I want to showcase some of the supports I have currently. So shout out to Spencer Clark and gal Horowitz. Please forgive me if I butcher your name $1 or more and I can give you a shout out in the video and $5 or more. And I'll give you early access to as much as I can whenever I upload things to YouTube. I normally do them in advance. I'll schedule them for a gradual release schedule. But if you don't want to wait, I can get you them as soon as I'm done recording and as soon as the content's ready. So thank you guys. Again, I'll see you in a later video.


Hi friends, I am Dr. Kunal Das. I am consultant and head of the department, department of Gastroenterology and Hepatology at Manipal Hospitals, Dwarka, Delhi. As you know that July 28th is celebrated as the World Hepatitis Day. So, I will talk to today's talk is about Hepatitis. So, what is Hepatitis? Hepatitis consists of two words, Hepa and Hepitis. Hepa means liver,itis means inflammation. So, Hepatitis means inflammation of the liver. What are the causes of various causes of Hepatitis? The various causes of Hepatitis can be due to viruses. These viruses are named as Hepatitis alphabetically. Hepatitis A, Hepatitis B, Hepatitis C, Hepatitis E are like this. The second cause of Hepatitis, the very common cause and very well known is alcohol. It causes alcoholic Hepatitis. Third cause is some drugs. Drugs like NSA's like aspirin, Desprin can also cause Hepatitis. Sometimes, tuberculosis drugs can also cause Hepatitis. Fourth and very important cause is what is known as fatty liver. Fatty liver disease is due to Hepatitis caused by fat in the liver. It can be due to alcohol or there are some causes known as non-alcoholic state of Hepatitis. The most common causes are obesity, thyroid and diabetes. Other than this, there are many smaller causes of Hepatitis like metabolic causes, autoimmune causes, etc. Now, let's come to what are the symptoms of Hepatitis? The symptoms of Hepatitis are usually jaundice. They may be nausea, vomiting, loss of appetite, ice may become yellow, urine may become yellow. They may be general malaise of the body. Sometimes, in some cases, there may be some water in the belly also as Hepatitis. Now, coming to what is the, how do we diagnose that patient has Hepatitis? The simplest way to diagnose Hepatitis is to do a blood test. The blood test concerned is known as Lever Function Test or LFT. As the word means Lever Function Test. By doing the Lever Function Test, we get to know about Hepatitis. In the Lever Function Test, there are some enzymes like HGOT or SGPT. Normally, this HGOT or SGPT is less than 40. If it is more than 40, then it is known as Hepatitis. There is inflammation in the liver. And we should go to the doctor to find the cause of it. I have just told you that there are many causes of Hepatitis. Second very important to diagnose liver disease is ultrasound. Very simple. People get a lot of liver inflammation. Lever is big, small, Lever's Ecosynicity is more or less. We can get an idea from that. By doing both the tests, we get to know about Hepatitis as a screening. Now, we come to what are the complications of Hepatitis? Why is it important to know about Hepatitis? There are many complications of Hepatitis. Two major are Acute Hepatitis and Chronic Hepatitis. Acute Hepatitis is caused by A, E, alcohol or drugs. Chronic Hepatitis is caused by Chronic Hepatitis B. There are many complications in it. The complications are in the form of water in the stomach, which we call as a Cytus. Sometimes, liver can go to a coma or a patient. It can go to unconsciousness. Third is Acute Hepatitis, which we call as GI bleeding. It can be an infection in the water of the stomach and the most important is liver cancer. These are the complications of Chronic Hepatitis. Now, what is the treatment of it? The treatment depends on what is your Hepatitis and what is the cause of it. For example, if you have Viral Hepatitis, Hepatitis B and C, they will give you this medicine. If it is caused by Diabetes, then its medicines will work. If water comes in the stomach and they have an ulcer, then its treatment will be through endoscopy. It will be banned in the endoscopy and the bleeding episode will be treated. If water comes in the stomach, it will be an infection. It will give antibiotics. It will remove water from the stomach. It will give medicines on the way of Peshawab, which we call as Diodex. This can be a treatment. Now, the most important thing is what is the diet. Suppose, if someone has Hepatitis, then what is the diet in it? Diet is a very important component. It is so important that in alcoholic Hepatitis, the diet will be cleared only by taking medicines. So, we need a balanced diet in diet. We keep more proteins. Proteins are in Paneer, Soyabean, Eggs or Non-Wish products. The amount of salt is less. The energy is good.  Your balanced diet and the diet of the liver will be good. So, friends, overall, World Hepatitis Day. I want to explain about Hepatitis in this. Hepatitis means liver inflammation. Most common causes of Hepatitis are Viruses, Hepatitis A, B, C, D, E. There are some causes of fatty liver like Diabetes, Obesity, Hyperlipidemia and Thyroid. And we diagnose it with blood test or ultrasound. If we keep the diet healthy, then we will be saved from the complications of Hepatitis. Our life will be better and longer. Healthy liver is healthy life. Thank you.


Save 10% with my code Bobby10 on raw, organic, grass-fed and grass-finished, freeze-dried organ meats from grassland nutrition. Link in the description box. All right guys, welcome back to the channel if you're new. My name is Bobby. Guys, today we're going to learn again about the differences between Sunni and Shia Islam. Today with the video of Sayed Anmar Nashqawani. Guys, I have to say, don't get angry at me. I'm simply reacting to videos that viewers send me. Oftentimes people tell me, man, why do you react to this guy? He's spreading falsehood. Why do you spread this doctrine, this ideology? This is totally false. I have no idea. People simply send me videos and I react to them. Hence the channel's name, Bobby's perspective. I'm simply sharing my perspective on things. I'm not saying that they are for this absolutely correct or absolutely wrong. We're simply watching videos about Islam at the moment. That's pretty much it. So with no further ado, let's have a look. I am Dr. Sayed Anmar Nashqawani and this message is brought to you by the Mohsin Anfawziah Jaafar Foundation. What is the difference between Shia and Sunni? Over the past 20 years, you find the terms Shia and Sunni have always been discussed in the news. When you hear about tensions in Iraq, tensions in Syria, tensions in parts of Afghanistan and Pakistan, whenever we hear the terms related to those tensions, it's always about two groups of Muslims, Sunni and Shia. And even within those two groups, you'll find that there are splinter groups which are also discussed. And so therefore when the non-Muslim looks at the religion of Islam, they ask this question, what is the difference between the Sunni and the Shia? First part of this answer that I'd like to give and make clear is that there are many more similarities than there are differences. Similarities in which sense? Similarities in the sense that Sunni and Shia Muslims believe in the same God. They believe in all the prophets of God, culminating with the final prophet, the prophet Muhammad, peace be upon him and his family. They believe in the Holy Quran as being the word of God. They also believe in the importance of the five prayers and fasting in the holy month of Ramadan and going to visit God's house in Mecca at least once in one's lifetime and being charitable, respecting one's parents, helping the poor and the orphans. I'm ignorant on this subject but I heard that Shias only pray three times per day. Please let me know in the comment section what is right, what is wrong. They believe in all of these concepts and they believe in the importance of purifying one's soul. They believe in the importance of understanding the biography of the prophet Muhammad, peace be upon him and his family and loving him and that he is seen as the greatest creation of God in both schools. So where then is the difference? I believe the difference ties into this last comment that I made and that is the difference between Sunni and Shia comes in which path to choose when you're seeking to understand the original teachings of the prophet Muhammad, peace be upon him and his family. That makes sense. The aim is the same. How do you get close to his teachings in order that you achieve salvation? One school undertakes a particular path that is represented with the notion that the prophet Muhammad, peace be upon his family passed away and he left it for his community to elect a leader and they elected Abu Bakr and he was known as the first caliph and from then on the rest of the companions who became authorities as well as the companions who lived alongside them are the best exemplars for anyone who seeks to find an understanding of the original teachings of the prophet Muhammad, peace be upon him and his family related to this world and the hereafter. Correct this is the Sunni perspective those are the rightly guided caliphs and they come after Muhammad and therefore are the best of generations. So where then is the difference with the Shia? The Shia likewise admire the prophet Muhammad, peace be upon him and his family revere him and want to get close to his teachings but the path that they have undertaken was a belief that the prophet Muhammad, peace be upon his family would no way leave this earth without having made clear who that caliph would be. In contrast to the Sunni opinion of an election taking place or an implicit appointment the Shia believe that on several occasions and notably on an occasion known as the occasion of Ghadir on that particular occasion the prophet Muhammad, peace be upon him and his family announces his son-in-law Ali son of Abu Talib to be the first of the leaders of the Muslims known as the Khalifa. It's actually surprising to me I didn't know that it was the son-in-law I thought that Ali was the cousin. The Imam representing the prophetic message. The prophet Muhammad, peace be upon his family is the final prophet of God and the person who looks after the teachings of the final prophet as can be seen in a famous narration that says I am the city of knowledge and Ali is its gate. Of course when we therefore look at this we see that the ultimate aim of both groups is to try and reach the teachings of the prophet Muhammad, peace be upon his family in turn trying to obey the path and the message of the Lord. But then from there the differences arise. The schools both admire the prophetic households however there is clearly an admiration which can be seen at a greater level in the Shia school than in the Sunni school. Not to say that the Sunni school does not admire the prophetic household but the Shia don't just stop at the grandsons of the prophet Muhammad, peace be upon his family they move on to the great grandsons and the great grandsons and the great great grandsons and see them as authority figures when it comes to the world of gaining knowledge and spirituality. Right this is the way that I understood it that Shias believe that authority is given by bloodline so the great great grand grand grandson of Muhammad would still hold the authority of Muhammad and nobody else could hold that position so to speak. You need to be blood related to the prophet in order to have authority and therefore out of their perspective the Khalif, the companions they couldn't be the followers or the rightful followers of Muhammad. Therefore that becomes the main difference between the two schools. A lifetime of seeking to gain closer to the prophet peace be upon his family do you go through the family and believe that they are chosen by the Lord or do you go through the companions who lived around him. It's sad that sometimes these tensions exist and there is a lot of ignorance around us but we certainly hope for a day where we can sit together on the table of brotherhood and be able to discuss our differences and indeed discuss the different issues that the world faces today. All right and this is it for today's video a very basic summary of Shia and Sunni divide most of the things I already knew please let me know in the comment section what do you guys think who is closer to the teachings of the prophet is it the Shias that believe you have to be related by bloodline or is it the Sunnis that believe that Abu Bakr was the first caliph and the companions preserved the message of Prophet Muhammad and by following the Sunni hadiths you are getting closest to the prophet's message. Please let me know what do you think in the comment section meanwhile I'm going to do my own research as always and keep on reading in both sites try to understand what the truth really is. All right guys but this is it for today's video if you liked it leave it a thumbs up if you haven't subscribed already guys please do so over 70 percent of you guys are not subscribed to the channel that means that most of my views come from unsubscribed viewers so please do me the favor and hit the subscribe button and the notification bell so you stay up to date when I upload a video thank you very much for that as always may god bless you all much love and peace


Attention Washington Park residents, this is a community notification of a new sexually violent predator in your area. Please stay tuned to the following short program for more information. Hi I'm technician Ron Hackett with the Denver Police Department. The sex offender registration and compliance unit at DPD is responsible for the registration monitoring and tracking of all registered sex offenders and sexually violent predators who live in the city and county of Denver. Here's a brief history of sex offender legislation in Colorado. Our state laws trickle down from federal government mandates. In 1994 we had the Jacob Wetterling Act which mandated that states would establish a sex offender list. Magans law of 1996 said that the public would have access to those sex offender registration lists. The Pam Litchner Act of 1996 stated that some offenders might have to have lifetime registrations and the Adam Walsh Act of 2006 unified sex offender laws across the country. In Colorado the legislature has determined that sexually violent predators by definition pose a higher risk to the community at large and therefore mandated that upon their release from the Department of Corrections the community must be notified. Sex offender notification in Colorado happens in two ways. The first is passive and ongoing through the sex offender registration process which is a list maintained by local police departments. The second way is active via community notification for those offenders determined to be sexually violent predators by the courts or by the parole board. Most sex offenders in Colorado are supervised by the criminal justice system in our communities. Most sex offenders engage in crossover behavior which means they may have been arrested for one type of crime but be apt to commit another.  There is no typical sex offender but all tend to be deceptive, manipulative and secretive. 80 to 93 percent of sex offenses are committed by someone known to the victim. Sexual deviancy begins in mid to late adolescence. Sex offenses are not impulsive.  The community has a vested interest in helping offenders to be successfully managed in the community. Sex offenders have the same need for housing and employment as any other citizen.  There are approximately 16,500 registered sex offenders in the state of Colorado. About 65 percent of convicted sex offenders are placed in the community on probation. The remainder are in the Department of Corrections or Community Corrections. Offenders may be caught for one type of offense but be at a high risk to commit another type. Crime of conviction is only one indicator of risk.  The offender's residents must be verified quarterly by the Denver Police Department. The full sex offender registration list is available by calling the Denver Police Department Identification Bureau at<PHONE_NUMBER>. Convicted felons and those with multiple convictions are posted online at DenverGov.org slash police.   Now, here's a look at the newest sexually violent predator living in Denver. Here's an overview of the registered sex offenders currently living in Denver. There are 2,540 total living within city limits. In Denver Police District 3, there are 333. Precinct 312 has 17 registered sex offenders. Of those, 10 have felony convictions and 7 have misdemeanor convictions. Carl Vincent Avery is a sexually violent predator currently living in Denver. He's 57 years old and was born on November 6, 1964.  He's currently living at 136 East Ohio Avenue in the Washington Park neighborhood of Denver. Schools located within one mile of this offender include Denver School of Science and Technology Buyer's Middle School and High School at 150 South Pearl Street, McKinley Thatcher Elementary at 1230 South Grant Street, Lincoln Elementary at 710 South Pennsylvania Street, Steel Elementary at 320 South Marion Parkway, St. John School at 700 South Franklin Street. Parks located within one mile of this offender include Aspirin Park, Aqua Golf at Overland, Overland Pond Park, Vanderbilt Park, Overland Municipal Golf Course, Washington Park, Platte Park, Johnson Habitat Park, Vanderbilt East Park. Recreation centers located within one mile of this offender include Platte Park Rec Center at 1500 South Grant Street, Washington Park Rec Center at 701 South Franklin Street. Bus routes located within one mile of this offender include Route 11 Louisiana Avenue and South Broadway, Route 0 Broadway and South Ohio Street, Route 52 Virginia Avenue and South Bannock Street, Route 3 East Alameda Avenue and Broadway.  He's currently on parole and registered with the Denver Police Department on May 5th, 2022 to 136 East Ohio Avenue in the Washington Park neighborhood of Denver.  Carl Vincent Avery has been determined as sexually violent predator after meeting the following criteria. Criteria one, age 18 or older on the date of the offense or under 18 and tried as an adult. The offender was age 33 at the time of the first offense. Criteria two, the crime must have been committed honor after July 1st, 1997 and convicted honor after July 1st, 1999.   Criteria three, the relationship to the victim was one of the following, victim was a stranger to the offender or the offender established or promoted a relationship with the victim primarily for the purpose of sexual victimization. The victims were all females under the age of 18, the offender was known to the victims. Criteria four, positive results or the passing of a risk assessment instrument administered by probation parole staff and a qualified treatment evaluator. Positive results include an assessment for the presence of a mental abnormality, a level of denial regarding the offense, treatment appropriateness and motivation, presence of sexual deviant interests.


Sailors and Marines assigned to Expeditionary Strike Group 3 and First Marine Expeditionary Brigade. We turned to the core mission this morning by successfully completing an amphibious landing here on the beaches of Camp Pendleton. As our Marines come back from spending really the last 14 years very involved in a land war, it's critical that we take the time to exercise together and ensure that we are as good as we can be at all of those missions that our countrymen expect us to do around the world. The amphibious landing was a premier event of Don Blitz 15. Don Blitz 15 is both synchronizing the blue-green team and exhibiting our readiness as a seago in military with the capability to move from ship to shore. For more information or to follow the exercise, visit the Don Blitz Facebook page.


All right, what's up, coach? Welcome back now in this video. All right, this is something that a lot of coaches talk to me about They'll they'll be like, you know When I tell people about what I want to do or that I'm a trainer. I get weird feedback Or people ask what are you gonna do in the next couple of years like a lot of people on the outside can look at This business as like a hobby or side hustle And the reality is a lot of coaches that I know make more money than lawyers and doctors I talked about this on Instagram the other day. I put a vote I said, do you think coaches can make more money than lawyers and doctors? The vast majority of people said yes people who said no Don't think that because they don't think it's possible But I want to start this video off with you know If you approach someone who's like, yeah, like, you know What are you gonna be doing in the future or are you gonna be doing this for a long period of time? like You don't have to to be negative when someone says that like your response should just be bold and be like Yeah, this is the business that I'm running like and at the end of the day Anyone else's opinion about what you do in your business shouldn't matter unless they are ahead of you in business Right, I would repeat that. No one's Opinion of your business should matter unless they are ahead of you and they're giving you advice They're giving you critical advice and feedback All right, so what a lot of people like to do. All right, my favorite Show that I've ever seen is the last dance and There's a clip in there where where MJ talks about like how you know He made up like he made up a story that this guy said something about him and then like that next game He like destroyed him And he had this imaginary chip on the shoulder now Personally, right And this is one of those things it's You know if you wake up in the morning, you have a chip on your shoulder that that can be good that can be bad I'm not here to say if you should have a chip on your shoulder or not because like Everyone is different Like there are some people who get motivated and it makes them more disciplined it gets them fired up to work harder But the thing is is like if you're doing something for a long period of time like It's gonna be hard to have the same chip on your shoulder for 10 plus years right, so sometimes you might have to Change what that the chip is or not have a chip on your shoulder at all and What I've realized over the past I've realized this more of the past year of my life I used to have different chips on my shoulder like people who doubted me people who like I don't know It was just like this negative thing that I used for motivation. I Don't need that anymore because what I've realized is like That was so long ago That has zero impact on me anymore, so my thing is it's really more of a game It's how can I be better today than I was yesterday? That is the chip that's on my shoulder at this point, right? How can I improve month after month? How can I refine things? How can I make things better? How can I make things more organized? How can I make things more streamlined? so again, you can have a chip on your shoulder, but Like at the end of the day Anyone's opinion like I said at the beginning anyone's opinion about what you do does not matter unless they're ahead of you Right and this goes straight into the second pointer, right? And all three of these relate to each other But at the end of the day like just think about this Do you honestly think that? People wake up in the morning thinking about about your business. No, no one cares about your business Like even if you work with me if you're a part of my program, of course, I care about you succeeding But like I'm not waking up in the morning thinking. Oh, man. I hope this person is Doing what they're supposed to be doing right now.  Because like you're just coaching right now, right? You're just doing lessons, right? Like the average person does not know that this can be a really successful business if someone's doing it for a long period of time And at the end of the day, this is why like the approval rating you should not care What other people think and at the end of the day people don't care about what you do they don't like They really don't the only person that might care about what you do is your wife Or if you're a woman coach listen to this if it's your husband Like outside of that like no one cares No one cares no one's waking up hoping that your business fails, right? And last thing here This is this is something that I've had to learn just with experience is people who don't own a business don't have an opinion on if you should start a business right and Guys I see this every single day Every single day coaches text me. Hey, I'm thinking about doing this but this person said or these people said or My film the blank said like and It's almost like a lot of people need the approval of others before they start something like which is the worst way to think and I'll give you an example of something like four months ago I Had this idea that came in my head and within 30 minutes. I set up that business Didn't talk to anyone about it Didn't get the approval from anyone. I didn't go like I Didn't do anything other than I just started it Right and The thing is is normally when you ask a lot of people who don't have a business when you ask them for advice What they tell you will get in the way of your decision-making? because they will Tell you to not do Things because they have not done it themselves and I have other videos on YouTube where I talk about How people who don't have skin in the game? shouldn't give you advice and This is why you should seek out people that do have a business and only talk to them about business related questions And it sounds so simple, but so many coaches don't do that They Taught to family members. They talked to Billy Bob down the road that has never had a business in his life They they want their friends to know what they're doing and all and all of your friends Are working nine to five and then most of them are gonna be jealous that you're starting a business because they don't have the nuts to do it and When you ask them about it, they're gonna give you bad advice right and This is the thing to I've said this before If I talk to a coach that's you know, they're like, yeah, I really want to start my business. I'll be like great go through My startup program that's gonna show you how to set up your business And coaches who do that typically get their business set up within 48 hours if they just follow the steps and Then oftentimes when I talk to coaches, they're like, yeah, do you think I can succeed in this business and I always tell people I always say, well, I don't know Why are you asking me? Are you asking me that question and this is the thing is Coaches want the approval rating. All right, they want their approval rating to be high and We you know want others to be excited about what we're doing and give us the approval You don't need that to succeed Right don't need that to succeed now. I hope this video helps because like They're I think it's natural at this point to just always think. Oh, well, I hope this person likes me I hope this person Thinks highly of me by the end of the day All right, people are too selfish to care about how your business is going All right. Now if you want to connect with me, there's two ways you can do this Monday through Friday, I put out these stories on Instagram and Literally, I have an iPhone 4 and I take a screenshot at Or take a photo. It's a black photo and I type I type some messages on there that I feel like can be very helpful for you I ask questions. I have a lot of engagement with coaches there You can send me messages On it on Instagram. All right, and that's my handle there to make money Coaching sports on my last video. I gave you the wrong handle. So I apologize about that, but it's too late Or you can text me at 21 0 9 6 0 5 7 1 All right texting is the fastest way Honestly, like I use Instagram for probably 30 minutes a day. I create my Stories I post them there and then I check them. I check to see if there's messages Like I don't post anything else outside of that. I don't follow anybody.  I I don't consume any content on Instagram So that's it for this video you can connect with me here on Instagram if you have that or you can message me here Text me at that number. That's it for today's video. Hope this helps And just remember if you're in this for the long haul don't need to care about what people think about your business You can build a really successful business if you have The right mindset and you learn and you Like go into it knowing that you want to have built a great product and a great service for your clients That's it. See you later


So thank you all for coming. And thanks to Nate, one of our regular members here. He's going to talk to us about container support in Slurm. So over to you, Nate. OK, hopefully that'll be quiet now.  So whenever the neighbor walks it, they just bark the little heads off. Yeah, I think you can go ahead, Nate. Oh, OK. Yeah. I don't know if anybody even knows me, but I'm Nate. I work for Schedemde with the guys behind Slurm. Today I'm going to present to you some container support stuff that we just were adding in the upcoming 2302 release. So that's just in March. Everything here I am presenting actually exists. I'm not just waving my hands. And if I have time, I'll even do a live presentation afterwards. All right, a quick rundown on what I'm going to talk about. Let's get that here. So I think everybody here knows this. Everybody likes Docker. They want to be able to use it. Lots of users really like it. There's lots of problems with Docker, but we're not going to worry about that for this presentation. One of the things that I've been asked for a lot is users just want to be able to use Docker. And so this is the way that our first real good attempt at actually getting Docker to work natively with Slurm. And by extension, Podman and possibly some love for Kubernetes later. First thing was we had to add support for OCI containers. We did that last release. It runs at works, uses all the existing controls. It's not very user-friendly. Never was really intended to be. But the support was required. And now with our upcoming release, we're adding something I like to call a OCI runtime proxy, which I'll explain in a few minutes. But more or less, it allows us to bolt in Slurm into Docker. So this is the container support that we got added. I don't think it's too relevant for this thing. I just have it here for reference. Containers are now first class citizen in Slurm. These examples, just running against some container that you have in tempFS. This is the current way jobs are run in Slurm. User logs in usually via SSH into a login node. And then they call one of the commands to start the jobs. The job runs on a compute node. This is the way it's been for, oh geez, 20 years. And Slurm's model is the continuation of existing models which are all the way from the 40s. Or, sorry, 50s. Try and intrude, works great. New model that we're adding now is, user will log into a login node via SSH or whatever. But instead, they will interact directly with Podman or Docker. Then Podman or Docker will call our new command, which we're ever so hilariously calling SC run. And then SC run will do all the magic that requires to get Slurm to work. And to the user, it'll look like they're just working with Docker directly. But in reality, their job will be running on a compute node and following the previous model for the job itself. And the expectation is there'll be container like an artifact or something like that where they pull their images from and everything they need. And in this case, swapping out Kubernetes there for Docker is definitely a possibility because everything works by standard, which is really nice. Definitely not perfect, which is one of the things. So for instance, we're only giving documentation for Docker and Podman, but since this is the research group, I also, you know, we'll look at Kubernetes. Definitely not something I'm promising anytime soon. At least not for this release. So I'm calling runtime proxy. I assume everybody here is familiar with what an OCI runtime is. In this case, all this functionality exists in Slurm one way or another. It's just not very cleanly set up for containers. So it's the game of a thousand small edits all over the place to get it to work. My entire goal here is to make it completely boring for users. I want the user to be able to call Docker as they would call it on their laptop and have it work as they would expect. And like all things are competing, there's a cost to this, which means the system administrator is gonna have to do a little bit extra work to make sure that the container images can be pushed around and the default config is what they want. So maybe having a specific queue that they send all the jobs to that are containers. In most cases, I assume most containers will be, you know, a single core or something like that, something simple, but it's definitely configurable. And then you continue to use all the existing stuff that Slurm has. One of the big gotchas here is when Docker runs or Podman runs for that matter, it sets up a mount namespace where it mounts everything usually with overlay fast depending on how you configure it. And that mount namespace has to be copied out or somehow exported to the compute node. And it only exists in that specific namespace. So that's why we have something called staging in and out of the image. It's done via script. I will talk about in a minute. The whole idea here is users be able to just use existing HPC resources and Docker now or Podman. Podman tends to be a little bit friendlier on the HPC boxes. So here's the first example. And I will note here that this is only rootless Docker. Rootful Docker is a absolutely unacceptable security risk on almost every HPC system. That's not just like a per user cloud hosted system. So here, the first line is you're exporting the Docker rootless control. Just telling Docker, hey, talk to rootless instead of trying to talk to the system Docker, the Rootful Docker. And then the second part is Docker, unlike Podman requires that you pass security settings directly over the command line. You can't just configure it out, or at least not a way that I've been able to find. And I have been searching the source code for it. In this case, all the security features don't make any sense because you're not actually running the container on the login node. So we just need to turn them all off. So no advanced networking stuff supported yet. So we just turn that off. App armor and SE Linux and the security containment whatever, all that just needs to get disabled because it doesn't even apply cause you're not running on the node you're actually running on. It's all headed by some anyway on the computer nodes. So I just make a quick little export here to make it explicit. And you just turn all of it off. I really wish it was an easier way to do this and I might end up sending some batches in. I don't know. First command is you're just calling Docker run, all the normal things. Hey, I want to run Ubuntu and just verify the release. And the second one is same thing, but with sent us just proof of that it works. You guys feel free to ask questions at any time. I didn't mean this to be too formal. So here's all the processes that will actually end up happening in the run. So the user logs in via SSH, whatever. Routeless kit is running Docker, which is running container D, which is running the shim. And the shim is calling SC run, which is our OCI runtime proxy. And it handles the work of calling out the slurm and initiating the job and all the other things. And then slurm D, which is basically, which is close what slurm mode is basically the cubelet for a slurm is running on the compute node. And then it's actually calling C run or run C, whichever OCI runtime you want. That's definitely configurable. So there's a lot of extra processes involved in this, but to the user, it shouldn't be visible. It should just work as expected. And most of these processes don't actually do much. So it doesn't slow down anything. At the end of the day, the user is actually communicating directly with S run. And container D doesn't actually have to do much. Quick example of the conflict that's required to activate this. I do disable everything that can that I don't want in the conflict that they let you do it. And then even activate no new privileges because why not more of the security the better. And in this case, the most important part is new runtime, just call SC run, which is the new binary provided by slurm, which is the OCI runtime proxy. Same thing for podman, although podman actually has configuration choices that disable all the extra security stuff, which is really nice. So in this case, normal podman command, I want to run Ubuntu, run CentOS, and then just for verification, I'm just having it print the slurm job environment ID so that you know that you're actually running as a job each time you call it. And for people who are unfamiliar with slurm, every time you run a job, it gets a new job ID number. In this case, just verifying that. Podman's a little simpler. It just has podman, which calls codman and codman calls SC run. Not too fundamentally different, little less abstraction. The conflict for podman is simpler than Docker. You can just disable all those extra security things. Say, I just want to run the host for everything because it's not running on the login node. Your job is actually running all the way on a compute node somewhere far away. And just telling it, hey, use SC run. I assume you guys can see in my mouse. Yeah, it looks like you can. Yeah, we can see your mouse just fine. So one of the gotchas is container staging. I mentioned this a little earlier. When SC run starts, it's actually around inside of the user namespace, mount namespace. It's its job to get that image and push it out to the compute node via whatever means is most efficient. Now, since every single HBC system I've ever gotten my hands on or seen is different. File systems are different, storage locations are different. This has to be really customizable. So in Slurm, it's done via a plugin which calls LuaScript so that a sysadmin can do whatever they need. I expect this will actually have different differences between different hardware types on certain clusters, especially for the cloud bursting ones. They'll even need to be some calculations of paying egress and ingress fees. I imagine. So there's just a LuaScript. Lua tends to be super friendly to sysadmins. I mean, if you don't like it, you can just call exec out to whatever script or code you want. It doesn't really matter. Nice thing about Lua is it has built in JSON support so you can edit and look at the images, spec file and all the other fun things and they change it as you please. And then there's callbacks inside of the Lua thing to tell Slurm what you have done. Like, hey, this image was here, but now it's over here on the shared file system or on this S3 bucket, whatever's required. Here's a incredibly simplified example. In this case, I'm just calling rsync and pushing out the image root to a shared file system. And then I'm telling Slurm, hey, the bundle is now here and the new root path is here. And it modifies the config file too. Very simplified. You can look at our documentation later for the full one, but I hope this gets the idea across. And then in the case of my example, when it's done with the job, it just deletes all of it on the root file system. First sites that have lots of rules or stuff like that, reproducibility requirements, they can always just send this stuff off the tape or something like that or just release the S3 buckets directly. Something fun like that. Or on mount, they fuse file systems. There are lots of limitations involved with this and I've been glancing them over. For instance, we don't support any kind of network game spaces, it's only host for now. And most of course, that's what it's probably gonna be forever because already made drivers and other things like that don't play nice with network spaces or C groups. Although there has been some efforts in the infinite band area to make that play nice, but it's not covered for now. Stuff like C groups, ARPOM or SE Linux support on the login host don't actually make any sense because you're not running the job there. So we just disable all that. Finding out where things fail can be difficult. I'm still working on that, but there's lots of places where logs can happen. I mean, every single demon has its own logging and you have to be able to look at all those depending on when things fail. I have found mostly once you get working, it tends to be pretty rock stable or rock hard. Minor details, you gotta make sure you compile things in the right order. Swim has lots of customization for sites. Something called CLF filter in Spank. Plugins that let sys admins insert plugins that modify user requests at certain locations. Really giving admin lots of power and control these things because in a lot of cases, users are not basically power users, but it's definitely configurable and if it's not done anything then user can do as they please. Authentication, we currently only support the Mange off. There's a lots of work done in the background to make sure that the username spaces are translated correctly, which is currently only possible via Mange, but the future release is JSON web tokens and stuff like Oauth can be set up to work. It just hasn't been done. Anybody have a questions? These are just minor technical limitations. I just wanted to list out in case people have questions. I mean, I have a couple of questions, but maybe I don't know how much more you have. It's a bit of a question of understanding if I forgot that right. So, I mean, first of all, I think this is really cool. Oh, I'll wear a question officially. Yeah, sorry. So, the socket, like the Docker socket then some, they are not available on the login nodes, but they are only available on the compute nodes. So the like the stem cluster, is that correct? No, actually Docker runs on the login nodes. Yeah. Let me go find that. But it mounts the socket from the like batch node? No, Docker doesn't have anything to do with it. Because Slurm has the native container support, Slurm talking directly to the OCI runtime. So either C, run, run, C, whatever you want. Where is that little graph I had? Yeah, so Docker will run here. Docker socket will be here. The job won't have that access to that because it's running on some compute node off from the cluster, potentially being burst out in the cloud somewhere. But once the job is over there and running, it can talk to Slurm directly or it can talk to its own container runtime and the container runtime has proper interface with the Slurm because Slurm knows the relatively simple config and state for it. Okay, okay. The principle, yeah, okay. I mean, it doesn't currently have the, like the Kubernetes thing where you can talk to itself and change the job around outside of the existing Slurm stuff. I mean, Slurm has all that functionality, but it's not specific to containers, but anybody can change around their job as they please. Okay, and the main use case would be interactive work with a container. Cause I mean, if you wanted to use container workloads, then you could use the native Slurm container support, right? It's like a lot of jobs and like, if you want to have like massive batch parallel jobs and then- Yes. But this implementation here, the point here is really to enable people to, you know, interactively work with this. Interactively. And then even though my example is really simple, once the image is made, the user can probably have some kind of an option to push it out to his common location and then submit large amounts of batched up to do production batch work. I mean, the whole idea is to let Docker or Podman or whatever you want to generate your containers and have them run or be prepared in the way that users would expect, same way as their laptop or work machine, workstation. And then you can run the jobs as you please. Yeah, nothing, that's great. And maybe one last question. I mean, what are the like system requirements? We're still running quite a lot of, let's say, you know, Red Hat or CentOS 7 systems. Are there any, in particular for, since you have like rootless, I mean, does that require like CentOS 8 or I mean, do you have an idea what's like the minimum requirement for that? So this is the fun part. On the Login node, I would suggest running the latest because rootless Docker has been doing massive amounts of development and improvements. And it just tends to work better on CentOS 9 or whatever it is. But that being said, the compute nodes run C has been rock solid stable for a few years now. So if you're running CentOS 7 and you want to run the job there on the compute nodes, I'll be fine. And doing heterogeneous clusters has been working for years. So you could have the Login node be, you know, current revision of CentOS and then have compute nodes be something old that stable. You do need to have username space support. So Red Hat 6 and CentOS 6 doesn't work. That's just the kernel limitations, there's nothing we can do about that. But besides that, if you have username space support, it should more or less work in your kernel, if it's in your kernel, it should more or less work. Run C is actually really simple. So it works pretty nicely. Okay, yeah, very cool. I mean, maybe I'll stop in case like other people have questions. No, I'm here for a question and answer. I guess this is a better example of the stock. Yeah, I mean, at the end of the day, it's running under C run or run C, whatever runtime you want to use, or even Singularity or Charlie Cloud. Yeah, on that one, I would ask like, what is the life cycle of the container again? So you prepare the container on the Login node, if I understand correctly, like you do a potman pull on the Login node, right? But then the configuration based on what the compute node needs is also done in slurm. And like in potman or Singularity or Saros, they use specific configuration that is done on the compute node, like OCI hoax or plugins in potman to maybe specialize the container and tweak the container to use the right MPI or use the right GPU libraries and so on. Is this that in the Login node? So, something about that is you can actually just activate that stuff. For instance, you could act, well, Saros, Cal C run eventually. The new command, so it's SC run, it has all the same cement as Alec and it has its entire set of environment variables that you can set up the same way. So you can modify the job to be on our nodes, 10 nodes, whatever you want. All that's there. The creation of the container, like the Docker create or Saros, like the life cycle management of the container, is it done on the compute node or on the head node? Because if you configure Saros on a specific compute node then your Saros run will be, the life cycle hooks will be executed on the compute node and it sounds like you are not using Saros on the compute node, you're just using C run on the compute nodes. Yes. So, this adds several steps to it. So yes, all the hooks will be run by Docker. Docker will maintain the image as you please unless you decide to copy it out. And then you can have the hooks that C run calls also. But C run doesn't call any hooks, right? Most of the time. But they actually are there and they do work. For some of them, the Docker thing, you actually have to disable a few of them. All right, it's called. Okay. But yeah, they're actually called on both sides. Okay, interesting. Yeah, interesting to see a live demo that's, I think that's cool. Let me go get it going. See if I can actually share my screen in one second. Hopefully I didn't break this in between yesterday when I prepared it. But, you know, it's the way of live demos. Let me get it shared. Okay, can everybody see this? Yep. All right. Now, naturally, I have conveniently removed any of the errors and other stuff in the presentation. So right here, I just called a pod mad run. And I did break it a little. So, I have all the debug activating here too. So here, I'm just a normal user on the cluster. I'm calling a pod man run Ubuntu. I'm just telling it uptime. These are the authentication work rounds I have active. That's gonna be fixed before March. There's a whole bunch of movement in and out of the namespaces that I have to account for. Slurm was written before all this stuff existed. So it's requiring a good bit of effort to get Slurm to play nice with them. And then there's some more logging. I can explain it later, but the expectation with an OCI runtime is that you have a process that runs that Docker or pod man communicate against. So in this case, we make one week and I just call it anchor. And it gets split off and then it starts doing all the effort. And then eventually at some point, srun is called and it has the container location. It'll know where. So that's the container location. That's where it's been pushed to by the Lewis script and then the container ID, which is handed to us by Docker. And then the job runs just uptime. I mean, if you want to make all different command that's cool too. Then we're just gonna ignore these errors for the terminal stuff for the time being. Definitely some interesting issues with the movement of the terminal permissions, just some minor bugs to fix. And then it does the stage out and which case it's just deleting it. I mean, let's see, OS release, it goes faster. And of course it runs slow for some reason. Probably doing some compiling the background or something. Reference here, whoops.  I'm running it on a CentOS. So this is AlmaLinux 8.6 and I'm calling Ubuntu. Go check, make sure I don't have the cluster full of other jobs, something funny like that. Oh, that's it, okay. It's just being slow for some reason. This is a problem of active development. But I hope it gets the idea across. For the user, they'll just see the normal podband commands or Docker ones. Honestly, I would expect most sites to do podman just because it's a whole lot less of a pain for them than Docker or Ritless Docker. But they both work. My example here only has podmint set up because it was just simpler because this is actually a Docker cluster. So... So this is a Docker-based cluster inside of compose. And it's actually doing that. So there's multiple levels of namespaces used here.  So I'm not exposing that right now. Which I assume you know all about, Christian. Yeah, I can do the work. I have made it, but the podman one tends to be the easiest and I don't know why it's hanging. And all the normal things. So I just take control, see to cancel it out and sends the signals as expected. Let's see if uptime works. Maybe I did something funky there. Yeah, uptime works. So I must have did something odd. Definitely it's not completely ready, but it does work. Might have had the interactive thing. There's some weird issues with TTY controls, but I'm working those out. Most of it involves just having to turn off a whole bunch of the features because we just don't need them or use them. I'm curious about one thing. For running the container with the resources request, and usually I've seen you create some kind of slurm scripts, does this work well with Docker, like with this SC run or? Yeah, if you wanted to, you could do, let me see if I have a queue maybe for this thing. I'd have to add the login node as a partition. I can do it pretty quick. But then once you do that, you could just do as batch. This is only along these lines. So I'll just tell it to run a login node and then I'll be fine like that. You know, that's what you wanted to do. It's not gonna work because I don't have it set up for that right now, but that's definitely something that should work. And then I guess it'd be a little, I guess, I mean, I guess I wonder what the overhead would be for like the containers like requirements for the CPU or memory versus what as batch requires. I don't know if those were quite one-to-one, right? It's gonna be a little extra, but if you're just running on the login node, it's the same price as the user calling it. I mean, there shouldn't be much of anything. I mean, most of it is idle the second. So most of the work done by Docker is done when it's creating the image, mounting it all up, and then staging it out to the login node. And then it's idle until the job's done. It's just moving the IO back and forth. Got it, okay. I'm gonna put it in the log. All right, well, thank you. And then the existing stuff, you know, Podman's log should work. I mean, you're just paying the price for having Podman or Docker do the log movement and then store it somewhere. Slurm does the direct writing of the JSON log files. So hopefully that's not gonna result in too much overhead. I mean, unless the log's a lot, but in which case you can always just tell Slurm to log into a different file and not have it go through Docker. Maybe ask another question.  Podman here is running as a user. It's all specific to the user. And yes, that is a possibility, but that's actually outside of Slurm. I mean, you can configure Docker or Podman as you please. Slurm only becomes involved the second it calls SC run. And then Slurm's gonna push the image back and forth to the compute nodes as needed. And yeah, you can do all the fun Docker caching if you want. You know, I'd expect any large site to have their own internal cache that they control and less certain images and whatnot.  How about you please? That's definitely up to the site to decide. It's nothing that we're gonna apply limitations on. And I mean, so at some point you showed that it's pushing the, like, I guess the extracted image. Like, I mean, you have it here and it's like serve container, spread something. So does this also, like, if you want to submit similar containers, does it then do any deduplications? Or is this like the common shared file system for the unpacked images or? That doesn't exist yet. Right now it's just a simple push of, you know, coin arch sync, deduplication is something I definitely like to look into the future, but it's not something we do right now. There will be as well along the slides so you have the images, you show potman images, right? And to create the image, this is unpacked or it's loop mounted on this particular part. Then you pass to the compute node. But usually what I see is that potman creates images so by everyone on a shared file system and then just loop mounted on the compute node. Because some compute nodes don't have storage, right? So a local storage, so you want to just loop mount those. Yeah, for everybody it's different. That's why I'm giving as much flexibility as possible. I mean, yeah, I'll show you the, I gotta leave the user to modify it. So let's see. Could not be too hard to not copy over the root file system of the compute node, but just loop mount the image on the compute node instead. Yeah, you could do something along those lines. This is the simplest version that I set up with is just calling our sync. But you could definitely do amounts. I'm accounting for all these things because I mean, I have sites that have really fast local file systems, fast Luster file system, GPFS, stuff like that. So I want to be able to make it work for them. And then we have sites with the ultra slow egress and ingress of pushing the images out to the cloud. I mean, and I'm giving as many options here. I mean, future work could definitely go to making that faster and duplication stuff along those lines. Yeah, so the, this slurm stage in allocator would be the magic too, or the place to make magic work in different ways. Yeah, I mean, I'd hope most sites could just use our sync, but definitely configurable. Like this is the actual thing that's being called for when the demo that I'm doing right now, it's extracting out of the environment who's running. I have serve containers as the shared file system that's pushed out to everybody, which is just a really simple volume that I have mounted everywhere for this demo. And like, go on. Again, the life cycle, like maybe mapping in a GPU. Is it also a callback or like a function that you can't compare to make it work for different compute nodes? If you have like two queues, one with GPUs, one without. So if you wanna switch between what you're calling and go back to Fred, my hilarious test user, you just be passing it as the environment to the container. So let's see, I don't remember how to do an apartment in one second. But when Slurma is called, so as you run the environment that exists there at the time of, you can set any environment variable in Slurma, read it and process it just as normal. So if you do along the lines of export, let me just go find the command for you. The docs aren't written yet, but the same, all the same environment variables for as Alec will exist for this too. So you could do something like this inside of the job. I don't remember what Podman does to export the environment. Yeah, we'll have to document this better. So one of the things that we are hitting is that you can't do something as simple as this. This is a limitation of Docker and Podman. So what I really would like to be able to do this, but the actual calling environment doesn't get passed by Docker. It might actually get passed by Podman. But the expectation is we will be getting the environment. So you can export it. That was a nice Alec. I would expect this to be like configured on the host and then you don't need to pass anything. It's just depending on where you are. Oh yeah, yeah. So the thing that I do know that does absolutely work right now is passing it in the Conf file. So give me one second. See container, Conf. So if you pass the environment here, I don't remember. But that's for where it's actually running, right? So that's the global configuration for all your jobs. This is the one for all of them, but you could definitely do it per user one if you feel like it. And if you really want to be able to customize it, that's what the spank and the CLI filter plugins are for, that the user, if the site really wants to do something smart. So I'm working on getting all those to work together. The passing environment is there. It does work. You can do it here, which I don't know the format off. But you just pass. Don't worry. I'll give it a try myself. I think other people have questions as well. So no, no, these are definitely valid concerns. I mean, I'm more than happy to take all these questions because it helps me to make sure I'm not missing something. Yes. The whole goal is that you could pass all the normal serum Conf. You can say number nodes, GPS per node, all that stuff. And even if you want to do multiple nodes and stuff like that, as long as you make sure that the image is pushed out to all those nodes, it'll run. Or with a shared file system, you don't even have to worry about it. Yeah. Maybe just to state my use case, I have to call two queues, one older queue, one newer queue. But I would usually do with Sarah's potman, whatever I would configure the hook on the, the container hook OCI hook on the compute node to pick up the correct MPI libraries to be pushed into the container. Right. So it's a on a compute node configuration. So I, and I would need this compute node hooks to be triggered somehow. So I guess my, this stage in a location thing would need to reach out to the host, stage the container on the compute node instead of the login node so that you books. And then it's independent on configuration of the just reaching out to the compute node, make sure that all the hooks for the compute node are run. And then the container is maybe already present on the compute node. So I would age the container on the compute node is what I'm saying. I guess. Yes. My thought is that the users would run. Docker pod men, but there, but you can definitely run it on the compute node instead by using as batch. That's definitely an option, open option. And your use case here of making sure the MPI hooks are called. I'm going to go and double check, but that's definitely something I want to get working. If it doesn't work already. So yeah, thanks for pointing that one out to me. I got to make sure that works. The fun of development. Any other questions? I'm, I'm very open to. Oh yeah, Docker built does work. Well, in this case, pod men build will work, but. Yeah, there's no reason that won't work. And it'll actually build on the compute node.  I had a question based on your first diagram that you're talking through, similar to what Clemens was asking, I think, just a couple of things when for a basic Docker run, I think I understand your login node and it's effectively then instructing the compute node to do the business. What's the kind of flow if you want to run many jobs? How does that actually work? You just hit it many times. I would expect if you want to run a ton of jobs, you could just pass the environment request that give it an array. So, you know, use this image, but do an array of 10,000 jobs, something like that. So you don't have to pay the cost of the pushing stage in and out each time. But that's definitely a possibility if you want to. The actual layers of the image and so forth that flows through the login mode on your diagram. When stage out runs, or yeah, when stage in runs, sorry, stage out is when it pulls it back. So stage in. So this is just a log for it. When stage in runs, it's running inside of the namespace provided by podman or docker. In this case, I just do a really simple rsync of pushing the final mounts out there. More advanced. Image slicing is definitely something I want to look into. But for now, it's not there. And how does that scale if you are running lots of things in parallel? Is that okay? So it depends on what your file system is. If you have a shared file system, it's one rsync command, push it out to the file system. And then the file system handle the dirty details of that. You got thunder, you heard problems, but that's nothing new. And then in this case of the job, you just tell it, hey, I want X number nodes for this and Slurm will run it just like any other Slurm job. So I want a thousand nodes running this, point it to this one image. I just point it pushed out to the shared file system and it'll run just like any other Slurm job. Right, I see. If the user wants to run a thousand different jobs, you have to pay the price of pushing out to the file system. That's definitely something we got to work on but baby steps. Makes sense. Cool. Okay. Well, that's great. I mean, we've got 10 minutes left. Does anyone got any final questions? Nope. And I'll point out here that when the staging is called, it's inside the namespace. And so I just have it logging right now where the config is. So in this case, it's where podman has the overlay fs and then there's the config file. Anybody who wants to go into advanced case of parsing the config file could go and grab each slice and only push those out as needed. And that's definitely a possibility, but it's not something I'm implementing right now. Sorry, did we get the question in the chat already? Does Docker build work was asked by Timothy? Yeah, it works. Definitely if it doesn't work, it'd be a bug, but it will build on the compute node. That's the important part. So you have to make sure that you understand that, especially if you're calling compile or GCC or something like that, call an M native or something along those lines. Just need to make sure that where you execute the job, it matches to where you can. You have to make sure that it matches where you build it to where you execute it so you don't have incompatibility, which in most cases, I would just set up a queue for it. That would be shared between the two because we're taking over the this DSA runtime. That's where Slurm gets introduced, so Docker build calls that anyway. So it's just getting pushed out to that instead. Great. Okay, well, thanks very much, Nate. Appreciate you taking the time. Really interesting stuff. I realized I skipped over at the beginning. We normally make sure that everyone's put their names in the attendee list and not straight into your presentation. Sorry, wonderful. And if there's any new joiners or new people who haven't been before, just stick your hands up and say hi. I can see a couple of names. Ricardo's here with no microphone. Yeah, we have one more session before KubeCon. So in two weeks time, which will be the 19th of October, which is just before KubeCon. I think Ricardo is saying the gateway API for the next session will confirm that and we'll stick out some notifications on Slack and email. Other than that, we'll also work on putting together a list of gender items following KubeCon. Yeah. I'll be at KubeCon in Detroit. Anybody's welcome to talk to me, especially on Monday in the Batch Day. Yeah, I will be there too. So, meet you a lot. Cool. Is anyone else coming, actually, out of this group? Yeah, I'll be there. This is Kevin. Kevin, cool. And I'm attending. That's my plan. If I can get a hotel in downtown Detroit, this is really hard. Holy cow, it was so hard for me to get a hotel. I had to go there every hour and just check hotels.com until one just popped up because I'm the canceled. Yeah, that's what I'm doing right now. My colleague ended up on an Airbnb in midtown. He's going to get a tram every day. He reckons or something. The thing that sucks is that if you could just go on the other side of the water in Canada, they have so many hotels available. But you have to have a car to pass through customs every day. I was looking at it. Can I pull this off? Our corporate booking system recommends hotels just based on radius. And in some places it's called Windsor. I was like, sure, they're close. And it's only one-third of a mile. So you can totally walk. No, I actually checked that. The Ambassador Bridge, they do not allow you to walk across.  Because I'm like, I can walk this easily every day. Yeah. It was a bit of a foot bump. Just a little bit. Cool. I think that's it then. Thank you everyone for your time. And see you next time. And then see some of you at QCon as well. Feel free to hit me up with questions or whatever. Comments on the Slack channel. I'm definitely open to hearing stuff like Christian Singh with MPI. I definitely got to make sure that works. And the intent of this is not to replace SARS. But to get the container stuff as a properly supported part of Slurm. And SARS can be bolted on top. To do its extra magic. Good stuff. Thank you everyone. See you later.


Russia lost five times more soldiers in Bakhmut than Ukraine. Russia has lost approximately five soldiers for every Ukrainian soldier killed in the battle for the eastern city of Bakhmut, CNN reported, citing NATO estimates. Moscow's forces led by fighters from the Wagner mercenary group have been waging brutal fighting for Bakhmut since August, taking severe casualties in pursuit of what would be Russia's first battlefield win in months. An unidentified NATO official told that the five-to-one death ratio was an informed estimate based on the US-led military bloc's intelligence. Despite the favorable ratio for Ukraine's forces, the NATO official noted that Ukraine was suffering significant losses in its defense of the city. Ukraine has vowed to keep up its defense of Bakhmut, a former salt mining city that now lies in near total ruin. Kiev this week said fighting had become increasingly difficult and analysts said its forces may have initiated a strategic retreat. But President Volodymyr Zelensky met with top commanders and his office said they favored continuing the defense operation and further strengthening our positions in Bakhmut. Despite the favorable ratio, it is said Ukraine was suffering significant losses defending the city. Iranian officials have repeatedly claimed they were inflicting heavy losses on Russia as Moscow tried to take Bakhmut. Our defenders inflicted significant losses on the enemy, destroyed a large number of vehicles, forced Wagner's best assault units to fight, and reduced the enemy's offensive potential. Colonel General Oleksandr Sirsky, commander of Ukraine's land forces, said after a visit to Bakhmut.