Hello and welcome back to the Metabolism of Cities YouTube channel. I'm Aristide and in this video I'm gonna show you an interview series that we did explaining what has happened in the urban metabolism field in Brussels and Flanders over the last five years. So Urban metabolism is not new in Brussels. It already happened almost 40 more than 40 years ago with studies from Duvignon and his team where they analyzed all of the flows entering and exiting Brussels. However, after this period of five to ten years, it kind of disappeared for 40 years and the field reemerged around the early 2010s, 2012, something like that, and 2015, well 2014 and 2015 we did a study for Brussels's capital region measuring the flows and entering and exiting the region. Since then this field has been used quite a lot by researchers, policy makers, practitioners and this interview series interviewed all of these people using this term to better understand how do they use it, how this field has evolved over the last five years and also what are the different uses that these people have well have used to in this concept. We also asked all of these people to understand how do they see the field in the future in the let's say next five years and how this community of people could consolidate in order to better collaborate but also build on top of each other rather than having individual contributions that make islands. We hope you're gonna enjoy this interview series. Please click on the subscribe of our YouTube channel in order not to miss any of these videos. Thanks a lot and see you in the next one. Cheers!


Love seeing those Chattanooga mocks down here in Mobile at the Reese's Senior Bowl. This is McClendon Curtis another offensive lineman. We have one in Corey Levin with the Titans Obviously, you got some good reps last year and a lot of people had a chance to see what you do What do you want them to get to know about McClendon Curtis this week? You know that I'm here to compete and I'm a you know dominant player done shy away from competition and that we belong here, you know I think the thing you've already shown is you've gone against some guys from big-time programs that no problems stepping up to that level The fact that Chattanooga played Kentucky played Illinois that has to have helped right? Oh, yeah, most definitely, you know those guys playing those teams help but also it really comes from the guys in practice We have a great always have a great defense line. So Yeah, people and so con football is really underrated, isn't it?  We want we want people to understand that we can play ball too Now I love Chattanooga. I loved it. Chattanooga when I was a kid But you played high school ball there. You played college ball ready to kind of experience another part of the world Just a little bit. Yeah, I am really Ready to experience the world. That's why I kind of moved away for training I get out of Chattanooga a little bit. But also, you know, I love my city. So oh, I know But you got to leave a little bit. You got to leave a little bit. Yeah, we love Chattanooga. All right So let's talk about in that training. What are the things that McClendon Curtis is focusing on? Right now, obviously getting after this you get ready for the combine. So uh increasing my bench, uh, 225 reps, uh speed Doing those agility drills more so right there and also improving some more like flexibility We have great treatment people at uh exos down in Pensacola.  I think that's fair Yeah, it's fair, you know, but to me, I just if they want me to play tackle I'll just have to adapt and play tackle. I played it this year. So all right We'll get to know the name right here. This is McClendon Curtis Chattanooga Mock going to be playing somewhere in the NFL in 2023


What is up, you guys? Welcome back to another one. If you're new to the channel, I am Gold Penny at the new car truck SUV reviews on YouTube and today, we are in the brand new 2023 Toyota RAV4 courtesy of Younger Toyota in Hagerstown, Maryland for more information on their inventory. Please feel free to check out the link in the description box below. And so there are some big changes for the 2023 Toyota RAV4. Not only that, of course, you get the legendary reliability. This one is going to be competing with other SUVs like the Honda CR-V, Mazda CX-50, just to name a couple there. And right now, this is the number one selling SUV in America. So they got pretty much tested all right there. So ultimately in this video, we will be testing out and going over everything about this one from acceleration of braking, steering for a ride quality, sound system exhaust club, all that fun stuff. So having said all of that, what do you guys say? Let's just go ahead and jump right into it. And as always, let's start with pricing. And so there are several different trim levels for the 2023 RAV4. First one being the LE, which actually is the trim we are in today, starting at $27,575, XLE for $29,085, XLE Premium for $31,975, Adventure for $33,770, TRD Off-Road for $37,195, and lastly the Limited starting at $35,880. And so the Adventure and TRD Off-Road, that's going to come standard with all-wheel drive. All of the other trim levels come standard with front-wheel drive. But having said that, you can add all-wheel drive to any of those other trims if you wanted to do that. Simply add $1,400 to any of those prices. We do have the LE all-wheel drive to be specific with us here today. But regardless of trim level that you go with, the power plant on the RAV4 is going to be the same. Powering the Beast is a 2.5-liter naturally aspirated inline-four cylinder, 203 horsepower at 6,600 RPM, 184 pound-feet of torque coming in at 5,000 RPM. Power sent to front wheels or all-wheels through an eight-speed automatic, zero-to-60 time, coming in at approximately 8.4 seconds. With MPG numbers then coming in at 27 in the city, 35 on the highway for the front-wheel drive, 27 city, 34 then on the highway for the all-wheel drive, taking regular on-leaded fuel. So then before we do any kind of fun acceleration test here in the RAV4, I did want to mention to you guys the drive modes because there's actually a ton of them. So there's going to be drive-mode buttons located just to the left of the shifter. They're going to include Eco, Normal and Sport for the on-road drive modes. Then you actually also get off-road drive modes, which you wouldn't expect and you definitely wouldn't expect on a base model of an SUV. So they're going to include snow, mud and sand and rock and dirt, and that's for the all-wheel drive only. So if you get the front-wheel drive, you're not going to get those off-road drive modes, but ultimately they will adjust things like the shift points, the throttle response, the steering sensitivity and the all-wheel drive system engagement then as well. And so now having got all of that out of the way, what do you guys say? Let's go ahead and find it straight away. Let's put the RAV4 here to the test and let's see how quickly we can get our new 2023 Toyota RAV4 here up to speed. All right, let's go ahead and put it in sport driving mode here. The gauge has changed to red. That's pretty cool. And three, two, one, go baby. All right, all right. Actually not bad. That's really not bad, honestly. You're definitely not going to have any issues in merging onto the highway. Honestly, zero to 60 time is not the best on paper, but if you put it in sport driving mode, honestly, that was pretty darn quick and the coolest thing is the RAV4 still is not turbocharged. You're not going to have any of that crappy turbo lag at the beginning of any acceleration. I like that. That's also going to keep the engine a lot more reliable as well. So I do like that it's still naturally aspirated for those reasons because honestly, that was a decent acceleration for the RAV4. I personally wouldn't have any issues myself with that acceleration. But anyways, to go along with that as always, braking is equally important.  As far as that six easier stopping distance goes on paper, it comes in at 126 feet. So let's go ahead and just hit the brakes. I like it. That's actually not bad. It feels perfect. It's kind of leaning on the firmer side of things. It's not as soft of a braking feel as I would have expected as I typically find on SUVs. So I don't mind the braking feel. That actually feels quite nice here in the RAV4. The touching on suspension and handling, upfront, you're going to get an independent McPherson strut front suspension. In the back, independent multi-link rear suspension, front and rear stabilizer bars. As far as ride quality goes, in my short little test drive here, on some very nice Hagerstown roads, I'll say that, it's been pretty decent. I don't mind it. Ride quality is definitely on point. I don't have any issues there. As far as steering feel goes, you can notice the difference when you put it in that sport driving mode. When you put it in the sport driving mode, it is a noticeably heavier feel to the steering. Better point you in the direction that you want to go. But then if you take it out of that and just put it in eco, instantly loosens up the steering feel. So much more loosey-goosey. So I do like that the steering sensitivity is adjustable based on the drive mode, because if you didn't want that looser steering feel, like typically with me, that's the case, you do have that sport driving mode to firm it up a little bit. So I am a big fan of that. As far as cabin noise goes, and we'll see, you do get a little bit of road noise. We're going 55 miles per hour right now.  But there's a little bit of road noise. The wind noise isn't bad. I will say that. The wind noise doesn't bother me whatsoever, but the road noise, it does get at higher speeds at least. You can hear it a little bit more. Touching of visibility, I can see perfectly fine out the back, typically with a shape like the RAV4, you're definitely not going to have any issues with rear visibility at least, but it did what I also mentioned for the XLE trim leveling up, touching up for visibility, you do get rain-sensing windshield wipers as well. So that's pretty cool. Obviously we don't have them today, but essentially what that means is whenever the RAV4 detects any kind of mist or rainfall, it's going to automatically turn on those windshield wipers where it's just kind of like automatic headlights. Just one less thing you got to worry about. It's kind of a convenience feature there. So I'm a big fan of that actually as well, but that pretty much rounds out the performance segment of this review, guys. Let's now go ahead and take a look at the exterior of our beautiful Black 2023 Toyota RAV4. All right, so here she is, you guys. The new 2023 Toyota RAV4 finished in midnight black metallic as it begins to rain here in Hagerstown, Maryland. But anyways, let's go ahead and start where this one is actually made. The VIN number actually is going to start with a two, meaning the Toyota RAV4 here is made in Canada, is built in Canada, so that is pretty cool. But anyways, as always, let's go ahead and start up front. Projector LED headlights now come standard on every single trim level across the board. I put it that way because for the 2022 model year, you actually still got halogens up front for the LE trim level at least. So I am glad that we got the LE trim level with us here today because last year, when I reviewed the LE, it did not have these projector LED headlights. Big fan of that, LED day-term running lights, of course, coming standard, automatic feature as well, meaning when it starts to get dark at night, those headlights will turn on automatically for you there. Automatic high beams also coming standard. So if you have your high beams on at night and it senses a vehicle coming in the opposite direction, it's going to automatically dim them back to low beams. And when that vehicle is gone, it's going to automatically bounce it back up to high beams then. LED fog lights coming with the XLE premium trim level end up, so we don't have those with us here today. That front grille, of course, is going to differ amongst the trim levels. You're going to have different looks dependent upon which trim level that you go with. So also the ground clearance is going to differ slightly amongst the trim levels as well. So I did want to touch on that real quick. The LE is going to give you 8.4 inches. That's going to be the same for the XLE trim level as well. But the XLE premium trim level and up is going to bump that up slightly to 8.6 inches up front. So I did want to mention that, but that pretty much rounds out the front and here of the RAV4. Let's now go ahead and make our way to the side. Our incident about making our way to the side of the 23 RAV4 roof rails are going to come standard on the XLE trim level end up. Again, that's why we don't have them with us here today. You're going to get a floating roof line towards the back. And so we actually get a little closer for this one because somebody put in the comments the other day, they didn't know what a floating roof line was. It's essentially where a piece kind of separates on the C pillar. So this little horizontal piece right here separates the roof from the bottom portion of the body there. So although we have a black exterior and the floating roof line is always going to be black, you can't really tell all that much of a difference on this particular setup, but if we were to have a silver or white, there is going to be that little black floating roof line on the C pillar there. So I did want to mention that for your privacy glass does come standard across the board as well. Then take a look at the side mirrors, body color, power adjustable side mirrors coming standard, heated side mirrors then coming with the XLE trim level end up. You will get LED integrated turd signals again for the XLE trim level end up, gloss black side mirrors for the TRD off-road and then puddle lights coming with the limited. So so you don't step on any puddles here since it's raining, but anyways, let's take a look at the wheel configurations. Again, differing amongst the trim levels, 17 inch steel wheels with covers coming with our LE trim level that we have with us here, 17 inch gray metallic alloy wheels coming with the XLE 19 inch chrome alloys for the XLE premium and limited trim levels, 19 inch matte gray alloys for the adventure.  So pretty much rounds out the side profile here. Let's now go ahead and make our way to the back. All right, so now since we are around to the back of the RAV4 here, body colors, shark fin antenna found all the way to the top there. Rear spoiler with an integrated brake light, of course, coming standard rear window wiper then as well. LED tail lights though, coming standard for every single trim level across the board. You don't always get that. So I do like that. You also get some trim level badging found on the right hand side of that rear tailgate there as well. Also, it's gonna tell you if the RAV4 that you're looking at is equipped with all wheel drive, then if you go all the way down to the bottom there, you will find dual exhaust outlets finished in chrome tips. Love this look. Love that they're not tucking into ways still like so many other manufacturers are doing right now. So having said that, I do believe you guys know what we have to do next is always here is that exhaust clip. All right, so now since we are around to the back of the RAV4, when it comes to opening that rear tailgate, it is gonna be a power tailgate for the XLE premium trim leveling up.  So anyways, I'm just gonna go ahead and open this one up. Once opened up, cargo capacity comes in at 37.6 cubic feet. If that was not enough space, there is a 6040 split, meaning the rear seats do fall down, bumping that up to 69.8 cubic feet then. There is a cargo cover back there for the XLE trim leveling up. It's gonna be available for the other trims. We do have that. So I was a big fan of that. There is some LED cargo lighting. You typically still find halogen bulbs in the cargo area. So I was surprised to see that we had LEDs back there. 12-volt power outlet is gonna be available for the XLE trim level and up. Then if you were to lift up underneath that cargo floor, you will find a spare tire, as opposed to the fix-a-flat. And there was some indented kind of a cargo box storage on the right-hand side of that cargo area and plenty of chrome-plated tie-down anchors back there as well. But instead of making our way up to the rear legroom, that is going to come in at 37.8 inches. So for reference, I mean even six feet tall. This is how much space I had back there. 12-volt power outlet is going to come standard for all trim levels across the board. Rear ventilation though, also coming standard for all trim levels across the board. Big fan of that. There is a rear center armrest with cup holders. Once again, all trim levels across the board. Gotta love that. Heated rear seats then coming with the limited trim level. But pretty much rounds out the rear seats. So let's go ahead and make our way up to the front seats here, manually adjustable cloth seating coming with our LE trim level. Power adjustable front seats with power lumbar for the XLE, soft-tex upholstery for the XLE premium trim. You are going to get some orange accents and some orange stitching for that adventure trim level then. You will find TRD stitching in the headrest for the TRD off-road trim. Then the limited trim is going to add to that heated front seats and an eight-way power adjustable passenger seat then as well. So overall, when it comes to my thoughts of the seat comfort, it honestly wasn't that bad. And really Toyota does a pretty darn good job with their seating. Toyota and Lexus, regardless of which trim level that you go with, it's usually pretty darn comfortable. And that's certainly the case. Obviously, if you go with the more adjustments, it's going to be a little bit more comfortable. But even for our LE trim level, I didn't have any issues personally. So no issues there. Then take a look at the steering wheel. Tilt and telescoping will come standard. It will be wrapped in a urethane if you go with the LE or XLE trim level but then leather wrapped for the XLE premium trim level and up. Then if you wanted a heated steering wheel, that is going to be optional on the XLE trim level and up. But it doesn't come standard on any particular trim level. So don't want to mention that. But anyways, let's go ahead and make our way to the startup here. Let me start by showing you guys the key here. Typical Toyota key. You got your Toyota logo on the one side. Then when you flip it over, lock and unlock. But I do want to mention it is keyless entry with the push button start if you go with the XLE trim level and up. Otherwise, you're going to get your traditional turn key start, which is what we have today. So in our case, all I'm going to do here is simply put my front of the break and turn the key. And so once started up here, gauges have changed a little bit compared to the 2022 model year. So I like this because before, you had a 4.2 inch digital screen in the center. But now you have a seven inch digital screen for every single trim level across the board.  So the fact that a digital gauge cluster is now available on the RAV4, I love that. And every single other trim level is going to get the seven inch screen that you're currently looking at right now which is going to give you your driving modes. And of course, it's actually going to change the color up there dependent upon the drive mode that you put in it. So if you put it in eco, it's going to be green. If you put it in sports, going to be red. If you put it in normal, it's going to be gray. So I do like that. And there's a digital speedometer up there. Attackometer is going to be on your left, fuel information on your right. Gives you your outside temperature and how many miles you have left until you hit empty, trip A, trip B, actually a time of the day as well. So pretty much everything you could possibly want on the digital portion of the gauges. So I am a fan of that. That was one of the changes for 2023 yet again. But then making our way to overall interior quality, there's a power moon roof coming with the XLE premium trim level and up. Overhead sunglass holders going to come standard across the board. LED interior lighting yet again for all trim levels across the board. Even in today, you don't get LED interior lighting typically standard on other manufacturers out there. This usually upper trim level kind of thing. And it's usually halogen bulb. So I do like that the LEDs are standard yet again. Homeland controls are going to be optional. Dual zoom climate control coming with the XLE trim level and up. Wireless phone charger again is going to be optional. One of the things that thought was pretty cool is you do get a little bit of storage just above the passenger side glove box. Although I do wish it would have been rubberized storage because it is just a plastic there. But still, I like that it's there. There is some plastic storage just in front of the shifter as well. USB charging port, 12-volt power outlet to go along with that. Electric mechanical parking brake just to the left of the shifter. Got you dual cup holders behind the shifter and within the center armrest. There's a decent amount of storage there. A couple phone charging ports within that as well. So overall interior quality is definitely finished on the basic side of things. Personally, I don't mind it, but yeah, it's definitely on the basic side. So I'll just put it that way. Now let's go ahead and make our way to the infotainment screen because again, this is new for 2023. Both screens actually are going to be new for 2023. So eight inch color touchscreen display is going to come standard on the LE, XLE, XLE premium and adventure trims. However, if you were to go with that TRD off-road or limited trim, you will get a 10.5 inch color touchscreen display. So it's going to be bigger than what you're currently looking at right now. But Bluetooth and audio streaming will come standard wireless, Apple CarPlay and Android Auto. So big fan of that as well. You can check out your driving statistics up there if you wanted to, along with your radio information. And so when it comes to the sound systems, there's two of them. One is going to be a six speaker sound system. That's going to come standard for all trim levels, but the limited trim level is going to give you an 11 speaker JBL sound system with an external amp and a subwoofer as well. We do have the six speaker sound system with us here today. So what do you guys say? Let's go ahead and turn on the radio, see what we got playing today and let's test out the clarity of this one. It's actually not bad. I would say it's above average for a six speaker sound system. So typically six speaker sound systems just suck, but that one wasn't bad. Again, a little bit above average. So I don't think I would have any trouble with that. So anyways, JBL obviously is going to be better, but last thing I want to mention to you guys on the infotainment screen is when do you put the RAV4 in reverse? We'll find a rear view camera coming standard across the board, letting you know what is behind you, which is always is going to lead us into safety. And so let me first start by saying IIHS top safety pick, which is a very good start right there. Front side, side current airbags do come standard. Driver's knee airbag up front as well, but also a front passenger seat cushion airbag. That's one that typically doesn't come standard on other manufacturers.  This is new for 2023, by the way. Toyota Safety Sense 2.5. And so this is going to include a pre-collision system with pedestrian detection, dynamic radar cruise control, lane departure alert with steering assist, lane tracing assist and roadside recognition then as well. Then if you were to go with the XL e-trim level and up, it's going to add to that a blind spot monitoring system with rear cross traffic alert, then the limited is going to add to that front and rear parking sensors. And so when it comes to my final thoughts here of the 2023 RAV4, standard safety is pretty darn good. So definitely a big fan of that. I like the updated tech as well. And that includes the gauge cluster. I like that there's an available digital gauge cluster. I like the updated infotainment as well. You got of course, legendary reliability with the RAV4. That's probably partly the reason why this is the number one best selling SUV in America. After all, I love the updated headlights for the LE because again, I reviewed the LE last year and it didn't look like these headlights. So big fan of that as well. Starz are in for improvement guys. I guess since we have the LE trim level, the trade off is it is pretty darn basic interior quality but it's to be expected. I suppose that's the trade off. But anyways, let me know what you guys think of the RAV4 in the comments section below. Sorry about my voice throughout this video. My voice is slowly coming back from having the flu. That's what's going on here. But anyways, be sure to hit the subscribe and the bell notification button if you're into new car reviews. That is what we do here on this channel. After all, do appreciate you guys watching more than you know and I will see you guys all in the next video. Stay Gold.


Good morning Warriors Corner. Welcome to day two. Our first presentation operationalizing training 2030 with presenters Brigadier General Charles Lombardo, Brigadier General Thomas Felty, Brigadier General David Gardner, Brigadier General Joseph Hilbert, Brigadier General Curtis Taylor, Colonel Scott Woodward and Mr. Rich Creed. Hey good morning. Thank you very much. What a great day and what a great topic to start today. We basically, I'm Chuck Lombardo from the director training for the Army. We've got the entire training ecosystem here represented. So from the department I'll kind of lead off then hand it off to our doctrine experts Rich Creed and our three great CTC commanders. Tom Felty's in there is gonna lay out with the institutional Army and then close out with Scott Woodward at the combined arms center training. So really appreciate you being here. I'll just lead off with you know the thing that we're looking at the department how have we trained in the past where we're going now. It really starts with our re arm our model. It's a regionally armed modernization model. It's really it's centered around protecting those modernization phases and the windows and really building the Army of the future. So it's really building that future readiness. And the chief has talked and the secretary has talked. We're always gonna have to balance readiness, personnel and modernization. No different today and we've got some great you know capabilities that all enable us to do that. The second big part though it's and it'll probably come out through all these themes is it's a culture of ownership and as we've kind of returned back to to Lisco in about 2016 it's the ownership in the training management and those core competencies that our Army leaders are gonna have to do or teaching it at the institution or practicing at home station and we're validating it at the combat training centers. And then you know the third and final thing before I hand it off to our team is the you know the principles of training that Scott will talk about but one of the big themes is you know the fight to train and train at levels that you can sustain and we have to continue to do this in a multi echelon training. We know that we have the chief is kind of laid out the foundational aspects of our training strategy. The department's gonna continue to fund that T1 T2 strategy but we know you're gonna have to have multi echelon. It's gonna have to be distributed.  And so without further ado I'd like to hand it off to the rest of our teammates here and they're gonna kind of explain how they're getting after that in that vein. Rich Creed over to you sir. Thank you sir. So good morning my name is Rich Creed. I run the Combined Arms Doctrine Directorate at Combined Arms Center at Fort Leavenworth and we now have a book right FM30. It caps or capstone operations doctrine that makes MDO multi-domain operations. The Army's approach to how it conducts operations across the competition continuum. Alright so when we talk about training what we're talking about is training to do what. And so you see the description there in the orange box at the top what multi-domain operations are. I call our attention to a couple things. Want to combine arms approach right. And so we communicate our culture to the next generation. It's not something that's automatically inherited so what is combined arms in the 21st century and to what degree does that mean including the understanding and those repetitions necessary to employ those joint capabilities. Right and then we do it across three contexts. And that requires a certain amount of education and training as well to understand the purpose of the operations we conduct during competition below the threshold of arm conflict during crisis like in Eastern Europe now or in during a conflict. And so you see the organization of the book on the left and then our model of the operational environment. And the thing about that operational environment is it's got three dimensions they're inter dynamic and there's something that's got to be understood that human physical and information piece. Tenants get to the qualities of the operations we want to conduct. Imperatives which is really where training needs to focus are those things that we must be able to do if we want to win acceptable costs. So with that I'll be followed by the armor commandant. Thanks Rich. And our team my name is breeder general Tom Felti I'm the 53rd chief of armor and the armor commandant at the maneuver center of excellence. So I might get a little excited about this because you know at the maneuver center of excellence a center of gravity for all things maneuver we get excited about about training our infantrymen our armor and our Caldraman. So as Rich kind of laid in and the theme of this whole session years are is is Army 2030 and Rich laid out our FM 3.0. And so of course there's going to be a cascading effects across all of the institutions as we now have to begin operationalizing you know this new this new doctrine. And so armor 2030 if you look at kind of this model that we have here you ask like so what is armor 2030. Well you look at we have new doctrine as Rich just laid out. We have an ever changing operational environment right. Everyone can see it. You're reading the news. You see things you're changing. Some of the character of war is a little different than now than it was and it's continuing to change. We have new modernization. We have new equipment that's that is getting you know flowed and flooded into our into our forces you know. And then and then lastly I think from the armor core we have a little bit of a lethality gap in the amount of time we've spent conducting a counterinsurgency operations and time off of our platform. So with those four reasons this drove our model of of a new armor 2030 and how we're going to approach how we're going to approach training. So this is really a bold step forward for our armored and Calvary forces in a lot of ways you can see on the right you can see our training and on the left you see the leader development aspects. And in the center we have this framework of standardization and that is really foundational to everything we're doing and the armor community is going to take a page out of the aviation's handbook and we're going to model what aviation does in order to build crew readiness across our fleets. And so it's going to be the same standard everywhere you go and you got to think our master gunners now are going to turn into instructor pilots and standardization officers and we're going to administer you know these precise standards across the board and I have another slide that I'll talk just a little bit about that. Another aspect of the training as we're getting ready to have new equipment as we look forward to OMFV is we have a new MOS that was just announced in April it's called the 19 Charlie and that MOS is a professionally a professional Bradley crewman you know that'll be in the in the in the turrets of all of our MECH infantry platoons you know and again it's time for a professional we're going to see an increase in our competency and you also will see a decrease in some of the tactical or some of the accidental risk that you know you might see out in your in your in your formation and a lot of this too when you when you with this model and the standardization and framework is is that we don't want to start from zero and we're going to capture everyone's training in a digital job book right that way we can transfer readiness from the institution and we can transfer readiness from the operational one operational unit to the next operational unit and that's a key a key aspect of how we're going to how we're going to do things we've also learned that our doctor and our process is good right it all works but we just need a little bit more rigor and a little bit more standardization in our approach sly place and then the last just just gives you an idea of of the RL progression model of course we don't want to follow the aviation too closely so we call it the standardized armor based of training SABO which for all you folks that aren't tankers that's the name of the the round that that that we use but you can see on the bottom we have something called a platform activity category and so this means if you are an armored crewman you have a lifelong obligation to stay proficient in your task if you're in pack one you know you you're you can see up there it's you know you have you've got to run through all of your different RL progressions pack two it's a little bit less and then you get to pack three it's it's kind of like an annual exam and those are for who is outside of the outside of the formation but the other aspect of it too is it shoot move communicate and maintain because we think you know we need to be absolute certified experts in all these categories as we as we move through the other thing that we're exploring in three cores volunteered to do a pilot of our of our training beginning in calendar year twenty three is the idea of certifying by position so certifier commanders and certifier gunners that they are interchangeable across all different crews and across our formations and so I'm going to pass it over to Kurt Taylor thank you hey good morning my name's Kurt Taylor and I have the incredible privilege of commanding the National Training Center out of Fort Irwin California so the NTC was created forty one years ago in the shadow of the Yom Kippur war for one purpose and that was to train our combat formations to win the first fight the first battle of the next war and we were coming out of a period of profound change in the character of war as the creation of anti-tank-guided missiles profoundly changed the way we fought we're moving out of active defense in the airland battle as we look at where we are in history today we see many parallels to where we were in nineteen forty one since that was the event that led to the creation the NTC we've got to think about how does the NTC change now in light of the evolving character war that we're seeing at the net are in Ukraine and in Nagorno-Korobok so the National Training Center is moving in for simultaneous line to effort to adapt the way we fight and the experience we provide to tactical units in light of the publication of multi domain operations and in light of the changing character warfare that we're seeing in theater first and most important if you saw FM30 which came out yesterday it talks about one of the imperatives is we must operate in an environment of pervasive surveillance we must operate with the understanding that all our activities will be observed at all times we are bringing that to life that transparent battlefield to life at the National Training Center so we created a cell in the up for that that is focused on the relentless pursuit of information advantage using low-earth orbit satellites and right here in the lower left you see a picture of commercial synthetic aperture radar low earth orbit satellite purchased for a few hundred dollars of a live photo taking at the National Training Center showing defensive preparations we can get that from commercial sources now with a latency of less than 18 hours we're also widely expanding the use of drones we recently had a drone attack of about 40 drones that attacked a blue four defensive position as they were conducting a defensive operation tied to the out force artillery preparation for that defense we're also using the EW spectrum to find fix and locate the blue for throughout the battle space what we have observed over the last eight or so rotations of doing this is generally by training day three this organization could come to can establish about 90 percent target custody of blue for locations so this is a real challenge that we're facing every day here at the NTC if you come to the NTC you will absolutely see that the second increasing the effects of enemy fires we're going after command posts last rotation in nine days we struck 54 command posts during that time 54 separate attacks and so we are driving units to find creative ways to make their command posts more survivable third we're bringing the division into the fight the division is a critical element of the of the tactical fight and is the is the decisive element of the of tactical maneuver so we're bringing our divisions in we just had one AD out in the box their division operated in parallel to the BCT in the box next in February we'll have third ID the division come out in advance and conduct shaping operations as it prepares its BCT to enter a rotation right behind it finally one of the tenants of multi-domain operations is endurance and we are working to bring the division in to create that endurance through a much more focus regeneration process that includes an external QAQC so we're not letting units leave thanks to general popis in the in the direction he's given from forces command we're not letting unit leave until they get to 90% operational readiness rate so we return them back to the force ready to fight so those are the four main initiatives we're working on at the National Training Center I'll pass it over to JRTC now good morning everyone I'm Dave Gardner and I'm the commanding general down at the joint readiness training center and Fort Polk so as Kurt Taylor my counterpart the National Training Center mentioned I say it a little bit differently when I was a young man I was made to study a book called America's First Battles I think the combat training centers were created to be the antidote to those America's First Battles much like 80 years ago Marshall said it we want the mistakes to be made down in Louisiana or at Hohenfels or at Fort Irwin we don't want them to be made overseas so what I'm going to share with you this morning are just a few things three of them specifically that I'm thinking about as I go to sleep at night wondering how we are going to be the instrument of change for the chief of staff and the force com commanding general the first is the division is now under large-scale combat operations the principal tactical formation so how do we do everything in that context but more importantly how do we preserve the training audiences intended by each event whether at home station or at the combat training center and essentially become experts at multi-escalon training the second thing is we enhance our learning opportunities is not just becoming experts at multi-escalon training how do we get better at multi-location training leveraging the full spectrum of live virtual and constructive operations to link together on vast distances multiple formations that replicate that core and that division fight and then the third thing is I think about multi-domain operations at the combat training centers and at joint readiness training center how do we model the capabilities that we will experience on the modern battlefield into 2030 and I think of it in two ways and I try not to be confused by that how do we first paint the environments how do we paint the environments of transparent congested degraded denied environments for our soldiers training in that fight but then secondly and more importantly how do we drive the training outcomes that we need if we put soldiers in an electromagnetic environment where they are denied they have options to drop down and perhaps do things analog perhaps go to alternate procedures but that is just experiencing the environment we have to pursue the realistic training devices that drive the training outcomes to counter that environment to fight in that environment and to succeed on the modern battlefield thank you I look forward to your questions and I'll be followed by JMRC and 7th ATC Joe Hilbert well good morning I'm Joe Hilbert I command the 7th Army Training Command and today I'm going to talk to you about what we're doing at joint at the joint multinational readiness center one of our organizations where we train large-scale combat operations in a European environment the first thing I tell you is you can see is Kurt alluded to with what's happened in Nagorno-Karabakh and in Ukraine Europe is a large-scale combat operations theater we're watching it unfold every day and here we go well there we go how do we how do we prepare for it and how do we do that in a European environment so unlike the other CTCs we are our Europe CTC we're conplan informed and we're conplan informing right so we are both looking at the con plans that we have and we are we are informed by them and then we take the lessons learned we feed them back up through US Army Europe and Africa to inform conplan repights we are Europe CTC as I mentioned and then as everybody said we know that the principal tactical formation large-scale combat operations is the division while our primary training audience remains the brigade combat team what we've done is and we've done this for a while as we'll put a division headquarters on the top of the rotation that can be a US division it can be a multinational division it can be an action as an example recently we had first armored division from Germany as the high con and they brought their division operations and intelligence section and they were the division fighting the fight we then put brigades in the constructive fight adjacent to the live brigade so in that particular rotation we had a Slovakian brigade in the north and we had a Croatian brigade in the south that division had command and control of those three brigades plus a Lithuanian brigade or I'm sorry a Latvian brigade that was the primary training audience with a US battalion inside it we provide a constructive division artillery and a constructive combat aviation brigade so that the division can fight all of those elements that they normally have it is a multinational division even if it's a US headquarters we're going to give them a NATO order and they're going to be considered multinational division homefills technically challenged there we've got the complete wrap in there but at the end of the day the main focus remains that primary training audience so the division the other brigades are all secondary training audiences and it's allowing them to get a good rep in it as Chuck mentioned we've got to make use of every training opportunity to train at different echelons concurrently and that's what we're able to do the final thing is we are not an agnostic training center so we are a European training center we train on European terrain obviously the physical terrain is the terrain of central Europe but we create a European operating environment that includes European interagency partners so every rotation will have folks we've had folks from the the technicist health fair out of the federal public of Germany a female like organization they'll bring their actual people into the rotation and function in that role in the rotation we've had Bavarian Red Cross do the same thing and then most recently we'll have consular officers from the department of state will come in and they'll run the they'll run our consulates inside the inside the training center as we do the fight so this rotation we had four consular officers running a consulate in a large-scale combat operation where where they're able to perform their function in a conflict environment and that is going to that is how we are trained in large-scale combat operations in Europe without I'll pass off to Scott Woodward from cacti good morning Colonel Scott Woodward from a combined arm center training it's a training aid training device simulator simulation in the army we touch it so we kind of run trip with a training proponent for the army some things were excited about you know 7 0 came out last summer 7 0 is going to get us back on track what we need to do is train training management so we're working with our professional military education systems company commander first sergeant courses to teach these young leaders how to plan prepare execute and assess training something we've got to wait away from in the past 15 years we're really going to focus on getting back on that our warfighter program a lot of exciting things about the warfighter program going forward where we used to do a multinational warfighters every other year we're now going to start doing them after the spring every every year so multinational more joint and we're going to make sure we touch all domains we just had a really exciting warfighter out in Indo Paycom with first core one of the new scenarios we built specifically for them so we're working on modernizing that program as well now home station training looking at upgrade and modernizing our ranges for home station training building ranges for mobile protective fire power we're getting ready to design ranges for the next generation squad weapon and then we've got some exciting things coming with our targetry we're using these deployable range packages in Europe right now to support our troops that are deployed over there and also use with our allies with trackless moving targets and we're developing for the future here a thing we call multi spectral target which has a radar signature will emit any W signature and can replicate multiple thermal signatures so that we can use the same target form to replicate different different vehicles on the same range we're working really closely with synthetic training environment cross functional team down at army futures command to develop what we're called the synthetic training environment of the state so that we can have a persistent training environment where soldiers that are training live virtual or constructive can all come together and be integrated into one exercise so really exciting there but don't forget we're talking about twenty thirty here and this this stuff won't be ready tomorrow and then lastly you know center for army lessons learned falls under us and right now they've got a huge effort going on to collect observations from the Ukraine and to send disseminate those out to the force thanks for your time and I'll be followed by a gentleman Bartle before I open up for questions just want to close out so you just heard from the masters of our combat training centers you know and in our pursuit of mastery in twenty thirty from our institutional army are doctrine you know the bottom line we do want we do we want in need and we're going to get a persistent training environment you know and that is aimed at giving time back to leaders it's turnkey and it allows training to occur at all times whether it's at the institution home station training in our rotational forces and in our combat training center program Lincoln in a distributed manner those multi echelon events will really I think enable our leaders to be at the training environment take them out of the data management business and really help us pull that line of departure back and get the most out of our training reps that four to port kind of mentality you know from the projection of our posts our garrisons are involved to the you know to the movement the RSO and I and to the execution of those those operations and those company battle task metal task that is what we're trying to do at home station and we are absolutely trying to validate that at our combat training center program and while deployed maintaining that proficiency to keep our forces ready at all times without further ado I'll take I'll take questions from the field and as we orient it to one of our experts I'll hand it off to them so any any questions at this time good morning at Todd South Army times I was wondering if you could talk a little bit about how a rotation one of the CTC's might look differently for brigade commander now that division and core and are enabled within that construct versus a past rotations which are focused almost solely on the BCT great question Kurt I'll go ahead and hand it off to you yeah absolutely so I'll give you a great example just last month first armored division was conducting a constructive exercise adjacent in parallel to 2 1 AD who's attacking into the box so we had timed it so that the division's river crossing was coincident with the seizure of the town of Rajesh so in a previous rotation brigade commander says hey I don't feel like the conditions are set for me to seize this critical urban objective I'm going to wait 6 hours 8 hours until I feel comfortable what we created in this scenario was the division commander who coincidentally was his boss was calling down to the brigade commander saying hey when are you going to seize that city because I got to set conditions to cross this river at the same time because we knew it would cause the commitment of the 803rd to protect the capital city which would enable him to get across the river so we're getting brigade commanders out of their box and thinking as that they are an integral part of the division's close fight as the primary tactical formation so that's a that's a phase shift when I was a brigade commander at the NTC they drew me a box told me get from one end to the other and gave me a bunch of resources to do that we're pulling brigade commanders out of that and they've got to understand the broader context of the division in which they're fighting yeah and I think what Kurtz also added is now that divardy commander that cab commander the DTAC can be a part of that training audience you know up until the last few years their only reps were in an MCTP warfighter which is great but getting everybody out in the box understand the science and what it takes to move those larger formations I think is also helping thanks for the question Todd any other questions Francois yeah nice to meet you French as an officer to Fort Levenworth you need a new way of managing the talents with modernizing your army oh we'll the new way of doing training help you shape fine the new talents you're needing yes sir in it we could probably Todd and a couple of us Scott can talk about this but the talent management the training management today and the where we want to go we think directly enforces the talent management of the 21st century as the chief talks about it quite a bit and I think Tom felt these up points could lay that out as we're looking at his progressions and just thanks for the question great question because because as our you know chief says people are everything for us and getting that right those right people selected early as lieutenants matter and so right now in our branches right now we have something called you know talent based branching and so as the branch chief for armor we lay out the you know the knowledge skills and behaviors of the officers we're looking for and we get to vote on every single cadet in the army and so there's a little bit of a match you have an officer that shows interest in in your branch but then there's also certain things that we're looking for in those officers that we know that it's kind of like lead indicators that they're going to be successful in our branch and so those are those are some of the ways of going very deep into the cadet pool to make sure that we're assessing the right officers now as we go towards army of 2030 and beyond in fact just a couple of weeks ago at the combined arm center led by the mission command center of excellence we were looking what what are those 2030 and 2420 40 knowledge skills and attributes and behaviors that we're going to need within our branch to make sure that we know what they are so we can assess in time for those for those officers. Thank you. Yeah. Yes sir. Joining. I was going to join in Lewiston. So as you're kind of working toward you know kind of this persistent training environment what data challenges are you saying with respect to data generation aggregation visualization and how you're doing that in tighter time cycles to give more near real time feedback to units as well as to accurately represent like units in the constructive domain. Well I know we got we got the great William Glazer here for the synthetic training environment I don't know if they're challenges it's just really the priorities of how we're tackling this. I know we're working on you know where we adjudicate you know data you know the tactical computing at the edge in the training environment but then I think as Tom has talked about and in some of our other folks the capturing of that training event is you know in the training the training rep custody along the continuum is the other piece that the training management tools will package and pick up from the state. So those training events will be captured and then passed along into the legacy systems or DTMS or eventually into ADIS to form that more of a three dimensional training record you know for the training at large. Now the local you know actions on the objective and all those trains I think we're working through that right now and you know will I don't want to put you on the spot but I think we have options that we're working through and we're in soldier touch points right now to do that. Yeah yeah thanks. I think we have time for one more question. Hey look thank you all we'll end where we began by thanking you all for coming I know this is very passionate subject for all of us it's our golf game if you will. So thanks to give a round of applause these incredible cadre of folks that have laid this out for us. Thank you very much. Have a great day.


I'm Emma Foley, this is Kristof Kepke and we're going to talk to you today about how to tell what's really going on in your NFE infrastructure, why you need to do it and what you can do about it if you can't see what's going on. So why do I need to know what's going on in my infrastructure? Well, I'm going to do an introduction and talk briefly about barometer and barometers. And Kristof is going to talk about collectee and I will talk about barometer again and how the two projects relate to each other. And then Kristof will talk about potential use cases and I will switch over to plans, upcoming features and open the floor to questions. Why do I need to know what's going on in my infrastructure? Well, as telcos and enterprises move towards a cloud-based IT infrastructure, they start moving their workloads from fixed-function network appliances to commodity hardware in order to reduce costs. But as they move to general-purpose hardware, they become more and more reliant on the data center and they become more vulnerable to the costs associated with data center downtime. Those costs are not just financial, although even a minute of data center downtime is very, very costly. The cost also comes in terms of additional complexity required and service availability. So as they move from fixed-function network appliances to the NFE environment, the tooling required to actually maintain, host and orchestrate this become more and more complex. At the same time, the requirements that customers have for maintaining service assurance, QoS, and the same levels of availability, they remain constant, they need to be meshed or exceeded. This requires more and more complex tooling and more metrics to be available in the environment. So that's additional complexity for deploying, additional hardship when actually maintaining the level of performance required, and then even more additional complexity in monitoring what you have going on now. Because it is vital to monitor the systems because there are many different things that can have an effect on performance and many different things as you move up in complexity that can actually cause downtime. And you move from not only having to monitor the platform itself, but also having to monitor the applications running on top of this because you don't want something like OVS or DP2K or OpenStack Kubernetes to go down, because that would be disastrous. This is where barometer comes in. And first off, a barometer, as in the scientific instrument, is a device for measuring atmospheric pressure. It is usually used for short-term weather forecasts. And another use that many people aren't aware of is that it can be used to measure altitude or height above sea level. Now, when scientists were designing barometer, they probably didn't expect this to actually be a use of it. And the same way when the barometer project was created, there were a lot of use cases that have since emerged that we did not foresee at the time. So barometer itself is part of OPNFE. And I'll explain briefly what that is because barometer's relationship to OPNFE dictates the activities that the project actually undertakes. So OPNFE is the open platform for network function virtualization. It's a Linux Foundation networking project, and it tries to ease the adoption of NFE. It does this by developing more NFE-friendly features in upstream projects and then providing tooling to deploy, test, and integrate these same features. So that is what barometer does. Barometer is concerned with collecting metrics that help you monitor the NFE infrastructure and exposing these metrics to higher-level fault management systems that can actually introspect and analyze and automate the management and fault detection in your data center. So like I said, barometer does testing, integration, deployment, and upstream development on a metrics collection. And that's what Kristoff is going to talk to you about, the upstream projects which barometer actually does contribute to. And I will try very briefly to explain what that project is. And Kristoff will actually give you some more useful information. Yes, Collegdi is a pretty major piece of software. It is kind of a veteran in the... Okay. Perfect. So yeah, Collegdi is a pretty major piece of software. It is kind of a veteran in the deployments across the industry, very well deployed. It is there for about 16 years. During those years, Collegdi was continuously evolving and adapting to industry needs. It is written in C, especially Core Demon. It doesn't have any dependencies. And it is built with small footprint in mind. It's open sourced, mostly MIT. Some older plugins are still GPL. But it doesn't have any dependencies. It is platform-independent on most of the available operating systems that are there. It is providing you the ability to collect multiple metrics and events, included in the Collegdi repository, there is over 140 of them of various types. Some of them are reading the telemetry from various pieces, like applications or from the platform, hardware, or many other places. It's also able to write this telemetry to multiple ways, to Norbont, either to the file of the CSV or to some time series databases like InflexDB or any other. And there are also binding plugins in case the plugins that are there are not enough for you. You can write some Python scripts or Java applications and feed them into the Collegdi or Demon to dispatch those applications for further integration with your analytics stack. There are also modules for logging, handling notifications, aggregation, thresholding, filtering metrics. Interesting plugin is the network because it is able to read and write the data over the network with the Collegdi-specific protocol. So Collegdi can be treated as a client that is producing the data, but also as a server that is receiving them, do something with them, for example, aggregating and forward them somewhere further. We know that Collegdi provides us the ability to collect the metrics, but which are kind of interested for you? Why would you like to choose the Collegdi actually? There are existing standards, organizations and bodies like Etsy or CNTT that are working on the documenting specifications that are listing out the set of metrics and capabilities that you are particularly interested in the NVV architecture. Today we are focused mostly on the NLVI, the platform telemetry and part of the traffic telemetry, but there are also possibilities to scrape the application telemetry directly from the VNFs with some of the plugins, for example, DPTK telemetry to push all this data to some telemetry databases for analytics engine and closing the loop with the providing feedback back to the manual systems to make decisions about corrective actions. So what's more available in the Collegdi to monitor the NLVI? There are plugins like MCE log, PCI errors or log parser that are able to provide you specific counters about, for example, memory errors that are happening on your teams through the Intolerant Sure technology or RAS features which are basically features built for reliability, availability and serviceability which are helping your platform to serve you longer even if there are any failures occurring. The Intel Research Director technology allows you to monitor per process ID or per core your cache utilization of the last level cache or memory bandwidth. VIRT plugin provides you the insights into the live VIRT domains so the compute, storage or networking insight, the VMs. There are integration for OVS and DPTK that allows you to see what is happening on your network with some packet processing counters including errors and drop rates that are occurring there. There are Python-based plugins that allows you to write this telemetry to the OpenStack for consumption. You can also push this data to the Kafka, to AMQP, to Prometheus or, for example, to the VNF EventStream which is a project in the ONAP. You can monitor the health of the storage or power consumption or something closer to the platform. In case you are, for example, selling the resources of the cloud to someone you may be interested in the Out-of-Bent telemetry which is provided via Redfish or APMI and there are also PMU counters that may be interested for you which are monitoring the low-level counters in the processor which may be useful in some cases like branch misses, mis-predictions or cache misses. So now let's get back for a moment to Barometer. This one's working again. Okay, you may have noticed that I like asking questions. So how does Barometer relate to Collectee? Well, Collectee helps us to collect metrics and that's the core of what we want to do because no matter what you're going to do with those metrics no matter how you want to manage your NFE environment you still need those metrics to be available and easy to access in whatever format you want in whatever higher-level management or automation that you use. So Collectee helps us collect the metrics and if this project didn't exist basically we'd have a lot more work to do in Barometer. So it's only fair that we try to give back to the Collectee community and we do this not only by upstreaming our own features but also by helping the Collectee community in general onboard new contributors, review pull requests and also Barometer itself provides a load of testing and deployment tooling which feedback into the upstream Collectee CI and provide validation information to developers on their pull requests and also assists release time to actually validate the Collectee releases and make sure everything is working. So if I want to play around with Barometer or Collectee and take advantage of all these new NFE features there what can we do? Barometer takes care of some deployment tooling as well that makes it easier to install and integrate Collectee into whatever system you have. You could also install Collectee from a package manager and configure it yourself but this gets a little bit tedious after one or two servers. So what we've done in Barometer is we've containerized Collectee and we've written a bunch of ansible playbooks to automatically configure all the plugins that we think are relevant that you can also put in your own. So this one-click installer will let you install Collectee as is or install it alongside InfluxCB and Grafana or alongside Prometheus. And this is a few examples of how the metrics could actually be consumed and I will talk about some of the pros and cons of these reference deployments. So first up is InfluxCB and Grafana. This is a very simple architecture. You dispatch the metrics from Collectee via its network plugin and these are sent to the time series database in InfluxCB. From here you can grab the metrics for whatever offline analysis you want to do hook it into any existing tooling you have that talks to Influx or create your own tooling around that and pull those metrics or very simply you can write out of the box and get some nice grass Grafana and if you're running Grafana 4.0 or above you get some basic alerting as well. So Prometheus is very popular especially when you're talking about Kubernetes and cloud native infrastructures but there is a slight problem when you try to deploy Prometheus with Collectee in that Collectee has a push model for metrics and Prometheus has a pull model. So Collectee as it doesn't have any in-built storage has to put those metrics somewhere until Prometheus pulls them. So there's two plugins that do this. There is the write Prometheus plugin and there is a Collectee exporter. Both of them work in the same way in that they create a small little web server which hosts the metrics until Prometheus comes along and scrapes that remote endpoint. For infrastructure scales this becomes a little bit problematic because Prometheus is scraping a whole bunch of remote endpoints and that takes a non-zero amount of time. Eventually what happens is the time it takes for Prometheus to scrape the metrics from all the hosts in that time Collectee will have created more metrics and those will overwrite the existing ones. So you end up with larger infrastructure missing data and another issue with this is that the timestamp recorded by Prometheus is the actual scrape time and this may not be the same as the collection time for the metric. So if it's a small deployment you can probably get over that because it's a small variation but as you scale up the differences become more and more profound and this actually limits the rate of which you can collect metrics so there's a lot of trade-offs that have to be made. I'm pretty sure it's something else to say about that but I'll figure that out. So the issues here would be the metric selection time is not being preserved and the latency involved means you have to trade off as you scale up. I remembered for a second what else was wrong. Normally when this happens you would just deploy more instances of your application but Prometheus explicitly operates in a single server mode so there's always only one Prometheus instance. If you want high availability you deploy two or more Prometheus instances but you can't share the data between them. Each Prometheus instance will be scraping all the endpoints so that doesn't really solve the problem of latency. So that's where the service telemetry framework comes in. This is pretty new in that up until Wednesday it was called SAF but we had to change the name. So in this case you still have collectee running. You still have the same plugins configured but instead of exposing a local scrape endpoint or a remote scrape endpoint for Prometheus all the metrics are dispatched over AMQ and then received on the other side in the STF application which is hosted at the moment on OpenShift. The metrics then are pulled off the AMQ bus by an application called Smart Gateway which exposes the metrics on a local scrape endpoint to Prometheus and Smart Gateway also takes care of the issue with the right time versus the scrape time. So then the metrics are available in Prometheus the same way as they were before and this also takes into account events and those are available through elastic search. This looks complicated. It actually ends up not being very complicated because all the orchestration for that is taken care of by the service assurance orchestrator which actually deploys all of these for you. So with that we have the metrics available and you can make them available to whatever other system you want with maybe a little bit of effort, maybe a lot of effort but there's a lot of reference limitations and a lot of choices. I like to use the STF acronym here so you can use these metrics to stop your system from being stressed to failure or you can use them to see the future or Christoph can tell you some ways that we're actually using them. Okay, so let's start with the first one that was actually being used pretty recently in November. So during the KubeCon in San Diego they have deployed a... We've been asked to start again. Is it not working? It should be working. Can you not hear? You can hear me. Okay, perfect. So yeah, they have deployed full open source 5G network. They have made a call from one city to another and as part of this virtual center office there for the monitoring the actual barometer have been used. So here we can see a Grafana dashboard that shows us some statistics from the system. So pretty cool big stuff. Now let's get to something simpler. This is actually just a proof of concept. Here on the one server we have two VB and J instances that are running in hot standby mode. So one is actively processing the traffic and the other one is waiting in one standby mode. They are deployed on two separate NUMA nodes. So they have different memory regions. And the resiliency part here is that if the one point on an active VB and J instance memory is getting corrupted during the time it's just getting degradated. The telemetry from there is scraped from the MCE log plug-in. It is dispatched to the Prometheus. And if the increase of the corrected memory errors is increasing too fast because usually memory is starting to generate some corrected memory errors, but small amount in the time. But as they are appearing more and more it's more probable that we will hit the uncorrected memory errors that could crush our platform. So before that actually happened we may find out the increase of the happening of the corrected memory errors and do something with it. So in this proof of concept we are just triggering the remediation action which moves the traffic from one VB and J instance to another just to simulate the high reliability. So that was one of the first proof of concept to show that it is possible based on monitoring the platform telemetry prevent the outage time or shorten as much as possible any service interruptions. But there are more than just memory being corrupted. You can also watch for example temperature headroom to prevent any CPU throttling or you can watch for the last level cache occupancy or memory bandwidth to prevent any noise neighbor impacting or affecting your workloads. You can combine all of those metrics into some similar indicators about half of your platform or a computer node which leads us to the second proof of concept that was doing actually that. So we have two compute nodes managed by the Kubernetes. We are scraping the RDT, PMU, IPMI and transfer technology metrics. We are pushing this to the Kafka stack for streaming analytics which we are calculating this host health indicator and it is providing this information to the Prometheus. Now let's take a look at this new component there that we are seeing the telemetry hour scheduler. This is extension to the default Kubernetes scheduler that is making it aware about the telemetry to help it with the scheduling decisions. So you can feed their policies which are monitoring the particular metrics and you can say if the platform for example is healthy you can deploy there something new. If there are some minor issues or the resources are getting really being saturated then you can just keep what's already there but do not schedule anything new or if there are any critical issues you can evacuate everything and reschedule on more healthy nodes. So by monitoring this metrics you can perform those actions and do some service healing and platform urgency. Then I can just quickly tell briefly about the parsing demo. On all of the slides at the bottom there is a link to where you can find more detailed information about those demos. So here we have a Kubernetes cluster that was running the VCNTS spots that were using pull mode drivers so they were eating 100 CPU all of the time. The platform telemetry has been pushed to the inflex DB and then it was being monitored by an analytics engine that was previously trained to find the correlation between platform telemetry, CPU core frequencies for performance and packet drop rates. Let's see the results. The red line here is the actual traffic pattern from one of the operators. From peak to peak it's 24-hour period time on the top and the blue line shows us the power consumption. On the top we are using the default Linux power governance performance settings so it is keeping all of the core solos on the turbo. In the middle we are seeing the on demand but due to the 100 CPU utilization it's also keeping very high power consumption and at the bottom we can see possible saving of the energy due to the lower core frequency being managed by this analytics engine. And as we don't have much time I will just skip that. In summary there are much positive changes that you can do by monitoring the platform telemetry going through the service healing, energy optimization, quality of your service. There is also possibility with the Intel Thread Detection to find the threats if someone is not trying to attack your platform which are based on the PMU metrics for example. But also there are OPNFV projects that are utilizing barometer and colegny. For example we have spare bottlenecks and yardstick that are using them in the testing phases. And as use cases are still growing the software still needs to adapt and evolve to metham which leads us to the next plans for example in the colegny and in barometer. So we don't have much time left based through this. Up next barometer in the next six months we hope to help contribute to the collective 511 release particularly for a new DP2K telemetry plugin which will use a new telemetry API in DP2K and to proceed the existing DP2K stats plugins that are available. We want to get the capabilities plugin merged and that provides some static system information.  We are hoping to do more work on our collect DCI to actually run more validation tests and help to verify collective patches and releases in an automated fashion. Always documentation updates and there are a bunch of metrics requests and collaboration requests from the Mano API working group and from the CNTT group which is the common NFV testing task force. So they want to provide a bunch of new reference limitations and unify efforts across a bunch of different projects in the Linux foundation and outside. If you want to get in touch we have a weekly Brommer meeting Tuesdays at 5pm UTC and bi-weekly collectee meetings Mondays at 3pm. Information about both of these is available in the mailing list archives and you can get in touch by contacting the relevant mailing lists for both projects. And if you want to try out some of what you've seen the best place to go is GitHub and Brommer and collectee source code as well as the service telemetry framework to get started with documentation on collectee their wiki is pretty comprehensive and lays out all the configuration instructions for each individual plugin. If you want to dive into plugin development in collectee we put together a plugin development guide in Brommer which is focused on getting your first plugin up and running and if you want to get involved by contributing features or share your own requests or requirements that information is on the opnfe wiki on Brommer's page all of these links will be up on the schedule later so you can find them there. If you want to contribute to collectee there is a bunch of different things you can do down to starting with symbol testing or you can contribute changes both features and bug fixes or you can provide code reviews more information on that link and if you just want more information you are welcome to comment on pull requests asking for clarification and if you want to get involved there is actually a collectee meeting happening later this month in Munich this is the second one and we are going to be discussing things like features testing strategies, upstream processes release processes and discussing architecture and requirements we are going to be discussing the next major release of it and we would represent a lot of efforts to make collectee more cloudy things like an API for submitting and querying metrics and for dynamic reconfiguration of collectee because at the moment it is pretty static in this configuration and also features like so that they will be a little bit closer in functionality to the two other collectors that are available information on that schedule on the etherpad and meet up information on the mailing list and before I finish I would like to note that it was not just us helping with this work usually when you get someone up presenting it is easy to forget that a lot of people contribute to projects as well so I would like to thank these people that helped with various demos, development and requirements and driving the projects and does anybody have any questions? I had calls to look at collectee recently and every time you add a new data source out of plug-in it seems to somewhat limit its scalability you are kind of bound to waiting for a new collectee release to add a new plug-in to get that new piece of functionality are there any plans to make that more dynamic? That's part of the discussion for 6.0 as it might require a major re-architecture of the quality internals so there are plans to make it more dynamically reloadable as part of this qualification Do I answer your question right now? Yeah, the question actually was that there is an issue with the collectee that if you want to change the configuration you have to restart it and are there any plans to change it? So yeah, the answer is yes Now you're presenting an approach which takes certain layers on top of collectee so I guess it's between the benchmark or how the scale or what's your opinion on how to size the system for operating this? So the question was that So the question was that collectee produced a lot of metrics a lot of disk space how does this actually scale and what we've presented here shows additional layers of complexity and do we have any benchmarks benchmarks for scaling or guides for scaling? We occasionally run benchmarks in terms of storage mostly the metrics are just batched to remote locations and things like Prometheus are designed for long-term storage of the metrics so typically they will be aggregated and archived to reduce the amount of metrics you have to actually store Fortunately the time's up If anyone has any more questions feel free to come up afterwards Thank you


X marks the spot for award-winning sales and service at Oxmoor Toyota. Visit our state-of-the-art facility today for exceptional service focused on customer comfort, tour our showroom, and our huge lot, offering a premium selection of new Toyotas and quality pre-owned vehicles with a safety inspection performed on local trade-ins and previous owner information available as one of the top-rated Toyota dealerships in the region and a dealerator.com certified dealer we pride ourselves on offering an exceptional buying experience easily schedule your service appointment online 24-7 our team will exceed your expectations with exemplary service and conveniences like valet assistance for easy pickup and drop off rental cars with free shuttle service and a convenient nighttime drop box a staff of five service managers to personally discuss your maintenance needs complimentary car washes with all service visits plus professional detail available at a low price relax in our customer lounge with free coffee free wi-fi and eight televisions and Tuesdays are reserved for the ladies get your nails done while you wait complimentary plus get 10% off service and parts remember X marks the spot for a convenient and relaxed buying experience with exceptional service go to ox more Toyota today you'll get more at Oxmoor