Good evening every good evening everyone So you've made it through day two of Drupal con I'd like to get just kind of a show of hands on Kind of where the room is far as Drupal developers or site builders. How many of you would call yourself? Maybe like a Drupal site builder. You don't write too much code, but you use Drupal every day Okay, how many would you call yourself theme errs or? something like that Any developers in the room All right, cool pretty mixed bag, which is good. So today I'm going to talk about Building a blog with Drupal 8 I've changed the title in the last week or two because I really think the key point of what I'm going to talk about is that When Drupal 8 launches, it's going to be the first I think Drupal Release that on the day it launches you can actually build full-featured websites with In the past we've had to wait for contributed modules to be ported to the new version of Drupal and Really Drupal 8 it has so much functionality built into it out of the box that that you can actually build quite a few sites With Drupal 8 that it with Drupal 7 core you just couldn't do so a little introduction about myself I'm my name is Bob Keppford. I work at Media Current and I'm a senior Drupal developer there I'm going on about a year there and it's a great company We build websites. We do Drupal. We do Content strategy as well as designing and theming and back-end development And we're looking to hire developers and themers So if you're interested come by booth and talk to one of us and we'll get you started in the right direction I also do a newsletter every week called the weekly drop, which is a Weekly rundown of the latest news in Drupal. So if you have Interest in Drupal, and I think you do since you spend good money to come to this conference You'll probably find the weekly drop is something you'd be interested in So check that out if you're not already subscribed Also, if you are a subscriber and you like the weekly drop and want to make you know help make sure it continues I am selling t-shirts in the Drupal store and So you could go by there and pick up a shirt and that helps not only me, but the Drupal Association So that would be awesome All right, let's let's start off with the kind of a rundown of what's new in Drupal 8. There's a lot of changes in Drupal 8 and there's some of it has been controversial but I want to make something clear if you've heard kind of Screams and moans from the developer community about Drupal 8 as a site builder as somebody building sites in the Drupal admin It's not a drastic change. It everything is kind of in the same Works basically the same way as it did in Drupal 7. It's just improvements. It's more of an evolution In the design of Drupal. So we'll cover some of these topics New field API changes HTML 5 improvements The content editing experience is much better Improvements to form and display modes mobile improvements views is now in core Which is probably one of the single biggest improvements to Drupal And several other things that we're gonna we're gonna go through a few of these One at a time so HTML 5 When we say HTML 5 obviously we're talking about more than just the the dock type and in Drupal 8 There's more Drupal or more HTML 5 integration within Drupal so That includes several new elements that are in the field API and one of those is picture element And this really helps if you're building or trying to build responsive sites and you want to be able to Provide a good image quality to your users on multiple devices But you don't want to waistband with or you want to maybe provide art direction With the different on the different devices So you want to have some control over which image is actually displayed depending on the screen size and so the Picture element was added to HTML 5 and that allows you to do this and you can kind of if you look at the code You can kind of see how that works basically there's media queries in line And this is supported out of the box with Drupal 8 you can configure this and It's a it's a big win you can do this in Drupal 7, but it requires the picture module So another another cool addition is the date element in HTML 5 spec The date element allows you basically to specify a text field form field is actually a date and that will allow the device you're using to Use that context of what kind of data it's expecting and provides you a calendar or a different type of Input element so when you're using a computer Something like like say the Chrome browser you get a nice calendar Pop up to select your date and whereas in the past like you may have to use like a jQuery library or something like that to Provide this functionality. So now this is just provided by the browser. So that's in Drupal 8 the new element other new elements are email and phone and again, it's the same kind of idea because the Browser is going to know what what to expect what kind of input to expect It makes it great for so if you've ever used a form on your on your iPhone or your Android phone And you need to enter in a phone number and it provides you with the the number pad This is it just works like this out of the box with Drupal 8 Another probably one of my favorite HTML 5 Attributes is the placeholder attribute so on any text field you can add a placeholder attribute And you can kind of it's kind of like a tool tip basically within the text field So if if you're the user is expected to enter a phone number you can it provide an example of what that looks like and it's Just grayed out You can theme this with CSS of course But this is something that's just supported out of the box in Drupal 8 now So all these were kind of HTML 5 elements. These are all a part of the field API now And but there are several other improvements to field API So there are modules that have been added One cool thing is that comments are now filled so you can control the display and the ordering of comments What in the UI now in a much easier way? The entity reference field has been added to Drupal core And this is a module you use quite a bit if you want to create like a relationship between One content type and another content type so that you can link back and forth you can link between users You can link between nodes any type of entity and this is extremely powerful module in Drupal 7 that I use almost on every project and now it's a part of core The link field has been added to core as well as the email field and the telephone field and But you know those are just things that you're almost going to use on almost every site so let's move on to content editing and This has probably been one of the single biggest gripes for folks that are evaluating Drupal is that Editing content has not been the most beautiful Process in the past and we often get compared to WordPress and how much better that UI is and that experience So the lot of work went into the user experience for editing content on Drupal And one of the things that people have been screaming for for years is basically a whizzy wig out of the box set up in Drupal core and For Drupal 8 CK editor has been added as the whizzy wig of choice And it's not just like a kind of a bolt-on thing where yeah, we have a whizzy wig editor It's actually very tightly coupled to Drupal so that whenever you're creating content types whenever you're using editing content in any way It's really configurable at the same time as it. It's easy to set up and I've done a little bit of work with whizzy wig editors and like tiny emcee and CK editor and CK editor is really a night. It's probably one of the best whizzy wig editors out there Their API is it's pretty easy to work with It's mobile friendly It's skinnable. You can customize it. It's not that big of a deal to write a plug-in for it And so I think as you start to work with it if you need to extend it It's you can find that that's easy to do So I think it's a really solid choice as a whizzy wig editor another cool feature that gets you know kind of Use a lot and and big talks about Drupal 8 is a inline in any inline images and Again, here's another thing that's always requested and can be a pain to set up and out of the box Drupal 8 Has any you allows you to insert images in line with captions using CK editor We also have in place editing now in Drupal core So this really looks cool when you're doing demos and I'll show you what that looks like But basically it allows you to quickly edit content without having to make three or four clicks to get to a node So and finally we'll look at we'll look at real quick about the improved publishing and user experience for for just creating a node So the whizzy wig editor, so here's a quick little screencast of the CK editor in in action So we can insert images and it's nothing, you know, it just looks like a pretty straightforward whizzy wig editor But it's so nice just and I have to set this up on every side anymore You can configure it turn, you know different buttons on and off and that kind of stuff But it's just nice that we don't have to assume That or we can know that there's going to be a CK editor installed on a client site We don't have to make a decision there. We can we can assume that it's going to be available And so this makes developing Drupal sites a lot easier in my opinion One of the cool things that you'll notice is that we're able to Have a published and unpublished It's not like a to checkbox anymore, so if you've ever had a client request that you have some sort of draft state for your content and or that It doesn't really make sense to a lot of folks that are using Drupal sites to create blog posts and stuff like that That you have to check a box to say this is published or uncheck a box to say like this is unpublished And so I think as far as user experience that the the improvements on the node form or just use are just huge So you can basically it's it's been converted to a button which some of us developers might think is a little trivial But I really think it's a big deal to people that are using Drupal So in place editing As a developer and as somebody that's used Drupal for a long time It's not something I'm too excited about but I guarantee you clients will will really like this So if you go to your home page and you want you found a typo right on a blog post And you want to quickly edit that you can just basically on the contextual menu You can just click edit quick edit actually and then edit the post and it'll be saved right there without actually going to the node page Which I think is Really handy for somebody that's not that familiar with Drupal. It's just really easy to go in there and make a quick change So let's get a little bit deeper into Drupal forms and field display changes And again, here's there's not a massive change in Drupal 8, but I think it's a it's a pretty good change So previously you had managed your field sorting. You had like a managed fields tab, right? Now there that's been split out to a managed form display and a managed display And so you can control the order of an element in your form on one tab And then the display of that in a separate tab and your managed fields is It is in its own tab So basically it's just it's just a little bit easier to identify where you need to go to update your content types And we're going to talk a little bit more about this views display or view display modes basically are We're all familiar with that if we've built a Drupal site So out of the box with Drupal, you're going to have the full display mode Which is like if you click on a tab or sorry if you click on a node And you go view that full full node You're going to see the full view mode display But if you go to your home page the river of news kind of you see the teaser display And there's also a display mode for RSS feeds But out of the box Drupal 7 that was pretty much all you got like if you wrote your own custom code You could extend that But now in Drupal 8 You can create your own view modes and what a view mode is is basically just a display of an entity so This really what what using these view modes is really powerful because you can create different displays for an entity And then you can reuse those displays without having to every time you create a view add Custom fields and custom order you can just set up like a headline view mode You can set up a teaser view mode you can set up an image teaser view mode and then the theme those And add your CSS and then you reuse those styles all over your website and without having to Add in custom template files for every view or write, you know custom code in your template dot PHP file So you can use these view modes over and over on your site Which is really cool and but it's been kind of something that wasn't well supported in Drupal like you could easily write like a hook entity info alter function and declare Your your view modes and add new ones that way or you could install the several There's several different modules you can use to install But it's it was gonna only kind of partially supported in Drupal core You had to add this extra functionality to be able to use it So now in Drupal 8 you can create and manage your view modes for all entities right out of the box You can have view modes for forms or you can have form modes Is what they're called or view and view modes and you can customize those per entity So basically if you're familiar with the view modes Then you're gonna like this because you don't have to install entity view modes module and you don't have to write custom code Just to do this if you're not familiar with view modes I suggest like Investigating that a little bit more. There's a really good talk from Drupal con Denver about these and why they're awesome or just Google Drupal view modes and and look into that because I think it's it's probably an area of Drupal That's not really known as much about I know a lot of developers use it and are aware of it But I don't I think a lot of people are just not aware of what they can do with that. So do investigate that So basically If you go to the view modes page, you can just basically add a new view mode in the interface and You know, you're not you're not the right custom code for it. So for each Yeah, I don't know why it's Don't know if it's gonna work. Apologize. This is screen resolutions a little bit different or something Let's try that. Does that work? Yeah, there we go All right So basically like these are all different entity types of content user taxonomy So each can have their own different view modes And you can create this from the interface, right? So you don't have to bug your developer buddy to do it Or you don't have to install a separate module Alright, so let's talk a little bit about mobile So everyone in here is probably aware that our sites need to be ready for mobile users And people are visiting our sites on mobile devices. It's it's just a fact of life. So Drupal should support that in a much better way than it does currently and If you build a Drupal 7 site, you can do that But it takes quite a bit of work. You need to worry about your theme There are modules you have to install to handle images there are you then you when you're dealing with tables That's a whole other problem to deal with So Drupal 8 a lot of work has went into the mobile front of Drupal 8 So all the themes in Drupal core responsive and that sounds like really good on a slide, you know But we do need to realize that's just Bartik and 7 so that's two themes. But it is that it is it is important I mean is the admin theme is responsive and and the theme that it ships without the box is responsive. So that's good The mobile toolbar is also something that's been back ported. You can you can use that in Drupal 7 now but basically When you're on a mobile device you get this icon type display you see here And when you're on a bigger screen you get the icons plus text. So It it works really well I you can actually install Drupal on a mobile device So you can you can be using you can basically open up your phone to the Drupal.org or whatever slash install and Actually run the installer from a phone, which is pretty crazy, but that's that's how deeply mobile is supported It's not just for content editing or viewing a site And one of my favorite decisions was to kill the overlay module I think we all probably don't like Overlay module was basically if you clicked anything It's like at slash admin or you edit content instead of actually going to that page an overlay would pop up in the window and then load that page within the page you are already in and There's yeah Yeah, so horrible for accessibility horrible for threeming Killed kittens all that stuff is horrible. So we're all glad it's gone I am sad for anybody who put work in that that their work has been Tart and feathered for so many years, but yeah, I don't think any of us are very sad. It's gone so I Think pretty much everybody's here is probably excited to use in the core like why did it take so long? But with views being in core like that that's that's a huge for several reasons Not it's not just because we don't have to download an extra module because when something is in core Versus it being a contrived module Developers of modules can assume that it's there and so they can use it and so that's exactly what's been going on I think there are still a few Listings in Drupal 8 that are not using views. I may be incorrect about that But most of the listing pages and lists in Drupal 8 now our views event if they were static Basically static functions or are you know hard-coded functions before they've been converted to views Which is really cool because that means you can modify Things in the admin that before would require would be more complicated to modify And probably most of us wouldn't do that. So now most of these listings in core our views It's easy to create feeds because of that like so Out of the box seven you you could create an RSS feed pretty easily But now you can create a JSON feed you can create an XML feed basically any view So if you're familiar with views and you use it it's there. It's not Very different at all, but it's in core and so that really helps helps us out It's just the same views you know and love already. So so here's an example of Here's some lists. I basically a list of different views that So you look down this list so content so your content admins of you your file displays of you the front pages of you Listing of users of you recent comments So a lot of the blocks that were hard-coded before are now views so you can configure those to make them actually useful And you can you know customize your front page? I mean a lot of these were actually things that we just Disabled and replaced with a view in the past as like a media current and probably a lot of you've done that So it's just these are just kind of best practice that have evolved over time and now now they're being put into Drupal core So one of our favorite things to hate on is blocks, right? so You might be using panels or or Context but there have been improvements major improvements to the blocks API so a lot of blocks in Drupal 7 are hard-coded which basically means you probably aren't using them because they're hard-coded And they're hard to change so you would just replace them with a view But now many of the blocks are views and not only they be used They're configurable because now they're full entities which means that we can add custom fields to blocks and And so imagine so it's basically like a block is the same as a node now Basically so you can add fields to it their view modes for it So they're they're a lot more valuable now So they're they're not they're not the same as nodes But imagine all the flexibility and what we do with content types that is pretty much the way a block is now another feature that You know just didn't work in Drupal 7 is if you put a block in one region You couldn't place it in another region. It couldn't be rendered twice. You'd have there's a special I can't remember the name of the module, but there's a module that does that but now that's not a problem Drupal 8 supports that out of the box and I mentioned custom block types which Unless you've actually had a need for it kind of sounds crazy probably But we'll look at just the the custom block library. So we it's really easy. It's the same as basically creating a content type so They're out of the box. There's one block type but for example say you're running a blog and you have sponsors and you want to create a Custom blog type that has a field for the sponsor ID or maybe a field for Some JavaScript or something like that something horrible like that You could do that really easy without writing any custom code So you create a custom block type and then you add the fields you need to it and all your fields are available So you can add images to your blocks and so it's just it's just another powerful tool So if you think about all the things that you could do in Drupal 7 and all the modules that these are all All these features are replacing it becomes real clear that you can actually build a lot of the sites you built in Drupal 7 with a bunch of contrib modules with just core now and I would really like to see folks start building install profiles with Drupal 8 actually just showing kind of what can be done out of the box Because I think it'd be a huge selling point for Drupal so we've talked a lot about building sites and Cool functionality mobile and things like that one of the things that's been kind of neglected is is Basically helping users that are new to Drupal or helping people that are content editors of Drupal sites Helping them figure out what to do There are some cool JavaScript libraries that will kind of guide you through a website when you log in for the first time if you've ever used I believe some of like Basecamp. I think does this. There's several I think github does it as well But the first time you log into the site You get kind of a guided tour And so there's a module of a Drupal called tour and now that's in core So you can create custom tours through your site for Your client or for your users that basically walk them through the process of doing something on the site And I'll show you a quick demo of this the views module has this set up already So you can kind of see how to work with the views interface So basically you click a button that says tour and then it basically gives you text and When you click next it gives you instructions and it points to different parts of the page And so I mean you could do this before but it required setting up You know a jQuery library that would do this and Now it's just a part of core So now when you develop a custom module if you're a developer you can actually ship a tour with your module to describe How it's supposed to be used And then this is just you know, I mean there's so much in Drupal now and there's so many features that You know it sometimes when I every time I talk about this It just blows my mind actually because so much is is out of the box just set up for you You can use it in seven. Yeah, I think I think there's a I'm not sure if it's called tour module Somebody can in the room probably knows the answer to this, but there are there's like I think a couple modules that kind of do this and I believe there's a software as a service that will help you with this process as well Yeah joy ride so there's there's a I don't know if the modules I think there is a module called joy ride, but I think it is just a Rapper for the joy ride jQuery library if I'm not mistaken. All right, so We built the site We've kind of used the tour module to give our users a guide through what we've done But we haven't really addressed the developers too much and and like what happens after we launched the site And we need to make changes and we need to make sure that the configuration that we wrote in the initial build gets Gets updated on the production site without losing any user data. So a ton of work has been put into the CMI or The configuration management initiative and basically if you're not familiar with this Drupal in the past has stored configuration as well as data or content in the database And and really the fact that it's stored in the database is not really the biggest issue The biggest issue is that it's not done in an API kind of way that it there are different ways that different types of configuration were stored and it It just kind of it has evolved over the years. So This is a big pain point if you're developing Drupal sites and the scenario kind of goes like this This is one problem. We develop a site, right? We commit the code to get maybe we push that up to our production server Now we have people using the site creating content Users are creating accounts and things are changing things are moving fast. Then the client comes to us and says You know what? We need to add a new field to this content type And we need to do that. We can't have any downtime We have live data and all this so we so we pull down the database We add this new field and in Drupal 7 there's a way to kind of work with this It's called the features module and there are other ways to do as well But typically we'll we'll update the feature module and that all of our configurations stored in code there But if you've used the features module it works most of the time But that small percentage of time whenever you hit problems. They're a lot of a lot of trouble. And so Getting getting your configuration that you've worked on in your dev environment up to production Is quite an orchestration And a lot more complicated than it than it needs to be and so a lot of work is going into Drupal 8 that basically handle configuration of modules anything is configuration in in one way and do that across the board and so I'll show you just kind of basically what is supported so you can take your Drupal site build it and Export all your configuration into a tar g-zipped file And so all of your configuration for that site is now in in in the ammo files And we'll talk about what they are in a minute and then you can take that file the from production pull it into basically import it into your Development site and you have the same configuration then you can make changes on your on your development machine and export those changes and then upload them to your production site and None of your user data will be affected at all And so what are you what how does this look so basically? It's really simple and this is the out-of-the-box supported way in Drupal 8 There's obviously going to be other ways to manage your configuration With like git and and your file system and that kind of stuff But this is this is the idea basically you go to full export You click a button and you click another button and you have a tar g-zipped file with all of your configuration for your complete site You can also do single important exports of like views and different pieces of your configuration But this is this is like the supported way to do it and it's a huge win Obviously, there's still going to be Extention extension of this like the features modules probably not going away From what I've heard from the features modules of the folks that are Developing that is that it's basically going to be something that you install that will help you Compartmentalize your configuration into features that similar to what you have now But now that Drupal handles configuration in a standardized API way the features module code is a lot more simple and a lot of the issues we've had over the years will be going away so What does a configuration file look like and what is it? When you when you download your configuration It's it comes out as a YAML file and YAML is a looks a lot like JSON or XML except it's a little bit cleaner They're just basically configuration files and you can see from this one. This is a File is this It's a field right in ID so Basically, they're pretty easy to read you wouldn't be editing these by hand usually you're just going to be exporting them Making changes in the UI Every module is going to ship with it with the YAML file, which is all of its configuration as a file. So This is a huge improvement over what we have now so The point of all this Obviously is that you can build Drupal sites with Drupal 8 that you couldn't do with Drupal 7 You don't and I really want like today is not a good time to build a Drupal 8 site that you're going to launch I think Dries addressed that the first keynote But I think it's not a bit It's a really good time to actually start playing with Drupal 8 and testing it out if you're a developer. I mean It's a little risky like to build your own personal site with Drupal 8 in that you know whenever the next alpha comes out It's probably not going to be a smooth upgrade path But I really encourage you like to check it out like you can go to a simply test dot me and install Drupal in like I think like two minutes or something like that and you have a Drupal installation in the cloud for like an hour and you can just play with it and then you just leave and you know It'll be destroyed if you want to Install it locally. You can do that as well There are several ways to do that Pantheon as well is another way like I know that they've been advertising this week that they have Drupal 8 in Installations that you can set up for free So there's several ways like to get it to try it out and kind of kick the tires But there's a lot of new things in Drupal Eight and then I had things I didn't have time to talk about better multilingual support web services You're just getting all this stuff out of the box. So Definitely, I'm excited about Drupal 8. I hope you are too. I've got some links in my slides here for resources That you can check out after the slides are posted online MediaCurrent has a Drupal 8 series that we have been updating over the past I don't know when we started it a bit as long time ago and It's good stuff. There's some good stuff on aqueous site. I also recommend again the weekly drop We have I have like a lot of up-to-date stuff as it's coming as developments are coming coming through the pipeline So Yeah, I'm excited about Drupal 8. I hope hope you are too Please evaluate the session and if you have any questions, I'm not guaranteed. I'll have the answers, but I will I will respond So anybody have any questions? There's a mic here if you want to come up and ask Yes, it is and I would say This to the about about what that question is CK editor responsive is that if you're using CK editor now I would really recommend checking out like four point three or it is a four point three or four point four Whatever the latest releases of it because they've made huge improvements and it the older versions were not responsive at all And now now it is it works really good on mobile devices as good as a wizzy wig can I mean we all hate wizzy wigs But you know, I hate that one the least so first I just want to say thanks for the weekly drop that it's been an awesome resource So I really look forward to getting that every week. So yes I was curious if The export feature for configuration is going to help do away with strong arm as well I mean is that going to help export variables that exist within other modules? Or is it really just for exporting your content types and your fields and that sort of thing? So I was waiting for the configuration management the strong the strong arm module that we use now in Drupal 7 Yeah, okay, but so when you export something It'll be included all configuration is is I was saying y'all configuration is is output as a file And that's true. I went to the configuration management talk yesterday Just because I know you get to get these questions and I know there's been a lot of changes in the last like three months So everything's exported as a file, but all your configuration is also stored in the database because of there were several concerns like Performance was one security was another And the user error was the was the third one But that's a configuration change like you can switch There's just like this basically a setting in your in your Drupal settings file And you can say like I want all my configuration written out to the file system But out of the box It's all going to be in the database and it's always in the database Until you hit that export button and then it exports all of the configuration files So for every module all the configuration is in stored in the yaml file. So thank you for the wissy wig Editor are there is there feature parity between the input formats and the buttons you see on the yes to bar now Yeah, like when you this is what I was trying to say with like the tide integration So when you installed the standard, I think it's what it's called still the standard install profile when you're doing the Drupal 8 installer It's it's very tightly set up So if you set up well out of the box like it has the bold and italic and link those are all set up in the text formats I haven't tried making like a custom text format and a custom wissy wig configuration But so I don't know that that happens. I don't think that happens automatically But it is set up.  So that's if that answers your question It's a CK editor module if you can like it's It's definitely not the wissy wig API module There I don't know that there's really much. There's I don't think there's an upgrade path at all with Drupal 8 and 7 It's a migration path. So I Actually don't know the answer that because it it's now in course I don't think like if you there's not a Drupal 8 version of CK editor, but If it if it does inherit any of the code from the CK editor module, I would not expect it to be very much Yeah, any more questions? All right. Thanks. I thank you all for attending and enjoy Drupal Con


We're back and time to look at what has been trending in terms of conversations on the social space, like we say, we want to bring them up right here on the breakfast. The first trending story, the road traffic agencies were told to form a task force over the Ojua-Legba Bridge crashes and yesterday we talked about some accident on Ifako Bridge and it involved a tanker and it gave us the opportunity to look at the incidents, the high incidents of heavy duty truck accidents in Lagos state and we went back in time from 2016 to see the headlines that we kept having and how many people had lost their lives you know and headline after headline you know trailer truck crashes into commercial bus trailer truck hits five vehicles three dead you know tanker falls down, crushes car, container falls off and it's been on and on and on and so I think yesterday we what I said was you know the authorities especially the Road Safety Corps need to have a special plan and program for the heavy duty trucks at least in Lagos because there's something wrong and but but this would do a leg bad bridge on its own it's actually famous not missus for falling containers, 40 feet containers and stuff off trailer trucks and what we're told is that the Lagos State Traffic Management Authority and the Federal Road Safety Corps in Lagos State have formed a joint task force to address the incessant truck crashes on that particular Geo-Lagos Bridge as well as other road accidents in Lagos state. The general manager of LASMA Apology Oriagba still at this when he received the new sector commander of FRSC and his team in his office so I hope this is not just a statement but it's something that they actually are going to follow through and I'm happy it's coming now because we talked about it just yesterday morning so it's fantastic so do you like my bridge I'm sure you've talked about it once or twice what will the tax force be doing and what are the people the individual constituents of that tax force doing right now because if you have a duty to perform if you perform it well you don't even need to get to set committees set joint tax force set this and that everybody now talks about just looking at papers car papers and all that I know there's something called road wordiness who checks that how do they even check it these containers go on our roads in a populated city like Lagos without latches they just go there nothing to hold the containers and then these trucks like you said earlier breakdown so much that is alarming what happens why do they break down who checks them whether they are road body you enter a bus and then there's a bus in front of you and the smoke coming from that bus is choking you in another bus behind or another car behind except you have AC and you wind up and all that and then nobody talks about it they talk about road wordiness what kind of road wordiness are you thinking about who do you check and who does this who should check who should make sure that the vehicles on the road are in good condition so that they don't harm other people we lose lives that are not supposed to be lost it's terrible you know you know in understand I mean you have go there it's like we would ask that you know ordinary these these agencies have their work you know they are their roles you know they don't have to form a meeting but well I think at least you're doing something I know that last month doesn't have any legal backing to check your particulars the Japanese EO officer one between Jibo or Balindi and wherever there is traffic kefi street okay air commander one over one two he jumps and then they go there yeah and then they try to I know it's funny and all that but the thing is I think the FRFC has more of a role to check these particulars but they have regulations road safety regulations that have been updated I think 2021 or 2022 you know and if you go through that document there's a lot that they're not implemented they are not there's a lot if you go through it but the thing about it is that if they want to implement it I think maybe 50 percent of people who are driving on roads who stay at home you know yeah but but the thing is you're saying that these guys ordinary they need to do their jobs so they don't have to have a meeting they join committee to but anyway at least they have acknowledged it and they want to do something about in fact the MD or GM of last month hailed in the statement release yesterday hailed his organization yeah for how last month for how it had been rescuing accident victims particularly those involving truck crashes in the state fine mr last month GM fantastic but we don't want there to be victims we want this to be prevented like they say prevention is better than cure but well one one thing he's saying is that um for sequel to the need these are his words to prevent further loss of life and property through truck crashes you know on a drill like by bridge last month has deployed trained officers to be redirecting heavy-duty trucks and tankers from a drill ever bridge article route so that I think is sort of like a sort of solution you know so is it they're not going to use the bridge anymore because the last one that happened was really sad remember the last house like a couple of months ago where the container fell on on a mini mini bus yeah it was it was so sad and including a child and the mother passed on you know so that's really sad but it's also saying that they are the agencies collaborating with agencies like the state ambulance service that's what they should normally do the legal emergency management agency access one name are legal spy and rescue service and nsc dc but that's what they should you said the way regulations that have been updated and all that at some point they told us that if your car broke down on the road there will be a towing van that will take it to the nearest place that it will be safe and maybe a mechanic a mega a mechanics workshop or something somewhere that it will be safe but now it's a nightmare for any legosian to have his car break down on the road because first of all the area boys will come and obtain what they should not obtain ordinarily and then people will come that will tow the van or the car and then you pay through the nose so what happened to the largest so to speak that they were going to give legosians that they will tow your car free of charge to a place where it will be safe and then you'll get a mechanic to come repair it that is not happening anymore so a lot of things in the books are not translated into the physical thing and i don't know whether it's a different realm that the laws exist the regulations exist the things that they need to do exist so if this collaboration will make them sit up no problem but it's it takes more than just coming together to get the job done you know you know that's that's it it takes what are coming together get a job done i had an experience i think on saturday coming from her from i think around them um uh a jar you know bridge you know let me say flyover yeah towards vgc and the vehicle i was in had a fan belt belt issue and you packed this is this is about maybe three p.m four p.m packed just underneath the the the new flyover being constructed at vgc within two minutes what no 30 seconds boys came around and they are make me helpful now wait till they happen ah and they were willing to help you know if i wanted to show that's where we could get a new fan belt to buy and when the driver went to buy the fan belt he rushed to go and call a mechanic who came with his tools and he helped but you know um my security awareness had already kicked in you see my phone i put in the pigeonhole i didn't put in my bag and then the driver's phone i hit it so many when is when i say take your phone unfortunately the car been wound down all the windows have been wound down and he went with a key um a moment is a minute or so three other area boys came around and they were playing i thought they were playing until i heard the sound of a breaking bottle yeah bottle yeah i thought we played until i this you said that you know when accidents happen there i thought i heard the sound of a breaking bottle against the wall i realized that that play i've done something serious one of them was chasing the other with a broken bottle and he was trying to prevent him i said you know what i'm not the reason why there's problem like today i picked my stuff left the car left it and just cross the road to to a filling station at the entrance of vgc and took some fresh air took so fresh air you know these days we have to pick opportunities to be heroes yes uh you know you should be here every time so so these are so and what you're saying is that we've seen on their twitter handle they're saying they are looking for waiting for you know touring truck to help too but you're saying that the real experience of negotiations is that when your vehicles break down these guys ask them to pay them money yeah into their private bank accounts yes it's really sad all right let's let's go on to the next top trending story let's let's talk about transportation and we had something similar yesterday uh a brt bus uh yesterday wednesday um was gutted yesterday when it was gutted by fire uh on ifako bridge in word in world of gudu the bus uh which was on ifako bridge in world so gudu um coming from ianae owaru uh was burning that's by the heavy rain in the morning and that's why we saw that traffic heavy traffic there um we hear that whilst the rain was on men of the state fire service were seen um trying to contain the incident we should get about 10 25 a.m that's why i saw that heavy uh traffic a thousands of motorists coming from k2 island uh from the island rather heading towards k2 iku do amongst other areas or left stranded uh on the bridge you know that's that's all we're told there's a bit more to to this story uh than this because i'm i'm hearing that uh something happened uh and that some community boys you know did something to that particular uh uh bus but we had a commercial a commercial bus driver died you know there was a collision there was a collision between that brt bus and then of course commercial bus and the driver died now the the the the story is that that bus brt was actually set up leaves it was set on fire because of the death of the commercial driver maybe yes downfall like we call it in legal state um it was a head on collision between the brt which is a legal state bus rapid transit uh service it's owned by and embedded by you know company uh under the legal state government um or for the legal state government um that was a difficult the driver we had of the commercial bus some assaulted we some assaulted and twice uh died instantly as a result of loss of control due to over speeding is what some reports are saying okay of course we wait for more but last time i already put out a statement uh they confirmed the accident and they said they are operatives rescued seven passengers with various degrees of injuries when i hear them saying they rescued you know so i wonder did they just go and take them or did they pull them out themselves but that's good um so they've done their preliminary investigation they put out a statement there they've put the blame on the commercial bus driver you know saying that these bus drivers these double drivers do not stop you know do not um slow down do not stop over speeding they don't adhere to speed limit signs erected by government across the state and that that is true okay i i i agree but but just a final one yeah uh the gem of last month um mr reagba you know has worn members of the public particularly area boys or what we call street urchins not to take law into their hands at any accident scene but to allow appropriate authorities to handle the situation so that's what is believed that it's set fire to the priority yeah um on monday i think we talked about mental health and all that um i i understand that some of these people that drive the brt are just people who were down for drivers as well and i wonder how yeah i wonder how the training is so funny the training for these drivers are because they still behave the same way you know when when the brt had an accident with the train just a few weeks ago it was because the the brt bus driver did not stop and the passengers were saying that they kept warning him do not do what you're trying to do do not cross at this moment and he didn't stop he thought he was smart enough and then it resulted in the loss of lives many lives and other people who were injured as well it could have been prevented so we now we now think about okay if you're employing somebody to be a driver so somebody who will be taking people from one destination to the other i mean the name of a government yes yeah so what kind of test do you give them what kind of training do you give them do you evaluate their mental health capacity to to to take some decisions to do what they're supposed to do do they subject them to all these things we're talking about police needing um a evaluation psychiatric evaluation or something we also need the drivers the pilots everybody that is involved in taking care of the lives of people even if it is for a minute okay and i'm not sure these things are done so while they're blaming the damford driver he's dead i'm gone he cannot defend himself i think they should also look into how their own drivers i'm talking about government now how their own drivers behave because sometimes they talk to you anyhow they don't explain to you anything they they they are very rude to you the drivers and even the ticketers and everything in that chain so the government should look into these as well so that some of these things can be avoided i i i i look at them how they the company involved you know they try to do professional things and i think they train them well you see blood is thicker than water at some points because i've used the brt services and um at some point i said to myself maybe the female driver should be allowed to drive all the buses oh you had a different experience from what i had with the female driver but one day i used that service i changed my mind okay none of them should be driving you know so it's sad what what negotiations who will have to grapple with using the public you know uh bus rapid transit services um we have to go um but but also sad that you know these street urchins are able to the fact that we know street urchins government is you know is trying to tell them the you know uh you know tell them to do the right thing we shouldn't be having these this kind of you know thing in our society you know we shouldn't be having if you if you get stuck in traffic in some parts of Lagos even that stretch at night you just have to lock your car and pray to god in Lagos all right we'll take a break and then when we come back we'll delve straight into our new separate review segment stay with us


The first thing is to not lose track of all the tools and what everybody's purchasing. I think being very considerate about are we starting to use this resource and where's that catalog eyes, right? Like where can I get an overview of all of the things that we're using, right? A lot of the problems actually with the cloud is people spin things up and later on they lose track of it or there's employee churn or someone gets assigned to a different team and then six months later someone looks at this and says like, do we still need this load balancer, right? It's just like, it's such a trivial resource in every AWS account, right? And you're like, where does it point to? Is that workload still running? Oh, there's some Kubernetes cluster. What is going on there, right? And I think essentially there's a lot of solutions, that help you create this catalog of things that you own in your cloud provider, but also overall like which services are we running? What is part of which service, tagging strategies, right? Keeping that overview is really, really important so that you can actually go over the things that you may not need anymore, right? Because a lot of infrastructure is just laying around producing costs, not actually being used. And that's a big focus of it and obviously very, very important in the Kubernetes space. Every customer I talk to is on a journey to public cloud, some at a much more further stage, advanced stage of adopting cloud, but the reality is almost every one of them is hybrid, right? They've got assets in the data center, they've got assets in cloud. And as they move to cloud, what we see is especially in terms of the cost of operating in cloud, the dynamic changes, right? Because up to now it was all about how do I make sure I plan ahead of my budgeting cycle and make sure that I'm planning for my CAPEX expenditure because I've got to go justify to my CFO that I need to go buy, purchase a whole bunch of hardware, set it up in my data center and then make sure I've got enough capacity, right? So you had dedicated capacity planning personnel that would be responsible for that and determining how to optimize CAPEX. Well, today the world has changed, right? You put it in cloud, guess what? You've got enough resources there, right? So the whole optimization of resources becomes less important. You still have to make sure you've got the right resources and the right place to meet your SLAs. But the problem is how do you make sure you're optimizing the use of those resources, right? Because any cloud provider will give you all the assets you need. The problem is that bill you get at the end of the month, right? You don't want to be shocked. You want to make sure you've budgeted for that OPEX and most importantly that you don't have assets that are idle, that you're not using, that you don't need. So technology that helps you look at that, look at your patterns of usage, understand where there's opportunities for optimization, right? Where you've got idle resources, especially in modern Kubernetes environments. We've embraced Kubernetes in a big way, right? With our own Helix SaaS platform, because ultimately Kubernetes is basically a very scalable architecture, really helps us deal with large volumes of data, managing at scale. But it's also important to make sure you've got the right resources, right? If you don't have the right resources, you've got overallocated resources, especially if you leave it to application owners, they're going to ask for all the resources they want. So understanding trends, understanding where you might have optimization opportunities, both in a Kubernetes environment, both at a cluster, as well as a container level, shifting the mindset from a capacity optimization, capacity planning sort of approach to more of a continuous optimization, continuous cost and budget optimization sort of motion. When you think about cloud and you think about cost, you have to think about it in a few different ways. And it's important not to get tunnel vision in the first, which is that first phase that I spoke about of just moving to the cloud, running more efficient and then optimizing for the cloud. You have to think about it in terms of infrastructure cost in that first paradigm. Second is how is developer productivity and developer time as a cost being incorporated into my cloud strategy? And third and really the future of cost considerations is what are these cloud investments doing to my business in terms of creating differentiated value? I think if you've got a well-rounded perspective and you think about cost in cloud and those three paradigms, you're touching on all the important things that you need to be thinking about when you make these large scale transformations. Don't try to do everything yourself. At the end of the day, you need to figure out what is your core business and stick to that. Best of the things you either collaborate or work with partners, try to deliver a solution, have a better go to market strategy that will always help you achieve your goals faster and in a more efficient way. So that's the usual thing, which I believe sometimes are missed out specifically for startups and some of the small companies. Bigger organizations are very streamlined to give any advice to them. So yeah. The simplest one is to find KPIs that make sense for judging your effectiveness. And it can be a little bit weird because you might not have been tracking some of the information that you need to actually make all that go. And I don't think that having tracked KPIs should keep you from thinking in the terms of KPIs. So for example, I think if you look at your systems and say how many times do I have human intervention in a process? Or how many times does this process fail to complete when I run it? Even if you have trouble coming up with an exact number, I think that you can ballpark in what you want that to be and what it is today. So in some cases, it's an obvious answer. You want zero human interventions. That's not actually even a realistic number. What you want to be able to do is say, all right, I want to go from 10 interventions in these systems to one intervention in these systems. And your teams can actually give you pretty good feelings for how those work, or they can give you a feel for how long a system would go before it needs some type of maintenance or repair, what I would call the half life of your automation. So if your team thinks that they could leave automation in place for six months and not touch it, then that might be a decent goal. It could be that they have to tweak things every week and that's not acceptable. So I think there are very concrete ways that you can talk to a team and find out where they're spending a lot of time and where they think they could improve without even looking at it. I will add one thing that we really started tracking is an interesting metric from a composability and reuse perspective, is we actually provide users of our software with a simple metric of how much of the software they're using is out of the box, meaning straight out of Racken's libraries and how much customers have managed to add or customize. And then they can even look within their own additions to see how much of that is going on. And so our target, just to give you a feel for it, our targets are over 90% of the automation that customers use should be out of the box, standard libraries. Most customers, when they're using things like Ansible or Terraform, writing their own plans, they're down in the 10 or 20% reuse and shared, maybe even lower than that, depending on how things work. And so that type of reuse is really a toil indicator where people are reinventing things or adding components that they have to maintain. And so for us, this KPI of standard libraries is a huge component in success for how well people use automation. My biggest advice is, one is don't just cut costs without the context. You know, this idea of being able to make your service efficient and make your team efficient needs the context of the value that you're paying for. And so one of the metrics I think about is sort of the cost to serve, right? You want to serve your customers at a certain level, but there's a cost associated with that. And if you can get down to those unit economics and truly understand the value, you might be spending a lot of money on cloud, but guess what? All of your customer revenue is dependent on that cloud being up and running. So you can't really just look at it and say, okay, let's cut costs. There are some try-and-true methods and low-hanging proof that you can use, absolutely, reserved instances and other kind of cost optimization techniques, but those have to be put into context. And I think that's my biggest advice is to make sure that you have that context as you're approaching whatever cost-cutting activity you're doing. Obviously, being aggressive about cost-cutting is really important, but at the same time, tempered with an understanding of what's gonna break your business as opposed to just excesses that are unnecessary. Nothing can be changed without a company decision. And if there is a change in culture that is gonna accompany every process that you run, this is something that can really create value, but just buying a tool, just optimizing costs, just firing people is not enough. We're gonna revert to the same kind of old habits. We continue to grow at cloud costs without any experience and whatever. But if engineers understand that cloud costs suddenly has significant meaning and they start to be responsible for what they're doing, and it's really the same with as we construct DevOps just a few years ago, that engineers understand that now operationally they are responsible for their code. So now they're responsible financially as well. And if a company can really get that shift in motion, then tools are gonna help, and companies can be significantly better in what they're doing. But first and foremost, it's a decision that the company need to make, and you need to back it up, you need to change the way that they're thinking about cloud cost and everything will flow from there.


That's the state where you can find it, too. Is that the old radio box? Of course, they don't even mention it. We sat next to each other. Do you remember that? It was before the campaign even coming out of the way. And I remember it because the several speakers before that, one by one, I'm crossing off lines in the middle of my mind. And I'm not doing it. Finally, I'm down to the one. He asked the resistance that I was saving. And that was gentlemen. India and China, 40% of the world's population, both their leaders, understand full well. And on our side, we have a great chance with both of them, Mr. President, because they instinctively like to do business with us. Our problems are too full in taking advantage of that tremendous opportunity. One is on technology transfer, we will say. We've got that straight now in China. With India, we're just saying how we think provides the adequate, safe balance. If we don't speed up on the technology transfer to India, it takes six months now to get something approved. We want to bring that down to one month. We can do that if we have a defense on board. Like they came on board with China, so we're going to do that. I think it's well worth doing for us, because India is a non-consonant nation. It means that our co-comp partners can send stuff to them without an export license. If you're an MOU, they have to give us an export license to show us who's going to buy them. That's one problem. We can whip that. Second problem is adequate. I'm going to follow up. Hello. Nice to see you, Mr. President. Have you met Reagan? No, I haven't, Mr. President. How's it going, sir? How's it going, Mr. President? I haven't. How do you do? I'm good. Good morning, everybody. Sit down. Thank you. Well, we're going to present to us young men. Well, it's a great elastic person, and it's not through the printed page and whatever. Right. Well, I know the time is short, so I'd like to make a couple of specific proposals, which I've taken the liberty of putting in memo form but a single page each, no more. And if we have time, a couple of other ones that might be mentioned. But one problem that's been exercising me for quite a long time is what I call equivalence between Soviet representation in the US and other Western countries and the other around. Now there's obviously an imbalance. There's no uniformity of policy as between the Western Allies, either on the principle of representation or on the principle of expulsion. Now, once is an exception to the rule, but for once I think the Brits are ahead of the ranks. And that is when the Heath Administration expelled 105 KGB and GRU men in 1971, 14 years ago, a fundamental decision was taken if anybody at any time is uncovered as a KGB or GRU agent, that man is not replaced. Now the other day, for example, two months ago we expelled four soldiers. At that time, the permitted level was 43, it's now 39. And each time that happens, it goes down. Now, I don't think you have that principle. I'm not aware that any other Western country has. If you look at the strictly diplomatic, intended to be diplomatic representation, there's a slight imbalance. Right. He was correct. He thought that Washington was in a rhythm over here and he was really... and not Washington has. I made a mistake. He correct me. He's looking forward to visiting your presidential library. He said, we're trying to make them all. Yeah, right. Sure, we need to get the same conversation over. Right? He went to CSM in college for a work that could stand as a coffee wheelchair. It was a kind of art.  And it was the seat of... Oh, he's just shaking. He's going to put in these words. Yes. Right. Here's a hint for you. Oh, thank you so much. Thank you so much. Is that his paper window? Oh, that's nice of you. Thank you so much. And thank you for having him. You don't have to be here. And that's... Thank you for being with me. Thank you. You're welcome.


Thank you everyone for coming I know it's a pretty late session. I thought you're gonna be out when the Sun is already out Thank you very much for coming to our session and the end of the day We're gonna talk about data caching strategies for LM training and serving with Alexio My name is Jasmine I run the open source community open source the devrel team at our company and I'm a partner Lou she's one of our machine learning engineer and she's also our open source project member community member For those of you I'm gonna explain a little bit about Alexio since not all of you know about us So we are a open source product that is started at UC Berkeley samplap back in 2014 And then it's about seven eight years now You know right now we have about 13 actually it says 1200 so a 1300 contributors That in our community and it's still growing that number more than 11,000 right now on our slack community. So if you're interested we also have the slack link there We're recognized as one of the 10 most critical Java based open source project It was written back then so it's still Java based by Google and open SSF And then we're also named one of the more most valuable repositories on github So if you're interested to check out our community slack, I'm usually on there We recently also won one of the first I to believe open software service award just of earlier this year So that's how they open source. So what do we do? Basically, I've lay out a structure there So this is what we used to do in the past when there was the hybrid cloud and a multi-cloud era So on the bottom of you see is basically all the storage so that you can you know where you can get your data as three Azure Hadoop Minayo all of those and on top you see all of the compute engines So Alexios and it kind of sits between the storage and a compute So we bit basically build a virtual distributed system that is a layer That helped to virtualize across all of the data sources to serve data to the applications Regardless of where your data sources regardless of their storage So that solution is applicable across environment whether it's in cloud or on-prem bare metal or containerized We do like I said, we started as open source project We are however if for a product company so the company has both the open source team and then a close enterprise team We do offer two type of product regardless. So for example uber and meta. They are using our open source software They use a lot so local cash to help them to improve their performance If you are interested you can check out the raptor X You know article from the presto team in Facebook back then right now on the meta team And it will be also recent release to engineer blocks on how they use Alexio local cash to help them to build their AI data platform So those are the sort of the companies that we serve and as Alexio those includes both the open source Users and then the enterprise customers. So we do have some Differentiations between the open source one and then the enterprise one for the area enterprise customers They get different features and support. That's another team that deal with that All right, so what do we know we're now moving to the AI you might be wondering so what do we do now is Alexio We used to serve in the sort of hybrid cloud air air now in the air AI air We see a lot of training from the large volume data to learn from the data set So that's where we come to space because at the end of the day so we're back to So Data management is under spotlight as company seeks to out Competitions, so Hey, I was an expert. Okay. So in the new AI at the training large Language models requires the data readiness to have vast amount of data and then whole storage and processing and protection Can be costly now. What do we do here? What is that meant being by data readiness? So that it requires high scalability and a high availability and high performance And those happen to be the things that we can do So Alexio at the end of the day the technology that we build is a large distributed caching So the data cache in this case it can help to boost performance and Then to help with save your cost and to prevent network congestion fetch data ones from remote data storage to repeat it Data excesses and to offload ender storage by bursted highly Concurrent AI workloads and put challenges on ender storages. So that's where we come to help That's today's agenda I'm going to introduce my partner loose and she's been working one of our machine engineer working on the LLM caching strategy Okay, thank you. Just mean So today I will have like a three main agenda The first one is what's our caching strategy based on different traffic patterns that we collected from our users They're actually like production data set and their traffic patterns and how based on how we based on those traffic pattern to come to Get the Strategies caching strategy to mess out the performance and the other side We also have the LN caching strategies that we collected from the production wallows And not only we will share our to share our experience with you folks We also want to have some discussion about some future direction that we can integrate into the AI machine learning the full life cycle So the first one is the traffic pattern and the caching strategies from AI machine learning So we know that catching plays a crucial role in the accelerator for AI computation But as we work with different users, they have really different traffic patterns and leading to different performance oriented catch strategies and recommendations So the first one is what's the data assess pattern for our production wallows So we figure out that there are two Many two scenarios First scenario is that the data is stored in some large structure files. For example, the arrow files in this case We found that there's much more precision and render risk than sequential risk For example, you may want to recent columns of the whole file Or you may want to assess some blocks and we found that the block assess is almost evenly distributed And each read is quite small It can be four kilobytes read in arrow And we know that for small position render risk, even our local disk doesn't perform that well And on the other side, we also found another pattern that the data is stored in many small semi-structure or unstructured files Which is pretty common in computer vision chaining The file number could be pretty big like larger than 10 billion files and the file assess is almost Evenly distributed for example, maybe each changing each training client. They want to read a batch of files and Then based on the traffic pattern that we just talked about what's the Hatch strategy that we recommend first we target performance so for performance side, it's quite similar to what we did in our computers like in our computer like science they have L1 L2 catch to boost the performance and Similarly in training part it also use the hierarchical catching Like first we utilize the system file buffer catch Which is leveraged memory that and then can provide the training files the training data at the highest best performance But we know that like memory is limited resources, especially in the training I heard that many people say that like they only have like a really limited CPU memory And that's become their bottleneck And so on the other hand many of our users they actually have local MV and E So by utilize the local disk page catch like we have we can We can put the pages like one megabyte pages into the local disk to boost the performance and on the harder hand if local disk is still not enough a Remote catch a separate catch cluster that closer to changing can help us to provide data Much faster than remote storage, but still like have a much bigger capacity So another recommendation is about how we optimize the position and render read So once suggestion we give to our user is that we preload the data So instead of loading only private data, you can preload and then to catch the whole file And another suggestion is that not just so for example We want to read 100 kilobytes of data from offset one megabytes and instead of only reading 100 kilobyte We can read data in trunk for example one megabyte So it helps that if the user the client they continually want to sequential read the file It lowered the request rate from like 10 times to only one times if they want to follow in data set However, if the user they only want that 100 kilobyte and then they jump to 2 megabyte and read the following 100 kilobyte Then in this case we actually have a 10 times re-application So it kind of a trade-off between whether we want to reduce a request number or we Will care more about the re-application issue So that's why Usually when we work with our users we want to know what's their actual traffic pattern So that to see what's the better catching strategy and read strategies and On the other hand because of a different assessed pattern So our users may not know in the beginning that what's our what's the capacity they want for their catching So the scalability and elasticity For the catching the catch capacity is important that they can add more catch or remove catch when they need it and So also there's another pattern other than the data assessed pattern It's about like in recent five years We see the growing demand for the cloud strategy and many of the users They move machine learning infrastructure from on pern cluster to cloud cluster Out that hybrid or multi-cloud environment to serve their machine learning infrastructure So here we present a general idea of a hybrid or multi-cloud machine learning infrastructure So on the right side is the off-line off-line training platform and on the right side Maybe like run your your right side right here So it's the online serving cluster and in the middle is the storage system So in the first step we on the on the training platform So there is a unified catching layer which responsible for fetching data from the cloud storage and to serving the data to the training cluster and On the online like serving cluster So after the training down the model will be written back to the storage and on the online serving cluster There is also a catching layer to help fetch the model and quickly deploy the model to other serving nodes and Based on this new hybrid cloud pattern So what kind of suggestion will we want to give for this scenario? So the first one is because it's hybrid and multi-cloud environment We want to be cloud friendlies We want to be able to switch different like training platform and also switch different storage system and We also want a configurable catch at the mission and evasion policy That we can get the data when we want and then if it if we don't need any more and on the other side a Training job it can take like weeks to do so any single point of failure in the data Providing will cost them the basically the training job to fail So any catching strategy need to be able to fall back to the under storage This means that if some of the catch is not available or the whole catch is offline We are still able to provide the data from the under storage to the users and for the cost perspective like For so many of the users they can actually complain about the storage cost So one part is that many storage like as three today. They are basically charge you based on the API cost So and also the data transfer cost basically how much data your job actually read the data from the cloud storage and For training job, we may need the same data set again and again So if we every time we need to go to a storage to fetch the data So it will be a high cost for both the API call and also the data transfer and Here is a general idea of how we can integrate catch with AI training platform So we have a AI training node which running some training jobs And we have a catch client that is deployed in the training node and in the middle We have a remote catch cluster which have multiple catch workers to serve the catch So the training know may want to real specific data set It will talk to the local catch client if it has local catch Then it will directly return the local catch and if there is no local catch It will talk to the remote catch worker node to get the data that they want If the worker node have the data that's great It return the data if the data worker node does not have data It will talk to the under storage to get the data That's a general idea of how the catching can be integrated with AI training And we also have some evaluation results based on the pattern that we just discussed Remained the pattern that we discussed previously about the data access pattern Like the first one is some large structure files And for this case, we actually get some production machine learning data set from our users And also we replay their traffic pattern on different re-strategies To see which one actually give them better performance So in this case, we evaluate two re-strategies The position read and streaming read And in this case, we see that the blue one is the position read latency And the red one is the streaming read latency And in this case, the streaming read latency is much higher than the position read latency That's why like a properly black position read all performance streaming read When reading large machine learning data sets And on the other hand, we also evaluate the small unstructured files We also collected the production data set from our users The original data set is pretty large And we sampling like 10,000 files from the data set And also we replay the traffic pattern So here we see a pretty different pattern Still the blue one is the position read latency And the red one is the streaming read latency And in this case, the streaming read latency Is actually slightly better than the position read latency So basically like streaming read all performance position read When reading small unstructured files So previously we talked about the catching strategy Actually based on different like traffic pattern And how catch can be used in AI training And now we want to talk about the actual catching strategy That we collected from the different users Like Microsoft, Sharpie and Jihu So in the first case, like what's their challenge That they face in their large-level model pipeline So this structure basically catches like many of our users They have actually different clouds They have their training clouds They have their offline cloud Like their on-prem cloud And also they have their online cloud for serving And so this cause they may be far away from each other And they have different storage systems Some are in the object storage Some are still using like traditional HDFS And so for the training clouds So they want to do the model training With training data in the object storage And in this case They first directly get the data from object storage And indeed, so what the problem that they face is that They found that the model training The GPU utilization rate is lower than expected And they also have their own offline cloud Which they still using like spot machine learning To do the training on HDFS data set And in this case, they found that their HDFS is pretty overloaded So basically like training We usually get the data like in dozens of QPS And this will have a really huge pressure on the persistent storage Which are not target for the burst like training workloads So in this case, their storage like cluster Maybe like basically like when you have some right job That want to write for HDFS It may be blocked by the request Or maybe have a really high latency And also in other hand for the online cloud Which we do the model serving After the data is changed from the model training clusters And the model is returned back to your persistent storage And the model need to be as quick as possible Deploy to the model serving platform And the time is really important in this space But consider that deploy the same model to like a large amount of nodes You need to read the model from the storage to every node And this is really easy to have a network congestion issue And the strategy to have a distributed catching Is that we basically add the catching layer Between the training the model serving and your storage system So the training data can fetch once from the under storage And provide to model training again and again For example, your training may have like a large amount of app parts Like a large amount of iterations on the data set Then you load once from the object storage or HDFS And you catch it in the catching layer closer to your training cluster And then you provide those data from the catching layer to the training cluster To offload the storage and reduce the API cost And on the other hand, it also like improve the model serving model deployment phase By having Alasio to load the data from the storage system Have a monopoly replica in the catching layer And then quickly deploy the model to the serving cluster So basically having a distributed catching It can have a high performance metadata and data cache Assess with catching And you reduce pressure on the persistent storage and network And also like the catching solution Need to have industry standard access interface Like the process API to turn the catching into a local folder format And S3 API to assess the data storage Just like assess S3 data set HDFS API to assess the catching just like assess HDFS So the applications can assess data transparently Without the need to modify the cost So that's an evaluation that we do Like compared to training directly from storage Which have a really long time in the data loading Like data loading here takes out 82% of the time duration And the GPU utilization rate is only less than 20% And while having a catching layer The data loading rate is largely reduced Which directly results in a higher GPU utilization rate And this one is like we collected from one of the users Like they basically is the latency that how long it takes to deploy the model And on the left side is the chart Is the number, the latency that they deploy the model Without having a catching solution When they directly fetch the data from their store Fetch the model from the storage And in this case it normally takes like 15 minutes to deploy model And the middle part is that When they start onboarding the catching layer And the time you can see the model deployment Is reduced from 15 minutes to around 3 minutes And after some performance improvement That we do based on their traffic pattern And the need for their model deployment The time is reduced to maybe like less than one minute Basically like in our shared blog with NVIDIA The benefits of our GPU acceleration are limited If data access dominates the execution time Okay so we also want to share with you guys some of our future direction Like the future items that we want to do So this is a general idea of our future direction Like we say we already talked about How data cache can play in the full AI machine learning lifecycle We have discussed some of the data access pattern And how to integrate cache with AI chaining and serving But maybe we can go a little further What can integrate a unified data catching layer With different components in the machine learning lifecycle The components can be data processing Feature engineering, model chaining and model inference So the catching layer can help fetch the data from under storage And give the raw data to data pre-processing And the processed data can be returned back to the catching layer And the catching layer can synchronize the data With the storage that you want to like sync with Presist the data too And on the other hand the processed data Can be given to the future engineering engine So that the features can be also returned back to the unified layer And similarly for the model chaining It can load the data and feature from the catching layer And write back the model And for model inference it can read the model And write back some of the carry results for future catching So thank you for your attention And joining us today to learn about What's the actual catching strategy for AI machine learning And if you have any further questions Or would like to learn more about Alasio Please visit our website or join our Slack channel We'll be happy to answer any question that you have And provide more information Or how Alasio can actually help you with your AI machine learning workloads So does anyone have any questions? Oh, thank you I have a question So compared to other catching systems What's the benefit Alusia provides For example like Radis Pretty popular open source So can you actually share some live with us Thank you Thank you So yeah As many users when they first on-boarding They will spread Radis as a memory in memory catching But Radis have a limitation like being a memory catching So for Alasio actually our main target scenario Is memory plus disk and mainly the local MVIE Because nowadays the local MVIE actually can have much bigger capacity And the performance are still good Any other question That's it, thank you It looks like it's the last session in the conference I hope you guys enjoy Thanks