Thanks Thank You Martin Hi, everybody My name is Sarah. I am I'm in the open source developer as a developer or in core So I'm not in the mobile team developer the mobile team are all these guys Sunday is our coordinator because it's the open source coordinator. So we share the same coordinator, but Juan Johnny power beta are the main team in working on mobile features all the features I will show you I Know all of them because they are also based on Barcelona with me But there are more people in HQ which help us to improve and to make grow the mobile app like Mary and Helen and Helen with the documentation and Barbara and Alberto with the UX What's new in mobile? 3.3 But 3.3. It's not the last version. It's 3.5. I 3.4 so so why I have to explain this think they have a Nice feature and it's important not to see only the last one It's also important to see other features that have been included during this year And that's why I think it's also quite nice to you see these features These features where this version was released on May of this year And include all these features and after of this has been released after of May There were the releases two more versions 3.3 point one and 3.3 point two and these are the main Features, let's see more detail it First one first release included in This version 3.3 was it also includes three more activities So feedback listen and database activities. So now it's with this version was almost Fully supported from the point of view of the student because from the point of view of the teacher There are also many things to do but from the point of view of this of the student It's almost complete a little bit spoiler about 3.4 News it's done now all the activities are included. So now it's fully fully for a complete so far We will see some minutes ago Now if with the 3.3 version we can also log in via wows So you now with the best if you have this version You can log in through Google Facebook Microsoft directly from your mobile app. So it's so good One of the news in model 3.3 Corp version was the course of a view it includes two tabs It's not only the list the course list that as we know as this version. It's Also a progress Complation if it's enabled so you can see where are you and where what you have to do to include and this feature Has been also include in 3.3 mobile app and It's also include the timeline you can also you can see the list of courses, but you can see From the timeline the tab you can see directly all the Activities resources you have to look for first because they are ordered by time So it's so great Ping forum was one of the features included in 3.1 I think so it's long versions ago and in 3.3 It's also supported these features. So now you can pin your discussions directly from the app You don't have to go to the web version to do it and Last but not least You can now from 3.3 search messages and disable notification sound. So it's also quite important features There are many more features than these you can check for them in the website, but These are the more important and what about the mobile version? 3.4 this version was released on This at the end of November. So only three weeks ago. It's so young And it has these features. Let's see more detail it First is not In the app as it is related to because now from 3.4 version you can highlight the app from your site There are there are some configuration parameters So you if you are an admin you can enable these parameters to show you to the students a link in the future or in the profile So let them to promote the app the use of the app So it's so great if you want your students use more than the mobile application And related with the app the news in the app In the 3.4 version is super for workshop activity. So now we are facing to announce that it's Fully super for from the students point of view or to all of the resources and activities included in the core model version But you can browse all activities. You can submit you can download and even you can work offline If it applies because for instance a chat offline chat. It's not a chat. So it has no sense So now it's fully supported You can now also enroll to pay by PayPal courses So if you from since now you have to go to the website and roll in the website version and after of this You can access to the course now directly. You can enroll from the Mobile app. So it's so great that you have you are able to do a lot of things directly from the app And even more features There is also super for forgotten passwords. I have never forgot my password. I have you ever forgot your password. Yeah Me too, sorry So now you can also recover your password directly from the app. You don't need to go to the web version To new features of 3.4 version That we will spin after of me by Yankee Other are also included in this mobile ad version The you can see the private files quota usage and this they supported the category events There is also super for restricted video videos, which was one of my more asked things in our forum So it's now we are really happy to include this feature and we have improved some myos Related things really with the fighter in and a blowering Have you ever heard about the desktop app? Who of you know there they are? Oh Only Yeah, well done I Recommend you to use a mobile the desktop version it's it includes all the features of the mobile app and Why to use it if I can have a browser in all my laptop if it's better because it has more Things because of the offline capabilities you can go wherever you want with connection or without connection Do a lot of things so it's so good To try it people during these days you have been talking about connection probably problems So this can be one solution for you. So let's see and It's also available for the for different operating system. So you don't have any excuse So you need to try You can download for free In this link it's for free. It's like the mobile app version. So You you have to do And what's coming? Why are we planning to do in the following versions? In the model mobile 3.4.1 with which we will be released on February of the next year We are planning to download all the courses now You can download course by one by one But from this version we you will be able to download all the courses So if you have a lot of courses, it will so great because you can with only Two clicks you will be able to have all of them download it in your app or even in your laptop or Computer so and we look so it will fax some backs And what about model 3.5? We are planning to redesign the app Things inside that it's not Inside that and also we would like to improve the outside the user experience and That's why we are going to need to to make it compatible only with versions with 3.1 or newer versions of Moodle. So it's so important if you want if you are planning to a Use the mobile app Be aware and upgrade your system to at least 3.1 version and It will be equal or This version will only work with hundred five point four and Ios eight We are also planning to improve the way to stop the supper Moodle plugins now it can be done. They are the remote add-ons. How much of you have know about the remote add-ons? Have you ever tried? none So if you have your own yeah, you You If you have your own plugins and you want to open directly from a mobile device you can do it using the remote add-ons He can explain how to do it because I'm not There are a lot of documentation And we can you can ask in the mobile forum with this and I'm sure that he will help a lot but We are planning to improve and to make it easier because now we realize that it's not so easy Are you agree? So we are planning to improve we have a draft specification It's open. It's an it's open. It's our work. We are working on this document So if you're interested in know how it's going to do be please Look for it if you can find I will be so pleasant to For you to show you the link and you can comment on this document and give your opinion because it's so important for us Perhaps we are not taking into account all the things that you know that we will be necessary Now you know a little bit better How? What which things you can do with a mobile app? What are the main features of the last versions? So I think that you probably will like to use the app With your students and it's so it's so important to have some some things Into account when you prepare your content That's why I'm going to try to give you some tips I hope you help you. I hope they help you but before starting with these tips I want to make you two questions Have you ever think about how much time do you spend on devices per day five? Yes It's only mobile or you're considering laptop more things only mobile and if you consider all the devices Yeah Okay, so There was one Some figures from three years ago Now probably will be because it's my feeling. It's the same. It's not now It's I think it's so much time. It's six hours and a half. It's so much time here in la India. It's wow In Indonesia in this time it was nine hours. So there are people who asleep less than a It's with the device even the sleeping so amazing, it's what crazy and Another question Have you ever thought about the time you stay? It's time you look for any device the more for instance How much time do you spend? It's short it's And if you watch it to be it's the same time that the device No, no, I'm sure that The bigger is the screen the longer you stay looking for the application So it's so important to take into account this these things because there is a New concept. I love this concept when the mobile team is pay me. It's a micro moment concept Have you ever heard about the micro moment? No, it's so nice My comment is each time it's quick action you do when you look your device some of them mobile or each each device So it's more related with a smartphones or tablets because it's more It's a smaller so it's so important first step. It's this is for free First step if you create content and you know that they are going to use the mobile phone Just as your students is so important you create a small chunks of information. It's not a big information This is small because they are only staying a micro moment looking for at the mobile So if you are planning a lesson about one hour No, no, it's not working because they are not the same as long with the device And be careful because the mobile It has a lot of good things, but it's also So this rapid so you can be interrupted with messages with you have a lot of things here You can you have games you have so it's so important you Prepare a small chunks of information to make it here to the students connect and disconnect to your contents and Think about the mobile because it's not only to design courses for a small screen it's because I have to create content and it has to be a Show it in this size of a screen. No a mobile phone is more than this So if you're creating content related with and you know that your students are going to use a mobile Please be careful because a mobile has a different input If you ask to the students they write a long Text It's not so easy. They don't have a keyboard a big keyboard So it's so hard if they have to write a lot with the Keyboard of the mobile. So one thing to be careful. It's the things we ask to the students because the input Things is Ways are not the same Mobile let you Two weeks and nice things you can move with it is easier than to take the laptop or to take the Computer and to bring whatever you want and you can be connected So there are more possibilities than to stay in a class there and do things there So you can move and you are connected when you are moving So you have to think what you can do with these kind of things you have more sensors It's not only Same things that you have in class It has it's so small, but I can take a photo. I can record an audio Has a GPS so I can move and knows where I am where I am so Think about the possibilities. We have we can quit it There is emotional connection with the mobile. It's not only a piece of think How much of you sleep with the mobile near your bed I'm sorry, but oh only only I think yeah. Yes, don't to be him yet. Yes, we do it It's it's more than this if you can look at the screen so because you'll get your batteries get off It's like no, I was waiting for a message With nothing happens because but it's more than a mobile and Remember mobile is this grouping So a students can can be Interrupted anytime because they receive a message. They remember that they have to do no they want to play sometime with or they want to Learn some language with so there are a lot of things to do with the mobile so important and Let's start with the tips There are different I will give you nine tips they are going to sit in three blocks a Content there. There is the block. The first one is the content creation. After of this We will see assessment at least at last we'll see a communication So let's start with the content creation block first tip is consider the creation of the content from the mobile point of view During the creation not when you finish Perhaps I could I could do this with the mobile no if you start to thinking about a course please start thinking about from the first thing because probably it's not only to adapt the content to the Application to see correctly it's because you can do more things So it's so important to think all the time that you have this and your students also and they can also So it's important first thing My students will use the device or not. So and if the answer is yes, please think about it When you start to create the content Second tip remember micro moments. They are only staying few minutes looking at the screen So it's important you prepare description short and simple It's I have no nothing more to do because it's micro moments and they can be disrupted. So please try to resume everything first tip related with images Before adding some image You have to think three three things First is the image really required It's the image. It's also because I want to be nice to make nicer the course Or it's really important they a student see this image to understand one thing because it is if it's only because it's nice Perhaps it's not necessary They are they will get more time to to see the course because they will need to spend some data to download it. So Think about it If the image is needed, okay, we have to include some images because it's nice It's it helps sometimes to explain what I'm with where we are going to explain Taking into account the file size It's you I'm sure you will have probably nice photos like like so lines this morning But it's not necessary to put the big the best resolution because Remember the screen in this case is important. It's only this screen. So From pixels or for Megas image. It's not necessary Because with that little more it will be better and a students will save time Downloaded it and will save that if they are connected it if they are not and we feel so Taking to account and it's important to crop the image to show only the Special part that the area of interest that you want to show to the students So remember all the required images the size the size is small As small as possible and The way that the images are shown in the The mobile devices is different in the web and in the app if you open to the web version in the browser Like Chrome here. You your all the images included in a course will be resized it automatically So you don't have to do anything and automatically will be Resized it and in the app is the same but you get an Magnifier glass icon so you are able to see the image bigger So it's important also to take into account and if you want a the students open the image with a high resolution It's easy to do in the application. So You can advise them you can instead of opening the mobile in the web version. You can try the app Last tip related code with content creation. It's the use of rights media content If you want to put an image it's so important to use if it's a photographic Gift it's it's so important to use the current because if not the size will not be the good The it probably the quality It will be the same Related with videos on an audience. It's so important to use this standards to avoid this the students has to install other applications In this case is this is also so important for any kind of fight you are you have to add for instance If you want to your students watch Document it's better to use the PDF format because it's a standard probably they can open Directly in the app without need to insult anything if you use other formats like Docics for instance, it's Probably they will need to install additional or they won't be able to open it So we we were in trouble with it's like no no better PDF or some a standard format and It's so important also to warn uses about the file size and type Why because of if they are going to need a special application to open it It's so important we tell them and it's also important the size because if they have to download a big video I think they will appreciate to know it because if they are at home They okay, but if they are outside and they have no data and the connection is not good. Probably they will wait to We've been a good way for connection to download it This can be done directly in the web The in the web version there is a in the on in all the resources. There are two parameters Which led you to if you enable them you can see the file type and the size directly You check these boxes and when you see the resource you can see see that the file type and the size It's important to take into account that is this is In the app version at the moment this information is not shown. So if we think we have a plot a video And we have checked this box Be careful because in the app is not showing so it's better in this case To write in the description field for instance writes a comment be careful because this is a video of 100 mega for instance So important we will try to add In the app, but now it's not so it's important to to take into account And what about what can we do with the students from their assessment? Point of view there are different kind of activities you can remember We are fully support for all of them, but there are some that is so easy to use and it's so You make you happy and you save a lot of time one of them is the choice It's so easy to create and it's you make for instance make quick kill Make quick class balls in in in class if you for example if you allow the They Bring your own device in your classes. It's so easy to use these prepare some Choice and let them ask some things that you want to know in this moment There's a trick to show the results a life when they are answering So if you are interested you can show How they are both in and how it did the the answers are coming This trick is explained it in in the dog in the model dog How to do it's only to copy some files in the server and so it's quite easy and it's so nice And what about the quizzes? quizzes are also so easy from the student from the point of view of the students you can for instance use them To a diagnose before the training events or even when you have finished the class you can give them some quizzes to check if they have understood so They can answer these quizzes when they are going to the class or where they are going to home So and use the mobile device for doing it. So think about it It's not only the things that they can do in class. It's easy for them to answer these questions from the from the mobile From the teachers point of view have different hands and hats and It's so important to be aware about the length remember micro moments They are only staying few minutes in our screen. So it's better to prepare three short quizzes that one big one I'm sure you will be able always to make them shorter and You will need some time to prepare it It's everybody who has tried to create a quiz will know but we'll save you a lot of time without the correction So Valorate it's I think it's a good thing you can do and it's also very well considered by the students it motivates it them so Taking to account. There are a lot of question types which are Really good for mobile mobile friendly like all the short answer questions And one curiosity remember in mobile the drug and drop question. It's stop and drop. So it's quite different, but It's important to know it and more things I Tell you before a this is more than a small screen The cast lot of sensors. We have camera We have we can make for instance a language in a language class We can use for recording them to the audio to know if the pronunciations is good not as mine in English for instance And you can also make another think about another kind of activities What about a Historical treasure hunt in a city and you have to be seen different Points and take some photos and after of this right it's you can do a lot of things So think about it. It's not only I can't use the mobile in the app It's a lot of things that I can use I can do if I use it last block the communication one The app one of the things that using the mobile in general with any application is that you can be triggered by Notifications all kind of notifications With the mobile app in the mobile app is the same you can get all this the same notifications that you get in the version or in the email So it's pretty important. You configure it. So Be careful and if you make sure that it's configured quite quite well You will need to get the push notifications You will need an a notifier server if you don't want to don't have one you can register your model site to have it Remember yesterday one when Martin tell there No, I don't remember this it's There were a lot of Sites here in India, but we are sure that they are even more than we have resisted it So it's so important to resist it because it let us to know that You are also you have also benefits if you register your site like for instance to use the air notifier servers And last tip It's so important to work to people if you are planning to do something with the students that they you know that they are going to use some Specific a mobile application one then before the the session because on this way you will You don't have to spend some minutes when the way you start the session With this kind of things before finishing only a few Things remember mobiles if we are using more and more a day by day So you have if you know if you have not think about it. It's important. You start to do it now It's not important. You know the latest models It's important to do you know the capabilities the things that you can do with them the mobile and remember so important think about sessions short sessions because the macro moments They are only staying few minutes If you are thinking about to use the smartphone 15 minutes perhaps if you are thinking about tablets It's 30 minutes. So think about it Some few questions I think we have and before finishing if you use the app, please rate it Write comments because we really appreciate your opinion. So We hope you enjoy the app Happy time for questions To use the app is not necessary to register the model only Is inside if you want to receive the press notifications on the mobile. So everybody can do is just to show me Okay, once again, it's a similar question that I have been thinking about You see Android and user security Is a serious problem. I mean There are very few people in the world today really trust Android for security How does it impact us in terms of mood a lap because you know, I Don't know what to say about Android if you know, it says you can they can enroll like or they can login the same that in the web version So it's true that you have to be careful if you share the devices It's so important you log out all the sessions But if you are it's the same that they with we have rosé you open up rosé and they left the session open it on go It's thing. What's your concern? Yeah, so is there is there any other data apart from the browser page that or the app is Android recording any other Data from the app I'm not sure if I understand in the question The only thing would be course information is downloaded into the app Into your local device. Yeah Oh really, I mean Are you worried that a hacker will come and steal a PDF that a student downloaded perhaps? They cannot only download They can do it in the web version So it's not if they can download in the web version, and it's not a problem for you in the app. It's the same Yeah, it's it's not more than the Just a quick thing to add on the files will be downloaded only into the Moodle app Correct not on the device It depends on how the device stores files, but they're stored in a protected area for the app Okay, so there's no chance of The learner being able to share a downloaded file to another mobile. There is every chance because the data security was well because Anything you can look at you can copy Anywhere any device of course I'm asking more in a corporate context where you know, most companies have got a protected system and they've got a licensed Moodle version that's running and everything's run on a An enterprise network that's got a thousand safeguards for information security, but that's not very applicable on a mobile At least not yet There are company specific apps to check Perhaps your mail or you know perhaps attend Skype calls through your mobile but not anything beyond that so It you can't depend on company security to protect your mobile if it's your personal device if it is of course a company issued Device then they'll have their own safeguards, but if somebody's taking a Moodle course on their personal device This data security could Could Be a concern at least for same with desktops if you're on a laptop Desktop laptops company issued ones are Fixed most most of the times if it's a company issued phone, then I assume they'll they'll pick a secure You know Distribution or it'll be locked down. They can't install apps things like that. And so it's the same I think Yeah Sorry, that was the follow-up. The other thing I wanted to check was What are the plans for integrating other applications mobile applications through Moodle? So for example, it can mood interface with WhatsApp Not camera. Can it interface with other third-party apps? So can I use Moodle to create a WhatsApp group and have that as a discussion forum? I Can answer this so we do have plans to integrate Moodle chat with other chat apps via bots Right Because it's all about membership in those groups in Moodle's accounts. Do not automatically translate to WhatsApp So there's no there's no direct method you need a bot that's sitting in the group and is Communicating back to the Moodle course backwards and forwards. It's the only way and not just what's app which is owned by Facebook I just want to remind everybody but but telegram or The other 50 messages the you know we chat is very popular in China, etc So we're doing it through bots Not just sorry not just chat. I meant any other application. Yeah, it could be I Think yesterday I was demonstrating to Tom. There was a paid chemistry lab application and It sort of simulates a chem lab. You've got all these bottles You've got all the chemicals and you just play around with it. Yep. So you can launch You can launch apps through links But the inter app Communication on iOS and Android is not so great I was talking to Apple and they and I they said, what's the thing you'd want us most to do? I said make us Be allowed to control other apps and launch apps and pass files to apps and have apps pass files Yeah, back to us. They don't do it for security Which is the it's part of the security of the mobile platforms. So there are some restrictions to that Okay, thanks. Yeah probably Last question from somebody Probably I'll just add up to the discussion that was happening here. Oh, there you are So we are doing a lot of work for like corporates that you said So one of the things that you would said rightly was about PDFs So we have installed an operation inside moodle itself where the PDF opens there It may not have hundred percent of its operations, but it very well opens there It does not download into a mobile app. Secondly for your scum files. They come in encrypted form So you put that in the memory card generally most of the users do not go to their memory card They decrypted and then they see so it looks like a remote possibility Coming to the third question that you said about linking it with others So we are also working towards it where we're actually like you said through buds We're actually integrating a lot of so it has an inbuilt forum We are also integrating like a face book where whatever you're learning you would probably like to share in a closed community So we are still in the process of doing it, but yes a lot of work is being done around that as well And sorry, where are you from? I'm from Mumbai. My organization's name is Shazatek. Okay Interesting. Yeah, a lot of this is moodle net also that I was talking about also what we're planning is a lot of sharing between things too So I'm just taking over your session Sarah. I hope you don't mind this My name is Rahul. I'm definitely last question so we can move on. Thank you. Just want to add on my name is Rahul I'm from McGraw Hill and we have our digital offerings in terms of connect connect to these other digital offerings For higher-ed customers in India. We have already inculcated the digital platforms through moodle That's a single sign-on through moodle, which could be Accessed access through web as well as through mobile number one and all the applications external tools could be accessed within model from mobile or web. It's doable Okay Thank you. I don't think you mentioned the single sign-on. Did you did I miss the single sign-on? Yeah, you did mention it. I missed it. Sorry. I was looking at my I was looking at my mobile One of the features of 3.0. Yeah, it's a great feature. Yeah single sign-on. Martin one question I have Let's say my moodle installed on a local network. So can I provide this mobile app solution to my employees, let's say Because it needs some public address, right? No, it it talks direct. So you just put the the the URL in the login screen No, let's say my application is on internet. That's good. So let's say That's fine the IP addresses being accessed They only will can use the app inside your Internet, but if they can access in your in there from their workplace from the they will access So they need to be in the VPN. They're mobile as well, right? I believe yes. Yeah, okay. Thank you Okay Although I'm tempted to keep going because those are very interesting. We've got a lot of interest But let's move on. We can have some questions at the end. Thank you, Sarah. Thank you very much for that


Russia better prepared than ever to attack European countries, Lithuanian Defence Ministry. Despite significant losses and the failure to fully capture Ukraine, Russia is now better prepared for potential aggression against other European nations than before its full-scale invasion of Ukraine, said Vydotas Yobelis, a top-ranked official in Lithuania's Defence Ministry in an interview to Business Insider. Now they have experience in fighting large-scale war that should be considered as a part of planning. Yobelis said, if you look just at sheer numbers, Russia now has more people in its armed forces than before the invasion, adding that Russia has the ability to quickly replenish its lost equipment. Russia is correcting some early invasion mistakes, including increasing weapon production to fill gaps and rethinking ineffective tactical approaches. Lithuania must prepare for the worst-case scenario of a Russian attack. Yobelis said as Russia views Lithuania and its neighbouring regions as part of its sphere of interest. Russia is enhancing its military capabilities and could be ready to initiate aggression against NATO countries within three to four years, Estonian Foreign Minister Margus Chakna warned. Russia is preparing for military confrontation with the West over the next decade and only a build-up of armed forces could potentially deter it, Estonia Intelligence warned. On February the 13th, Russia has the capacity to produce enough military equipment and mobilise sufficient troops to offset its losses in the war against Ukraine, the group added.


Push yourself and stop. OK. Hello, guys. I'm Paru. I'm a PhD student at BU. This is like a collaboratory project between Red Hat and BU. I'm going to be talking about how, in certain applications, the main memory can be a bottleneck. And we're proposing a certain mechanism to get around it. OK. So most modern architectures have multiple cores. And you can run a lot of workloads in parallel. And they have sharing at different levels of hierarchy. And with inherent sharing comes a lack of isolation. There are usually two types of isolation. One is spatial or space-based, which a lot of thought has been given to it. And there's lots of mechanisms in place to ensure that you have spatial isolation. So applications of different users are isolated, even with the user and the OS. And even within the OS you have isolation via VMs. But the other kind of isolation that is there is temporal or time-based. So what do I mean by that is the fact that when two applications are running on the same system, when one of the application affects the runtime of the first application, that means there is a lack of temporal isolation. And there are usually three main reasons for it. One is the fact that there is sharing at the cache level. Then that the main memory is a bottleneck. And also at the memory controller level, because the DRAM can only perform so fast. So with keeping all these three things in mind, what really affects your workload really depends on what kind of application you're running. Because if you have something that's doing a lot of compute and has no interdependencies and can be run on multiple cores, then none of these things would actually affect you. But most workloads that run on cloud these days not only have compute, but also have huge memory requirements. So what do we know about the current DDR structure? So the current DDR4s, you can get the maximum bandwidth that you can extract from a memory bus. It's around 20 gigabytes per second. And one of the cores on a socket can already extract up to 5 gigabytes per second. So if you have four cores that are running really memory intensive tasks, you've already saturated the memory bus. And any additional task that you add will create contention for this shared resource. And you will have a lack of temporal isolation. So we know that theoretically this is going to be a problem. But we also want to see how bad this gets at an experimental level. So before I go into the experiment, I want to talk about the synthetic benchmark that we created so that what we were running, we had complete understanding of this. So we started by creating a 100 MB buffer array. And we just looped over it 100 times. So at one instance, in one of our experiments, we were almost accessing 10,000 megabytes. We wanted to create low cache locality. So what do I mean by low cache locality? It's that every time I access something in this array, I should get a L3 miss. And I should have to access the main memory. So how we did this was every time I looped in the array, and the next entry that I accessed, I was skipping 16 integers. Why 16? Because that's exactly 64 bytes, which is one cache line. So the next entry that is 16 integers apart would have been in the next cache line. That would cause an L3 miss. And you would have to go to the main memory. So what we did, we ran this experiment, and we actually measured how many L3 misses we were getting using PAPI. And what we saw, there was a 15 to 20% discrepancy in our value. So the theoretical value was actually 15 to 20% higher than what we were expecting, which was a little suspicious to us. And at this point, we had already turned off all the hardware prefetchers. So what we thought was maybe there's another prefetching happening that we haven't been thinking about, and we haven't been tracking. So we tried another approach. Rather than skipping 16 integers, what we did was actually skip a really huge prime number. So what this does is from the computer's perspective, it looks pseudo random. So it cannot figure out the pattern that you're trying to access. And this would fool the prefetchers. But what we still saw, that PAPI was still underreporting our L3 misses. So the hypothesis that we had was the fact that when you use Intel machines, their L3 replacement policy is not completely random. There is some kind of pseudo random replacement policy. So some parts of the L3 cache actually get used way more than other parts. So the way we dealt with that was we, rather than having a buffer size of just 100 MB, what we did was we increased the buffer size to be 2 gigabytes. So what this does in one iteration, you have way more data. And then way more data needs to fit into the L3, because you're accessing it. So even the parts of the L3 that were less likely to get evicted, there would be more data trying to fit into those. And you would actually replace them at some point, which actually did end up working. And we ended up getting more accurate results in the N3. We ended up having a one-person discrepancy. But that is much better than what we were seeing before. And this kind of proved our hypothesis. So now that we have our synthetic benchmark, which there are two options that we have in our synthetic benchmark. One is just performing reads, or the other is just performing writes. So all the experiments that I talked about in this talk later, I have results for both reads and writes. But for the presentation today, I'm just presenting the write data. So I've explained the synthetic benchmark, and we completely understand this. So how bad is contention at the main memory when you use a completely memory-intensive task? So this is the result we got. So on the x-axis, it's the number of other cores that are also performing writes. So you can think about it as number of other cores that are contending for the main memory. So if you look at number 10, that means there are 10 other cores that are also trying to access the main memory at the same time as the core under analysis. And bandwidth is what the core under analysis is how much memory bandwidth is the core under analysis getting. So like I said earlier, theoretically, that one core, when nothing else is running on the system, can get around 5 gigabytes. But as more and more cores get activated and you start contending for main memory, you see a drop of performance drop of almost 50%, which is like if a task is really latency sensitive, this is a huge drop. So we've shown that this is a problem. And the fact that when you have multiple workloads running on the machine, there is very little intuition of how it's going to affect one workload in particular, when other applications are also contending for the resources. And a lot of actual use cases are there for this. So imagine if you are in a cloud computing environment and you have a premium user who has an SLA agreement or cares about the 99% tail latency. So how do you make sure if you're running any non-critical task on the same machine as this premium user, how do you make sure that the premium user is not suffering a lot and is actually making these agreements? The other is in the HPC community, like a typical HPC workload has multiple threads of execution. So how do you make sure that these threads are all getting completed more comparatively closer to each other so that you get a better overall execution time?  And how do you make sure critical tasks actually make their deadlines when other non-critical tasks are also competing for the same resources? So currently, all these industries have their own way of solving this problem. So in cloud, you have a lot of underutilization of resources because they don't want contention happening. In HPC, programmatically, people are making sure that everything is getting done as it should be. And in real-time, people are sacrificing performance time and execution time by actually implementing software solutions to these problems. So other manufacturers have also realized that there is a need for innovation in this direction. And one such technology that has come out has been Intel. And there are two things that this technology provides. One is the profiling aspect. So if an application is running or number of cores or a virtual machine, you can see what the last-level cache usage is for that application number of cores or virtual machine. You can also see how much memory bandwidth it's using while it's running. The second aspect of this technology is the management part, which lets you partition your cache and also divide your memory bandwidth into parts. And the intuition we had here was that it would maybe look like a traditional network bandwidth controller where you have a reserved quota of the total bandwidth. And you just give it to a subset of the application. That was the intuition we were having when this came out. And then we ran experiments to see if we were going in the right direction or not. So before I get into the experiments, I want to just briefly explain the architecture and the test setup. So even with the previous experiment where I showed contention is a problem, we were using this machine and this setup. So we're using the Intel Skylake architecture. And it has two sockets. On each socket, we have 20 cores. And each core has two hyper threads. And the last level cache size is around 27 megabytes. So because we wanted as much, as less noise from other things that were running on the system, we took certain kind of precautions. First, we made sure that our CPU was only running at a constant frequency. So when we're not doing memory transaction and doing some CPU workload, we're always getting a constant time rather than some discrepancy in that. We made sure that our CPU was never going into idle state. We turned off a turbo boost. We turned off the hardware prefetchers. We made sure all our experiments are only run on one of the sockets and all the kernel calls and stuff is pushed onto the other sockets. So it doesn't interrupt or anything when the experiments are running and give wrong results. Second, lastly, the resource director technology or the RDD, there are two ways to control it. So the one that we're using is the one, there's an Intel library on GitHub which lets you change the registers, the MSR registers and stuff and set this thing up. The other actually is via the kernel, via the kernel which exposes a file system interface which lets you also manipulate this. We have currently turned that off because we didn't want multiple ways to control the same registers and not be able to make sure that if one of them was changing, the other wasn't doing anything. So for the rest of the presentation, I'm only gonna be, even though RDD has multiple features, for the rest of the presentation, I'll be only focusing on one of them which is the memory bandwidth allocation. So there are eight classes of service and these classes of service are 10, 20, 30, 40, 50, 60 and they skip over 70 and 80, then 90 and 100. And so what you do is you take one of the classes of service, you assign it a percentage and then that class of service is further assigned to a core or a set of cores. And then based on what class of service the core gets, you get a delay value. So all this is very theoretical knowledge. Like we don't know what these percentages mean, where like what are their percentage of, where is the delay value being added? But so the rest of the experiments we did were trying to figure this out and what these numbers actually mean. So on the X axis, we still have the number of cores causing contention and on the Y axis we still have the bandwidth of one of the cores under analysis. So the core under analysis is always getting 100% of the bandwidth. And the other cores that are causing contention, they're put on the same class of service and what we do is we try to assign all the different classes of service to it to see if any of the settings actually gives any protection to the one core that we're giving 100% to. So it means like when we give 40%, then we're trying to say that if all the other cores are being throttled at 40%, does our core that is at 100% actually gain any performance isolation? Because you should, as you can see, in the 10% case, there seems to be some kind of discrepancy here. Because if you look at this line, it's going right here under the blue line. When there are 12 cores causing contention, you're here, but when you have all the other cores being throttled at 10%, then you actually end up getting way higher bandwidth. So you get like a 45% increase in bandwidth when all the other cores are being throttled at 10%. But that's not the case for most of them because the lines for like 90, 60, 50, 30, and 20 are almost at the same level as if there was no throttling being done for them. So this seems like it does not provide any protection to the core that we are trying to isolate. So another thing that we wanted to see is like how does, when we put multiple cores on one class of service, how are these cores actually getting their bandwidth? So we had two hypotheses. One was the fact that if you have multiple cores on one class of service, they're all subjected to one amount of quota. So no matter how many cores are there, you should all, the total sum that you get should be about Q. The other hypothesis we had was the fact that if you have more cores, then you're actually extracting way more of the quota because you're each getting a Q amount of quota. So if it was case one where you had multiple cores on the class of service and you're all subjected to one Q, then as more cores ended up getting onto the class of service, your bandwidth for that one core, for each individual core in that class of service should actually decrease because you're all splitting the Q amount of quota that you had. But if you were in this scenario where you had your individual value assigned to you and no matter how many cores came into that class of service, you would still see this value. Then your line should have been a flat line. And we ran this experiment. We ran it at 10% so that we wanted to make sure that the system was not saturated because if we actually made the system saturated, we would have seen a decrease in bandwidth. So we made sure we were running at 10% and we kept adding the cores. And as you can see, we get a flat line. That means that each individual core has its own value or quota assigned to it. Even if you're throttling everybody at 10%, but if you have like 10 different cores that are all in that same class of service, then it's extracting like 10 times the bandwidth. So the core that you're trying to isolate and you're trying to protect will still see so much more contention if you had all the core share amount Q of bandwidth. So in my opinion, it made more sense to have all the cores that are on the same class of service share the amount of bandwidth totally. Then you would be able to say if you have X, if your system has like 5,000 megabytes and if you throttle everybody at 10% and everybody that's in that 10% has to share around 1,000 megabytes. Then that 4,000 megabytes that is leftover, you have still so much more protection unless you have so much more protection because no one else can go over that 1,000 bound. So why is it that each core has its own quota? It's because the way it's been implemented in the hardware. So because it's in the core part, so this is where the delay is being added. It's being added before, it's being added between L2 and L3. So the delay is actually being added before it even leaves the L3 to go to the main memory. And this is done because it's much easier to keep track of all the threads when they are still in the core part because you have the core IDs and everything attached to it. But once it leaves the core part to go to the uncore part, it's much harder to keep track of all these extra variables. So okay, we have this between L2 and L3. That means that even if something is in the last level cache, a delay would have been added to it. And that's the next thing we wanted to see. But before we did that, we also wanted to make sure that it actually made sense to add delays to something that was already in the last level cache. Because everybody, at least for me, I thought that if something is in the last level cache, you're already getting such great performance, why would you want to add delay to it? So what we saw was on the x-axis, we still have the number of cores causing contention. And on the y-axis, we still have the bandwidth of one of the cores that we're trying to analyze. What we saw was even when two cores were contending on the last level cache, oh, I'm so sorry, I forgot to tell something. So the fact was that the buffer size has been decreased by a lot. So before we had our buffer size to be two gigabytes, now the buffer size is only four megabytes. So even when we have six cores, it should easily fit into the last level cache. Yeah? Look at your cache, it's still associated with it. Yeah, yeah. So yeah, you can't guarantee that you'll do a small chunk of everything that you like. But the thing is we're looping over it. Yeah, because it's algorithmic based on the address. The probability is high that you're having it. So we still have something that should six times four is 24, we have three megabytes left. We have one way there, one way there. So like people that it fits in. So it will add some noise perhaps at the end of the graph, but in general, she's coming right, it will fit in. Also the fact, should we loop over it like multiple times at some, okay, okay, okay. Yeah, it's also from the replacement section. Oh, okay, okay. The policy also which we can implement so the program that you could see. The solution. I did not really rank them. It's also not, it's not LRQ, it's the middle thing, they call it PLRU, Sulu, these brand news, which by itself add in the noise as well. And after the approval. Yeah, but that's for a business policy, that's not the address there. Yeah, yeah. Yeah, no, the address, I think so, one thing which Pru didn't say is that for this machine, we turned off money until leaving. So then we are mapping the net resolution to the URM modules, resolution, and therefore we have the ashen policy much simplified, so in a sense, okay. Do you want to add anything to that, Tom? Yeah, so in case there's also around multiple times as well, so every time I look at new physical memory, it's unlikely that even if sometimes you get that sort of unlucky spot where you have conflict that may go out of the cash, right? Because this was around multiple times. In the end, we took an average and essentially this trend comes over again, so something else. So even with like two other cores, you see that your performance is going down and even, so by the sixth, by the fourth core that is active, you're almost, like your bandwidth is almost at the same level as if you were going into the main memory. So it seems like even though your data is in L3, your performance is acting like you were going into main memory, which is like pretty shocking to me. I mean, that was shocking to me, I don't know who out everyone else. So we saw that contention is happening at L3 level. So we were like, okay, if this is not helping, if MDA is not being able to provide support for isolation at the main memory, can it provide support for isolation at the last level cache? So we repeated the same experiment where the core under analysis was always given 100% and all the other cores that were contending went through all the different settings. But the only difference is now rather than having the buffer size P2 gigabytes, our buffer size is four MB. So some of, at least for some of the cores, it should have fit into the last level cache. So what we see is, so this line that falls right here is the base case where we are not having any control. We are, no one is being throttled and everybody seems to have, but the default setting is that everybody gets 100%. So that's the default case. But if you see that when you throttle all the other cores that are causing contention at 10%, you can almost scale up to 16 cores without having any degradation to your performance. So at 16 cores, it's like you are seeing performance as you were hitting the L3 every time. And for when you throttle everyone else by 20%, you can still scale up to almost 14 cores and then 12. And you see that even though that they might not be like these percentages don't mean something, like they're not equally spaced like if they should be, but they're causing some kind of performance gains. Yes? Question, in that graph, is there still one thread who has 100% of control? Yes, yes. And this is the number of other threads that are controlled at the given percentage? Yes. The graph's actually the one, the one that's getting full bandwidth. Yes, so the, You're wrapping the one that's getting full bandwidth. Yes. In the presence of a specified number of other threads getting control of those threads? Yes, yes. Thank you. Yeah, so this was good news for us because when we were doing it for the main memory bandwidth access it seemed like the hardware wasn't doing anything. So the kind of hypothesis that we came from this was maybe that the delay value is so small for all these like throttling levels that it's only stopping it for such a short period of time that all these accesses are hitting the main memory and they're still causing contention because there are so many other accesses already waiting there. So if somehow the delay value could be increased and we could make them more sparse at the main memory level we would actually see the same benefits that we see here at the main memory. So this is what where we are here right now and I'll talk about a couple of next steps. So one of the next things that we wanna figure out is the fact that clearly there is some benefits in using MBA when the data size was for MBA but there were no benefits when it was around two gigabytes. So where is the sweet spot where MBA actually works and when does it not? So like clearly there at some level the delay value stopped making sense and at some point they do. So we still need to figure run more experiments with different data sets and different data sizes and see where it works and where it doesn't. The other thing is that the other thing that we need to also do is like all our experiments right now have been on examples that were only doing memory transactions. So like it was either doing one read after the other or it was doing one write after another write another write and there was no actually compute period of this experiment. So what we need to do is also simulate a real experiment which has both memory transactions and compute and the way we would do is like have some kind of memory transaction then have a busy loop then have another kind of memory transaction and just experiment that and see how MBA reacts to that. So before I end the presentation I just wanna give a very brief thing about what the big picture is. So imagine if we can profile an application for how much memory it uses over a given period of time. So on the x-axis I have the time, the execution period of an application and on the y-axis I have the memory that it's trying to access. And then I look at this, I can somehow profile this. I see that this initially it wants to access something in the L3 by the bandwidth and then it wants to access something in the main memory and then finally it has something that it can access from L1 and L2 so it's pretty fast and the bandwidth requirements it needs is pretty high and it finishes an X amount of time. Then if I have all these memory like the bandwidth controls then what I can do is I can because this was going in L3 and I know that MBA would work on that. I can throttle it to some amount by using MBA. Then when it was going into main memory if MBA doesn't work then I can use some kind of software based mechanism such as Memguard or something to throttle it at a different level. And then when it's going into L1 and L2 it doesn't need any throttling and it'll just work as, because those are still private so it would just work and I would be able to give, have a hypothesis or predict the new execution time. So the hope is that we can build an end to end system where we can profile a set of applications and then we can co-locate them on latency sensitive applications on the same machine. So not only to get guarantees about temporal isolation but also about, also to make sure that the machines are getting high utilization and thank you. Just a curiosity, do you see a substantial difference between the question? Do you see a substantial difference between the read and write? Yeah, so it's almost twice. So when you see the, It must be twice. Yeah, because H write is like twice, two accesses to the main memory. So like remember that contention graph which had a 50% drop. So when you're just doing reads you only get a 25% drop. But we don't know yet how the quotas are actually right by the double lines whether they're counted once or twice. Yeah. And then the second question I had was, does the do, this is an earlier version of the implementation of this, right? Yeah. Do we have any data on the later version? Well, Joe has to provide us the machine. The implementation. You know, we don't have any data. No, okay, there's no data at all. So I'm just curious about that. I haven't even looked at the new machine or anything. Okay. I think. Thank you.  How many memory sticks do you have in this machine? Like, like, like three? Memory modules. And these are eight memory controls per socket, my thing. Of course, now we have eight on that. So we probably, this is 256 megabytes. Two socket, I'm just like, eight per. So six and we can have, so eight. Eight, okay. So you used all the channels? Ideally, yeah. So you were using the channels, whether the mapping of the memory really used all memory channels. That's simple to question. Sure. We haven't really seen that, but we already couldn't have used all the memory channels. Okay. Thank you. And we made sure that was local memory. Yeah, local memory, I think, so that's good. I'll be quick. So it really is sort of an intuitive, what's your intuition? How workload dependent do you think these tunings are gonna be? I think they're gonna be very workload dependent because so we recently also read that what they did, how they did the delay values. They did it based on one application. Okay. So you have no idea what these delay values are or have any idea what that application is. So maybe for the application that they used, those 10% 20% actually meant that the bandwidth they saw was actually dropping to 10% and 20%. So they named them those. But I think the fact that we've already seen that when you have different sizes, like I know that was a drastic change in size, but when you have seen the different sizes, there was a change. So I think that workload would change things quite a lot. It's not only the delay between them, it's also the mix between how many, at any point in time, how much memory you put in certain time periods, et cetera. So they really have some specific application in mind and part of what the crew just mentioned that in the last slide, we're gonna look at what she's gonna look at next because we make what we look at next. It is to have right both, which is simulating the ratio between accesses and right work they're doing. And it's also when they might have a time to see whether they can approach them. That was the crash. And learn more about the time in that case, which is amazing. Right, so they don't have an anti-starvation mode. They really only have a rate-limiting allocation mode. The thing is here, so anyone who doesn't know, this is a poor man's instrumental. They try to get the bullet points on the slides for the market and so on. And any real implementation of this would have been the implementation of the course, but that's complicated because you need global state for that. So they went with a simple thing. They put these C.O.S. guidance in the state of the core and therefore they're affecting the L3 accesses as well. So they're right in saying that they can limit the bandwidth utilization, but they don't save the neck of science. On the other hand, I think one thing that came out when it was interesting was shock like that. Is that I typically don't think as an L3, as a bottleneck, right? And yet in some workload, and perhaps we are being very logical in terms of which workload we deploy, actually L3 is a bottleneck for some type of workload. Imagine you go and try to write your application to be as L3 sensitive as possible because you want data locality and try not to go in memory so often because that's going to be a performance hit and try to fit in L3. And then even if you have a partition, a cat allocated with cat, still the bandwidth to L3 is going to be a performance, it's going to be a performance hit. And how much is going to be a performance hit? Well, as bad as going to main memory. So you may as well not optimize it at all and just go to main memory if that's the worst case. Now, in this poor man implementation that Intel did, actually gives us some, some except the books to control that kind of contention that we were not aware of. And maybe Intel was not aware of, or maybe they were. Maybe that's what they were observing when they tested their test case application and say, oh, yeah, that's it. But I'll tell you, I can say, so Bruno mentioned at the beginning that in the, especially in the field of real-time programming on some, people are already sacrificing absolute performance for predictability. So if you are writing your program so that it only expects 50% of the total performance and implement the restrictions using the available cache location, memory method location. So the thing which we might want to get through, but if she manages to get this to the point, is actually to say, we can actually guarantee something in the absence of something which Intel has not been aware of, actually six percent have not been able to provide them the best, any kind of guarantees. They were simply off limits, were not possible. If we are limiting the workloads in some, perhaps we can get and say we have a tail latency of whatever, which we actually can guarantee. So that would be a positive outcome. So by the overall, so Bruno always felt bad that she didn't have the big thing and can say, I provided you with the library which can do everything for you. So we keep telling her, please tell her as well so that a negative result is also a good result and it's good to publish it. Just going. A question back to you again. In what scenario was the L3 cache as slow as going up the main memory? Can you re-describe that scenario? So the one. It's essentially the case where you're working set size of your application, you are co-running on different cores. It's still, the sum of their working set size is still below the size of the L3 and yet because they're all contending on L3 bandwidth, they have a person. They're all contending for L3, not for main memory. So it's a bandwidth out to main memory. All the bandwidth is L3. Yeah, that's correct. The control is between L2 and L3. And on the skylight, L3 is the victim cache. So if you victimize L2, it goes in L3 but you're competing with all of them. Right, that's what the problem is. Correct, that's why writes create more problems because you're reading a write back to it. But you can combine this with cache applications. So you can, in this case, you could guarantee that you have it but you still would not get the backup. So that the next experiment is like actually split. That was one of the experiments that I needed to do and these people have been telling me to do it for a while. Is to put each, when I do this 4MB buffer, I actually, so there are 11 ways on the machine. So I give one way to each of these six core and the remaining ways I give to all the other cores that I'm not even monitoring or caring about so that make sure that none of these cores that I'm trying to care about take that extra part of the L3 out. Then I run the same experiment when they have their fixed section of L3 and I know for a fact that their data is in that way. And I would probably still see the same amount of contention and drop. So if you read the Intel architecture documents that they publish in the Erata sections, they do describe on Skylake that bandwidth, cache allocation, cache technology, cache memory monitoring and memory allocation. Don't work as described. The cache allocation will not restrict to the cores. It'll leak over the bandwidth numbers, may not be real, the bandwidth, whatever. So, and they're working toward fixing that in Cascade Lake and beyond. Have you seen where that has cost you numbers, irregularities in your numbers? So we haven't worked with Gad yet. I'm sure I believe you that they were over spilled. The one where we did see a lot of irregularities was when we were trying to use the memory band with monitoring. And also, yeah, when we were doing the memory band with monitoring, there were two different levels. So one was local and one was remote. And the local and the remote did not always add up to the total correctly. And also, when we just looked at the total, we would only see around 90% of our data in there. Like, because we would, so when we were doing that 10,000, we would only get around 9,800, 9,000, I think. Yeah, something, we had some discrepancy in the total amount of data that we were missing. So monitoring, there was some missing? Sorry, sorry, sorry, sorry, sorry, sorry, sorry. So we had misses all the time. Yeah. Work build was always missing. So that's why one had to capture. Yeah, because we did that whole pseudo random access and the two gigabytes to make sure. The small amount that you learned but in this case, it's highly, highly unlikely. So with a two gigabyte reference on a new, if you use a pseudo, if you use a pair-wise prime, it's right at through the arrays and you're really making your own. So that way you have so many catch lines to access and get it's highly, highly unlikely that any little, any one of them will actually remain anything. And she's disabling all the attention. That's all kind of people. So it's unlikely that this has to do with any of these. And also the numbers don't kind of, it's one megabyte in L2 cache. So the size is not large enough to make such a difference. So I got a couple, not questions, but just sort of comments here. First of all, do you think it's interesting to, since this is a memory bandwidth allocation and control, do you think it's interesting to have a buffer size that fits in the L3 cache period? Wouldn't you want to miss in the L3 as much as possible? That was our initial intuition and that's why we were doing that huge thing. But when we saw this, I don't know, here. When we saw this, our intuition was the fact that it's between L2 and L3. That means that the delay is even being added. When you miss something, so I think there's like the underlying like assumption that if you miss something in L2, you're probably going to miss it in L3 as well. And the fact that it's easier to implement this in other core part versus the uncore part, but yeah. Go back to the previous one. Even before seeing this, the thing that give away was go back to the beginning, I think. Okay, can I interrupt for just one second? This one, yeah. Right after this talk, if you get on the registration, we're giving out the party tickets. So just want to let you know, if you want to come to the party, it's Friday night, seven p.m. and it will be here. So, but continue, I just want to make sure that we're going on to the next session. And then the next thing I wanted to ask is have you guys thought about the NUMA aspects of the system and how that affects this? It's all local, man. Okay. And then that's what I was going to ask. One of the first slides I talked about shared memory here. You're not doing shared memory. It's not system five shared memory. I mean, it's L3. I mean. Shared memory, sir. One of the first slides on this, it talked about shared memory. Individual processes. You're doing malloc or MMAP version to get the memory. It's not system five shared memory. And also the fact that I'm using NUMA CTL to make sure that I'm only accessing the main memory of that particular system. Right, but it depends on how it's allocated. Well, memory policy should be the mission. It's getting, it's coming from malloc or S-breaker, MMAP anonymous. MMAP, yeah. Okay, all right. And then the other question that I had was have you looked at the possibility of the three different page sizes and Intel impacting the system? We have also the, we have experiments for both big pages and normal pages. What about like gigabyte usage? Yeah, that's the big pages. How did you get those? How did you get those? Because they won't come from malloc or MMAP. No, the MMAP. You have a new flag that tells you and then you can also double check. You checked that, okay. Yeah, I double checked it in my code. In the code itself. Yeah. I just was curious about it. Oh, of course. Yeah, the first, very first part of it was controlling the variable that can affect the experiment. And yeah, you had PAPI measure the misses to the TLB misses for the huge pages versus non-huge pages. Thanks for all again.


Two sides. You don't have too much to worry about at the end of this Sky Bet League 2 campaign meet in the sunshine this Easter Monday as Colchester United post-Bratford City. The visitors are nicely clear of the battle at the bottom even if they haven't found a win in their last five outings. But they're hoping that that run can come to an end today against the Colchester team and the eight points clear of the drop serve on a two-game losing run. Brown hopes his side can return to four for the end of this current campaign. He scooped down at the byline. Kenlop has a go. Brilliant finish. Beautifully dispatched by Miles Kenlop. 16 minutes in. Colchester United have given us the breakthrough. It just came so easily to him. So much room at the back post. No one's picking him up at all. I thought he might fancy it first time, but he takes the touch and smartly so picks his spot. Arrows it into the bottom corner. Songo gives it to this near side. Response needed from Bradford now. They're falling behind so early. Every down in the corner. It's done well to get it out, but the header's off target. A sign of life going forward as Sutton's header is off the mark. Good bit of hard graft in the build-up. Just that finish isn't quite there. Flick down. Bradford shirt that can get onto it, unfortunately, as Colchester are winning that battle in the middle of the park. It's going to be a free kick. Chance just sent one forward from midfield. Judge to take. It's cracking pass. Even better. Not across goal as well. And that's the second. Brendan Sopong with it. With a lovely head-up and a very well-worked move from the set piece. It's his first goal in over 12 months. It came pretty easily in the end. He's done a really good job of finding that bottom corner. It's the same bottom corner that Kenlock found. There's so much space in behind this Bradford defence and Colchester exploiting it here. Sears can't find the third before the break. Get the feeling there's going to be more chances coming though for the hosts. The room that Chilbers has. It's an easy pullback as well to Sears. It's off target in the end with the finish, as Mark Hughes said at the half-time break to his side. Just to see a response. Andy Cook taking all three defenders and the blue shirt's come away with it. Sears begging for it down the centre for a kick instead. Card as well for Paulio Connep. He's protesting his innocence. There's a cynical pullback from the defender. Talking to Anna Booking as well. There's not much in it but he just sticks an arm out. Drives back Chilbers there. Poor defending in the end by Tommy Smith dealing with the danger. Bradford in building up the attacks. Folds. He's in possession. It's a free kick and takes it quickly however. Gilead would have ride the challenges. Does very well indeed. Hired towards goal but it's an easy collection for George. He tested too often today so far. Really a goalkeeper. Chanel George isn't going to be beaten at his near post from that sort of effort. Judge gives it inside. Back out again. By Ken Locke. Beats his first marker. Loses possession though. Plenty of space behind him for Bradford to break into. Sutton gives it out wide. It's in the box to Amat. Very good knockdown indeed. Still no room to pull the trigger. Tipped over in the end. Angle's looping effort. Causing the first really dangerous problem for George. Thought for a moment the away-sided wasted it. Falls kindly to the substitute. It's a good save to keep it out. Strong firm but fair challenge. Sears, that's wide of the target. He's been champing at the bit to try and get in behind and get in on goal today. Had a couple of opportunities. That probably the best of them but Freddie Sears unable to stick it home. He's got to deal with it. He's not really done it with much grace. There might be a problem here as well. He's already been booked in this second half. It's a second yellow. It's red. Bradford 2-0 down on the score sheet and now a man down on the team sheet. Portia O'Connor hands off the captain's armband and goes for an early bath. You can understand why he's a bit frustrated with that decision. Schilderzo just gets in behind him. It's an untidy challenge to say the least. I'm not sure he took enough of the ball to get away with it. Somehow the visitors find a way through the centre of the park. Angle just can't hit the target. Rare chance you feel for Bradford in this second half. Now they're down to ten men. That one just dribbling wide at the mark. He could lose his out. Lovely little through ball. Sears sensational. That's the one he's wanted all day today and it's the most emphatic finish. He's had a chance to produce as well. Top corner, top draw stuff. And three points are staying here for Colchester United. Once more, there's so much room on the edge of the area but he decides to take it early, hit it first time. No chance for the outstretched arm of Alex Bass. Angle hasn't given up the fight. It's a battle that one that he's going to lose in the heart of the pitch. Sears in behind once more. Can't beat the keeper this time. It's a chance now that the host could really run right here. Confidence they're playing with. Bratford side that are just getting dragged all over the place. Effort from a long way out and just for a second there. George is a little worried that it might take a miracle for Bratford to find the back of the net today. They almost had one there. Just about sums up the away side's afternoon. Corner to come. Struck in by Judge. Collected by Bass. That is the full-time whistle. The job serve community stadium. Three points are staying here for Colchester United. Fairly comfortable victory on home soil. Three goals to Nill. Thanks to strikes from Miles Kenlop. Brennan's up on Widow. And Freddie Sears with the grand finale. The third for his side. A sensational finish into the top quarter. Both sides now are going to be mathematically safe. And in Skybet, lead two for next season. Finishes here. Orchester three. Good nil.


John Crestani here. Yeah, there's a recession happening and people don't know how to make money online Well, that's easy here. I'm gonna whip out my money gun and show them how Hey folks So John Crestani here, and I'm gonna show you Exactly how to make five hundred and fifty eight dollars a week using my space Which is an old social network that's still around now at its height over a billion people registered But the millions of people per month still use this site and we can message them to make money And I'm gonna show you step by step by step process on my computer of how you can get this money Now it's pretty easy the first step We're gonna go over is creating a link the next step is going to be or the steps are gonna be joining my space and Then the next steps are going to be messaging folks now You can do this no matter what country you're in around the world You can do this no matter what age you are I don't care if you're eight years old or if you're 80 years old you can make this happen I'm gonna show you exactly what to write how to write it. It's gonna be copy paste You're not gonna have to write a word of your own This is marketing and it's fun, and I'm gonna show you down the rabbit hole right now How we can get this money from it. Let's get it Hey all it's John Kerstani here and we're gonna be going over how to make money with my space And what we're essentially gonna be doing is messaging people But I suggest at this point that you flip well, I have a I have a flip phone but You're your your phone smartphone flip it to landscape mode so you can follow along more cleanly or Use a laptop really and if that is your first investment if you really want to get into an affiliate marketing or any marketing or any internet Business is get a laptop. So we're gonna be going to this link right here. Okay, so John Kerstani dot com back slash resource so you can follow along with me And do the steps and I'll show you exactly what's on that that page right now So once you go to John Kerstani dot com back slash resource, you'll see first off You'll see all of my free traffic methods right here. This is a long document as you can see There's a lot of stuff here where I'm detailing out each of the methods to get free traffic from the internet So you can make sales and make money online I outline them step by step and for our purposes here today We're going to be looking at my space how to make money with my space So you'll want to click on that link right there and that'll bring you down To the my space section On on this sheet So here we go Which is Everything is step by step. You see there's 22 steps here, which we're going to go through in this video Now the first thing let's just get right into it. The first thing is you'll need to copy this google document This is going to be your pre-sell page This is going to make sure that people that the people who click on your links when you message them on my space end up actually You know Getting interested and the information they need about the product in order to make a decision So when you click on that link, you'll come to this page, which is Um, which is a pre-sell page, which will help people eventually Click on your link and they'll make them want to buy the product But you just have to follow the steps I won't explain all the marketing psychology here. Just follow the steps So you'll want to go up to the top left tab right here. Okay where it says file See that And you'll click file And then you want to click make a copy. Okay Right there now after you click make a copy. What it'll do is it'll just Make a copy of the document, but it will exist on your own you know cloud Google cloud thing and now this is yours and you should be able to edit it. You should see these additional Um Buttons here and you will also be able to click this link and edit it Which we're going to uh and change it to your own affiliate link So you get credit for the sale now the next step is you can you have to register in Digi store or you could use click bank to get a link for my product. Okay Um to get your affiliate link So we will register on digi store and here's what it'll look like. It'll say please register on digi store So you can get access to these affiliate products to get your links and you'll need to scroll down if you don't already have an account And uh, just sign up, you know enter in your username. Whatever you want that to be none of this stuff really matters Just enter in your information and then sign up. So here I am logged in to digi store Digi store 24 and they pay out almost a quarter million Sorry a quarter of a billion dollars to affiliates Every single year they paid out over a quarter billion last year. So 250 million dollars Now what you want to do is you want to go over here to the marketplace, which is this uh This button in the top horizontal navigation. We'll click marketplace And you'll see some of the top products here. Wesley virgin um And but what you'll want to do is you'll want to go over here to this search bar and you will type in You can just type in my last name, which is christani and click enter or click the search button and you'll get a link You'll see the uh, you'll get your link from my course now in I don't know why it says $2,000. You actually make $500 per sale Okay, there is recurring revenue you can make with this Um, but it'll be $500 per sale and you get one sale A week and you are making $500 per week And we have hundreds and hundreds and hundreds of affiliates who get sales for this program We paid out almost No, we paid out over 2.2 Million dollars to affiliates last year who are promoting This course So and this year we look it looks like we're going to pay out even more than 2.2 million dollars So it's working very well So to get your link you'll go over here to where The link is right here. It's called your promo link And we will copy this and we'll click copy Right Right there So just click copy you can do this on a mobile phone. You can do this on a tablet You can do this no matter what sort of internet connection you have You can Copy the links and you can paste them on mobile phones. So this works on mobile phones Again, please don't ask that question in the chat. So then I'm just going to take over my link And once again, this is the resource file if uh You want to choose to join along at this point. So here's our link I posted it in the notepad. Um, I like to save these things in our case. We're going to go back up to our document This one that we originally copied And we are going to click this link and we're going to click this edit icon Right there And we're going to edit the link and we're going to delete right now. This is my affiliate link. Well, Whatever it is, but basically you will want to paste in whatever your own affiliate link is Right in there if you want to add some extra tracking, you could just say My space message one okay at the end and click and we can copy the link click apply and you'll see That this goes to This goes into my funnel. Okay And uh, when people go through this funnel and they watch the video Um after clicking on your link and they decide to buy Then you uh, you make money you make five hundred dollars and from what I've seen it takes roughly a hundred people Um to be sent to this page Quality traffic and you will make a sale So let's get into it. So now that we have your link in here We're going to go up to the top right corner of the page Right over here and we're going to click the share button Okay, so share and then you're going to want to change this It says get link restricted. You're going to want to click on this And change this to anyone with the link okay Anyone with the link right there you change that And then you're going to copy the link you can you can click this button to copy the link or you can highlight this And copy the link it doesn't really matter. I'm just going to click this the link is copied And then we'll click done. So now we have the link to our pre-sell page So this is this is the link right there. We what we want to do next is We go back to uh the instructions and the instructions So now we saved the link somewhere handy. We're on step number 14 and we saved it on our notepad So we have that right there and uh Now we're going to go to myspace and register for myspace and we're going to start sending people messages So here we are on myspace.com And what you want to do to register is you want to go over here to the sign in or sign up button I think you'll need to sign up already signed up for it. A lot of people have signed up for myspace Um If you don't remember your login just sign up again. It doesn't really matter. Okay, cool We're logged into myspace. You see there's no sign up link anymore um And what we do by the way, I think you can also use myspace to uh repost videos Oh, no, it's just songs. Oh, no, you can post videos on myspace So this is another way you can use the my video reposting techniques. Um on myspace But what we're interested in is finding people to send messages to so we can get traffic for our links and uh Get people to ultimately buy, you know offer people products that they might be interested in and uh might buy So we have to find real people. These are all top musicians but Here's a fan Right. Um, so you have some fans in here. You have some musicians. Let's look at Kanye West. Okay So what I'm going to do I again, we don't want to message Kanye West We want to message people so I'm going to look at photos I'm going to look at something because I want to get to real people's profiles And I'm just going to click on a random photo again You can pick any musician you want and boom. This is what we're looking for We're looking for all of these We're looking for people who use myspace and you see we have one two three four five six seven Uh, in fact, they're you know, there's there's a number of people There's a lot of people who shared it. There's a lot of people who liked it 173 people So I'm going to focus on folks that are in Uh first in in in countries that earn a lot of money such as, uh, australia, you know, america australia Um, so let's let's bring up some people to message. I'm just going to open up some tabs Okay, and I suggest you message 25 people a day. Okay 25 a day Is it's it's what I do, you know, in fact, I I do this And this is the best way to really solve any problem Is is talk to 25 people a day Whether you're in sales or you're in marketing or you know, you're recruiting or whatever you're doing Messaging, you know reaching out to 25 people a day is a great way to start So here we have, you know, bobby nyuma says it's restricted So we can't really connect with her so Screw that and here we have another person lauren collins. Okay, so uh, we see she's in new jersey cool And so what we want to do now is you want to go up to this top Right corner where you can see this this little icon right here Okay, I'm just going to point that out Once again to make this really simple So we're going to click this and then we're going to click send message right there. Okay Lauren message. I'm in love with life. There we go. So we're going to click Send message And we're going to type her a message Okay Now what do you type? What do you type? Um, well, I have some message templates for you right here that you can use as guides Uh in in what to say I'm going to say, hey, I saw We're both Fans of artists. I figured you might find this useful. So I'm going to copy this link Or is this this message? Right here And I am going to send this to lauren So, hey, I saw we're both fans of artist and I'm going to replace that with conier west Okay, because that's how I found her I figured you might find this useful link and what we're going to do is we're going to replace that the link With our own link to our pre-sell page Okay, so I'm going to click copy right there copy And I am going to paste this link right there So now we have this full message Okay, and I'll just I'm just going to Really just to show you kind of what it looks like Uh, so you see it. Hey, I saw we're both fans of conier west I figured you might find this useful and then it has this big link Okay So then you just click send. Okay, and there you go. You have that now. I'm going to do that again Okay, we have doris crane again restricted profile, so we can't message her so Doris, sorry, you're not going to get a message from me But now we have eva murder that sounds pretty cool from brisbane city australia And we can go up here and we can message her send a message Once again, we're going to paste in our thing and we're going to click enter See we just sent another message and here's victoria wheeler Okay We're going to go up here to the message area We're going to click Send a message Right there And we are going to Send her a message And we can do this over and over and over and over and over again We can open up more folks We can open up, you know We can just keep going with this And send lots of messages and the more messages you send the more traffic you'll get So we see we have herald here. We have richard restricted profile We have dominic, you know, again, you know, he's from ganna So, you know, probably doesn't have a lot of money to spend So you probably won't earn any commissions. We have baron From poland, you know, it's I don't know poland's poland's up and coming country So we'll send a message, you know, again, send a message right there Send a message and boom So you just do that over and over again and that's that's the method That's that's exactly how it works And my suggestion is that you send 25 messages a day for five days And you do that for five days, you will get 125 People out there and our conversion rate Is about 1% So you send 125 people You will likely, you know, as long as it's targeted People in first world countries that have the means Get a sale and a sale is $500 So if you're but remember this only works if you do anything And for those of you watching and wondering, well, what percentage of people actually do anything? Less than 1% of people I've measured this actually Do Anything from these videos Out of 100 people 99 Yeah, 99 people don't just watch these videos and don't use any of these techniques to make any money Um, so it's actually a lot Lot less competitive than you may believe When you're applying these methods You can use these methods for anything you want to promote and my space has millions and millions and millions and millions of users Um, so you have a lot of opportunity here It's very easy to do this and get free traffic without spending any money whatsoever Now If you're looking for a little more encouragement First off, I suggest you subscribe to my channel the subscribe button will show up right here for you And make sure you click the notifications because at you know, you enable notifications because as you see I do live streams every single monday every single monday morning around 9 a.m Where I will answer all of your questions Because really I I get thousands of messages a day And I can't respond to everyone so make sure you register You subscribe to my channel and enable notifications to see those videos Also If you are looking for More free traffic methods You can on the resource file which I shared with you and here's the link once again It's john crostani.com back slash resource you can go on that file And you will see lists of other affiliate networks you can join Let's say you don't want to use my templates and you want to promote your own, you know other products you find on your own That makes you feel better You can join all of these affiliate networks and find additional products And I suggest you join all of the affiliate networks here at least submit an application to all of them because You have better, you know, you won't most of these networks have approval processes So you won't get uh, you won't get into everyone you get their email newsletters where they'll tell you what the top products are This week or this month And it'll give you advice on what you should be promoting and how to be promoting It's very helpful, you know all of step two right here all of my other free traffic methods On youtube and you will see a playlist. I show you how to make money with instagram I show how to make money with facebook with with google with emailing people Free advertising with twitter with quora with text I show you a ton of different free methods to make money So if one doesn't work out for you if you don't understand one if you don't want to use my space There's a lot of different ways you can make money without having to spend a dollar without having to spend a dime Just using your time and your your your hustle You can make money and if you're having issues getting, you know Getting into marketing or motivating yourself or really, uh, you know doing this doing the work By the way, this is this is a funny debate. Uh, I think I destroyed him in this debate. Um, Some guy was saying I'm not the real deal So I don't know it was funny. I said let's debate in this in the video you're watching you can go to join my discord channel Which is a forum and it's where it's our little affiliate marketing forum and it's pretty active It's really exciting and this would be the best way if you want more help Please don't ask me.  They go on little buddy You can do it watch my videos, you know everything everything i've ever Really learned myself is in my videos Um, so anything you need to get started is in my videos So I'd suggest you watch my videos But if you want that extra motivation with talking to people and seeing what other people are doing I really highly suggest you join my forum and uh, as you see we have a lot of you know People posting their success here always excitings when people get their first sale Very first commission from digi store. Love you john true marketing guru, you know, here's another user's ad We just you know, here's another user who made $3,000 in france Uh, you know people just are posting all their all their cool success here Really exciting stuff and I suggest you go on we have different sections for affiliate marketing for the discussion for e-commerce for amazon fba, etc So I hope you enjoyed this video I hope you learned a little bit and if you're going to take action type in i'm taking action in in the chat below Uh And and and actually go out there and do it and remember the world is a lot less competitive than you think because 99 of people they don't do anything, you know most most people just don't Do any work they just watch these videos so you can buck the trend you can be an action taker I'm an action taker. I'm I'm constantly constantly trying out new stuff and failing and It works out right because all all I need is For one in ten things that I try out to work and I make a lot more money So you can do the same go out there join the group Uh, and I'll talk to you soon. See you in the next video. Bye


Right now now during the every year I prayed around the world so during the off seasons on our village we didn't have much energy and the Prophet'sijo got angry and we dreamed on the sun to pray for the sun During that time and in that time it was said about praying for the sun and deciції��들 did not pay any concern. Let's pray for mother's sake the oh,NOT for the father's sake Uh… did God unfortunate �එ්කරකයුරිඏව ඇපෑමකීකයකරෙේ තාර්තුසේයකයකෙන්තකය කිර්පුසයකදන්ම්තුෙයකයකයක්තුයක්තාරේයකයක්න්නුරලකයුරකයක්පුස්විස්ම්යාම පස්ය వ౔తో వౘి బా� half గరియాకౢడా아니 participants అన deixa తోAU నిమి toggle నౕధికోం göst�ిను ఆచినా కో టకరో మ఼ినంఎయాదాన్ ఀబవమాచకలాదハハయాహవ�傷 Fehler స౦న� saving for this topic is to dive into vastness from the inside of the garden and eat Nak. മക്ചീട് ഏയിമിഥിക്ടാനുി്നുആണായ്ച്ിമ്ച്ച്ട്ക്ട്ച്ഽ്റ്്ട്ച്്ച്ച്രിച്ചുഅച്ച്്ക്ക്ച്ക്ച്ക്ച്ട്ക്ച�