We're calling this welcome to the dark side because in a lot of times with gaming people are a little confused about what, you know, the gaming industry is like, you know, what do we, what do we really do in the in the game space and so just to give you a brief overview of who am I, my name is Tony Pollyaco, Pollyaco. There will be a quiz at the end of this presentation so but I'm born in Boston I went to Arizona State University got a degree in computer science. I worked there for about maybe 10 years in a women's web network called she knows.com. I went back to Boston because I thought it'd be great to get back to my roots. I took a director's position with a market research company discovered I hate snow. I hate black ice and I could have good pizza out in the West Coast. I went back and I came to Washington where I worked for the last six years for Wizards of the Coast where I was the senior product manager for Premiere Play and Esports. And then six months ago I changed positions. I'm now at Boeing where I head up a team of product managers in the data science and artificial intelligence space working with Boeing commercial air and Boeing defense and security. So I got about 18 years in the game.  I spent you know a little chunk of my of my career you'll see that little you know blip in my resume that's where I was playing poker and magic professionally full time. So I was traveling the U.S. playing magic tournaments. I was going to Vegas for poker tournaments. The when people ask about playing professionally they say oh wow you must be great. If you look at like the NBA I wasn't a LeBron James I was more like a 10 day contract player. I was good enough to get on the stage but you know never the never bought on the trophy so. But you know working at Wizards was a great experience. It was good to see things from both sides of the coin because having been so involved with that game for so long. It was great to see how sort of like the how the sausage was made like you know behind the scenes. So for tonight's agenda we're going to just have a really quick to the point in terms of like you know welcome who am I. Here's our agenda blah blah blah the stuff that usually happens in these presentations. But then we're going to talk about online gaming. We're going to talk about our goals for tonight. We're going to talk about how does product management fit into the equation of gaming. Because gaming companies have a reputation for being the hoodies and the sweatpants. You know vodka and beer on your desk and things like that. So how do you effectively manage a product in that space. We're going to talk about getting your foot in the door if you've ever wanted to be in the gaming industry. How do you get your foot in the door. But then once the door is open you know what are you going to do how are you going to actually get in the door. And then once you're in the door now you're screwed what are you going to do. But we're going to tie up put a nice pretty bow at the end of it and talk about at the end of the day what your mission is as a product manager in the gaming space. And then we'll take questions if you want. So our goals for tonight we want to talk about three main points is one how do you get a job a product management job in the gaming industry. Because when you talk about gaming there is a wide space of games there is Xbox console games you've got web based games you've got desktop computer games off steam. You've got mobile games it goes on and on and on so how do you get your foot into that space. But because gaming is a different animal entirely what are going to be the unique challenges that you see in that space. Because I saw stuff at wizards that I never saw anywhere else and then when I tell people about it there's like huh really. I'm like yeah like these are some of the challenges we face on a daily basis trying to get games out to 30 million players. That's our player base just in magic is 30 million I'm not even counting Dungeons and Dragons.  But we're also going to talk about tips on how to effectively manage the balance between the business the people who want to make the money. And the developers and the engineering teams that want to make art that want to make quality doesn't mean the business doesn't want to make quality. But they're not going to be happy if they're making you know they're going to be happy making $15 million versus two. So let's talk about gaming first and who here consider themselves a gamer to that's enough. Who but who here's played Xbox. OK you're all gamers you all have inner gamers inside you it's OK. We've progressed as a society it's not it's not embarrassing to be a gamer anymore OK. My friend Ben was actually the executive producer for Farm Bill and yes it definitely counts.  And the best part about it is that you know from my perspective with gaming. I got started way back in the day on the MMORPGs the multi the mass multiplayer games EverQuest World of Warcraft. I then moved into Counter Strike which is a sort of a first person shooter team based game. Got into magic and started playing magic the not the video version but the the paper version. And then of course there was poker too. These are all when boils down to it all these games are very analytical they're very analytical they're very logical. That is why when you have experience as a gamer and you want to go into product management. It's a great combo because I would say a heavy majority of the stuff that I did when I was a product manager. Is very succinct to OK well I need to get this feature built from this person I need to sign off. So if I do this they're going to do this or this OK cool. So if they do this then I'm going to do either this or this and I'll map this all out in my head like a chess game. Trying to see how do I get to where I want to be how do I get what I want. Because as product managers all we care about is the customer and the product. We will go through heaven and hell to make sure that we have the best quality to deliver the best experience to our customers. And part of that means sometimes we have to play games in looking at the evolution of gaming though. And I'm and I'll be upfront I'm forty two. Like I said I'm from Boston sometimes there's no filter between here and here OK. So I'm very blunt I'm very open about things but being older. I started off with the original Nintendo and I got hooked and ever since then it went right through through college.  But looking at where we've come from gaming from the Nintendo first to now Xbox whatever Steam mobile all the different platforms you can play on you can play anywhere now this is a game that you can be on a bus going to work you can be in your bedroom you can be at a hotel you can get online and play a game and interact with someone else and challenge yourself to compete. But what that means though is that the system is getting huge now OK. The gaming industry is getting huge 905 million revenue last year just on games. So all those times when you're growing up and your parents are like get off the get off the whatever you're never going to make money doing that.  This is up 38 percent from the year before. So you find me another growing industry that's growing close to 40 percent year over year monetarily. And that's an opportunity as an opportunity for everyone in here because Seattle is a hotbed for gaming. It's volatile. I mean it can it can flux but it's aggressive. And I mean this is the place that you want to be doing especially with that much money on the table. But when we look at the two sides of gaming you know we talk about the console side. We talk about the multiplayer games. We talk about MMORPGs and these sort of evolved. They started from like the desktop to the web to your phone and and that would be like the ever quest to Farmville. Ironic I put that in there and Clash Royale. You know type games.  Within a 10 year period though the gaming sector has gone from being to one of being one of the smallest to being the largest segment grower in that 10 year span. There's no other industry that has grown in volume revenue and in employment than the gaming industry over the last 10 years. Now on the flip side of the coin this is where we're talking about eSports now.   And then she would say you know I don't care. That's why we have Twitch. That's why we have different avenues now mediums of communication to not only showcase what we're doing but to share that and monetize it as well. Those are great things because now when we move into eSports we're talking about taking the NFL mentality of a production of excitement of competitiveness and prize money to boot. And putting that in a medium where everyone can view it by tickets for it and treat it like a real sport. The funny part is though is that you would think that from an eSports perspective it would be eSports companies putting money into the game. You would think that it would be like like Riot League of Legends or Heartstone or things like that. No it's actually all third party money. My very last conversation I had at Wizards before I left was with a professional sports team that was wanting to talk to us about possibly partnering with us. Because they had already invested 35 million in their eSports, their own eSports League. And I was like man this is absolutely bonkers. This sport has nothing to do with the games they were offering. They were just sponsoring standard games like League and CS and Dota and all those things. They weren't even sponsoring like NBA K2 or any like sports games. That's what made it even crazier. But as these opportunities grew and advanced it was amazing just to see the growth in that eSports sector. $137 billion in 2018 was spent on digital, online and mobile games. Now I know for a fact I'm good for 10 bucks out of this $137 billion because I candy crushed a few times and bought extra lives. But this is talking about the console games. Every single type of game we talked about $137 billion. There is some companies that are just getting filthy rich right now and they're growing and they're hiring. And what they need is they need solid awesome product managers. Because without them there is no one minding the ship. You will have the incorrect people guiding the product and guiding the future of that product. And there's a very good reason why that is. When you look at product management and you look at how it fits into gaming. So I asked who was gamers earlier but who would be interested in looking at a product management gig in the gaming space? And that's fine. The reason why though is that because when you do you got to be very, very aware of what you're doing. This isn't Amazon where you could be working on like a Kindle one week and then something else another week. It's not Boeing where we're working on in the aerospace field. So you have to ask yourself why do you want to get into gaming? What is your goal? Are you hoping just to not have to get dressed for work anymore and just go in there and do all sort of cool stuff? That's fine but there's got to be a good reason for it. What are you hoping to do? Are you hoping just to be a fan? Are you going to work at this company because you've played their games forever and it's a great thing? What working in gaming is, what I mean by this bullet point here is what working in gaming is is it is a job. It is a real job with real business, real money, real people. It is not the stereotype that you might see online or in movies where people are just like, you know, this isn't Silicon Valley from HBO. We have no Guilfoy. But what working in the gaming is not. It's not a pass just to skimp on quality. It's not an opportunity for you to try and change things that you like about games just because you like them. I mean essentially, and this is going to sound brutal, I'm sorry, but when you go to work in the gaming industry, you don't matter anymore. The reason why is because you are not building for your experience. You are building for the customer's experience and you're no longer a customer. You are now steering that ship and making sure that the person who is taking that train from SeaTac into downtown Seattle is having the best possible morning because of the game that you're helping manage. So when we look at this and we say, how do you get your foot in the door? Because I know a lot of people who have tried to get into gaming and they always say the same thing. Who do you know? How do you get there? I applied and I never heard anything. Well, this isn't a mom and pop industry anymore. This isn't someone just getting emails and picking some to look at for resumes and some not. They have HR departments now. They have the same scanners that every other company does. You have to do the same thing that you would do for an Amazon, a Google, a Facebook. You have to trim the resume. You have to look at the job description. You have to curate it and make it special for that. But the same tips apply. LinkedIn. LinkedIn, LinkedIn, LinkedIn. I can't stress it enough. The reason why is because you need to be able to form bonds with people. If you're trying to get an inside track on someone else, there's someone over there who is just filling out application after application and praying. Then there's someone else who's on LinkedIn and active and being a little sneaky. I'll show you what I do and what I've done before. I will find, I'll do a search in LinkedIn and look for the title. When I would type in for Wizards, for instance, Wizards of the Coast, and then I would put in something like Producer, Product Manager, Recruiter, HR, whatever. Some titles in there so I would find a list of people. Then I would see what groups they were in. Then I'd get involved in those groups. Then what I would do is I would start interacting with those people to be able to be like, oh, that's a great post. Yeah, that's a great post. I'm coming in on the side. I'm not like saying, that's a great post. By the way, are you hiring? No, I'm not doing it that way. I'm just forming a bond in conversation because now eventually I can LinkedIn connect with that person. They're going, oh, yes, that's the person who was being cool with me on that thing. Okay, now you're connected. Then a quick message, oh, hey, thanks for linking up. We'll get to know each other or whatever and just leave it at that. Because then they'll contact you back because now they think that you don't want something from them but you do. That's okay because you're being strategic. You're using your gaming instincts on how are you going to win the game. Don't stalk people. They're following them on Instagram and showing up where they are.  Don't do that. I'm just saying for LinkedIn, it's a great networking event. Gaming events, open houses. A lot of times Microsoft, Amazon, they'll throw these open expos where they'll show off their studios. They'll show off new games. LinkedIn's a good place to find out where those are. You have to hunt around for them a little bit. They're a great, great place to go. Anything just to meet people. When I went to Microsoft's for their Xbox team, I got an offer, not an offer, but an interview with the Azure team. My cloud skills were a little iffy. I was like, hello, but I kept in touch with the person who was there. Super cool person. Now we trade. I'm like, I need a product manager so bad. Oh, I have a couple of candidates I know that I can hook you up. We trade. We talk. We go back and forth. It's helping each other because we're all in the same community. We all want to do the best. We want this discipline to be one of the most respected ones out there. And so we do that. We have to work together. Career websites, duh.  A lot of these companies are going to post on there. A lot of these gaming companies will third party their job postings. So they'll have a company that's out there posting them on some of the bigger sites. I would definitely not just look at them and say, oh, that's not real. It's definitely real. Most of the times, the smaller studios that are growing that maybe 200 or 300 people in them, those are the ones that are going to probably use that sort of service. So definitely check the career websites. But the one thing to remember and get your foot in the door is that they want talent. They don't want fans. They have enough fans. These games have millions and millions of players. They don't need someone coming in and talking about their high score and how amazing it is. They need to go in there and talk about why they are the best person to deliver the products they need to do. So the door is open, but now the interview. Really, just treat it like any other interview. Don't do what I didn't get so jacked up that you're actually interviewing for a job in gaming. I mean, for me, working at Wizards and having played it for six years, I mean, played it professionally for 10 years, but working there for six years, I went into my interview more excited to show how much I knew about magic than actually talking about product management. And I could have messed myself up really bad that day. Remember the basics. When they're asking questions, state your problems, state the action that you took, state the results. Show the efficiency. Show the KPIs. Don't let your knowledge of the, let your domain knowledge of the game show or let your domain knowledge of gaming show, but don't let your passion show. And that's going to sound weird because passions are really important part of product management. So I'm going to explain what that means when I say don't show your passion. That's sort of what I was referring to about your high score. A lot of these people who work in some of these gaming companies, some of them don't even play games. You could be interviewing someone who just doesn't, who just loves Python and is like, yep, I'm just Mr. Python, but I'm not going to know anything about this game.  I did this thing and what are you talking about? I don't know. I want to talk about product management. I want to talk about how you are going to take this idea and turn it into $50 million. Final thought before walking in that door and you're wondering why the heck is Ronald McDonald on this screen? And this is what I like to tell people about, remember McDonald's, okay? When I was in high school, I was a wrestler. I played football and I would routinely consume close to like two big Macs, 40 nuggets a day. And it was like, this is great. Going to school in the morning, I'll grab two, you know, egg McMuffins. It was great being young with a high metabolism. But when I was 16, I also got a job working at McDonald's.  Disgusted with it. So be really sure that before you get into gaming, you are ready to know that you might not like games afterwards.  I will tell you myself, I do not play magic anymore. And it's not because, you know, it has nothing to do with the company. It has nothing to do with the game itself. It has to do that for six years. I went in and we made discussions about decisions on everything down to a font size, to a game feature, to an integration. And after that, I said, man, I just, I know I don't even want to go to the other side anymore. I'll just, I'll play, I'll play Farmville, I guess. I'll be frank and hook me up with the link. I'll play Farmville. So remember McDonald's. So you get your foot in the door. You find the interview and you actually get an offer. And this is great because the one thing I will give the gaming industry is that it is... So I'm going to, I'm going to phrase this a little differently because this could rub some people the wrong way. But I'll do that at least 10 times in this presentation. Don't worry about it. The gaming industry is a very accepting and very open industry. It's one of the most, speaking from wizards directly, one of the reasons why I played Magic for so many years was because Magic The Gathering was a game on a Friday night where you could see 50 people come together in a game store all from different clicks in a school. So you'd see like a couple of jocks. You'd see a couple of buh, a couple of B, a couple of C, whatever, you know. But they would all come together for these four hours. And for those four hours, we were all Magic players. And we all talked about the game and we talked about the new stuff that was coming.  But it was a welcoming community. And the companies that work in that space are also very forward thinking, very welcoming because they understand who made those games popular. It was very tough for me when I was in high school to tell people that I played Magic because I used to get joked on.  Yeah, so I was just checking, you know, and that's fine. It's okay. But the thing is now we've gone past that. And these companies are, they are, they want passion. They want talent and they also want to be successful. So if you have those three drives, those three values embodied and personified in your daily, you know, daily day to day stuff, you're going to do good with it. Now, once your foot is in the door, though, remember now you are on the dark side now. You are now part of the evil empire. You are making the game. You are no longer the consumer of the game. Yeah, you may still play it when you go home or whatever like that, but you need to look at this from a totally different lens now. And when you get into this new position, you've got a network right away. The gaming verticals are extremely competitive inside the companies. The reason why is because, and I'm going to, this is my opinion, camera, this is my opinion only, is that there is so much ego in the gaming industry from people who work in the gaming industry. I mean, you think that developers have big egos and they're prideful about what they do. Oh, you go to a gaming company and check it out from there. It's times 10 because everyone thinks they've got the answer to the next big thing. Their code is the best.  It's all competitiveness. But with these companies that are growing, people are thinking, okay, we're at 80 people in this company right now. We have a new game launching this year, one launching next year. We may see a round of Series C funding that's going to be about maybe $14 million based off like $100 million valuation. Okay, that means we're going to hire like 80 more people, which means there's going to be leadership positions opening up next year. I can see down the road on that. I want that position. So I'm going to make sure that my, you know, I almost said something really bad. I'm going to make sure my face is pretty. That's a good way to put it. I'm going to make sure my house is in order. I'm going to make sure they know who I am, that I'm doing the best stuff. And if that means maybe not helping another teammate so I can get ahead, that happens. Is it cool? Hell no. Is it unethical? Oh yes. But it's part of the game, how it's played and I've seen it. This last part, I talked about this in my last presentation when I was here. And so when you join a gaming company, you are now a level one noob. You are a level one newbie and you've got a ton of hit points. And what that means is for those of you that haven't played games with hit points, it's essentially you're a warrior. You got a lot of armor. You can take a lot of hits. The reason why I mentioned that is because one of my favorite things that I like to do with new companies is called newbie credits. And what newbie credits are is that you're a new company. You don't know everything yet. And you have a lot of credit to make mistakes. Which means that if you want to go forth and be like, oh well, I'll give you an example. One of my recent jobs, I was there maybe a week. And one of my teammates asked me, you know, hey, we want to do X, Y and Z. And so I said, okay, done. So I went and did it, made the right moves, moved people around. And then about like an hour later, I got an email that was like, you know, Tony, we're not supposed to do things like that. There's forms that we need to fill out and there's approvals that need to be signed off on for it.  Oh, it's okay. You'll learn as you be here for a while. It's six months. I'm still occasionally sometimes I even still use the credits now. I'm like, you know, I've only been here six months. But I don't know what's going to happen after six years. That excuse is not going to fly anymore. I've only been here six years. I'm sorry. I can't. I did that again. But you do get these newbie credits when you work in a new product management position. So it gives you the opportunity to make some mistakes. It gives you the opportunity to be bold and then play the card to be like, oh, sorry, I didn't know. But it also will help you just establish your presence, which is actually the most important part. That leads into the networking. Quick wins. Quick wins early in this gaming space. There's it's intense. There's pressure from both sides from development and the business. And you need to be aware of where your quick wins are going to be. Is it volunteering to help someone else with something so you can, you know, get attached to it? Is it trying to, you know, suggest a different way of doing things that doesn't impact the delivery, but in fact makes it better.  And I would never tell a new person at a company to burn through all your newbie credit because I've done that and it's horrible because then you've got to get more credit. By getting these quick wins, you start building a portfolio of good reputation. And your words and your decisions as a product manager are only going to be as good as your reputation. If you're known as a blow hard that just always talks and never delivers, it doesn't matter if you get up there and speak like you've done it for a million years, no one's going to believe you. But if you're the person who gets it done no matter what breaks through the walls and makes it happen, it doesn't matter what you say, your actions are going to speak far louder and that's what's going to actually deliver the best product possible. So unique challenges in gaming. This is interesting because I was going to use some examples from Wizards but instead I was going to use some other examples from other friends in the gaming industry and the reason why is because there's similarities. A lot of times in the gaming industry you have two types of gaming companies. You have the ones that started off for gamers by gamers and what happens is usually that company will grow and at some point those VPs or the founders they end up taking different roles because they have to bring in people who actually have experience in global marketing or global distribution or package art or tax laws or all that sort of stuff. So when you get to a new company, your business partners, the people that you are asking you for what they want, they might not understand your world. The gaming world is very unique. The gaming world is one where we have our own language sometimes, it sounds like. In magic we had our own set of buzzwords that we just used with each other, not like we planned it, it was just like the vernacular of the gaming community.  It was hilarious and that's one of the things that in the same idea when you're working with the business with marketing and sales and all these other departments, they're not going to understand the funny little inside jokes about the games, they're not going to understand the buzzwords, they're not going to understand. What they want to understand is the data from the players that tells them what's the best direction to go. So if you're still ingrained in those communities, get that data, know where to find it, know who to talk to and be able to pull that in to be like, look, it's not just me who wants to be able to do XYZ, all these other people want to do it as well. We are your audience and that's the way you have to look at that. Your business partners aren't going to know everything. Same thing for the developers too. You can write the best code in the world and you may not even know how to play a game. And granted, it helps if you're in the gaming space and you're a coder because then you're able to use what you know about the games and be able to put that into code at some point or put that into UX or however you're doing it. But again, just remember, not everyone at a game company is a gamer. Some people is just a job. Not everyone's going to be a fan. So when I started off at Wizards, it was interesting because I was so stoked to be there.  I would look at me and at Wizards everyone. I'd be posting on Instagram, Facebook. Oh, well, sorry I can't go. I have to go to Wizards for my job and just let everyone know. But other people would show up to work and just be like, you know, my kid's got a baseball game at the floor. Can I go home? You know, they're not like super stoked about the game. So, you know, you have to remember, there's people there who aren't there because of the gaming company. They're there because it's a company. You have a job. You have a mission. We've covered what that is. It's delivering the best for the customers, delighting their experience, which in turn makes money, more jobs and great things for you because you'll be up the ladder. But stay your lane. Remember, you're there to do a job first. You're not there to go swing by R&D and see what's going on. You're not there to go offer to help test new games, you know, every single day when you have like, you know, an hour break. You're not there to find out what the new secret stuff is so you can tell your friends. You have a product. Your job is to make that product amazing and to do it by any means necessary. Stay your lane. If you get offered, sure. When I was at Wizards, because I had played professionally before, they had asked me, hey, do you want to come down like, you know, and help us test new magic cards? And it was called the Future League. Now for anyone who doesn't know, I should have said this earlier. I apologize. Who doesn't know what magic is? Essentially, and since I don't work there anymore, I can say this because they hate it. They hate this reference. If you took poker and chess, made it into a card game, added a bunch of dragons and made it extremely skill based. That's magic. And so I would go down there and help test these new cards that would get released. But it was like, it was, you know, for an hour or two a month. And it was cool. But then there was like someone else who worked at Wizards who was just on the fan train. And every single thing that was there, person was going to be there. This person's goal was to work in research and development. Fantastic coder.  And eventually didn't work out because the passion wasn't there for being a product manager. The passion was there for being a fan of the game. And they don't mix. Also, look at the kind of company you're going to. Are you a technology company or a gaming company that's learning technology? And there's a difference and it matters. I'm sorry, I said that with so much passion, it matters. Reason why is because there's a company that was here in Seattle and they got bought out by King Games. The company did Candy Crush. And then Candy Crush got bought out by Activision Blizzard. They were a gaming company. Pretty good one too. They know gaming, they know the gaming mechanisms, programming, whole nine yards. Now take Wizards. Wizards was a tangible product game. It was a card game. Dungeons and Dragons, all books and manuals and things like that. Even until I would say maybe the 2000s, they started dipping their toes into the online video game space with Magic Online. And now the new version is Magic Arena. But there was a huge learning curve because Hasbro had just recently bought out Wizards of the Coast that time. They had gotten into video games now, but they had no experience in it. They were a physical company making digital games versus being a company that was founded to make games. You see the difference there? And it's important because you got to know before you go in what you're getting into. When I started at Wizards, I was flowing out for an interview and I met with the CTO, the VP and who would be my director. I said, are you guys using Agile? Are you using Scrum? What are you doing for your processes? Oh yeah, we're an Agile company. Just saying that you're having a stand-up does not make you an Agile company. I'm very pleased to say that since I started at Wizards to where they are now, they are now a pretty efficient Agile shop over there. They've made leaps and bounds in terms of some of the stuff that they're doing. But at many other companies, it's the same thing. Boeing evens the same thing. We're an aerospace company. We build the best planes in the world, but we're not known for our games. We're not known for like, we don't sell software, things like that. We don't sell Microsoft Word or anything like that. So keep that in mind. Being the peacekeeper, now in product management, one of the biggest things that we do on a daily basis is we deal with temperamental people. Whether it's business or engineers or whatever, someone is going to give you attitude at least once or twice a day. In my case, five or six. And so you've got to assume that you're going to be brokering a lot of peace meetings between the business that's going to say, we want everything and a cherry on top. And the developers are going to say, well, that's going to take about 76 years. One of the biggest conflicts I see in product management and gaming is that you have to be able to set one rule down right away. You either get to pick what you want or you get to pick when you get it. You don't get to pick both. It doesn't happen because the minute you give the power to the business to be able to make that decision and also when it's due, you are effectively telling your development team, I don't care about you. Now, that also means that as product managers, we have to have that extra chip on our shoulder that we can go in to any person's office and tell them no. I will do that every night of the week and I've told my team this at Boeing too. I said, if you can't go into our VP's office and tell him no to his face and stick to your guns and tell them why you were saying no, this might not be the right job for you. There might be better ones out there. There might be, you know, maybe some skill training that we can get to help with that. But you've got to have the ability to say no because otherwise the business will run you ragged. That was one of the biggest challenges that I faced at Wizards. We had a very, very smart, very aggressive business side of the office. My boss was a VP of marketing. His name was Jerome. I mean, he was probably one of my best bosses ever. Jerome would have your back. If you weren't his team, Jerome would have your back and that's where I think I learned a lot of mine over the years of how to get my teams back because Jerome always had my back even if I was wrong sometimes. But there was a lot of times where we had to push back some very eager expectations. And one rule that I had with my teams is that I never, ever commit for them. So when someone say to me, we want to get this release out here instead of here on the roadmap, that's great. So good, we're going to do it. Nope. Well, why not? Because I don't make that decision. My job is to explain to the team very clearly what we're doing and then I will accept their commitment. Oh, we don't have time for that. Well, I'm sorry, but you said that we're an agile shop. And if you're not embracing the agile values or respect, openness, commitment, then you're just talking. The business cares about the money. I hate to, I'm not trying to paint the business side of things as being cold and, you know, calculated and everything. But if you're in, like, say marketing, your job is to market a product. Your products are measured by how successful they do in those markets. If you're not making money off those products, then you're not doing a good job at marketing. So that's why the business cares about money. Now, development, I think, cares more about the experience and the quality. My son is a fantastic musician. I can say that because I'm his dad. And he, but music is another kind of art, an art, version of art that I cannot even comprehend or do. But from the coding side of things, that's another kind of art. And when I was a coder, I used to make beautiful, I used to love that experience of just seeing all these random things and all of a sudden run it and say, oh my God, this is great. I did this. I couldn't believe it. Like when I pushed my first app live, I saw it on the Apple store and I was like, I was 14 years old again. I was like, this is amazing. So you have to think about in terms of your balancing that measuring stick between the two worlds. Also get all the voices to the table before it becomes complicated. And I'll tell you what that means. A lot of the times in a lot of gaming companies, you're moving quick, you're thinking quick and a lot of hallway conversations go on. A lot of drive-bys go on where it's like, hey, are we going to be good for Friday? Yep, all right, cool. And then I'm off to something else. Now someone else is coming from that direction and saying, oh, you know, are we going to be good for this on Friday morning? The person's like, yeah, sure. Now this person's double booked. They don't even want to come to work on Friday now. We have no paper trail about who asked first. I mean, it just goes on and on and on. And so what I would always make sure to do is that when one of those things would happen, one of those drive-bys would occur. And I mean, drive-by could not drive-by. Drive-by is that I would be like, look, we need to get the sneeze at the table. We need to get the people doing the work at the table. Oh, but we don't want to have another meeting. I would rather spend 20 minutes with the people at the table and at least hearing the same things, hearing the same vernacular, being able to ask questions about specifics and making sure we're using common language so a proper commitment can be made.  Now I broke one of my own rules there and I said, we'll have a meeting. Because me personally, I detest meetings. I think that most of the time it's people who just want to hear themselves talk. I've played games sometimes in previous jobs many, many years ago. Recording. Where I would just sometimes use big words and just see who bought into them. Because I wanted to see who was really paying attention, who cared about the product. I wasn't trying to clown on anyone and embarrass them. I was literally doing a litmus test to see how much attention they're paying to the product and where that passion lies. Because if I'm feeding them straight BS and they're saying great, that means that I wasn't doing my job making sure the business is well informed about what was going on. It meant that I was doing a poor job and I had to rectify that. So you're always going to keep that up and keep that in your mind. Get those voices to the table, make sure people are heard, make sure they're being respected. Because if you're going to drop the hammer on someone because something didn't get done off of a commitment, then you've got to make sure that respect was there in the first place. You can't just turn it on when you want to. You can't just be convenient with it. You've got to be steady with it. You've got to stick to it. And that's the last line here in terms of using a process. If your team is using scrum, agile, waterfall, I don't care. I'm not here advocating or evangelizing one process or another. No way. But what I'm saying is that if you're using a process, stick to it. Stick to the fundamentals. Stick to what the book says. Stick to what your team has done.  You have lost control of your product. Because now you're justifying excuses to skimp on quality. And if you're not getting effective information out of your retrospectives, if you're not having a daily stand up and being able to communicate, if your whole team can't communicate about what's going on with your product at that very moment, then that's an issue. And that's not something that you're going to fix by just making it more blasé and more easy. You have to drop the hammer sometimes, but at the base of it, you've got to stick to it, and if they try and make you change it, push back. Otherwise, you are not a strong team. And that's the only way that you're going to be an effective product manager, and it's the only way that your team is going to deliver greatness. Reality is the gaming industry. I hate talking about this, but my mandate here tonight is to tell you the truth. You already know I'm blunt. Maybe I'm noxious. That's fine. That's fine. But in the gaming industry, sometimes you're only as good as your last game. A lot of these companies are fragile. And it's not because they're bad companies. It's because they have different models. If you're a company with, let's say we form a company right here, okay? We put out a game, get up to, you know, make a quick 80 mil. Sounds good. Let's make another game. So now we get another group of people that come in. We get salaries, and there's insurance, and then there's liability. Now we need more office space. Everyone wants new Macs. Keep going on and on and on. Now you've burned through most of that profit already because you're investing in the company. Now you release your second game, and it's awful. Tanks dies, stinks. Now how are you going to be paying the 160 people you have versus the 80 you had when you were safer? Some companies work like that. Because when it pays off, now they're like 3-400 people, and they're cranking out three games a year. I mean, that's definitely an aggressive way of doing it. I don't look down on it. I'm just saying that's the way it works. Like I said before, gaming is fun. It's a relaxed atmosphere. You probably do more than you would an insurance company or something. I hate naming names because I tend to do that, and I'm like, I can't do that. He's recording. Just remember, you have a product to deliver. Gaming companies are fun to work for. There is more relaxation. There is more opportunities to do some cool stuff. But you know what? That's in a lot of companies nowadays. I worked at Wizards for six years, and when I interviewed at Google, I would have left for the food bar at Google in a heartbeat. I think it was amazing. Avoid getting jaded and taking criticism personally. Reflect within.  No, that's not me.   And then next thing you know, your phone's buzzing every six minutes because they found your Twitter profile and now you're getting destroyed. You can't take it personally. Okay?  Okay? I did that. And it cost me about 18 hours of scrubbing Twitter and other social media sites because I was one of those obnoxious people. I was the one who was sitting on the sidelines yelling at the company, you don't care about us. You're not good at what you do.  And then when I got to the other side of the coin, I said, man, what am I doing over here? This is weird now because I was taking the heat on the other side. You just gotta understand that people are passionate. They love their games. It's what makes them happy. And if you're infuriating people in a way you're doing a good thing because you know that people are paying attention to your game, you know that they're giving you an opportunity to make it right. And if you do that, you will earn a lot of credit as being caring for the customer. Now, not everything you can change that they hate. Sometimes you do it for a business decision, but it's important to always keep on top of that. The last thing is keep on top of trends. They change way faster than you think. Like I said, I was a programmer for about eight years. I worked in Pearl, PHP, some command lines, languages. And when I moved into management and moved into the product side, I had stopped programming. And we would start talking about different ways of integrating certain services or integrating building certain portfolios or whatever. And I'd be talking about, oh, we should try doing this. That's like six years old. Like, oh, what are we doing now? And they would list some new framework that's being used. And I don't know what that is. But me being me, oh yeah, that sounds like a great idea. Let's use that. Yeah, that's a much better idea. So you got to keep on top of that. That's why I got back about maybe two years ago I started programming again. I started working in Python. Considering I'm working in the data analytics space now, it's very helpful, especially with machine learning. I can build apps. I can do stuff on the web. I taught my kids Python. So it's great now because we have, I'm doing the data analytics machine learning stuff as part of my learning. My son's using the Python SDK for mobile apps. My daughter's working in the web framework to Django. I mean, I just got to have like three more kids and we can have a testing team. And then we got a company. But keep on top of those trends. Look in terms of like, even with blockchain now, there's a lot of blockchain based games that are becoming very popular, especially not just crypto, but the actual blockchain technology. There is other companies getting into the crypto space. I'm not touching that. I'm not even talking about that. I'm just talking about the blockchain technology.


Hi guys, welcome back to Siano and if it's your first time come across Siano please consider subscribing. By the way if it's your first time don't forget to subscribe, it's mixed from the mall, mixed creation TV. Yes, we talk about a lot of opportunities, we talk about jobs in the Gulf countries. I've definitely talked about jobs in Qatar, for people in Qatar. Right now you'll have blue with me.  Most of you in those companies and you definitely know what I mean. Some of the companies right now are laying off workers or are giving workers what you call forced vacations. I know some of you might have heard this. You might have not expected this to happen before or even at one moment of time that we can have a recession in the jobs or we can have this kind of situation coming in at one moment of time. So what we used to see, we used to see that you normally had to complete what you call your two years after completing your two years according to the agreement or according to the contract that you sign with that company then you can get the vacation one or the other. But now companies are forcing people to go for vacations even if when they've not completed what you called the two years. Some have a few months to go but what I have to let you know right now is that most of the companies do not have what you call the contracts and they have what you call excess workers at what you want done. So what they would think of doing at that time is to give some people vacation to go and that's what you call forced vacations. Yes, it may not be the right time for you to go for that vacation. But what brings back in your mind is that it just tells you or warns you that every single moment of time you have to be a little bit very careful and plan or what you call you need to plan yourself again in any single day of say at one moment of time. Yes, why all this coming and what would I want to share with you is about the contracts. Yes, I know most of you are there but you do not know the type of the contracts that you signed with the company. Yes, if you feel you don't know the type of the contract that you signed with the company just go to the government website, just go to the website. The good thing that we have here in the Gulf countries or what we have in Qatar, Oman, Saudi Arabia, Kuwait, anywhere you can access some of these official documents online. So go to that website or website, look for that contract. Just type in your residence permit number and your mobile number. If it is a similar mobile number that was registered, uproar that contract, look at that contract and see what the contract is saying. You may think you are in two year contract but actually what is on the ministry website, what is the ascertained copy of the contract with the ministry is the unlimited contract of five years. Meaning that you have an agreement with that company or that company or that sponsor for five years. What does it mean that in that case of tuition he has over more rights over than you can imagine at one moment. He can block you to change to a new company. For you, you want to change, definitely you need either to fast complete of the five years or you need to exit outside the country then after you can return on a fresh visa after being cancelled out, then you can get a new visa to come into the country as that. So it is to the newcomers and even those old comers, you are out in the city but you do not even know the type of the contract that you have with that employer. What are your rights in that contract and what are the rights of the employer in that contract. So it's always very, very important for you to check that contract, download the copy, check the contract. See what the contract says before you think of changing, before you go think of going somewhere, before you think of anything that you want to do. Either you want to follow the passage of the law or you want to go against the law or you want to complain about your employer, go and check what the contract says. So that when you try to engage in your grievances to that employer or to that sponsor you have a point where to start from. But it's so sad that you wake up to do whatever you do but you don't even know the copy of the contract. You don't know what is in the terms of that contract. That is the asserted copy. They will ask you, did you read the asserted copy? You say no. Why? Because you don't download the copy and leave the copies for free of charge. So normally what happens? I have to let you know. We have force vacations, yes. If the company is buying for you a ticket one fluke, yes, take it. Because if you don't take it in the government, the company will force you to take it annually, which will still not benefit. But look at a tuition in this tuition that the company is giving you a return ticket. Yes, take it and come back. But something still I need to let you know or something that I still need to let you know or warn you is that make sure as you move out of the country your residence permit at least is valid for six months. Remember when you go out of the country and you spend six months for you to return into the country, you will need what you call an exception permit. Hope a tight shift something for you. Thank you so much for the support. Thank you so much for coming back to this channel. Remember, it makes creation TV, life as the way it's us. Anything that you need to know, please don't hesitate. Get in the comment section. Tap in, put a question, always be able or always, always get back to you. If you say there's something that you can do, please get to my TikTok account at makes creation TV. Also turn into my other channel, which is Malcolm Makes TV. I'll definitely give you the best. Thank you so much again in the next video is Max from the makes creation TV.


Hi guys, welcome. I'm Wilfred Ung, I'm the program coordinator of the Master of Sociology, and today I'm going to give a short introduction into our beautiful master program. Two weeks ago we were shocked in the Netherlands by news that a referee in soccer was killed by three youngsters. Last week in the US a guy did a shooting on a school and he killed more than 20 people. Is crime really on the rise? Or does it just remain stable? Or does it even decrease? More generally, do we get along well with each other? Or do we see each other less and less? Or is that compensated by an increase in social media usage? Such questions are questions about social cohesion. And this is our focus of our master program. We use a theoretical empirical approach to studying questions of social cohesion. The empirical approach means that, well, that we study whether crime is really increasing. Actually, empirical research shows that it is not increasing at all. It is decreasing, and this has been the case in the US for the last 10 years, but also in the Netherlands. So all these images we have about crime are just not true. This is our empirical approach. Our theoretical approach is why is that the case? Why is crime on the decrease? One reason, one theory may be that arising educational levels may be responsible for that. If you have a higher education, you have less reasons to be involved in crime, and you may also have less opportunities to get involved in crime. This is just one theory. Another theory is that it is due to, for example, more efficient policy. In the Netherlands, for example, politicians steer less at putting people into prison, and they advocate community service instead of prison. This may have an effect on the decrease in crime rates. Here in Tilburg, at the master program of sociology, we test whether such theories really hold. Is policy really that effective? Besides this special focus on social cohesion and our approach, the theoretical empirical approach, I think there is more reasons to study here in our beautiful program. First of all, we have broad master options. We don't only have a one-year program in one-year master program, but we also have a two-year kind of exchange program with the University of Trento. You can go to the northern part of Italy, surrounded by beautiful mountains of the Dolomiti to study there in this small university town, doing one master here and one master there. This is just one of the master options. Another beautiful option at this point, too, is that we have a long internship. We have an extended master program in sociology of one-and-a-half-year, of which one year is doing for 50 percent of your time an internship, and for 50 percent of your time writing your master thesis. The third really beautiful reason to come here is that we are very small scale. There is not so many students in sociology, and there is enough staff. This is favorable to lecturing and to entering rooms, lectures, and asking questions. This is really very good for students. Fourth, we have excellent student evaluations. They are really rated high, and students are satisfied with our lecturing. Fifth, and finally, we have high success rates. Last go-hard, 100 percent, so all the students succeeded in finishing their master thesis within half a year. I think this is really good reason to come here.


Hi, I'm Stacey Wilhelm and the scripture I would like to share is in First Nephi chapter 17. It's actually a comparison of four different scriptures. First, in verses 20 and 21, Laman and Lenuel are talking about the journey that they've experienced. Thou art likened to our Father, led away by the foolish imaginations of his heart, yet he hath led us out of the land of Jerusalem, and we have wandered in the wilderness for these many years, and our women have toiled, be in bed with child, and they have borne children in the wilderness and have suffered all things, save it were death, and it would have been better that they had died before they came out of Jerusalem than to have suffered these afflictions. Behold, these many years we have suffered in the wilderness, which time we might have enjoyed our possessions and the land of our inheritance, yea, we might have been happy. And then, speaking about the exact same journey in the first two chapters, their brother Nephi the prophet says, and it came to pass that we did again take our journey in the wilderness and we did travel nearly eastward from that time forth, and we did travel and wade through much affliction in the wilderness and our women did bear children in the wilderness.  And thus we see that the commandments of God must be fulfilled and if it be that the children of men keep the commandments of God, He doth nourish them and strengthen them and provide means whereby they can accomplish the thing which He has commanded them, wherefore He did provide means for us while we did sojourn in the wilderness. So even though they were taking the exact same journey, Nephi was grateful in all things and for the blessings that the Lord had given them. I know that the Book of Mormon is of God and I am grateful for its relevance in my life right now and I know it was written for us in this time. And I say these things in the name of Jesus Christ, Amen.


President Mohammed Buhari has asked the Senate to approve the request to pay the judgement debt in sum of 566 million Naira, 754,584.31 dollars, 98 million, 526,012 thousand pounds and 226 billion Naira. The monies were owed by the federal government through the insurance of promise 3.0. Buhari's letter of request was read at plenary by the Senate President Ahmed Lowry. I wish to request the Senate to kindly consider and approve through its resolution the settlement of the two priority judgement debts and general judgement debts incurred by federal MDS in the sum of USD, 566,754,584.31 cents, 281,801 Naira, 64 Kobo through the issuance of promissory notes. The Honourable Attorney General of the Federation and Minister of Justice and the Honourable Minister of Finance, Budget and National Planning shall provide any information that may be required by the Senate for the consideration of this request while looking forward to the expeditious consideration and approval of the Senate, please, except the single Senate President the assurances of my highest regards. You are sincerely Muhammad Buhari.


Good afternoon. I think it's time for me to get started. My talk, actually I'm going to, me and my colleague are going to give two talks on automotive security. One is on the canvas, canvas anomaly detection and another one is on the immobilized security which we are including demo and then we will open, we will try to hack the immobilizer on the site. So let me introduce my team first. My team is from the largest security company of China called Chiku 360. We have like over 7000 employees. So it's a huge company and we are also, our team specialized in the wireless security including the GPS, V2X security and anything that use video we are all interested in. So we have made some wireless hacking gadgets you can use. If you are interested in you can drop by our vendor area to say that what we have brought here. So let's get started. The outline of my talk would be like a quick recap of the status quo of connected vehicle security research. I would like 20 pages of power point to explain the current status quo. And then I will talk a little bit about automobile working principle because I had an automotive background so I want to share with you how a typical automobile work and finally I will get to the course, the meat of this talk, canvas anomaly detection which I will explain later. So this is a timeline of the car hacking development, car security development. It all started from like performance tuning. The hackers or the car tried to modify the firmware in order to like increase the performance of their cars. Maybe for example, if the car manufacturers have like a speed limit program inside the controller of the automobile, they might change that. And then immobilizer hacking which is with the purpose like they want to steal the car. And then it started from started to like remotely hacking the cars physically so you can remotely control the car too. That's kind of like a qualitative change because it started, car hacking had started to threat the driver's life. So these are the famous car hacking instance examples that have happened during the last few years. For example, the Tesla hack which is done by my colleagues and the BMW, the Jeep hack last year released by Chris Walasek and Charlie Miner. So that's why we should pay more attention to the automobile security. So this is a talk that Charlie Miner just gave just a few days ago. He talked about how to inject canned packets to control the physical features of modern automotive. My talk is targeting this kind of attack. I'm trying to detect anomalies by building a mathematical model that can detect this kind of attack like the parameters proofing and the packet injection. So this is how the Jeep hack, how they can remote control of the vehicle. You can see it affects a lot of cars because it's internet wide. A modern car, especially the ongoing development of the autonomous vehicles, they are facing various threats. For example, the sensor security that my colleague is going to talk about tomorrow, the LiDAR ultrasonic sensor and the camera that are all susceptible to the hackers. So this is last year's research by those researchers that they have done some experience on the autonomous vehicle sensors. And the GPS proofing also done by my team mate that we cannot hijack the car's location capability. So a little bit about the automotive working principle. How does a typical car work? I will explain only the aspects that only related to my research. A typical car has a transmission, an engine and the steering system breaking. So the engine output is powered via the transmission and the transmission controls the gear ratio so the car can vary its speed. So what exactly, why we only talk about the car hacking recently because the car has changed a lot. For example, this is a drive-by-wire system and the car has changed from like using the physical connection between the acceleration pedal to the throttle body. It was a mechanic connection but nowadays they have introduced like a drive-by-wire system which they use several motors to control the throttle body and they use the computer to control that and the throttle acceleration pedal now is just a sensor. So under the ECU, ECM, the electronic throttle control module is connected via canvas and on the canvas there is typically another module called infotainment system. The infotainment system is connected to the internet so that's what's introduced the danger, the hackable. So you can see the drive-by-wire systems, the acceleration pedal, the signal is gathered by the electronic throttle control module and the throttle control module outputs the signal to several that controls the throttle. And the engine control unit is connected to the throttle control module so it's dangerous if a hacker can gain control of the canvas that is used to network those ECUs and the steering by-wire system is also the same. Used to be a mechanic connection so you cannot hack the steering but nowadays you can see that there is a clutch and they're also controlled by ECUs so it's very dangerous. So automotive control system actually usually a typical automotive takes as its input the environment, environmental variables, driving conditions, vehicle variables, user variables, user variables, for example the driver's input, the gear, the acceleration pedal so that's the user input and environmental variables are like the sensory input and the location etc. And it's based on this input the vehicle controls the engine and transmissions to change those input. It's like a closed loop control system. So this is a typical vehicle communication system that consists of multiple protocols like lean and drive. Drive can, there is multiple canvas, diagnostic can and there is infotainment system which often use like most protocol. So actually I will, in my work I have to acquire the can traffic so I got my can traffic from the engine can and the drive can. So let me take the speed as an example to see how the system is susceptible to hacking. The speed is produced by the electronic, for example the electronic stability program they will use speed as its input. The engine management also needs speed to control the throttle so many ECUs on the canvas are using the speed as its input and the transmission need to use the speed to make a decision on how to change the gears and the adaptive cruise control of course it also needs the speed because you have to keep maintaining the speed. And then the initial navigation system they have to use the speed as well to calculate the location. Okay, this is canvas signaling. You should have two wires and it's high canal and it's differential signal is using differential signal. So this is not closely related to my research so I just skip those but you can see that the can signal is not like this. It's a differential signal so it's not susceptible to the common mode interference. So this is a can typical can frame structure. Can packets usually only have a can ID. It doesn't have a source or destination address so you cannot use like this. You cannot block the packets or filter the packets based on the typical computer firewall does. So you can only make your decision based on the contents that it carries. So this is a canvas access arbitration process. A canvas, all the nodes on the canvas can send packets with any ID value. So how and there are all connected to the canvas like this. So if two nodes on the network try to send a packet at the same time so which can, which node gets to transmit the data to send the data. It's determined by the arbitration process here. So packets with can ID value is lesser than the value of another can packets gets to send. So you can see that the lower the can ID value the higher the privilege of that packet.  How can you, how could you block that, how could you defend that kind of dark.  For example if the load A controls the engine if you block the communication of that module the car will be more function. So it's hard to like simply block the communication. And another problem is that the can, it's very hard to trace back to the senders. So as I just mentioned the car, the can bus only have a can ID.  So that's a, that's a problem too. And the third problem is that high cost of positive I just mentioned that if you just simply block communication between certain ECU and the other ECU so you will cause more than likely to cause problem. And all the packets on the can bus they are very often they are, they are real time parameters for example the current speed, the current RAPM. So the, so those parameters are required has time constraints.  You do some calculation on it to see if it is malicious.  That work would introduce delay. And it's not, it's not very good. So can bus attack usually includes this two kind, two kind of attack packets injection. For example you, an attacker, an attacker can, can observe on the, the traffic on the can bus to see what packets contains what features of the car. So and then he replays that packets or in, or modified packets to do some injection. So this kind of attack is very often. And the parameters proofing for example in the G-PAC the transmitter conducted that in order to control the, like the steering, steering at high speed you might, you have to like spoof the speed to make this car thinking that it's traveling at low speed because the car won't allow you to control the steering when the car is traveling at above five, five miles per hour. So it, you have to spoof the parameters. So, so that's, okay. So related research of car security, the SAE has also published the separate circuit guidebook for, for car security. And, and there's a national highway and transmission, transmission department they also published the, the, the white paper that stated that it's the, the need for intrusion detection solutions. So that's what my research is about. Now let's get into the meat of this talk. This talk is talking about like to detect the parameter injection and spoofing attack. So I have mentioned that the kind of network architecture is like they have two wires. One is kind of high and another one is high, high low. And these two wires is connected next to this. So how can you defend, defend against the, the attacks? The first, but not practical method is to introduce a gateway between every ECU and the canvas. But this requires very many changes to the, very, very, you can change the basic kind of network architecture and it's, so it's hard to implement. So I, I propose this architecture to defend, to defend against car, car hacking. So this is the original canvas, not modified. You just, you just add an IDS intrusion detection system to, on the canvas to detect the attacks. And then you use the, when an attack is detected, you, you, you control the wireless gateway that, for example the infotainment module that has internet, which has an internet connection. When you detect an attack, you can, you like control the wireless, control the serial connection or other kind of connection like Wi-Fi or Bluetooth. You just control those connections to prevent the hacker from further getting, getting control of your system.  So how to detect the, the, this kind of a, those attacks, those attacks I, I, I for mentioned. So the, the, the can manufacturers come up with like the intro fee based anomaly detection, which is, which is used the, the, or the intro fee on the network to detect an attack. They, they assume that if a, can network is, is, experience, or experience some kind of attack, the intro fee of that, of those traffic will, will change. But the, and the, you can see there, there is out there, like they injected four, four packets and they, they detected three of those. So what's the, so why those method is not very good, are not very good because, because they are not considering temporal features. For example, the speed is like a continuous variable. So if, if those next, the intro fee based anomaly detection, they cannot detect, they are not considering these kind of features. For example, the speed at time t is like 60 kilometers per hour. And t, t plus one, the speed suddenly changed to like 100 kilometers per hour. So that's, that kind of anomaly they might not be able to detect. And so my method can take into consideration is the, the relationship between one parameter, certain parameters to the other parameters. For example, the speed is related to the engine rotational speed and is related to the current gear, the transmission is, and is related to other, like the acceleration pedal, like the engine intake, the air speed, the, the air mass flow. So all those parameters are related. My method is to exploit those, the relationship to detect the attacks. For example, you, you, if the attacker want to, if the real speed, current speed is like 10 kilometers per hour, and the attacker tried to spoof the speed to show, he want to fall in the other, the other issue into thinking that the speed is like 60 miles, 60 kilometers per hour. The relationship between the RPM and other parameters will change. So for example, I have explained that the relationship can be used to detect this kind of attack, but how to implement it? For example, like this equation, just a linear equation of RPM multiplied by gear and multiplied by another constant, is the speed, is it, is it, is it, is it that simple? But it's not that simple, right? So you have this, this is like a typical transmission and it has many clutches. So when you have clutches, much you introduce nonlinearity. So the, the equation I've just shown is not practical. You cannot use a simple, mathematical model to describe the relationship between those, those two parameters. So, so this is, you can tell from the speed, this is a graph that I grabbed from, directly from the internet, that you can see the speed and the, the speed and the, and the gear ratio. They are not even like that linear, the relationship between, between them is not linear. And you can tell that the speed is also, it's a continuous variable. So these features are, you need to consider, we take consideration, take into consideration those, those features to detect the attack. So this is the real data that I, I received from the, my experiment, the car, the, my, my car, my experiment car. And you can see there, I, I, these are the parameters relationship. You can see the purple one is the acceleration pedal, the, the gas pedal. So you can see that when the gas pedal goes off, the, the general trend of other, other parameters also goes off, but you cannot use it as simple function or to like describe this relationship. So how to do, do this. And, and now I know that all the parameters are related. I can use the other parameters of current value to, to see that if another parameter is anomalous, anomalous or not, but how to implement that. So let's, let's assume that we already had, had like a mathematical model to describe the relationship of those parameters. So how could we use that, uh, mathematical model to detect attack? You, you, you'll receive the, the live data stream from the CAN bus. The CAN bus, uh, like for example, the speed gear, RPM and the acceleration pedal. And you use this par, these parameters as input to the mathematical model you have just built. And, uh, uh, and use, for example, you know the current gear, current RPM and acceleration pedal position. You use those parameters to, uh, to as input of, uh, of the system model, the mathematical model we just built. And you make a calculation, uh, you, you can say it's prediction of another parameter, for example, the speed. So, and the, the, the speed you received on the network, if it's deviate very much, too much from the speed you just calculated based on the other parameters, you, you can say that's an anomaly, that's an attack. So the basic idea is like this, to increase the accuracy, to increase, uh, uh, um, to, to reduce the error or force positive. You could use like, for example, the, uh, cross, cross validation you use. For example, the attacker is currently spoofing the speed. You use other parameters to, uh, calculate the, the, the speed. And you, this is one, one, uh, one result you can get. And, uh, and you use that speed, whether it is, uh, be the real speed or the spoofed speed, you use that speed, uh, other parameters to ca, to calculate the, the current gear. So, uh, it goes on like, and, and then you use, uh, uh, you, you calculate RPM based on the other, the rest of the parameters and then use that to do like a pulling.  And now let's get in, uh, to talk about, let me, uh, introduce how to build this system model. Uh, the method I employed is like deep learning. Deep learning is just, uh, although there are so many, so much, many, or hype about them, deep learning, but deep learning is basically just a, a, a method to build a mathematical model. So that's, uh, how the machine learning or deep learning work. So we, we, we now want as, uh, to build a mathematical model, but no, so we, the deep learning is using like a neural network. The neural network, you can, you can just say that it's, uh, it's, it's just a like universal function approximator. You could say that it's just a template of the, uh, mathematical model. So you have to use the live data stream from the car to train the model. The training process is like you, you give the, uh, um, this, this model some example and you, uh, you, the machine learning technique is used to automatically figure out the relationship of the, the, the parameters. So, uh, I don't know if anybody can have questions here. Uh, and I haven't, uh, deployed this, but you could do that.  So the relationship between the parameters will change. For example, yeah, a new, a new car, you press the X-ray paddle pedal slightly, the car will travel, travel very, very fast for an older car. It's not the case, right? So it's, so you could use, uh, so continuous, the, continuously updating the model is the best way, right? So, so you could deploy the system like this. The, after the training, this, this network is just a bunch of weights and the network configuration. So this parameters you can, like for example, uh, you, you could use a server so all the cars can grab the trend, trend, already trained model and deploy it on the car to detect, detect the anomalies. Um, another case is that if the car, uh, has, has wear out, the, the relationship has changed, you may retrain those model using this specific, specific parameters, the specific parameter of that specific car. So does that make sense? Okay, thank you. Okay, let me, uh, go on. So, uh, you can see this is just like a template of the mathematical model. All the, uh, let me use here. So this is a specific neural that in this network, you can see that, uh, there is the input x, x one to x n. Those input, uh, as a, as a parameters I just mentioned, you use these parameters and, uh, uh, I'll, I will introduce the, the input out of, under the input vector and the output vector of my system, uh, uh, first, uh, I'm wondering how, how many of you had a, a knowledge about the deep learning or machine learning? Okay. Oh, great. So, uh, you use the normal data of the car to train the model. So, uh, after trend, uh, after trend, the model can wear, uh, let me introduce the training process. Uh, this is a neural, you give it, uh, some training data set, some example to make the new neural network to figure out the relationship between the input and output. For example, I, I don't, I don't know the current, uh, uh, the previously mentioned that, uh, uh, the function is just a simple mathematical model. For example, the C, the constant is not initialized. You don't know what the constant is.  For example, there is, you can imagine that there, there is a curve, uh, on the x, y plane. The curve, uh, there, there, the, the part, the mathematical model can be used to describe that curve, but you don't know the mathematical model yet. So I, I gave you a bunch of points on the, uh, on the curve. And you, based on those curve, uh, those points, those, those, those x, y points, you can figure out what the, what the curve, the mathematical model that describes that curve is. Uh, I, I just, uh, uh, make, uh, take, take the example to explain what the machine learning training process is like.  So that's the training process. It's, it's, it's not exactly describing, uh, description of that curve because, uh, you have errors, but it's approximate, uh, approximate need, uh, uh, approximation of that curve, the curve of the mathematical model. So this is very important that has anybody understand this? Uh, no, you're training the, you're training the model using the, the, the normal data. Yeah, we'll accept the anomalous, anomalous traffic as well. Uh, so let me go on. So if you have any question you could ask me later. So you can see that, uh, uh, this is a training process. You can see you, you use the examples to, uh, uh, train the model. It's, it's like a first thing and you use the first example and you, uh, output, the, the output is zero. You can see that there's a threshold if it's larger than, uh, zero point five, you give it, uh, one. If it's lesser than zero point five, you give it a zero. So the first, the first example, you had this three input, you got zero output, but there's, there is, uh, zero point eight.  So you have to modify the weights. The, the, the hammer is like the modifying the weights of the network. And then you'll get that using another example, the training data. You can get this, this resulted here is right. So I just skip a little bit of this. And if you have an expression, uh, this is the experience card that I used. It's, uh, has many cyber physical features. You can, it's a hybrid vehicle. It was used battery and gasoline and it's, uh, it has electronic brake, uh, steering and the electronic throttle. So you can, and they have rich internet, uh, based features. For example, you can use a cellular connection. You can use their cloud service. You can use, uh, a mobile phone to remotely open the car for your friends. And you can use Bluetooth KVC. You can use, uh, uh, phone as the car's key fob. And it's network architecture is like this. So I mentioned, uh, previously that I acquired, acquired the data from the engine canvas. So the, the, the, the, this is exactly the same thing. Why I'm, uh, I would like acquire the data from the engine canvas because the engine canvas has all the parameters I just mentioned. Those related parameters are just mentioned. So I acquired the data from there because they're the gateway. So, uh, not all the parameters are transmitted on all the canvas. Otherwise it won't be, uh, lead for the gateway. Uh, so, uh, the canvas, uh, they can't data, they can't package. Uh, what can, can't, can't package with what ID, uh, is, uh, carrying what kind of parameters is kept highly confidential by the manufacturers. You have to do some reverse engineer to understand what's, uh, what's in the payload of those packets. So this is like the result of my reverse engineering, uh, work. And you can see there are many parameters. For example, if you turn, uh, uh, single nights, there will be a packet on the canvas. And these parameters, uh, after your reverse engineering, you get a canned database that's highly confidential. Okay, this is an example just to show you how, how to, uh, how those, uh, reverse engineered, uh, signals look like. You can see that the, the canned payload is actually eight, typically eight bytes. So what, uh, the signals like the right turn signal is, uh, only like, uh, one byte. So that one, one bit, one bit, that one bit indicated if, if you are the right turn or left turn. So that's the signal. And, uh, so the whole process of building the mathematical model is like this. You acquire the data from the canvas and then you'll do some deep process, prep process on the data and then you analyze the data, the reverse engineer. And then you'll select the features that are related to each other. And uh, you're training the model and then finally you're testing. So this is the procedure. So this is data acquisition from the engine can. I use the computer and the interface device to acquire the data.  Uh, uh, this is a raw traffic, uh, that the can package capture tool called the bus master is open source. You could try to try this at home. And uh, so the data, uh, at, at different scales. For example, the RPM might range from zero or ranging, might range from zero to like 1,000 the RPM. You have to do the conversion to get the real RPM and the speed also like this. So you have to, before you use the data to train, train, train the model, you have to normalize the data to convert to make them ranging from zero to one. So that's normalization and interpolation. Our experience is I use this simple, uh, um, um, simple like equation to convert to, to normalize the, the, the input and the interpolation because, uh, I, I just mentioned that the can package have different privileges. For example, the, the, the package with lower KID value has highest privilege. So it gets to send more often. Yes. It's often that's part of it. Those parameters are important. They, they are transmitting at high, higher frequency and those and, and other parameters may, may, may have lower privilege so that you can see that, uh, uh, you can see that when mini-map package may transmit like twice once per second, but other parameters might appear only like once per second. So you have to interpolate to do, derive the, the, the, the, the value of that parameters. Uh, uh, as those, uh, when, when the parameters are not transmitted on the network. So you have to interpolate. I'll stop sampling. After you interpolation certain parameters are not, you will change very, very, very slowly. You can see this, the parameters, uh, that, that, that as the most left side, uh, column is, uh, is, uh, uh, time in, in microseconds. So you can see the parameters, uh, the parameters, the intake pressure, uh, is not changing that very fast. So you, you could go to some sub sampling to, you know, to make the, uh, trend in set, trend in data set smaller. Okay. Uh, after the sub sampling is like this is change. You can see the changes of the, okay. Uh, this is very important, very important. How do you, uh, uh, get the input vector and output of, of vector of those parameters? Um, you, you can see that, uh, because, uh, most of the machine learning techniques, they are supervised learning. And now I only have the, uh, normal data of the car. I don't have the attack traffic on the car. How do I try this model? So I, I used this. I used, uh, because I mentioned this, this, these parameters are all, uh, continuously variable. So I used the, uh, the value of those variables, those parameters, uh, the, the value of those parameters that form like time, uh, use the previous values to predict the values of, uh, uh, and use like, uh, how to explain this. I used like, uh, the value of those parameters from like time minus, uh, 10 to time t minus 1. I used those values of, between the, that time to predict the values at time t. Does that make sense? So, okay. I used, uh, so, you can see that I used like, um, seven parameters, seven parameters, the intake pressure, the RPM, the speed. Those parameters, I used the, uh, values, values of those parameters from time to minus like, 10 to, uh, to, to time minus 1. And to use those values to predict the value at time t. Uh, okay. This is how I, uh, how the input vector and output vector of the neural network is formed. How this, uh, I don't know if everybody can, can see this code. Uh, actually this code is used, uh, is, I used the open, open source, um, deep learning, uh, uh, software called Keras. This software is very simple to use. You just, uh, preprocess this data. It's in Python. It preprocesses this data and, uh, you, you, you'll split the input vector and output vector and use those data to train the model. After train, then, then, then we show you the result. So, uh, the, the, this is the, the speed. The, the one, one of the curve is, uh, curve is the prediction, the, the, the result calculate from the mathematical model. Uh, okay, okay. Output vector, I think I, I talked about that here. And you have this, uh, you can, you can see that the only data I have here is this kind of data. Those curves, those curves, the only data I have, and these curves are normal data. I don't have the, uh, don't have the attack traffic. For example, you, you, you'll slip the traffic when the attack, attack is happening. I don't have that data.  And, uh, not only I think it's not that simple.  So, you're not based on the decision. Uh, you're not predicting the, the, the speed. Only using the speed, the past speed. So, you are also using the past values of those RPM intake pressure or, or can you understand that? Okay, great.  You use, uh, uh, the curve. This, this section of the curve to predict a single, single point at this place. So, okay. Okay, this is the result. You can see that, uh, uh, it looks, uh, pretty, pretty good. Okay. There's the speed. You use, uh, you use, uh, all the parameters for, uh, to predict the speed. It's pretty, pretty good. And I used, uh, measure to, to measure the, the, the, used, uh, the mean square error as a measurement to, of the deviation between the predicted speed and the real speed I received on the network. Uh, because, because, actually I have plotted the, the mean square error on this graph as well because it's not on the same scale. So it, it cannot see it. So I reached, plotted it here. So you can see this, uh, this is, uh, point zero, zero four that the scale. Okay. It's much smaller. So let me try to, uh, try this on, uh, like attack, uh, uh, attack. This attack is like the RPM is, is the, the, the attacker is replaying the RPM. It's like spoofing the RPM with the original, the, the right RPM is also transmitting on the network. So you can see that the RPM when you plot it is oscillating because they are sending it the same, like the same frequency. So you can see the curve is oscillating on the top right left corner. And, uh, this is the abnormal RPM.  And, uh, you can see, uh, below is the attack and above is a mean square error. You can see when there is an attack happening, you can see the prediction. The prediction is deviated very much from the actual value you're, uh, you're acquired from the network. Okay. Uh, I think this is, uh, all, all I got to have any, does anyone have a problem? Okay. No problem. Oh, the threshold. Yeah. This is, the lower the threshold, uh, the fourth more false positive you may get. Yes. How do you do it? Okay. You have to, like, uh, next stage you use the real attack and may, and there may, you may create some attack traffic and test that and then based on those test results you'll get the threshold. Or maybe you can make this threshold adjustable. That's based on, yeah, that's based on your, uh, anyone has a problem? Question? Okay. Okay. Sorry, sorry. My English is very not accurate. Oh, that's what would be a big, big problem for him. Yeah. If you just try to speak, uh, I used actually, I, this is like a prototype. It's a preliminary research. I used like seven parameters. But if you are an attacker tries to send all this kind of parameters, I think it's very hard because you only can control of one ECU on the network. You should, uh, one ECU on the network usually. So you can, canvas the speed of the canvas is, uh, not only the speed is limited, but also if you, through all this, you have to first make this kind of model in order to spoof all the parameters, right? Because, for example, if you want to spoof all the parameters, you have to build a model that describes this relationship between those parameters in order to decide what value to send, right? Yeah. Yeah. Yeah. Even, even, even if you do an attack like this, that you spoof all the parameters, I think this, this model can still detect the attack because when you spoof the traffic, you have, if you're not, you don't have this kind of model. This model, the, this, the model, because I use the data from a specific car to try the model, even if you spoof all the parameters, I think I would still be able to detect that attack. Do you remember the polling? You cannot, well, for, for example, an attacker usually don't have the capability to, like, uh, spoof the, the, the, the, those values so perfectly, I think. Playback the data. Playback the data is, is still can be, is still can be detected. You see the oscillation, the oscillation, you mean, uh, spoof, as you mean, replace the data traffic while blocking all the normal traffic. The car, I think the car would have already stopped, right? I can't differentiate between this, this, this two scenarios because, uh, if there's a mechanic finier, I think, uh, it's, it is, I think the information that, like, for example, you, you could, the system would opt to, opt for this kind of scenario as an attack, but I think it's still informative to know that. Uh, I beg your pardon, sir? Oh, you mean just like, uh, differentiate. I think your question is, uh, is very familiar with the, the, he asked. And I think, uh, with more work, you can do that. Once you detect, uh, detect an attack, you add another stage between the final decision and this detected attack. You could use, like, a database that, uh, describe in the situation you just mentioned and, you know, do, uh, add a filter to that, maybe. But I, yeah, I, it's just, um, like, sir? Oh, you mean that those parameters are not related to, like, the, those packets not, not related to other parameters. For example, a random human input, right? For example, the break, uh, you don't know, you cannot say, predict how the user are going to press down the break. That kind of attack, um, this model cannot be used to detect, detect that kind of attack. For example, if the attacker want to, like, send a packet that only gets sent when a user press certain button, button, you cannot use this to detect that kind of attack. But I think there's more, I think the, the, this model covers, uh, the most important attacking scenario already. For example, the speed, RPM, acceleration, this, this, this attack can all be detected.  This kind of attack is, like, based on the user's random input. I, I, I assume it's random because I don't, don't have sensors to take the current, uh, environment where, where, where it is, uh, across in front. I cannot detect. So I, I assume it's random. So I cannot, cannot detect this kind of attack. Oh, I haven't considered that, but I think it's necessary to consider that, you know, because you, the system is certainly going, going to get many, like, false positives. And I, I, I said, suddenly it happened to me that the question that, that gentleman has asked, I, I think I got, uh, another, uh, had to further answer. You, you said that, uh, uh, certain parameters for, for them, the, the, the charimeters work. And uh, uh, recently the cement, cementics company has released their, their product. Those products are based on like the, uh, they also use machine learning. Uh, uh, but they use machine learning to learn the frequency of certain parameters. Uh, or the frequency of certain packets. So, uh, I think, uh, their system might be, uh, I don't think their system will show the problem you just mentioned, but I think it's, uh, uh, would, would add, uh, add capabilities to the, the system. And I, I heard that, uh, uh, some, some academic researchers also had the idea of, like, um, measure the, uh, subtle deviation, subtle, subtle error of the certain packet, because the, the ECUs, they all have the, the, the microchip. This chip, the, the, the timers, the, the, the accuracy of the timers, uh, very high. So the, the certain packets you can see that it's, uh, the periodic messages, the packets are, uh, different packet, the time, timing, what, what exhibits anomalous behaviors. Okay. Have anybody still have questions? Okay, sir. I, I, I wish, I wish I could, uh, add more parameters to the system, but, uh, a typical car only have the, the, the, the, that many parameters, uh, like related to each other. So if you are able to, like, mount all more sensors on the car to monitor in more parameters, and those parameters are also, uh, like, related to each other, I think it's what dramatically reduce the force positive rate. Uh, I beg your pardon? Okay. Okay. I don't know how much time I have to spend here on this. Okay. And the next talk is also from the research done by my, uh, by Unicorn team, my team. And, uh, oh, sorry. Uh, I think, uh, uh, there's a client man. So, okay, I am not very that, uh, machine, uh, machine learning savvy. So I asked them, I had help from those, those folks from my company. There's Professor Shui Cheng Yan from the Shihu Shui 60 Institute of Artificial Intelligence. They are very good at the deep learning. And, uh, I have, uh, uh, Dr. Min Lin from the Institute of Artificial Intelligence there, which is a student of, of Professor Shui Cheng Yan. And I also had, had, uh, from my colleague, Dr. Lin Huang from, uh, my team. So, uh, hereby, I acknowledge, uh, appreciate their help. Uh, these are the references. So if anybody who is interested in, uh, cash security research, you can, you know, reference, you create those papers to take a photo. Uh, it's, uh, I think the, the carol, uh, carol cautious, uh, research on the Chinese research are, are very good. And, uh, okay, other research. Okay. Um, so the, the, the, the, okay, fine. The, the last page. Okay. Many, many paper to read. Okay. Okay. Thank you. Thank you everybody.


Juan Tare O'Nongo has passed on at the age of 87. O'Nongo, who heard from Giotto Acaquande, local government area of Benway State, was upon the secretary-general of the deformed Nigerian People's Party, NPP, and the former chairman of the noven eldest firm NEF. He passed on in Jaws, Plateau State. He had heard several political positions and was involved in constitutional conferences where he contributed to the social, political, and economic development of the country until his death, the late Steve title hold of Juan Tare was chairman of the board of the Nigerian Educational Research and Development Council and the RDC. Hello, hope you enjoyed the news. Please do subscribe to our YouTube channel and don't forget to hit the notification button so you get notified about fresh news updates.


The Ministry of Agriculture, Fisheries, Food Security and Rural Development, in collaboration with the Food and Agriculture Organization, FAO, held a consultation meeting to gather input on the current state of the agriculture sector in order to develop the agricultural policy framework and strategy for St Lucia 2023-2030. The agriculture sector in St Lucia has faced many challenges in recent years, including climate change, limited resources, and the need for increased productivity and competitiveness. With this new agricultural policy framework and strategy, the government aims to address these challenges and create a more sustainable and inclusive agriculture sector. Permanent Secretary of the Ministry of Agriculture, Fisheries, Food Security and Rural Development, Barry Morphilicier, expressed his appreciation for the valuable input and feedback provided by the various Ministry officials, emphasising the importance of collaboration and partnership in achieving the goals and objectives of the new policy framework and strategy. The agricultural policy for the Ministry of Agriculture expired in 2022. We sought assistance from the FAO, that is the Food and Agriculture Organization, for the development of a new policy. This policy is supposed to run from the year 2023 to 2030, in tandem with the 2030 Sustainable Goals Development Agenda. Therefore, the Ministry is ensuring that we meet those international milestones and the commitments that we signed up for. According to the lead technical officer on this project attached to the FAO, Ruben Robertson, the new framework and strategy aims to enhance the productivity of the agriculture sector in St Lucia, while promoting sustainable growth, especially in light of the new challenges Benin faced. We want to make this strategy homegrown, that is owned by not only the Ministry of Agriculture but all the stakeholders in the agricultural sector, so that together we can change the dynamics in terms of having a strategy that not only focuses on the recovery of the agricultural sector, but transformation, doing things completely different, making agriculture more attractive to the young people, making agriculture more responsive in terms of reducing the food import bill and at the same time increasing and enhancing the livelihood of all the people who seek and eat a living out of agriculture. The Ministry of Agriculture, Fisheries, Food Security and World Development is committed to ensuring that the new agricultural policy framework and strategy for St Lucia 2023-2030 is aligned with the needs and priorities of stakeholders in the agriculture sector. The policy is expected to create new opportunities for farmers and other stakeholders and contribute to the overall development of the country. From the Communications Unit of the Ministry of Agriculture, I am Anisia Antoine reporting.