Hi, welcome to this USAR 2020 presentation, a risk-based assessment for our package accuracy. My name is Andy Nichols, I am the lead for something called the R-validation hub. I will be introducing that hub today before handing over to Julianne Manitz to talk about the risk-based assessment framework that the hub has jointly helped develop. We are here representing both the hub and the executive committee, the names of which you can see on the slide. So that's Doug Kelcoff, Yolong Zhang, Lynn Taylor, Joe Rickert, Min Lee, Kevin Amerson and Julianne and myself. We have included an abstract for our talk. I won't read that out. It's a short presentation and we'll be covering it in the next couple of slides. But the format of this presentation will be such that I'll just introduce the hub and what we do and then I'll hand over to Julianne to introduce the particular challenge that we face within the pharmaceutical industry and to talk a bit more about the framework that we've developed for our packages. So the R-validation hub has been in existence for around about two years, coming up to two years now. We are an R-consortium-funded working group and over the two years that we've been in existence we've grown to the point where we have around about 100 members from 50 different organizations. We work within the pharmaceutical industry and therefore most of those organizations are made up of pharmaceutical companies but it also includes independents, contact research organizations and regulatory bodies as well. This is a large group of people. Our mission within the biopharmaceutical industry is to enable the use of R, in particular in a regulatory setting so where the output may be used in submissions to regulatory agencies. This is something that has been a challenge for a long time and it's not an area where R is actually used very much today. So before I hand over to Julianne I just want to let you know a little bit more about the R-validation hub and give you some information should you wish to find out more. So we have a website www.pharma.org. From that website you will find blog posts giving you up-to-date information about what the various streams are working on within the R-validation hub. You'll find this presentation and previous presentations that we've delivered over the last couple of years and crucially you'll find the white paper upon which all of this work is based. So if you want a bit more detail around some of the things that Julianne is going to be talking about please navigate to the website and have a look at the white paper. Julianne is also going to be introducing a couple of tools. In particular she's going to talk about an R package called risk metric. If you want to have a look at that package then you can navigate to our github page which you can get to from the from the main website and on that github page you'll also find various other resources and things that we've developed and soon you'll be able to find a risk assessment application. So that's a shiny app that implements the risk metric package and allows you to add comments to that and generate reports for documenting the reviews that you performed. All of which Julianne will talk about in the next few slides. So at this point I'm going to end and hand over to Julianne to deliver the more interesting part of the presentation. Thank you very much. Thanks a lot Andy for the introduction. My name is Julianne Mannis. I'm a member of the R-Validation Hub Executive Committee and I help with the communication. Working with R in Pharma means working in a regulated industry. We are facing a number of different regulations and here I just want to mention two of them. The first one is the good clinical practice guideline by the International Conference on Harmonization of Technical Requirements for Registration of Pharmaceuticals for Human Use, short ICH. This is an international quality standard for conducting clinical trials in general. They state that software use should be reliable and the documentation of appropriate software testing procedures should be available. On top of that in the United States FDA, the Food and Drug Administration, has similar guidelines and further specifies validation as establishing documented evidence which provides a high degree of assurance that a specific process consistently produces a product meaning it's the predetermined specification and quality attributes. In other words software validation needs to establish three things, accuracy, reproducibility and traceability. The R-Validation Hub focuses on accuracy because reproducibility and traceability refer to environment in which the statistical software is executed means no difference between R and SAS. Validating R can refer to different things so when talking about R we can refer to Core R which is the base product owned by the R Foundation. This includes the base and recommended packages that include packages such as Survival, MGCV and R-PAD. So you can do already a lot with just a base Core R packages. However to make real good use of R it's essential to use community contributed packages which may have different owners varying quality and varying popularity. Guarding the validity of Core R the R Foundation fortunately provides a guidance document on regulatory compliance and validation issues. This document provides details on their software development life cycle and good practices that ensure accuracy. For instance hiring of highly qualified individuals, proper maintenance of R source code and control of releases, testing of each R release against known data and known results as well as the identification of issues and resolution prior to release. It can be therefore concluded that there is a minimal risk in using Core R for regulatory analysis and reporting. That is great news. However for contributed packages things get a little bit more tricky. We know that for each package on CRAN that it has been had to pass a series of technical checks but that does not necessarily guarantee the accuracy of that package. One way to assure accuracy would be to develop your own tests. However we already know that the maintainer of the package provides their tests and in addition popular packages go through some type of community-driven peer review testing and that considering the other Lidation app is suggesting a risk-based approach to evaluate the accuracy of contributed R packages. Let me walk through such a suggested framework. In the first step we would qualify whether a package is intended for use, means the user is directly loading it into the R section or whether it is a dependency and indirect import through these packages. If it is a dependency maybe minimum checks for suitability are enough. If it is intended to use we further process the package in a risk assessment. In the first step we figure out whether we want to make use of a statistical method implemented that also includes algorithms and things like that or if it is just non-statistical such as data manipulation, application interface, communication or plotting. If we have a non-statistical package the establishment of various metrics the measurement through various metric might be sufficient. So one bucket would be checking whether good practice of maintenance has been is performed and that can include existence of vignettes, websites, newsfeeds, form a mechanism of bug tracking or whether the source code has been publicly maintained. In addition the community usage should be assessed in a risk metric. We assume that the more exposure a package has by the user community the more ad hoc testing has been performed. Therefore the better the quality. If the requirements are not met we can always go back and check the test coverage by the maintainer or add even more testing by ourselves. Based on that risk assessment we should be able to determine whether a package of interest fulfills the requirement accuracy for a given use case or not. You may require higher standards for submission relevant work by accepting lower standards for exploratory past-hoc analysis. So this is all very theoretical. For practical purposes they are fortunately already tools which are implementing those particular metrics we have been talking about. Let me introduce you to the R package risk metric which has been led whose development has been led by colleagues co-authoring this presentation. I selected a few packages with different popularity in order to illustrate how it works. Our risk metric is itself not yet on CRAN but can be also included. U-Terts is an R core package. Ggplot2 is a very popular tidyverse package. HMS is a little bit more old school. ServeMiner is less popular but well established in pharma and Cox robust has been the author's package on CRAN at the time of selection. First risk metric is referencing the selected packages and with the call of the function package assess the package metadata is assessed and the package metrics are stored. This information is then converted into a numeric score value between zero and one where zero refers to poor and one to great quality. Finally each packages risk is summarized in a weighted sum of assessment scores. The rates for each metric can be determined by the organization. As an output we get a number of metrics for evaluating good practice for maintenance, the number of downloads for community usage and test coverage as well as the overall risk. We'll leave you with a short introduction. Hope that you can answer the question whether it's time to integrate R properly, integrate R into pharma and want to strongly encourage you to get more information from our website pharma.org. Please feel free to sign up for the mailing list to stay up to date and any feedback and experience on the implementation of the framework in your organization are very welcome. Thanks a lot for your interest and attention. Bye.


When I heard that your company is the biggest venture company in Angola, I was expecting to see an old man. Old man? Old white man. Old white man. Old white man. I love that. So I'm Wilson Ganga. I'm an entrepreneur here in Angola. I have a dream to bring millions of jobs in Angola and also a big dream to build up Africa and bring education and financial inclusion. We have a company called Pay Pay Africa which is leading the fintech here in Angola and I'm very excited for you guys to hear a little bit about me and thank you for all of his team and for choosing to interview me. So thank you guys and I hope you guys enjoy the show. Cheers. You guys did this. We did. We did it. How? Hard work, knowing the market, studying, being able to study outside. And having education from America also opened up the ideas. And we have a good young team. Good young team and good people, good family. And then the last six years, the Angolan government also opened the laws. They made it easier for young entrepreneurs to be able to apply for a license for a fintech and we did it and it's going good. I think people watching us don't know who you are. I just want, first of all, my first question will be like, what makes it the biggest fintech company in the whole of Angola? It's the biggest because of transactions, the number of customers that we have. We have about already one million paying customers that are transitioning every single day. And it's one of the first also too. The biggest is also one of the first, you know. And we have many services to imagine. From our local currency, you can pay Netflix, Apple Music, you can pay services outside from our local currency. So it's big for our customers. It's good. I want you to explain this. Yeah. What does your company do? Yeah. So it's a mobile app, a digital wallet app, where we connect with all the banks in Angola. And with it, you can make payments via SMS transfers, payment by QR code. And that's pay-pay. And then inside our group, we have Dilever, which is the biggest electric car company taxi in Angola, which connects to pay-pay.  So it's a big, it's pretty much a super app. You can do anything. So that's why it's important. And you are saying it's the first ever in the country? Yeah, it's the first in Angola. So if it means that something that did not exist? It didn't exist before. Where did the idea come from then? I mean, traveling, touring, and also coming from solving problems. As we talked about before, if you go to ATM in Angola, there's many, many people trying in the line to get out cash, right? And many, many, many, many of Angola is just always cash, cash, cash. So we try to make a way to make payments more secure and able to have financial, to have your financial services more in your hand, you know? So, thank God we created this idea and it's going good, yeah. If you have the biggest FinTech company, I want to ask how many people have you guys employed so far? In the FinTech right now, this company is probably the least people at 40, but in a group, overall, it's 10,000 people. From the mobility company, Tileva, from Tupuca, which is the on-demain delivery service, which were so many restaurants, supermarkets, everything is connected to our system from the tourism app. So we have about 10,000 all young people. Okay, I'm the oldest, maybe at 31. What do you mean you're an oldest? At 31, you know, but all of them like 20, 25, 26. So we're doing things pretty good here in Angola market. No, I don't want us to rush this. I want to know the history, the dream. Who started this whole dream? It was started at, okay, first it started with me back in America. You know, I feel like I was very fortunate enough to go get a better education. You know, my parents were able to pay in education for me outside. And I was like, wow, like, Africa, there's a lot of poverty. There's a lot of lack of education and lack of job opportunities. So my dream overall was trying to bring the education I was experiencing there and bring value here, right? So that was my goal of bringing jobs, you know. So it's like, because many people that maybe didn't have this opportunity before, maybe building an economy by bringing jobs, bringing education, then people were going to be able to also start making money and start investing in the economy. So that's where the dream came from. How long did you live in America? I lived there for 17 years. But ever since I've been back here, I've been obsessed with Angola, you know. I don't understand how you get the chance to go to America. Yeah. I lived there for 17 years and decided to come back. In Africa, we have a question that we normally ask, is everything okay with you? Exactly, exactly. Is everything okay with you though? Or you want me to check? We've got to understand that America is not ours. Like, at that time Angola was in war. So the education system wasn't good. So many families, they couldn't, they put their kids outside to get a better education. But America is not ours. Our home is Africa, man. You know what I'm saying? And we have a lot of natural resources. We have a lot of opportunities. We're very, very smart. People just need a chance. You know, it sounds like, man, if I could go back and give people a chance, bring jobs, bring ideas, bring innovation, maybe I could help build, I'm doing my part. Maybe I could do my part and help build the economy. And we've been doing so. How long have you been back? Back now, about 10 years. Will you say it's worth it coming back? Of course, man. I think Angola is, you know, it's difficult. But it's your home country. It's your love. You're born here. This is your soil. This is your land. No one's taking you out. I believe that since you're playing on home grounds, you're scoring more goals. Exactly, exactly. So it's for people. And people look at you as a hero. And as an example to them. So that's why whenever I can share my stories to people, right? I try. I try my best. Sometimes I'm busy, but I try my best to go out and give speeches, right? At advance, try to do something on YouTube just to share my experience. Because I may spark a light bulb on the next entrepreneur that also is looking for ideas and motivation. You never felt like a hero in America? I mean, I played sports in America. I played football. I felt like a hero. I was very good at football and basketball, you know. But it's American. It did its job. But man, any African that's going outside and getting a better education, okay? You must come back and do your job for your economy. The economy is us. If we can't complain that Africa doesn't have the infrastructure, we need to come back and fix. Like if everyone does their part, you're going to have a big, rich economy like the Mansa Musa days as it was before, you know what I'm saying? But everyone has to do their part. We can't run away from this. It's like, thank God for the first world country that do our part in getting a better education. But we must come back and fix our economy. It needs. I really want to go around your office at a moment, but I want to ask you something. When you hear the name Africa, what comes into your mind? Opportunities, you know. Opportunities, rich, natural resources. Like I'm talking about, you can go down the street here and you'll see a palm tree. You know what I'm saying? A palm tree. Or a coconut tree, you know what I'm saying? You take this, and this grows coconut tree. Naturally, like this is natural. Without you doing anything, you can just take this coconut and you can sell it. There's countries in the world that don't grow coconut trees. You know what I'm saying? So it's like, it's crazy. I can go to the ground and I get a diamond. You know what I mean? The first world country is looking for this type of, you know what I'm saying? Everything grows here, but it needs us too with our knowledge to be able to explore this. If you have a message, since you also came from the diaspora, if you have a message for the diaspora, what would that message be? I mean the diaspora is anyone who was born in Africa, left, and they're not thinking of coming back home. Stop playing games. Time to come back, man.   It needs all of us, okay? I'm doing my part here in Angola, and many other Angolans are also motivated in doing their part. But in the future, we can create one big African economy, like as it should be. We see the first world, and they did it very, very well. But it's our time, man. And it's because our older generation, they're getting old. My parents are like 60s, you know what I'm saying? So we're going to be the future. So it's like if we don't do something now, maybe our kids are going to be living the same thing that we did. So it's time for us to make a change. Yeah. I want you to take me in there, man. Okay, good, good, good. So. Oh, thank you. Yeah. So I basically want to know how this whole system works, the apps that you have, how it works and all of that. Yeah, it's, like I said, it's one app. You download the app. It's three different apps, but all built in one. Now it's pay-pay. So it's one FinTech app, which you can buy your telephone services, TV services. You can buy, you can buy water bills, all the stuff like this. You can actually call your taxi. I guess the best way is to explain, you know? So here you can call your taxi. You can scan by QR codes.  So it's, you can do many different things inside of the pay-pay app. And we're always trying to bring more services inside. How many services are you guys running so far? I think we have like hundreds of different services, you know? But different services where you can just pay directly in the app, but from merchant standpoints in Angola, maybe we have 2,000 merchants, you know, that we can go and just pay with your phone. So without having to take out cash or paying card, you know what I'm saying? It's cash is very tricky now, you know? Yeah. Maybe the notes are fake. Maybe even the machines, it's a lot of fraud and stuff going on around the whole world with the card. So the goal is to make payments more secure. How many users do you guys have? About a million people. I've already downloaded and active users using it every single month. Wow. Yeah. Would you say just creating this app is so worth it, man? Yeah, it is. It's going good, you know? It's cool. It's alright, you know? I'm talking to a young billionaire. Not yet. Not yet. I think I wish. How soon? Yeah. Maybe 40. The goal is 40, you know? 40? Yeah. So this is off. This is off. This is some people working. Some people working here. Are people upstairs in open space? Yeah, we can go in open space, yeah. Chinese is for development, making sure that our system is secure. So you guys own this office? Yes, yes, yes, yes. The whole office? Yes, yes, yes. This part, this is our part. This part. Okay. Here we'll go to the open space, the marketing and sales team. Right now, most sales people are on the streets. Yeah. Oh, okay. Most people are on the sales street. Yeah. This is the marketing director. This is the other marketing guy. This is their little thinking area. Sometimes we do podcasts and things here. Oh. Yeah. So it's like marketing and sales. And I think we can go here. It's more like IT and customer service. Okay. I think some are having lunch right now. Oh yeah. Some are working here. I came out at lunch time. How? See, you have people that like you, right?  I've been in China, right? Yep, yep, yep. I follow your videos. Wow. That's nice. Nice to see you. Good to meet you too. Yeah. Let me, let me hug you, man. Thank you. I see. I think your last, you were in Namibia. Yep. And wondering that you didn't know. The Angola, I just walked to Angola, but I couldn't get the visa to enter. But I'm here now. Yeah. So Elders are CTO. So here in charge of all the technology, the system, make sure things are working perfectly. Oh, nice. Let's take a picture. I'll take it, I'll take it here. Thank you for sure. It's good. Yeah, make good content. Here, one, two. Good, good, good. Thank you. Thank you so much. Yeah, so I'll walk you here. Yeah, so this is a little bit of just the paper office. That's the area where they eat. Then we'll walk down here. This is my office. So this is the goal. So I guess my dream is this, you know. Okay, one young artist painted this for me, but it pictures what we're trying to do here. You see, okay, Africa, there's an Angola, but we're trying to build this. You know what I'm saying? Like we, Africa needs to be like Dubai or the next big metro city starting from Angola. But of course, the Angola is not the end point for us, right? It needs to be the whole of Africa, all the entrepreneurs to be together. So this in general is, I like to put this here.  What has been the major challenge setting this up in Angola? Dealing, adapting to the education in here in Angola. We have a lot of people that are very motivated that want to work, they want to get jobs, but they don't have the work ethic and they don't have the skills. So it's the ones that do have the skills and educated maybe their salary range is very, very high and affordable for us. So it's like we try to work with people that are, okay, they might not have the skills, we build skills, right? We build skills, we can help with education, but we look for people that can do or die. They'll ride or die with us like midnight to midnight, they're ready to work, right? But then we'll help them grow. But at the beginning, most of the problems we have is because of this lack of skills. So it just sits, because the older generation, the education wasn't that perfect. We're losing with this, right? I know some countries like Ghana or Nigeria, the education, I know the people are very, very more skilled, but it's happening here. It just takes time. I think you have to give them a little bit of context of what he's saying. I think people don't understand. This is a country that has gone through war for over 20 years. So for him to say that, I believe that is a meaning because so far I've never been through what they've been through. It was like 30, 40 years we went to war for colonization, which was Portuguese. Once we got to country, then we went to war between ourselves. So it ended in 2002. So at that time, of course, we didn't have the best doctors, the best educators, of course. So it's just from 2022, that's when the country started building. So the country is really only 25, 30 years old. So it's not the country's fault, we're pushing. It's the generation that's coming from outside. We need to do our part in trying to make it better for the next 20, 30 years. But you know what, I'm so inspired. You look so young and what you've done. I believe that there's so many young people out there that will be so inspired of what you've done. If you speak to a younger guy watching this video right now, what will you tell him? It's time to work. I'm all about entrepreneurship and creative jobs, so we need to understand that not everyone has that skill. It's normal. If you don't have the skill to create and be a business person, then okay, find a good employer and try to do your job and try to be the best worker and give it all to them every single day and help them accomplish the dream. For those who are young and you want to try to build something, do it. You can fall. At least you're still young. When you wake up and brush your shoulders off and do it again, until that door finally opens. How many times did you fall? A lot. We still fall every day. But now I like falling. You know what I'm saying? You start getting bored and you just want to risk. Before, the first risk was always the most difficult. After the first risk, you're like, shit, I need to work. Every crazy idea, let's do it. You don't have that fear anymore. Some people have that fear.  But if you don't die, okay, you get up, then you get up and do it again. I don't believe that you really want to take this business to a different part of the continent. But that's definitely a challenge. Of course. That's what I'm saying. As we said before, I think all the leaders, the politicians, need to sit in Africa. As we business people do, you sit, maybe one guy in Nigeria, remember the guy in the central, I'll tell my president to try to do this. Invite all the leaders here for a network. And they have good food, good wine, and this has a closed dialogue with each other. We all sometimes depend on support from other different African countries.  We need to be free, right? Free, free between borders, each border. Even though we're trying to make money, okay? Let's just be open, right? For me to go to Nigeria or Ghana, I should need a visa. For you to come here, you should need a visa.  You know what I'm saying?  You look and go on in 10 days. 10 days of you, you're like, come on, it doesn't make sense, right? So things need to be open. And once we have this happening, I think we're going to have a lot of business between us. Maybe we can be self-sustained. As an African continent, we can be self-sustainable. But it takes someone to just do it. That's why it's like we need to go younger. Leaders need to start going younger, because I think younger people, especially the coming from different countries, you understand you need to network. For me to do what I'm doing is I've networked a lot. And I have friends that go out and go see, and you talk. And maybe our leaders right now are very political and military. You know what I'm saying? So when it's military, military people are more strong. You know what I'm saying? They have to... That's how they were born. That's how they were grown. It's not their fault, right? But I think now we're at a different level of doing business. Now needs to be networking relationship. We need to open up the market. Are you hoping that someday businessmen will run Africa? It needs to be ran by business people. Like I said, I see sometimes in the evening, politicians are going to strong positions to be minister. I'm like, what is he going to do? Once he starts making errors, it's not his fault. It's like, who appointed him in the first place? I can't appoint a doctor. For example, for my accounting, I can't appoint the guy that's a sales guy. Sales guy like money. They like commission. He can't be an accountant. If I put a sales guy in accounting and then the books are looking weird, it's my fault that I made this error. You need to find exactly who studied accounting. Who's the best? Who has a passion for it? Put them in that position. It's simple. But it takes education. That's how it needs to be. Why do we see your company in the next 10 years? In the next 10 years, man, it's a unicorn. I hope we can be all over Africa, competing with all the other African countries where it's like, even you from Ghana can have pay pay, but you can send money to your other account. I don't know other accounts you have in Ghana. It needs to be free. For me, my company is like, I'm not worried about competition, but I always try to have the best service. If everyone has my service, I'll be happy. If you had a chance to turn one thing in Africa, what would it be? I wish we had better teachers. Because through all the problems, all the big problems we have from wars, it's all miscommunication, right? It all goes by education. Education is the root. My kid is two years old. I'm seeing as a baby how these girls, education, you have to be on top of it. If you're not on top of it, he starts going right. You have to keep pushing him every day to go left. Education is the root of all of our issues, war issues from ego, from anything is education. I wish we can have the best teachers. I wish all governmental, all African countries, instead of 70 or 80% of their budget being military expanses, right? I think they should invest in having the best teachers here. Because after you have the best teachers and people are very smart, then we're going to start creating, we're going to start mining, then we're going to start producing, then we're going to start creating factories from our head. We'll think for ourselves, right? Because you can spend so much money on military, trade on things that don't matter. When people are smart, they can just do it way cheaper. Education. Are you saying there's something wrong with our education system? It's, like I said, because of war, most of the African countries, long years of war, it never built up as it should, right? So that's the biggest problem. So I think we need to step back and invest most in this. Because through everything, it's like if you have, if the kids, like Angola has 35 million people, but 70% are 15 years old and under. If these kids don't grow smart, the next 15 years, you see, we can have a flying city like Dubai, flying cars, flying everything, right? Or we'll have an economy depending on Chinese, depending on American, bringing things here. So that's why it's very, very, very important. But I heard that Angola is really heavy on imports. It's heavy on imports because, like, for example, why are we importing food? Think, why am I importing rice? When I can go to Malash, where you went? Okay, put some seeds, put some water and grow rice. You know what I'm saying? Why? But it's like, we lack education for our culture. So I feel even for me, once I came back here, I started backwards. I came from a technology, I love the America, I love Google, I started coming from this technology and I built my technology apps when I was able to bring 10,000 jobs just from this. But I think, man, Angola didn't need this, you know what I'm saying? Okay, it's good, it's a need, people are using it, but it's like, now I'm going backwards. I started taking, I'm starting a studying farm. It says, once I started making money, I bought a farm, at least 5,000 acre farm.  I'm doing what? Study and I'm starting to, all the best farmers in Angola, which do not much, starting to have lunch, start having dinner, going to the bars, just to feed off how they did it. So it's like, I think if, maybe since I, the way I motivated many people from the technology standpoint, if I do the same thing from agriculture, maybe all the young generation will start also farming. You're looking forward to investing in agriculture. Yes, yes, yes. Because we import, we import everything. You know what I'm saying? Like we import chicken. We import chicken, we import salt, everything we import. I guess the only thing you guys don't import is remote beans, man. Yeah. It doesn't make, it doesn't make sense. Like everything we grow, we can grow any product here, but like it's like, we need the education, because it takes time. Education goes, because when you're building a company, it takes patience. It's like, you need to know the products. It's like, it's all about the herd, you know? So that's, I think everything is agricultural. I believe that funding in Africa is extremely tough. Yeah. So my next question will be like, how did you guys fund this whole company? Yeah, so every, just like the way the American dream is, right? It's everything we, first we'll start, the first business started with the pulka, and then, okay, it was us and my four partners and each family member, two thousand, three thousand, like family fund, right? Everyone from the four founders did the job, and I think we had like $60,000, and we were able to like buy the app and buy a couple motorbikes, right? And with our head, because most of all the shareholders were from outside. One was Russian, the other three also were coming from America. So with our head, we were able to start.  Yes, yes, yes. All of them are back. Yeah, all of them are back. That's what I'm saying. Were you brothers? And I didn't know who they were. What? I didn't know who they were. I was coming from America, and because in America, I opened up my delivery business too, in Indiana. And I was coming here, and I was starting to build my, I wanted to build it here. That was my dream, sort of doing the business plan. And you look at the competition, I put Google and golden food delivery online. And I see a guy named Eric said, shit, this guy's trying to do the same business. And he's giving a speech to his school. Yeah.  Yeah. His was delivery. Okay. Shit. This guy's also doing it. Now this is where education comes. I could be like, screw these guys. These guys. Yeah, I'm not, I'm gonna do everything to be the best at the computer. I go on LinkedIn. I look at them up. Eric said, hey, how you doing, bro? I'm Wilson. Yeah. He was like, I don't know who you are, you don't know who I am. But I'm coming from America. This is my company. Trans and delivery. I've done this, you know what I'm saying? And I see that you guys are trying to do the same thing. So maybe we should try to sit. Sit. You know, so we sat at a hotel. We drank a coffee. We talked. And he had the same dream. I said, I'm trying to do this too. I'm trying to do this too. It's like, say, man, I already have some business partners that I'm doing this with. But it's like, I need, I want you in. You know what I'm saying? It's like, it's like me too. And I tried to network other people. It's like, man, I need people to have the same vision. So I was like, let's sit down and do it. So you met next day, the other partners that you had with, asking me so many questions. So I was like, I know the business, man. You know what I'm saying? And I feel like now, guys, let's do this. Eight years later, can we have 10,000 workers? And but this is just, if I would have been like, you know what I'm saying? I want to be alone. Yeah, man. Like we don't, you can't be greedy.  You need team, you know what I'm saying? The thing is I hate is doing things by myself. I was like, I need team. I need, who can help me, you know, I need a family for this business to go. That's how things happen, man.  Thank you. And I wish I could meet all the team. But anyway, I guess you represent all of them. And my brother, thank you so much for talking to me. I really appreciate your time. Thank you. And I will see you at the other side. I would love to introduce some people to you. I think we'll network a lot. Definitely. In different countries that are also doing similar things. And I think they don't have the app. So probably you can just give them the whole idea. See? I don't know, maybe you might have paper in Côte d'Ivoire. Yeah. Very soon. Anyway, all the fans are going to paper. You guys want us to go there? And what? That's what I'm saying. Like, are you looking forward? Let's say somebody wants to be maybe a partner from Ghana. I want to bring a paper to... I don't know Ghana market. I have the system. I know the business. And I have a very ambitious mindset. Okay? I don't know Ghana. So it's like, I'm not going to go to Ghana and do business in Ghana without someone that's from there. So I'm like, hey, come here. I have this. I need a guy that knows the market, that can open this up, that knows the local blah, blah, blah. You know what I'm saying? Hey, how are you going to do it? 50, 50? Okay. 50 is this side. 50 is your side. The same way we did here, connect and let's move. You know what I'm saying? I don't need everything by myself. I don't know what I want to do. What does partnership means to you? Huh? What does partnership mean to you? Like, what am I going to do with like a hundred billion dollars? Nothing. You know what I'm saying? Like, nothing. You know what I'm saying? So it's like, if you have five, he has five, he has five, he has five. We're all just chilling. I want to be a business partner. Yeah. So we're going to go to Ghana. We're taking pay pay to Ghana. I'm there. And we're just going to talk. I'm going to give you my contact. We'll talk and see how best we can take pay pay to, I mean West Africa. I mean, I'm not a shareholder.


Hi there, and welcome to this short introduction into structured data for developers. Let's start right at the beginning. What is structured data, and how does it benefit your website? In short, structured data is an additional machine readable piece of information that you can put on your website to tell machines, like Googlebot, more about the content of that website. There's a wide variety of standardized ways to identify and describe your content across various verticals. The list is on the slide here. It's just a small selection. For the full list of verticals that are supported by Google Search, check out the link here. So if you're wondering, why should you add this machine readable semantic data in the first place, you might have actually seen some of the things that are powered by it. Many different vendors, including Google, use this information to highlight your web content in many places it would otherwise not show up. Let me give you a few examples just from Google's side of things. And again, keep in mind, there are more vendors and products that use this data. When you search for recipes, for example, you may see these results with a picture, ratings, and other information. We call these rich results. These are not the only type of highlighting your web content might get in Google Search. Content from any of the other supported verticals, such as books, may show as specialized rich results, too. Note that implementing structured data is not a guarantee, though, but it is a necessary step to make your website eligible for rich results. One format of specifying structured data, and the one we recommend, is JSON-LD, short for JavaScript Object Notation, linked data. This can be added as a script tag on your website with the required properties and the information on your content. OK, so now we know what structured data is, why it matters, and how does it look like, but how do we get this into our websites? We can, of course, just put it in our website statically as part of the HTML or using our content management system. Luckily, the handling of structured data in Google Search is also part of the indexing process, so it does benefit from the JavaScript rendering, allowing us to also specify the structured data dynamically. However, this may vary between different vendors, and we do recommend to have a server-side solution, as those tend to be more reliable and robust. If you were to use client-side JavaScript, an implementation could look something like this. Here, a script tag is created, filled with structured data coming from an API response, and injected into the document. That is a viable way of working with dynamic structured data. Alternatively, you may use Google Tag Manager to grab the information from the page and inject it into structured data templates that then go on the page in Google Tag Manager. There are many ways of getting structured data into your pages, but most importantly, you have to test your implementation to make sure your pages are eligible for rich results. So let's look at testing for a moment. The best go-to tool to test implementations during development or ad hoc, if you're interested in rich results, is our rich results test. It supports copy and paste of your code or taking a URL to test. It shows you any markup that is used in rich results was found, what the rendered HTML looked like, as well as if the markup fulfills all the requirements necessary for the rich results. If you want to monitor your structured data across your whole site or multiple sites, you can use the free Google Search Console. It provides you with reports for each type of structured data that was detected on your pages, along with statistics on possible improvements and errors. Last but not least, using certain frameworks and language features, here we see a React web app built with TypeScript, allow you to get warnings and errors at development time. All right, that was a lot to take in, so let's summarize this real quick. So structured data is additional machine-readable information about the content of a web page. That information is standardized by the schema.org community body and used by various vendors and their products, including Google Search, to highlight your web content in various ways. For Google Search, it's fine to inject this information using client-side JavaScript. If you want to learn more, check out our intro guide on structured data in Google Search. All right, thanks a lot for watching, and I hope it made you excited for structured data. Stay safe, have a great time. Bye-bye.


Hi, I'm Levi from United Kingdom, and you're watching Truck and Josh on TJV. I'm really sure what they're doing here. Oh, I see there. They're cutting a new road through here. So this road goes to the right and goes around the hill. They're making a road that goes right over the hill. I wonder how much money this is costing them. And how much time is it actually going to save commuters? Hey, watch. You'll see we go around this side here. It goes up there and it meets up with the same road around this little bend. So it's going to save us probably about 20 seconds. How many millions of dollars do you think it costs to build that little shortcut? Here, I'll thank you with me around this corner to show you. I remember this on the way to Ottawa. I was already shaking my head at it then. Like, of all the projects that need to get done to make this highway safer and to make the commute through here better, they chose to spend their money on this. It seemed like a good use of money when there's other things that really need to be done. Like, maybe take the money to start widening or create a shoulder. Like, we can't even pull over on the shoulder of this road if we have a problem or if we have a tire blowout or if something happens. You can't get off the road. That shoulder there, I'll sink right into it and I'll need a tow truck to get back out. There's nowhere to stop. You have to go to the bathroom. You're technically not allowed to stop these things off to the left. Apparently, some guys that I know of, well, my cousin, he knows some people that got in trouble for parking in one of them. So, you're apparently not supposed to park in those, even though everyone does. There's nowhere to stop. There's truck stops closing along the 17 and 11 left, right and center. So, once a truck stop closes in this region, they block off their parking lot so that you can't park there. So, all of us lose parking. So, that doesn't help anybody because then we have even less places to stop. There's lots of things that we need to spend money on in this area of the country for the commute. I would love to see a four-lane highway all the way through here, though that's not really realistic for the next, I don't know, probably century. See, we went around that hill now. Oh, we gotta stop here now. Oh, no, they're letting us through. And this is where it meets up again. So, you see a little loop around the hill? They're just cutting off that little loop, saving us about 20 to 30 seconds overall afterwards, after it's all said and done. Yet they had to cut through the rock to put this... I mean, I'm glad they're doing it. Like, that's something, yeah, but I just... Maybe I'm missing the whole reason why or the point of what makes it worthwhile, but you sort of get what I mean, right? Here comes out this way, and then you'll get to go straight through instead of going around a little bit. That is making it better. That is making it better. You can't lie about that. These roads through here are so expensive to make because you gotta carve them out of the rock, right? And that's it. That's interesting. I mean, I'm not in charge of this kind of stuff for a reason. I'm no expert. There's obviously someone convinced someone to fork over a ton of money from the taxpayers for that. So there must be some good reason, right? You'd like to think there's some good reason, other than saving 20 seconds. We made it. We made it. And there's a scale up ahead here. Is it open? There's the Manitoba sign. The Invenue. Well, thank you. Is it open? Where's this flashy light? No, it's closed. Good. I'm going to pull in there anyways, because I need to take a break. I'll pull into the scale if it's closed. Unless if they got people there. If they got inspectors just hanging out there, I don't really want to show my face anywhere near them, give them an excuse to come over and say hi. No, no one here. Good, good. So don't mind me. I'm just going to sneak in here and have a little break. I'm going to make sure that my break is on the other side of the actual scale so that I can just drive out if anybody does show up to open it. I'm not going to go over the scale. I'm going to slowly drive past, see if there's anybody inside. And let's see, let's see. Nobody's home. Good. Just the way I like it. So I'm going to park past the scale here so that if I see any vehicles pull in and anyone walk into the office to open her up, I'm out of here. I passed the scale when it was closed. So we're just going to put ourselves on duty here. Load check and tire check. Mark that in here that we checked our load. Don't need to idle the truck and waste money. We're going to go out there and check the load. Beautiful out here. You know what's a lot warmer in Manitoba than it was in Ontario. That's for sure. All right. Let's go take a look. Shall we? Yep, still there. Good, good, good. Now you got to make sure that the chains are all still tight. You don't have to untarp it every time, but you have to go over each chain. If you know where the chains are, check each one to make sure there's no slack in it. You can even reach your hands underneath there if you want. I'm just going to go put some gloves on and then do that. And then check all the chains on all of here. Because there's two, four, six, eight, ten, twelve chains on this load. And I got to make sure that all of them are still tight. You don't want one of these things falling off. Just one of them weighs almost 12,000 pounds. And we'll go around and do that to the other side as well. Make sure all the lights still work. Make sure we got no flat tires. It won't be on the way. When you come into Manitoba from Ontario, or when you're about to hit the Ontario border from Manitoba, you hit this forested area. It's all protected forests. It's a white shell provincial forest. There is a lot of wildlife in these bushes. A lot. Almost every time you are guaranteed to at least see a few deer. At least. On an average day you'll see a lot.  When you're in this section, be ready to hit the brakes. Or, you know, veer around. One thing I can give you some advice on if you're not in a truck, don't drive beside a semi if you don't have to in sections like this. Because if a deer jumps out in front of me, I need that second lane beside me to get around it. If I hit a deer, it's not going to be pretty. It's probably going to fling it out into your lane anyways.  If you want to pass me, pass me. Don't take your time. Get past me as fast as you can.  Don't sit beside me. You can stay behind me too if you want. Don't tailgate, but just don't sit beside me. There are so many people who have their crews set at like one kilometer an hour faster than me. In a car. I can understand if it's another semi who's covered.  Some people just like to drive right beside me. And some people will stay there, right beside my truck in the passing lane for like 15-20 minutes if I don't do anything.  If I speed up, they speed up. It's like they need a little buddy. Like they're lonely on the road. They need a travel buddy. I'm not your travel buddy. Get away from me. Stop driving beside me. I need that extra space. Thank you. Yeah, so far I haven't seen any deer here yet. I was kind of hoping I'd be able to show you on the vlog. I can't be talking the whole time going through here either. Because you guys are pretty bored of that. You know, it's probably a little early. They come out more so around twilight or around like just after the sun goes below the horizon. That's when you'll see the most deer. Also when it's the hardest to see them conveniently. Funny story. I had to stop by work here. I better not put it up there again. I had to pick up a copy of the paperwork for this load I'm pulling because I had my paperwork up here just to where I was about to put the second copy again. And I'll show you here. I had it up there. And I opened the window and it got sucked out in Northern Ontario and there was no place to pull over or park. Which is very frustrating that they don't even have shoulders in Northern Ontario for emergencies like that because I could have pulled over and walked back and picked it up. But nope. I had to keep going. So I called into the office and said I'm gonna need another copy of that. Good thing I had taken a picture of it to send it in. When I picked it up. So I just took that picture and sent it to them and said can you print this off for me? Leave it in my mailbox. So I had to swing by work here to pick up a copy of the paperwork otherwise I'd have no paperwork for this load that I'm pulling because it got sucked out the window. The weather was so nice I wanted to have my windows open. What? Well got my bed all set up. I know it seemed like a little bit of a short day probably to you guys. But trust me it was anything but short. It was a long day for me. We're in Brandon. That's all that matters we made it. So I gotta go straight to bed now. Short night. Well short as legally possible. We'll be delivering this first thing tomorrow morning and then heading home to mow the lawn. Yay. I actually love mowing the lawn I'm looking forward to it but first we have a whole bunch of errands to do on the way home.  But I see you invited yourself up. I am the lord of all weasels. I will invite myself up when I'm ready. I was ready. You may be the lord but I'm still the king. You know how this works right? Hierarchy. King. Lord. You got it? Lord of the weasels. Whatever you say man. Whatever you say. I do what I want when I want. Because I'm the weasel. Won't even look at me eh? He knows he came up without being invited. No you're okay Diza you're okay. Well don't worry about it buddy. I'm just tired just messing with you. I'm just messing with you. He always asks permission before coming up on the bed. Always. So if he comes up on the bed without asking permission like that he realizes what he's done and he gets super guilty right away. Especially if I tease him a little bit like that. He always asks permission. He's a very polite lord. So I'll see you tomorrow everybody. Sorry I didn't have much footage for you today. I hope that it all turned out. I guess I'll find out once I put it together. But tune in with me for me with me here tomorrow. I promise I won't be as tired in the morning. I'll get my coffee and we'll start the day. We'll have a good day. We'll go unload the steel. I don't want it anymore. It's weighing me down. Give it away to these people here. Get them to sign some papers and that'll be that. We'll see you tomorrow.


So, Gypsy's up. All right, so, first of all, every single solitary human being here should have had a very good week with me. There were every trade that I called worked, okay? Every trade that I called worked and there are weeks like that, but to start off earnings season this way and the year is pretty spectacular and I am extremely focused right now. Starbucks is trying to make another lay down. So, if you're in it, it looks okay. Steve said, yes, thank you so much. Some of you had extremely huge weeks. I received some emails from some of you and even the new students who just did the class.  Today, I'll probably send out an email but Gypsy emailed me. She made over $7,000 in the Netflix option with only six contracts. So, I mean, these are some, this is real, real money people. So, it is not just me. You can do it too. Gypsy is a regular person. Tayoga had a big week his first week. So, you know, there's every person here should have had a positive week. I don't think anybody did it. Barry, I don't think you traded. And I'll have to talk to you later. But if you don't trade, then you can't make money. Tayoga and ANTC made $400, still holding 500 shares, 4850 stop. Okay. Yeah, I just, I think that could have been the morning move for this. Not that it doesn't have a secondary push with the market but I just don't know what time the market gets going. I remember it's Friday also and it's been a good week. Okay. I think it's problematic if you do things on your own but I think when I'm calling such good calls you really gotta follow me if you wanna get the benefit of being here and if you choose to do later trades or secondary trades, I mean, that's fine, that's on you. Yesterday, I did right in the room before I left a second trade.  Yeah, I did, I mean, this continued. I don't know if anybody did that second move then. I had not closed the room out yet. I was in the phone and then I wrote it in the room. It did have a second leg down. Did anybody do it? It did go pretty much to some crazy number. It broke 24. So I called this here. If anybody was in the room, you could have done it. But I think everybody, but Gala had got that yesterday and sometimes like I said, if you press something and you can't get in immediately then you can wait for a second set up or you take it, if it's run into the price, just grab it, keep pressing it with a different ECN, try to get in with a limited market order, however you can, and then put the stop in and lower your amount of shares if you don't get filled with the price that you want. Sometimes they reset up. In that case yesterday, that thing just fell. Market really looks higher. Market really looks higher. Market, I'm just throwing this out there and I don't know for sure, but the market could have a big green bar today. It's possible. We're setting up to break out. That's how this whole thing looks to me here, which I kind of thought we'd do at some point. Again, every day we have these nice green days, but nothing Jimongo, you know, but we look like we're gonna make a new high again today and everything. Well, I got your email, Gala, how are you gonna try a different way to get in? You don't wanna use limit orders and that's fine. Obviously today was a long, so I'm sure everyone got in this perfectly fine. But you know, we're aggressive on these trades so most of the times we all get in. Obviously everybody gets a different price. It's hard not to jump the gun sometimes. Sometimes some of you do and then it works out and sometimes I miss it, I gotta take it later. It's one of these things. Anyways, the point is that everyone here had a good week and you need to pat yourself in the back because obviously you did your own trades even though I called good trades. So let's have a strong, you know, earning season.  You took the trade today from the level two with no problem. Though there you go, then that's what you do from now on. That's your thing. That's what you wanna do, whatever works. Any questions, any comments? The number one and most important thing is the focus and I just truly believe it's that way with anything. If the focus is there, you will succeed with my guidance 100%. If you're not focused, no amount of guidance that I gives you will help. So it really is up to you to be very focused on what you're doing and obviously having a positive attitude about it and doing it and working through whatever issues you're having, whether it's getting filled or platform things or whatever, you know. You can get through those kinds of things. It's not the end of the world. I truly believe that the highest chance for people to be successful is to come with me. I'm very good at what I do. I guess that's why I'm on TV and I'm getting better. I'm gonna give myself credit. I mean, I'm getting better. In some of these calls I'm making this year, I mean, you know, I just gotta stay focused myself but sometimes, you know, I've got a lot going on and I have to think about what I'm doing in the moment, whether it's TV or stocks or talking to you people, you know, very happy about the way things are going. Tayega said it's phenomenal cause, Melissa, thank you. Thank you for a fabulous weekend and nice trade on no sleep. Thank you, Mountain Girl. Big fudge, I wouldn't be long on WL. I don't know if you said that just to get me going here. IMTC is the long today. How crazy is it the way that people see things? Some trader put on Facebook, I saw it this morning and asked if I was gonna short INTC and I didn't respond but, you know, people, traders love to short these things thinking it's gonna fill the gap. I mean, this was just an absolute long right at 48. You couldn't have even done it in the pre-market. Back, let's look at it. Let's look and see if it, once it got over did it ever break it? Nope, it didn't. As soon as that stock got over 48 and never looked back, it's not done either, I don't think. Look at that. So unusually why it stopped there today but just because, you know, the market wasn't 100% this morning, I felt like that's where we needed to put it. It's something a little different there. If you're gonna quick one, Starbucks looks like the quick one possibly if it drops. Well, I don't know about quick here, it's trying. But if it does drop and break the low, could have a big move down if 57 didn't get there yet. This is holding. My golly it is holding. So, wasn't crazy about where it opened, made a call, some of you I guess didn't and you could get back into it here now. I mean, this is a brand new setup in here if you wanna do it. But again, if you did INTC, I would just get out but this is trying to break a second time and the market really just looks higher to me in so many levels. I wanted to say one thing, Gala had you had emailed me about something. I forget what it was. Hold on, let me find his email and I thought I'd just talk about it in the room. Let me see if I can find it. Las Vegas trader, are you here? No, he's not here, he must have signed out. Let me find, you asked some question, let me find it, hold on. Oh, you were talking about date training versus options and I just wanted to say one thing. Are you there, Gala had? Gala, let me know you're there because I'm responding to your question. And Barry, I believe this is your issue too if you're there listening to me because I know you're really not day trading. So, actually this is studying up again if anybody wants to do a new trade. You can go long INTC right in here. You could put a tight, tight stop at 48.50 if you wanna do it. Looks like it's gonna push over the high again. There you go for it if you want it. The thing is that there's different times when there's a lot of option calls and then there's different times when there's not. So, day trading is consistent where you get stuff consistently, way more consistently than the options calls. To rely solely on options calls, you're gonna miss out on a lot of potential profit with the day trades. Right now, I've been making an obscene amount of option calls simply because they're there. But it's the conditions that lend itself to that. I can't say it'll be like that throughout the end of the year. In fact, I would be quite surprised if it would continue in that way, that either would be this many. But it goes in waves. So, the day trade, look at this is pushing over the high. What a nice call. It goes in waves. You gotta stick with the day trading because it keeps you in the market. Even though some of these numbers on the board with the options seem so amazing. If you stick with a day trade, it's gonna keep you fresh reading charts and you're gonna have more consistent opportunities to do stuff. Plus, most of the option calls I've been making have been long and you don't wanna lose your edge in knowing how to read charts or shorting. The fact that you can make something like GypsyMade7 granted an option is simply because of the fact that these stocks where I'm calling most of these in are huge, huge movers, okay? But they don't set up like that all the time. They don't set up like that every week and sometimes the cost just doesn't match up. When all stars are aligned, you do them. And they have been recently, which is why I've been making some great calls and a lot of you have capitalized on it. It's just really incredible. But it is not gonna be like that every day and every week and every month through this whole year of 2018. Even though the market's gonna probably stay bullish all year. And I wouldn't even be surprised if the market power trended all year. I mean, that actually could be the reality of life and that will create a very difficult environment for traders of all kinds. Option, swing, and day traders. It will be a very difficult environment if the market power trends all year. Not for me, but for most traders. I'd say 95% of the people are out there. They won't know what to do. People that wanna go long will feel like it's too late. They will wait for pullbacks. We've had none yet this year. People will attempt a short, the short attempts will fail. You really gotta be very specific when you're looking for weakness. Would have liked to see more of that in Starbucks today. Did rate it. It had one quick drop. It is trying so hard to break. But wanted to see something a little bit different here in this today. It had a move. You could have made money. You had to get out quick or you're waiting. I mean, you wouldn't still be up in here from this price point. But INTC was much easier. Anyways, don't get lured into thinking about just doing options. The way to make money is really to do it all. And the day trading keeps you consistent. It keeps you having that edge of reading charts. And you don't wanna get away from shorting because that's where there's a lot of huge potential as well. And the opportunities that are there, that I've been calling are there right now. It is not a weekly thing, but it all adds up in the end and evens out where I might call three at once and they work huge and then we don't have any for another week or two and that's what it is. And remember, it's earning season two. You'll be doing nothing in non-earning season if you do only options, Galahad. I don't know what's killing you.  And I don't know what's killing you at all.  If, I mean, this should be no excuse in my mind for every single person in here that's been in here consistently from January, whatever, till we open till now. And Gerard, when he was helping out called Good Solid Trades too. There's been two losses this whole year. It's only been a month, but that's great. Day trading, we've had two losses since the start of the year. There's no excuse for you not to be up money. And Barry, there's no excuse for you not to be trading. So, everyone should be up. Back some of you that are doing really well could even increase your risk if you want to. It's still earning season. All right, I am very tired. Let's look up what's out for Monday. And also, one should bankroll the other. I know some of you have separate accounts and that's fine too. But if you make 50 cents in a day trade move or a dollar or whatever, it can help bankroll some of these options trades for some of you to be able to take more size. I have a feeling, and Gypsy can tell me if she wants in here. I have a feeling she's doing well with the day trading. So she's taken more risk in some of the options. It's paying off. And here's INTC making a brand new high again today. Monday morning, we have STX. It's the only thing I might like here. Let's take a look at it. This is Monday's watches.   Nothing that you did in the past should even be of a concern to you. If you wanna do well right now, get it together, that's it. I mean, I don't know what else to say. You haven't been consistent.  At least you've been taking profits in the options trades, thank goodness. But you've been, you haven't been consistent. You must be consistent. Let's look at STX. All right, so I don't know what this does. This is Monday morning. But, you know, again, we went long today. If we gotta go long Monday, we'll do it. So I'll be looking at everything, everything in both directions unless something just screams at me that it's really good to the downside. Which Starbucks really didn't today. And this did, this is the best gap. All right, I'm gonna head out. I am tired. Have a wonderful weekend. I will see everybody on Monday morning. Okay now, you're welcome. Bloomers are gonna be retiring, Qualibur says. As they start cashing their equities could bring the market down at some point, which would be good for shorting skills. There's no signs of markets coming in or coming down. There's no signs of markets going anywhere but up. And congratulations, Gypsy. She had a huge day yesterday. All right, see y'all on Monday.