Well, hello everyone. It is 11 a.m. here in Canada today, and I would like to welcome all of you who are joining us on today's webinar. And good morning, good afternoon, or good evening depending on where you are coming from. Welcome to Engineering for Change, or E4C for Short. Today we're very pleased to bring you the latest in our 2016 webinar series, specifically on the topic of understanding behavior change to ensure success. My name is Yana Aranda, and I am the Director of Programs here at Engineering for Change, and I will be one of the moderators for today's webinar. Now, I'd like to take a moment to tell you a little bit about today's webinar, which was developed with our collaborators at the Center for Affordable Water and Sanitation Technology, or COST. Successful delivery and adoption of technology for development is highly dependent on behavior change. However, changing behavior is difficult, and understanding what even constitutes successful behavior change is unlikely to be part of an engineering curriculum. So, we've invited Hans Mosler, Senior Research and Group Leader at EWAG, the Swiss Federal Institute of Aquatic Science and Technology, along with Valerie Kavin, Senior Advisor at Helvetas Swiss Inter-Corporation, to share their insights on evidence-based behavior change methods and provide some guidance on how to apply proven behavior change techniques to solution design in order to ensure success. They are joined by our guest moderator, Laura McDonald, who is a Knowledge and Research Coordinator at COST. I'd like to welcome all of our speakers, and thank you for joining us today. Before we get rolling, I'd also like to thank you for seeing webinar series team. If anybody out there has questions about the series or would like to make a recommendation for future topics and speakers, we invite you to contact the team via the email address visible on the slide that you are seeing. Now, before I move to our presenters, I'd like to tell you a bit about engineering for change and who we are. E4C is a Knowledge Exchange platform and global community of over 1 million engineers, designers, development practitioners, and social scientists leveraging technology to solve quality of life challenges faced by underserved communities. These can include access to clean water and sanitation, sustainable energy, improved agriculture, and more. We invite you to join E4C by becoming a member. Membership provides cost-free access to relevant and current news, professional development resources such as this webinar, opportunities such as jobs and fellowships, and a growing database of hundreds of poverty-leading products in our solutions library. E4C members enjoy a unique user experience based on their site behavior and engagement. Essentially, the more you interact with our site, the better we will be able to serve you resources in line to your interests. We invite you to join our passionate global community and contribute to making people's lives better across the world. Check out our website, www.engineering4change.org, to learn more and sign up. Now, the webinar you're participating in today is part of our professional development offerings. The webinar series is a free, publicly available series of online seminars showcasing the best practices and thinking of development practitioners. Information on upcoming installments in the series, as well as archive videos of our past presentations, can be found on the E4C webinar's page. The URL is listed. If you're following us on Twitter today, I'd also like to invite you to join the conversation with our dedicated hashtag. Hashtag E4C webinars. E4C's upcoming webinars include a segment of our special mobile data collection series with the development impact lab at UC Berkeley, where we'll be introducing a sample of six survey software tools with a demo on how to implement each tool. That one's not listed on this slide, but it will be on March 10th at 12 p.m. and will be featuring Survey CTO. On March 24th, our topic will be revolutions of nice things humanitarian aid through local making. And we'll be joined by Naomi Ludman of Humanitarian Makers and Abby Bush of Field Ready. Check out the E4C professional development page for registration details. If you're already an E4C member, we'll be sending you an invitation to the webinars directly. Now, a few housekeeping items before we get started. Let's see first where everyone is from today. In the chat window, which is located at the bottom right hand of your screen, please type your location. And I'll get us started. Today, I'm in Waterloo, Canada. Oh, there we go. We have people coming in. Toronto, Detroit, Piscata, New Jersey, California, the UK. Welcome, everybody. It's the coming of the rush. Milan, India. Thank you. Thank you all for joining us today. If the chat window is not open on your screen, you can access it by clicking the chat icon on the top right corner of the screen. Any technical questions or administrative problems should go in the chat window. Feel free to send a private chat to the Engineering for Change admin if you have any troubles. You can also use the chat window to type any remarks you may have. During the webinar, please use the Q&A window, which is below the chat, to type your questions for the presenters. Again, if you don't see this, you can access it by clicking the icon on the top right hand corner. If you are listening to the audio broadcast and you encounter any trouble, try hitting stop and then start. You may also want to try opening up WebEx in a different browser. Following the webinar, to request a certificate of completion, showing one professional development hour for the session, please follow the instructions on the top of the E4C Professional Development page and the URL is listed. Now, I see a lot more folks have answered the question of where they're joining us from today. And thank you so much for all of you from Grenada to Wisconsin to New York to Michigan and Accra and Vermont. All over. Thank you. It's so great to have you all here. I see some folks have entered their answers into the Q&A, but do keep in mind that that is dedicated to our questions for the presenters. Now, with all of this preamble, I'd like to turn it over to our guest moderator, and I'm going to do a quick introduction of Laura McDonald, who is part of the Haas and joined the research learning team in August 2015. As a knowledge and research coordinator, one of her key roles is managing the content and the newly launched household water treatment and safe storage knowledge space. Laura also engages with wash researchers, practitioners, and policy makers to ensure that cost work addresses the needs of the sector and key findings. Welcome, Laura. And I'm going to turn it over to you. Great. Thanks so much, Yana. Hi, I'm Laura. As Yana introduced me, and I am an Elgin Research Coordinator with cost. Just a brief introduction to cost itself. At cost, we focus exclusively on capacity building services, meaning we are not an implementing organization. And within capacity building, our area of expertise is on non-network systems, so water, sanitation, and hygiene in households. Since 2001, our services have largely been provided in person with some remote support. We provide training, but we expect that training is often only the starting point. So with ongoing tech reports, we aim to equip our clients with the skills needed to improve their programs and ultimately address challenges on their own. And we also provide support through freely available education and training materials on our wash resources website. And as a result of our in-person and remote support as well as our educational resources available online, we've helped over 3,000 organizations in 164 countries access our services and support continuously 970 implementing clients. So with that, I'll hand it back over to Yana to introduce the speakers. Thank you. All right. So the first speaker today is Hans Mosler, who is an environmental and social scientist who has spent extensive years studying human behavior as it relates to health issues in developing countries. He's currently, as I mentioned, a senior researcher and group leader at EWAC. And Dr. Mosler's studies focus on how these behaviors affect her into successful implementation of water and sanitation projects in order to reach better hygiene and health standards. His research topics and publications relating to safe water consumption, sanitation, hygiene, social dynamics, and behavioral guidelines have made him an expert in implementation of strategies for positive and lasting social change. We're very excited to have Dr. Mosler join us here today. He will also be joined by Valerie Kavan of the Water and Infrastructure Team at Helvetas Swiss Intercooperation. She is in charge of the thematic of household water treatment, water quality, marketing sanitation, hygiene education, and behavior change. At the moment, she is leading the learning expedition of behavior change of Helvetas in close collaboration with EWAC. She has experience of working a wash in more than 10 countries in Africa, Asia, and Latin America. Previously, she's worked at the EWAC, as well as a project manager in the field of household water treatment, and at the Swiss Development Cooperation in Nepal and Switzerland. We're very excited to have you both here. And I'm going to hand it over to Dr. Mosler to take us through his insight. Okay. Can you hear me? Can you hear me, please? Perfectly. Perfectly. Thank you. Thank you. Thank you. So thanks for the nice introduction, Jana. And hello to everybody, wherever you are in the world. The title of my presentation, as you see, is systematic behavior change using the run-up approach. And what systematic behavior change means and what the run-up approach is about, I will tell you in the following. Let me begin with a statement that I think that you, as engineers, like implementers, do a good job. Yes? Mainly. Okay. But what about the users? You see here on the left, a rainwater harvesting system container. But if you take a closer look at it, then you see that there's a direct connection between the latrine and this container. So it is really a misused system. Or here. Very nice toilets, ventilated toilets. You see that with this tube on the roof. About 50 toilets in the Bolivian Highlands, but not even one was ever used. Or here. Sorry for the disgusting picture, but it's very illustrative for toilets which are really badly used so that nobody else can use them anymore. And here we have also toilets badly used, shared toilets in Kampala in Uganda. And the question is, how can we motivate people to clean their sanitation facilities regularly, especially when they are shared? Promoting solar water disinfection, but you have only limited or partial or even no uptake? Question arises. How can we motivate people to apply a correct water treatment method? It has none to be so this. It can be chlorination or boiling or whatever. Then introducing hand washing, but there might be no compliance. That's for example here in Haiti. Question arises. How can we motivate people to perform more hand washing at key times? How to introduce behavior changes? Then the question. You implement hardware, for example a safe water kiosk. And you expect that there is a lot of consumption of safe water, but it doesn't happen because there is a person in between. And the person, and therefore the statement is behavior change starts in the head of the people. How to introduce behavior change? You install hardware and some people might use, for example, the safe water kiosk. Other persons like person B here not. So they are somehow different in their mindsets. And we call them they are different in behavior factors. What are behavior factors? Behavioral factors are, for example, thoughts, beliefs, feelings, perceptions like knowledge or what do you think about the water? If you would drink it, what would be the taste? Or how do you perceive social pressure to perform the behavior? And so on. So together with the hardware we need some kind of software. Software is a promotion technique. It is a behavior change technique with which we try to change these behavior factors. You see factor A minus C minus and then factor A and factor C plus. And it is more complicated. We always will have doers and non-doers. People who drink safe water and people who don't drink safe water. And they are different. Different here indicated by factor C. Maybe they have not enough knowledge or they don't like the water or yeah. And so the first step is that we identify these behavior factors. Then we want to measure and calculate the differences between the doers and non-doers. And select behavior change techniques accordingly. Accordingly means that we want to select the behavior change strategies accordingly to the factors we have to change. Here indicated by factor C minus and factor B minus. Factor A we don't have to change because it's the same for doers and non-doers. Then we design and implement the software and at the end, not at the end, beginning at the end we have to monitor change. But not only in behavior but also in behavior factors. We want to know whether we were able to change C minus and B minus to C and B. So we have and this is now the systematic, the rather systematic behavior change approach. It comprises four steps as already introduced. The first step is to identify the behavior factors. Then we have the tools. For tools we have qualitative interviews and the run-off model which I will present in a minute. And we have output. We know then which behavior factors we have to test. Then we measure and determine the behavior factors. Do this doer, non-doer analysis. Then we know which behavior factors we have to change. Next step is that we have to select the behavior change techniques and design behavior change strategies. Therefore we have a runner's catalog of these behavior change strategies and then we know which behavior change techniques to apply. And the fourth step is that we implement and evaluate the behavior change strategies. Therefore we use a before-after control trial and then we know which behavior change strategies is the best and the best to apply and then we know the effective behavior change. Okay, let me go into a field situation.  What do you say?  Yeah, might be for example am I at risk and why? Or how to do it? Or what does it cost? What does it bring to me if I apply it? Do I like it? Do I like chlorinated water? What will others say? This woman in the back is talking to others so it might be interesting or important for her what others will say if she applies chlorination. Can I do it? Am I able to do it? And these and how to manage it? Yes, it's a bit difficult to manage the slides. I'm sorry about that. Okay, these thoughts can be arranged into four blocks of factors. The risk factors, the attitude factors, the norm factors, ability factors and self-regulation factors. And these come these blocks of factors do not come out of nothing but they are based on environmental and health psychology experience of let's say more than 50 years of trials and theories and so on. Oh, that's not the way I wanted to present it but I try to deal with that. On the left in the green you have the behaviors. You have behavior A and behavior B. So you have always an alternative to the intended behavior. Drinking, you want to promote drinking disinfected water but there's also a behavior drinking raw water and the taste might be different. So both taste play a role. In the midst you have this factor blocks. Risk factors are the person's understanding and awareness of the health risk. The attitude factors are a person's positive or negative stance toward the behavior. And the norm factors are concerned to the perceived social pressure towards the behavior. The ability factors are about the confidence in the person's ability to practice a behavior and the self-regulation factors are very important. The person's attempt to plan and self-monitor a behavior and to manage conflicting goals and distracting cues. On the left side you find the behavior change techniques which each of these block of behavior change techniques we know that we can change these behavioral factors. And on the bottom you have the context. The social context, socio-cultural context for example. The physical context, how far is the well for example and the personal context. How well is the person or yeah. So we have identified the potential behavioral factors. Now we know which behavioral factors we have to test and become to the next step to measure and determine the behavioral factors. We do that with a questionnaire, with a standard questionnaire. You see I have marked the norm for example and in the norms looks the perceived behavior of others. We asked here what do you think how many people of your relatives practice open defecation or use a latrine. Here the questionnaire is about open defecation or if you go a step up feelings how pleasant or unpleasant is it for you to defecate in the open or use a latrine. Then when we have measured these factors we do this do a non-do an analysis. Here you see person A to W score in health knowledge and score in others behavior and person B to set also score in health knowledge and score in others behavior. Something is missing here on the left side we have the doers and on the right side we have the non-doers. Maybe they appear no they don't appear. Okay so we have to compare this mean score in knowledge for the doers and the non-doers and we see that there is not the big difference but for the score in perceived others behavior there's a big difference. So we know now we know that we have not to tackle health knowledge but we have to tackle the perceived others behavior. Okay we have selected the behavioral factors. We have selected the behavioral factors. Now we need to know now we need to select the behavior change techniques. How do we do that? We have a catalog we have a random catalog of behavior change techniques. This is also coming out of health psychology and environmental psychology. The first of these I have highlighted you know it quite well. This is when you want to change health knowledge you do it by presenting facts. You present information about the circumstances and possibilities of contracting a disease and about the relationship between the behavior and the disease. Second I have highlighted when you want to change beliefs about cost and benefits then you do an inform about and assess cost and benefit. Provide information about cost and benefits of a behavior or of the mission of a behavior and conduct the cost benefits analysis. I will give you an example in a few minutes. So others behavior change techniques which you might not know so well are if you want to take a barrier planning then prompt coping with barriers ask participants to identify barriers to behavior change and plan solutions to those barriers. If remembering is the problem then use memory aids and environmental prompts. So for each of these behavioral factors we have behavior change techniques with which we can change these behavioral factors. I have not displayed all but the total number is 36 behavior change techniques. I want to emphasize that communication channels and behavior change techniques are not the same. Communication channels are the mode of delivery of behavior change techniques. I know that when we ask development organizations oh what kind of promotion activities did you do and then they say oh we had community meetings and then I say yeah but what was the contents of the community meetings. So the contents is the behavior change techniques. For example if you see here at the left households visits by promoters then what does the promoter say and that's exactly the behavior change techniques but the promoter himself or working with promoters is not a behavior change technique it is a communication channel just to make this distinction clear. Let me give you an example it's about fluoride removing community filters in Ethiopia. You might know that excessive fluoride consumption of fluoride is very bad for the for the body and my colleagues here from AIWAC the engineers have installed these community filters and we did the social analysis for that. So here's the do or non-do analysis it means differences in mean of 100% users and less than 100% users because 100% is necessary otherwise you will fall sick and you see here the difference between the users and the 100% users and not 100% users is indicated by this green bar. It's not in the right place but you see that costs of course costs are the most important behavioral factor here. It is the costs are and that's not surprising because this water costs double than the normal water. So how did we implement this behavior change techniques in form about and assess costs and benefits? We did a persuasion of perceived costs. The first was that we said higher price is better quality and this we did with examples from the daily life of the people. Then we did a personal the promoter did a personal water budget. The promoter calculates the water consumption of the family for food for cooking and for drinking and how much water they then need from the community filter and how much does it cost at the end and that's not so much if you calculate through. So and the NGO wanted that we perform also a persuasion on children's vulnerability. So we asked about the current water source that they used and how contaminated it is. Then we gave a personal risk information for all children and then asked what can you do? I have to go back up that's possible and you see that vulnerability and severity also perceived vulnerability and perceived severity are the same for the doers and non-doers and we would not have done any intervention on these but the NGO wanted to intervene on that and okay we did it. I'll present you the results in a minute. So now we come to the next to the last step implement and evaluate the behavior change strategies you we do that with the before after control trial. How does it look like? Here you see evaluating the behavior this percentage of safe water consumption of total water consumption and the first value I you see person A to S got the intervention person B to T it not get the intervention and the first value is before the intervention and the second value is after the intervention. So person A used 40 percent of safe water of the total water consumption before the intervention and 80 percent after the intervention so the improvement was 40 percent more and you do that for the person who got the interventions and for the person who did not get the interventions and you see that there is a big difference in mean increase. Mean increase means some of differences divided by the number of persons and then you can say okay the behavior really changed differently for those who got the interventions compared to those who did not get the intervention but we do the same hello it's not running ah yes now but we do the same for the behavioral factors here's the example with the others approval yes do you think that overall people who are important to you rather approve or disapprove that you drink safe water yeah and you have a scale for one to five and you see that person a before the intervention had the value two and after the intervention the value five and and this is an improvement of three if you calculate the mean change like we did it for the water consumption and you see that there's a big difference between the people who got the intervention and the people who did not so we can say that the factor aimed at year perceived others approval really changed and we were successful with regard to this and here you see for the example of the Ethiopia community field filter light blue is before and dark blue is after the intervention and you see here we have the mean value for the intervention group and for the control group and this is about perceived costs so with our intervention in the Ethiopian example we were able to change the perceived cost to decrease the perceived cost and simultaneously the consumption of safe water of filtered water increased and it is important to point that we did not change the real prices we changed the perceived price nothing more and I don't hear anything from you can can we give anybody a feedback whether you hear me or not yes we can hear you Hans continue thank you because I don't hear anything it's a bit strange for presenting okay okay then I come back to the to the questions posed at the beginning of the presentation how can we motivate people to clean the sanitation facilities regularly cleaning of shared toilets in Kampala in Uganda you see by implementing group discussions and additionally commitment cleanliness of shared toilets could be improved by factor three how to motivate people to apply a correct water treatment method use solar water disinfection even 18 months after the intervention 75 to 85 percent of the households have observed so these bottles in the sun this was in peri urban Harare in Zimbabwe slide yes and how to motivate people to perform more hand washing at tea times here we induced TPTAP construction and public commitment in the Burina zone in Ethiopia and it was quite successful because around 95% of the intervention households were successfully motivated to construct the TPTAP they did it by themselves and two to three months after the intervention termination in 50 to 80% of the households these TPTAPs were still in function more information you can have on our website we have compiled some intervention fact sheets about success in different projects and if you want to know more about the approach then have a look at our methodological fact sheets these are two pages so you you get an impression very very short take-home message of this webinar understanding behavior change to ensure success systematic behavior change enables you to the exact determination of the behavioral factors to be changed and this brings you to understand behavior change really then you do the focus selection of corresponding behavior change techniques and then you prove the record of success you ensure the success so understand and ensure how can you now make use of the Rana systematic behavior change approach I would say check first your behavior change activities on the background of this approach the first question is which behavior factors are you targeting only health or more health knowledge and then which behavior change techniques are you applying with which purpose look at your behavior change techniques and then think about what what what do you really want to change with them or second step would be revise your cap survey if you have one or build on your questions on according to the Rana's model we have ready to go questionnaire you have to adapt it to your local situation of course but look at your surveys and improve them and at the end measure before and after and compare to a control group so that you are sure that you have a success not only in behavior but only in changing the behavioral factors and if you want to learn more about the Rana's approach we have a practice oriented era course on the topic in on March 15 to 16 and you can participate in the course via internet if you want please join okay thank you for listening I hand over to Valerie thanks so much Hans and March 15 to 16th is good timing given that World Water Day is on March 16th okay we're handing over to Valerie I just wanted to ask you one question and thanks to those who have submitted questions so far as a reminder to submit your questions in the Q&A section this question is from Rachel how long was water consumption measured after the intervention for example was it six months after two years after and how do you know if your intervention passes the test of time once you leave I shall I shall answer directly yes yes okay and we have we have tested it six months and twelve months after the last intervention in the case of arsenic safe water in Bangladesh directly after the intervention we had 65% of new users of arsenic free water wells and this decreased to 45% so there's still a large percentage of new users which had access before to arsenic safe wells but I would say you have to to continue to to with your promotion activities for up to a year that it is really it because that it really becomes a habit and when it is a habit then they will do it automatically not everybody but many people so we are quite successful also in the long term as I have presented for the solar water disinfection but I think you cannot expect that people do it life for the lifetime okay thanks so much and I'll ask you to mute for sound quality and now okay yes to Valerie Valerie go ahead thank you okay good morning or good evening everybody and I'm Valerie come from Helvetas fishing the corporation and I hope you hear me now I will show you or present you our learning expedition on behavior change which we started some almost more than a year before so first before I start to talk about our learning expedition I just want to give some very few information on the Helvetas fishing the corporation and we are a Swiss development NGO which exists since 60 years working in almost 30 countries with 1200 staff which are mainly national national staff in the country and we also have a good 14 years of wash experience and still trying to be innovative and trying out new things that's just in short what we are doing if you want to know more about Helvetas then you can look at our webpage so now coming to our learning expedition I hope you you are not too much confused up after the presentation of Hans Mosler because I was when I first heard about the runners methodology but it I kept it in my mind when we encountered is all these problems in our wash projects so the background of this of the start of the learning expedition was that the water quality of point of use was a challenge we always do some external impact study of our project and we did one in collaboration with the ETH in university in Switzerland about our project in Benin and the result of the study was really improved we had improved water quality through our new technology but there was no change at all of the water quality at the household level again we also did another study in Nepal with very similar results 91% of the sample at the household level were contaminated so this was a little bit a shock and result and we not just cannot just continue to introduce new technology for water supply and at the end the effect is vanished through recontamination of the bad management and that hygiene at the household level so in most of our wash project this behavior change is really a challenge I think it's not always a not only a challenge in wash project but in many others like food security and nutrition and our classical approach did not really give the expected results so we we were really thinking we really have to to switch from hygiene promotion to behavior change but then the big question was how how we can do it so we started to do this learning expedition on behavior change we call it like that it's a it's an expedition we don't know where it will end up and also how long it will go but we started this collaboration with the AIVAC and the main objective of this learning expedition is as you have seen the runners model is a relatively scientific behavior change approach and we wanted to see how we can adapt and make it more applicable and less intensive for our project so the main question was how far we can simplify and not losing the scientific essence how much support do we need for our local team to implement such a new approach and also a little bit what is the cost benefit ratio introducing this systematic behavior change approach for that we started some pilots in Haiti, Mali, Benin and Mozambique where we wanted to to find out how what's how we can implement this kind of thing really in the field with our local teams with not much external resources so I very shortly just give you a small idea about the project what kind of project we have where we did implement this thing we have a new project named Zikura in Mali not a very big pro project trying improving access to water and hygiene practice small one but with the aim to experiment with new approaches then we have another project the one mentioned in Benin where we already work since several years improving water and hygiene in school health center and on the community level with the long-lasting experience of transforming well new developed approach in Benin and then we have another project in Mozambique which is a big project mainly with the emphasis on water governance issue but having hygiene and sanitation also as a focus so first we got some trainings from airbag and they said okay it sounds logic and we have to get to know more about behavior change and how it works in our head in our black box but listening at we thought we we have to to simplify the approach because it's for our local staff it's far too complicated so we the first thing we did we simplified the terminology because we thought it was difficult to understand all these scientific factors I'm also not a psychologist so it's also far away from my from my common language then we also simplified and reduce the questionnaire because doing surveys is for us in our more sometimes it are the smaller project it's a big issue then we also decided to reduce the sample site to them then I think to to the minimum which was scientifically or reasonable for the methodology and also the analysis of the data we decided to do it only with Excel only calculating mean and not entering into more statistical analysis and we started in Mali then in Benin and Mozambique and during the implementation we always adapted and simplified again the methodology so just to to explain how we proceed it we did some capacity building of the team on Rana or on this psychological concept we choose the behavior and the definition of the environmental factors in Benin we choose water transport and storage and handwashing we elaborated the questionnaire and did some interviews with the household did the data analysis defined the promotion campaign and launched the intervention and we'll do an evaluation so now I'm I'm showing you the some of the results so be not afraid about the presentation it it's just roughly there are some other and there were quite some information these are the results on handwashing just to show you have where we identified the biggest difference between the doers and the non-doers so how you see it was mainly in the norm factors and also in the self-regulation factors so for Benin the point was really what others are thinking about the behavior how others are motivating you and and what others are doing on the self-regulation factors it was mainly the the folk forgetting of handwashing so and what is also typical or became sometimes also obvious that all that the factor about the risk were not the the the relevant factor and in the and before we were mostly communicating on risk factor on health issues then based on this information we discussed in the team so how we tackle these other factors or how we could adapt our intervention to tackle these factors so here is just a short overview on what we change and we define an activities to tackle the factors of the others behavior so we we the intervention should inform about the behaviors of others and for this we use the theater where we were well what we already did before we did some theater on hygiene and all that kind of thing but what was new it was the content of the theater we did not focus the message of the theater on all this health issue and and and and risk but we were targeting the issue of norm what others are doing the pressuring the pressure in the family when the majority is is washing hands in the situation of of the new wife entering this new family what we also did to support the other approvals is was to inform the others about the approval of the others and and for that we we tried to identify an influential person in the household and in the village who was ready to take a picture of him doing the hand washing and then hang up the picture in the family in the village regarding the forget of the self regulation factor we we produce some prompts where we put at the place of hand washing to remember people of doing the behavior and if I going now to to Mozambique here we we looked at the latter news and again and if you look at the result the main factor of the main difference was also on the norm factors and the self regulation factors and what we also did in in the cell way we also collect a lot of information and also on the information of latrine condition condition and here we also identified that there was a big difference on the latrine condition between the users and non-users so it was also kind of a conclusion that the condition of the latrine also have an influence and that we also have to consider that in our intervention so on the norm factors we we define an intervention where we want to to inform the other people of the village about the improved latrine and the nice latrine it was kind of trying to visualize the households which has already a good latrine in in putting a sign on the house so that people finish who has a good latrine and increasing the pressure the social pressure and then for the self regulation factor we stressed out that we we want to this was the commitment which was important and there we organized community meeting where there was a public commitment combined also with the motivation if people will improve their latrine so that people see who is committed to improve the latrine and use it also appropriately in Mozambique and this is also a bit a lessons learned was a challenge that we this project is really in close coordination with the local authority because it's a governance project and this is also we tried to integrate them but it was a little bit of challenge introducing this concept but then they they both they both did they were motivated to to change a little bit the intervention strategy but then for the for the implementation as they decide in which commune they will intervene it was not we there wasn't been a little bit the mismatch of the intervention area where they were applying the new approach and and where we did the survey so we will have some challenge in the evaluation so all the challenge applying this method and also based on it I think it's it's watch teams of technical person and I think it's not only only regarding and watch project often if you introduce new technology you have a lot of technical market people and psychology is really far away from from their agenda and it has to understand it's the same if I would ask a psychologist to build me a latrine I was also not he will also not feel very comfortable then the question of development there are very specific questions and I think in the first time there is some support needed we try to to reduce and simplify the question as much as we can but when you start you really have to spend some time then data collection analysis and interpretation I think this thing which is relevant for all our surveys but it needs some some skills and you have to plan enough time what we have seen in Mozambique we did the data collection with mobile mobile phones and and this was really more easier and much motivating more motivating for the people then I think what for me is the biggest challenge after you have done all this work this data collection analysis then it was really the thing that people know okay now we have to to address norms and self-progression factors but then when we see when we they started to develop intervention they fall back into the old behavior so they did this we started to to present hygiene message health method so it really has to to make click in the head that to change the content of intervention you usually do another thing it's a little bit of time factor takes time it's a whole process if you do the evaluation afterwards intervention so it's very important that you have a focal point person and that you don't hurry too much regarding the lessons learned is really that you you need an open-minded team who is ready to enter into the new field and also the support this management what was very important is this exchange between research partner local partner the head office to create a little bit the wincy tuition I think to research in the cute can learn from from us as well as we from them then you also have to sensitize and below the capacity in your organization it's reducing this new technology and it's it's a continuous learning I think we are still doing kind of try an error thing in simplifying and adapting to to field conditions other as results are not always that very quickly visible in regard to behavior change it's kind of a risk-taking exercise so you have to be open and to try an error and to have this long-term perspective and and this implies also kind of behavior change in the organization explaining it to the owner to project team what is also an issue which was also clearly coming out is that we always want to change too many behaviors I think we want that they they use a new household treatment technology that they change the hygiene behavior that they use the latrine that they pay for for for water so it's it's to be a little bit less ambitious and I think what we are doing because there was some question how much you have already implemented and how realistic and affordable is this and we have foreseen an evaluation in Malian Mozambique to really see how the intervention was functioning and regarding to the cost I think all this baseline and analyzing the data this is a cost factor but then for the intervention for the intervention you usually do this intervention already you have some sensitization work but it's more a kind of what is the content and to who you address it and how you you address it what we are now doing is to develop a two-option approach for project one is which is really more kind of short and dirty and quick and cheap version for project who we do not have too much resources and not a lot of capacity we and we just decided one or two days ago that we will somehow make an experiment an experiment during our regional wash meeting in May in West Africa where we want to apply a really very short kind of run-up approach in analyzing why people are not ready to pay for water to have a clear picture in in the group with the different projects in in a four or five base time and based on that we will have some further evidence how this is functioning and then the other option is really to for project which have a more capacity and more budget to have kind of full stretch simplified run-up approach with really practical guidelines then what we also try is to pilot kind of distance to board and training for the short options we started this in Pakistan trying to improve their cup studies and introducing this kind of survey and also in Bolivia on another topic not on more on waste collection and not on wash I think we based on the results we will have we we want also to taste the transferability to to other issues of behavior change it could be on on nutrition food security things where behavior change is also very much linked to to to the successful approach so this is a bit in a nutshell our experience we made and we are still learning and trying out great thanks so much Valerie that was an excellent presentation I know that some of you have to it's now just past 10 o'clock we will go for 10 more minutes to about 1015 to allow for a couple of questions answered and as a reminder this recording will be made available on the engineering for change website so Valerie one question that came up was apologies specific to children so Michael asked how does compliance with desired new behaviors vary based on the age of the user and do children follow the desired behaviors on their own or do they require supervision so in the projects that Helvetas has been involved in what have you seen there with respect to children okay and I think I think we did not focus on children yet but when we were talking about behavior change on hygiene or using safe water I think you always try to identify who which person or which target group has the biggest leverage effect on on on these and then you try to orient the study on that person because this person will have the biggest influence and can be motivated to change the behavior of others okay and there have been a couple questions regarding perceived price so first is could you explain a little what the difference is between perceived and at all cost and then secondly how do you change perceived price and can you unmute yourself now now I'm here I'm okay yes well the perceived price is the price in the head of the people and I can illustrate it very easily if you have a lot of money in your pocket ten dollars will be less than if you have only a small pocket that's an easy explanation and we we change the perceived price by by making the people aware that it is not that much that they have to spend additionally for purchasing filtered water from the community filter this was I think this was the central the central point and the other technique was that we we said okay higher price is higher quality and this is what something they know now but there is an intervention fact sheet where you can look at our own page and there it is described in more detail great thank you so a question for Valerie was you talked about having an adaptive process as you piloted this approach can you mention any specific examples of changes that you made as you adapted the approach in the pilot Valerie can you unmute yourself there you are okay what we tried it's I think the how airbag was doing the questionnaire it was a really almost 20 30 page questionnaire which was very scientific and now for we reduce it to to some some pages and also simplified the question in the way they were asked we did it that we really let the local partner participate in the elaboration of the questions and they were immediately saying oh this is a crazy question I don't understand or this it will be difficult to translate and this had already helped to simplify the whole thing what we also what we also will do on the evaluation is that we do to reduce also the question that we then focus mainly on the factors which were the one we we tackled most and we will not again ask question on the risk because this was somehow not so relevant and I don't know what airbag is thinking about but we we are in discussion on that and and also reducing the sample size and the how you analyze the data was was one thing this this other option you want to develop is more to to use the model with the different factors to analyze what is already done and where we can focus more of the rich factor we didn't neglect and where we can focus more without doing a really big study before excellent thanks Valerie Hans a question from Aaron Tanner have you seen a specific criteria that are frequently important or well-performing or have you seen any trends when using the Ronas model or is it takes home really that there are no trends in each population has to be studied yes there are trends but I yeah there are trends of personal trends social pressure is always important and also the the attitudes cost-benefit thoughts of the people are also very important however we find that it in some populations for for some behaviors also health knowledge might be important or vulnerability or severity so if you want to you I would say if you can't do it without any any survey or you apply your shots a small survey or or a big one but I recommend that you that you do a survey who wants to to get medicine with without a good diagnosis from the doctor excellent thank you another question perhaps for you both because Helvetas has been involved in adapting the Ronas model for use by implementers and then of course Hans you've been the developer of the Ronas model Myra what would it take to adapt Ronas for an emergency context I'll start with Valerie your insight on what further changes you might make to the Ronas for an emergency context and then I'll let Hans also contribute okay so I think honestly I don't see Rana I don't see Rana do you hear me now yes we can hear you yeah I don't see Rana's in an emergency context because it it takes some times you you yeah you need some time to develop and it and I think this behavior change things is a long time it's a more a long-term process it can help afterwards or based on if you have already some information on the situation then you might be better positioned to design intervention when it's an emergency but I don't see too much in yeah in that context thank you and Hans no I have I have ideas about that I am in contradiction to Valerie and no no we I think we can reduce the relevant questions in the survey to 10 minutes and add some spot checks observations some some behavioral observations and and do a kind of triangulation getting out of these data the the right interventions in in a in the short time we have no experience with that but I have ideas about how to do it and I would like to collect evidence on that that's it all right so Maya you should connect with Hans on that after the webinar for sure and just one quick question for each of you there were a couple questions regarding resources that you mentioned Valerie a question from Lee Boudreau is when do you anticipate the draft manual being completed and will it be public for other organizations who are looking to practically implement RONS yes I think we can share it I think first Hans they have worked on on on their guidelines and and they will I think Hans you have to correct me publish them somewhere in summer and I I am waiting the the evaluation of of our project to put some more insights on that and my guidelines are more on on the practical how to do step-by-step and and the guidelines of Hans are really the I think that has a basic and the the big framework okay and Hans from Bradford he asked Bradford asked where can we find the sample RONS questionnaire that you mentioned in your presentation look at the methodological fact sheets on our homepage okay on a Vox homepage yep okay okay so so with that I'd like to thank both Hans and Valerie again for being the panelists and taking our questions it's been a great presentation and I'm glad that we took some time to ask questions afterwards this recording will be available on the engineering for change website again thank you for attending as Diana mentioned in the beginning you can get a certificate for your professional development using this information that's available here if you have questions feel free to email webinars at engineering for dot or you can also email cost at support at cost org and of course we hope that you'll join us for future webinars so thanks to everyone and have a good day


I think he deserves more than Ronald Pross, and we're going to get our female solo great sergeant, John Zach. My name's John Zach, and I've been with the department for just over 40 years now. I came on on June 16th, 1982. In 1982, John Alway was a senior at Stamp 40 years of service, and I had to just give a huge shout out. I got with John, I said, you know, I'm going to talk about 40 years of not one citizen complaint. The city really is in awe of what you've done, John, and I appreciate everything that you've done. Thank you, sir. For me, engendered in an attitude of I need to have a job that makes the world better. And there were a few different options I considered, and this is the way I ended up going. I had two or three years in the radio room, and I had 15 years in the evidence room. Other than that, yeah, it's all been patrol. You know the nice thing about patrol, particularly as an officer, not so much necessarily as a supervisor, is you come in, you find out from the morning roll call what today's challenges are.  There's nothing you take home, and the next day you start fresh all over again. One of the things I liked was getting in the car and driving around. That was my office. I didn't have, you know, a desk and four walls with no windows confining me. I had windows all around me, and I could move my view anytime I wanted. I didn't know we made 40-year pens. The Denver Police Department's commitment to a continuing evolution towards excellence. When you're young and you don't know everything that's going on around you, the changes that are made, you might seem as good and everything, but over 40 years seeing continual progress of doing things better and better and better always. I think that stands out to me the most.


Everybody forced here ripping 20 22 museum collection baseball This is 12 box full case number 17 tier random teams You can check out these results at late sports cards comm at any time And there's a link in chat for them as well. Good luck everybody. Thanks for joining Yeah, Shane, don't you have a couple orders? I'm just gonna combine them if that's okay Yeah, you had one from earlier, so you're for sure for sure good tonight You see What's the last time you two museum done I don't know the last time I went I this is Kosei What No, it's like a science science place. I don't call it a museum though I think I don't even know unless I'm I want to it's a very sciencey thing where they have like would you call an aquarium? I mean it's displaying something. I Don't think it is a museum just old stuff Your definition of museum Does anyone have a definition of what a museum is okay, so so what would you qualify an aquarium? Yeah, it's closer to that right It's gonna push back like happy year I'm pretty sure which is kind of crazy like Like don't announce it and push it back so far. Just just release it when you to release it, you know By rookie copper Johnny bench. Oh check that out one of ten Andrew McCutcheon Pirates patch card Got the shoulder buccaneer logo right there nice hit pirates to start the break And yeah, that's game used of course Sweet start for the pirates.  I'm excited Canvas to grom Quad jersey Dodgers Clayton Kershaw 50 of 75 Miss force the punts. All right. Come on. I'll miss on the win this game Julio Rodriguez rookie Copper rookie wander Franco for the raise and also for the raise triple relic auto Wade Boggs That's right. Devil raise Wade Boggs 16 of 25.  I gotta eat that mustache And I think we have a we have a case area. I think we have a metal frame the pack is cold Yeah, we're gonna start with it with the with the case hit got blue Ricky Henderson a is 46 of 150 and it is Albert Pujols eight of 15 Silver frame auto Dodgers What a car Dustin K 180 I would think Sick Pujols that is awesome the machine Mr. 704 fourth player to ever hit 700 the first non-american Not American born. I don't know he's a citizen or not No idea, I would think he's been here for like 20 20s playing 20 plus years copper Peter Lonzo a quad jersey David Ortiz 5 of 25 red socks Yeah, definitely one of the best to do it. It's kind of weird. I feel like I Don't know. I feel like there's this weird because obviously he's older now that people don't remember How good our rules was his whole career? Weird man purple Mariano Rivera 86 and 99 Yankees canvas bone Jersey card Patrick Corbin Nationals 450 Like I don't think there was enough hype around 700 home runs like that's absolute insanity Merry Bonds, but a lot of people A lot of party poopers Hank Aaron Rookie copper Spencer Torkelson for the Tigers Bobby Whitton, Jr. Royals and Triple relic Otto Gavin Lux for the Dodgers Nice hit Dodgers numbered one 73 of 180 Bonds Aaron Ruth Pools copper rookie Hunter Green Reds Archival auto for the Phillies Mike Schmidt 54 125. Yeah, that's true Everybody believes in conspiracies now work down now Guys I Would not do that against Bama a canvas question Mike Piazza quad relic Max Fried 17 to 75 Braves They got a first down Yeah, Bama player like good up got up and like pushes push the quarterbacks helmet down into the end of the ground Artist-proof Ichiro canvas there you go Mariners. Oh, no, they did turn it over Okay, never mind. I thought it was first time on this They could have called that unsports like if they saw it, but Bama ball because I was four down about a third Copper Otani Cal Raleigh got a jersey card.  I Don't know. I don't know a lot about college as you guys know Delacruz Ricky copper archival auto Andrew Jones Atlanta 270 of 299 Your dream for sport auto card. Let's see my dream for sport auto card Me personally baseball. I'd go David Ortiz for football Tom Brady basketball Tracy McGrady for hockey I'm gonna say No, I'm gonna I'm gonna be super biased. I'm gonna go.  Quad jersey Yankees Garrett Cole Louis Severino Chapman and Zach Britton is 66 to 75 Nottingham is on fire right now for sure. Of course. I would say a Bruin Vaughan. I said for sport Wow, who else am I gonna say Gretzky? That's fair. That's fine, but no Talk about mine 28 and 99 Bryce Harper Phillies purple. I don't actually do have a Bergeron auto I lied. I was gonna say I don't have a Bergeron auto But think I'm trying to get all my favorite Bruins autos most of contrarious 22 at 35 Cubs triple-color patch Bobby or be good Bobby or was the one I thought about after those two. I Don't have an or auto. Maybe like a willio re on that. That'd be pretty cool Are you more of like a certain like that auto or just a auto that looks cool I think you meant like on the same card like no, I mean like I'm the same for you like when you cruise Nothing particular. Oh, that's pretty five of five jumbo patch auto giant Brandon Crawford with the three colors on it We did prison World Cup earlier David Four breaks of it earlier to start the day ice Crawford for the Giants And yeah, personals are full Any comments on Mike Piazza playing baseball? He is a Hall of Famer, so he is a good baseball player Some would say great Purple Steven Strasburg 25 and 99 Nationals dual Jersey Auto Twins Max Kepler 237 or 399 well got another one right now Eddie in the midst of it Into the thick of it Into the thick of it Take talk crap. I don't know what it's actually from but Tick tock these days Hannah and Cortes would always be quoting like tick tocks and All the time man Yeah, Tim Thomas to I liked him on the ice Yeah, his prime his prime was short, but it was like an elite like truly truly awesome So good Canvas George Brett got an archival auto Aramis Ramirez Cubs 56 of 299. Are we frozen? No, I think they're saying that's where the Oh, it's from frozen. Yeah, thank you, Penny At least I would assume I Am not from Boston, but That's how I was raised my mom and her her whole side of the family. They're all from Massachusetts in Rhode Island Wanderfranco rookie dual relic auto Tampa Bay 13 of 99 awesome hit raise Going to Thomas J. Congrats Thomas Get that mag for you, buddy No, he's not he's not David. He's actually sick right now. Got a blue Reese Hoskins 128 150 Phillies.  How do those things equate Rory? He might be sick because of Brentford, no, I don't know Copper Justin Verlaner, I guess it was flu season, right? So I got Quad Jersey Sunno 49 of 99 twins Happy taking my vitamins. I try to eat healthy. I'm doing my best guys I'm not going on the injured list not doing it You can't afford it. Oh, you're from Nottingham Matthews. So are you an NFC fan? NFU patch card raised Joey Wendell 19 of 25 That's right. Three of the last four matches Are no three the last five Liverpool spurs and Palace victories for Nottingham Forest Are the spurs on the tape are like as far as like ranking like standings right now. Well, just yeah, I think record I don't even know where spurs are. They even they're like top. What's six still blue Garrett Cole 56 and 150 the Yankees They've had some struggles recently though. They're doing what they were doing well in Champions League each year oh Quad relic Padres Fernando Tatis Jr. 14 of 25. I have not looked at the table since the last Two match match days actually two match weeks. They did lose the full of David didn't they Right now they drew with full. I can't remember man. Everything is Everything everywhere is just spinning everywhere. I go man. I can't remember anything Do a relic auto white socks. Yes money grand all number 3 30 of 357 all as I know all I know is Tuesday night I'm going to the Orlando Solar Bears game. I'm going to see some hockey. It's still in Come on Ole Miss you got this pudger Rodriguez Marlins 87 of 99 archival auto Tim salmon angels 106 of 2 at 99 Monday night is the next personals that I have available basically Monday night So Eastern time we start 5 p.m. All but it's all night personals Monday night. So yeah, that was a create out I watched that match. I was a fun one Matthew Spurs leads was great. I watched the entirety of that one usually when it's not like I don't know when it's not like a huge matchup like a lot of Saturdays. I have something that I got to do but today I watched the I watched that one. That was awesome. Even though force is playing. I was like, I gotta I Gotta watch this match quad relic Ryan Mountcastle 26 of 99 Orioles How legendary would it be if they drive down and score? Take the lead Royce Lewis rookie copper twins Patch card Yankees Louis Severino 29 to 35. Hey, appreciate it David. Yeah, man. That'll be a lot of fun prism It's been good. Obviously it's prism. It's it can it can be tough, but when it hits. Oh God so much fun Jared Durand rookie to 126 of 150 Red Sox. I just like turn my foot It hurts so bad. I did one of these like I don't know All right Luckily, you don't need to stand to break who Lee Rodriguez rookie archival auto Cardinals Jack Flaherty 36 out of 50 Not like felt weird in a bad way. Not like hurt real bad, but it's like what? Her like a pop It's probably important.  Let's go. Let's go Red punch Rodriguez 13 of 50 Marlins Got a triple relic auto Orioles Ryan Mountcastle 27 of 3 99. I think Kobe game use sign cleats Um would be a little a little too high-end for even ultra high-end Almanac. Those would be massive When I say cleats, I mean sneakers obviously Yeah, TCU text is the game I'm putting on after this one photo, yeah, I mean David photos tough the entire checklist could be a blue shimmer you get a blue shimmer auto Which is not numbered in a blue shimmer to five. So Yeah, but again, it's the whole checklist. So it could be any it could be any player on that list Quad relic Mets Phillies Dodgers Nationals Peter Lonzo Reese Hoskins Freddie Freeman Ryan Zimmerman 83 of 99 So let's see per our rules. You would need Over 50 majority, which is three quarters of this card to have it outright Uh Dodgers Nationals is Dustin K Mets Travis U And Phillies Joseph P that is a random at the end Nobody has more than 50% Yeah, so the risk is just more David. The risk is just more Got a Josiah Gray auto 178 of 299 The risk is higher. The reward is higher essentially With the first off the line box Especially a prison first off the line box We are going to be doing some group breaks with prison first off the line though guys, uh, hopefully this coming week We're doing a lot during the world cup. I think that'll be a lot of fun to be ripping Prison world cup as we're watching it. So It's wander rookie canvas bogs Dual bat relic auto braves matt olson 50 of 50 It's just the one. It's just the one blue shimmer as far as I know. I did one and that's all it was Blue shimmer parallel out of five and a blue shimmer auto non numbered blue frank thomas 123 of 150 white socks one of one Todd erin smith jim tomey white socks original canvas. That is a sketch I said we would do it and we did it White socks brian m congrats on the tome That mag of course and dual jersey mats pita lanza or francisco lindore 17 of 50 Fourth and 16, how did they get here? What happened? They were just like first and goal now. It's fourth and 16 Most Ole Miss thing ever GGs Yeah, 500 home run club jim tome What's up, brian? How's it going man? Congrats on the sketch Thanks for joining Elliot Ramos quad brewers relic yellow shader burns in here at the 75 No, that's mississippi state Where they do the cowbells and it's So dumb patch card giants haven't long gory a one of 35 The tampa bay rays do that too Why do the rays do cowbells? Uh because they need a gimmick to be loud They're like cowbells is like a go to Yeah, it's definitely it's the most gimmicky thing you can do to get to be loud essentially blue mike trout 68 of 150 angels dual jersey autopadres eric osmer Numbered 159 to 300 archival rookie auto astros chasmic cormick 65 at a 299 Yeah, should i get a bubu zala guys for the world cup and just Every time we do a world cup prison break i'll just Be playing the bubu zala I say playing like i'll actually know how to What's a bubu swala remember the 2010 world cup in south africa? No, they had those Those like here. Let me show you what it looks like bubu zala Is those horns? Yeah Yeah, we're gonna i'm gonna get one of those i'm gonna get over the whole shop. We're just gonna Not a shop bubu zala everyone's getting one every time you're the goal We have to walk in here and just start going to make it part of the lsc uniform you have to have it with you at all times Yeah, jake that's what i'm saying Uh, i'm not sure david. I don't think so. We were thinking about doing a random group Got purple carl stremski 93 at 99 red sox Archival auto brewers christine yellis 24 out of 50 Johnny cash fan. I mean johnny cash is fine. I like john. I wasn't johnny cash every now and then Let's say i'm like a fan. I only know the popular songs Hey, david, that's up to you. I said the risk is higher but the reward is higher That's all I can really speak for Triple relic auto royals at merafield 133 of 200 McDonald's is gonna get fired already. How? If they lose he's gonna get fired I mean the raiders are gonna stink no matter who their coach was Why can't they just accept that? They're bad at building a roster well They're okay at that but drafting players that'll be on the team. They're bad at that Dual patch mets pita lanza francisco endure 28 of 35 How would they ban bubu zealos? america's always afraid of stuff like that cowards purple jackie robinson 38 and 99 dodgers dual jersey auto cubs nico horner numbered 192 of 399 Yeah, i'm gonna go to uh the bubu zeala outlet and get so many bubu zealos I should have bought them like a year ago because now they're they're the bubu zeala price has got to be way up now They were like 10 bucks last year now. They're like 35 bucks Got an archival auto for the cubs derrick lee 33 of 125 The bubu zealos supply chain issues I mean it's everything right it's not just one thing Got a triple jersey auto cubs derrick lee numbered 52 out of 200.  Yes, I am they deserve to be hated I'm tired of hearing every off season about how they're gonna be so good Got reggie jackson 44 out of 50 a's You're tired of hearing the derrick cars in top five quarter. Yes, so tired of that I'm so tired of like last year It was like every sunday fun a mixture was like I think derrick cars better than dak in sanity Quad relic 53 a 99 lost the meadows raise I hate that. I can't see that look Yeah, that's Right like you're you're it's because he's your rival like he's a good. I'm not saying dak is like a top five quarterback When he's a good quarterback But anyway, I digress on that Anyone that wears a star on their chest. I don't have a Billy fan or not star is just that Yeah, that's true jim not saying that But that division is not as good as people thought it was gonna be not even close 76 and 99 braves hank erin Yeah, like it's not a mcdaniels thing necessarily rookie bat relic jake burger eight of 50 white socks I'm a patriot's fan. I think mcdaniels is a fine coach But obviously he deserves part of the blame. They're like a solid team. They just They're there's something something's off there Quad jersey brewers devon williams 93 out of 99 That's that's fair right there bon Although that man did win a playoff game with tim tebow, right?  There you go giants. All right. I don't know what you're saying anymore mouse Anyway, I'm gonna move on without brujan canvass Xander there and dual bat relic auto brewers keston hero numbered 149 of 399 Let's do a quick random and then we'll do a recap Mets Philly's Dodgers Nationals that's philly's dodgers nationals. All right, cool. So we have this quad relic Nobody had over 50 percent majority. So we got Mets Philly's Dodgers nationals quad relic here To 99 Alonzo Hoskins freeman and Zimmerman good luck A nine six and three whoever's up top gets the card one two three four five six seven eight and nine Mets Mets. All right guys one sec here. We'll do this recap We'll start with our relics. So we've got Brewer's devon williams White Sox jake burger Rae's austin meadows Dodgers max muncie Alonzo lindor for the Mets Giants evan longoria brewers quad here Got Alonzo lindor Mets again Severino Yankees Got Orioles ryan mountcastle Padres tautis Rae's joey wendell Got twins miguel sanu Patch card blue jays bo buchettes patch card cubs william can trick or wilson contrarus excuse me Yankees quad here Quad pitcher there White Sox he has money grind all Got braves max freed nationals patcher corbin Red Sox david ortiz Dodgers clayton kershaw And that really cool patch for the pirates andrew mccutchen Part of the old buccaneer logo. All right, we had autos now Brewer's kestan hira A giant's redemption gaylord parry archival auto copper Cubs derrick lee Cubs derrick lee Cubs nico horner Royals wit merafield Brewer's christian yellich Astros chas mccormick Got Padres eric osmer Braves matt ulson nationals josiah gray Orioles ryan mountcastle Cardinals jack flaherty angels tim salmon White Sox he has money grind all cubs aramis ramirez twins max kepler Giants brandon crawford of the jumbo patch aisle Hey, mike. What's up, man? White Sox jake burger Braves andrew jones fillies mike schmitz Dodgers gavin lux Rays raise wade bogs Rays dual relic rookie auto wander franco numbered to 99 You'll raise A silver framed auto albert pooholz dodgers eight of 15 Congrats dodgers.  So it's a sketch of jim tome white socks By todd erin smith Nice car. That'll do it. Thanks again, everybody. We are on to one-on-one basketball now


YouTube afterward. So we had some troubles with YouTube possibly because of some settings in the live stream We don't know yet Emily said she's gonna take a look. So hopefully we'll get that sorted out and Also Yeah, so we can get started. I don't recall if we ever went through the team specific team retro notes But they're linked in the Google doc as you can see so teams can everybody can go go through those specifically and Read those and then we can actually talk about how we want to do this Retro in the future at the end of this call, which might be relevant previous retro improvement tasks again is more zoom troubles So I think Trevor left a note saying that he's going to take a look and so you can take a Peek at issue 185 in the people ops general project if you're interested But beyond that we can jump into it I see a lot of people clicking around but does anybody want to start talking or put on some notes into a one well this month If not, anybody want to speak specifically in their particular area and we can click through to Particular team So the plan team I did a lot of good things. So if you look at the plan link for the retro We shipped a good number of issues in 11.3 And a lot of them were we're good that ultimate features with with epics and for full management in general so I guess What I'm leading to is actually not me not not not the planning did a great job But it was often that the the production team and the team getting the releases out So I was really happy and I think all the folks are responsible for getting the RCs out early Was really amazing So so we had a good number of features that unfortunately didn't make it for 11.2 And they were pushed to 11.3 for portfolio management So it really sucked because we were really close, but we missed just missed a freeze But it also meant that those features were just merged During the you know the the like the red regression stage. I don't know what we call that those two weeks of After 11.2 free so they were already in master and ready to rock so Because we got our release candidates out so early at least users of gilab comm and in particular us We're able to enjoy those features really quickly So I think that was great. We're making huge strides towards continuous deployment from that perspective and so I Kudos to team. I think that went really well from the plan perspective or for that impact in the plan team So I'll leave a comment there in the agenda Anything else people want to bring up? Bob is just typing so might as well speak up Bob Yeah, so We had some patches that need to be applied to get lab comm during the full release cycle So that started somewhere around the first of them up until the 22nd We Remember those patches often, but just as often we forgot about them And then we had the release on the 22nd Which basically is our last RC that we tacked with the same version number a cosmetic release We call it so it looks like the same release that our customers are getting and so on and after that we Try to apply those patches, but something went wrong We didn't notice what happened immediately, but we continued with our weekend because it was a Saturday So that means that gilab comm remained unpatched Over the weekend and we only noticed on Monday that was going wrong. There's a Postmortem document about that which I'll link and which I'll dig up and link from from the main document here All right, if nothing else we'll jump to the final point Which is making this meeting a sink so you can click through I'll let Eric speak to whatever you're typing Yeah, I'll capture the notes after what what I think we should do is one engineering should should take over ownership of the other retrospective PM screw the own and run the kickoff so we can kind of divide and conquer there There's this trend of teams doing their own retrospectives That's really important because a good retrospective is like a psychologically safe space to you know in a nice way You know call someone out your teammate for something that they should have done But maybe maybe didn't do and when it's a broad meeting when it's streamed to YouTube I think people are holding back from doing that sort of thing and we're seeing that so you should formalize the the Individual group or team or retrospectives engineering managers run those record those in docs If they want to do them a sink great If they want to do them sink or in a scrape that have a dock either way and then this meeting should be about Transparency external to the company and internal to the company and I think what this meeting should become is you know managers coming here and and You know populating the stock with essentially the highlights from their individual docs That doesn't mean a little bit duplication of information, but I view that as curation like we're curating this like what what do people outside? The company want to understand about what's going on Of course we link back to those docs that people want to dive in And then this be this is still a synchronous and live-streamed meeting so that way it's again is serving that purpose Transparency and outward communication So I think I'm I've articulated that in the in the issue But thanks for creating that Victor and we'll run with that. I think our goal will be to If that's the plan lock it down if it needs to change change it but tape but in the next starvegy a month from now Perform whatever change or we're going to do and then that'll allow you to focus on the kickoff Great Did you want to assign somebody to that so unless you I don't mind running this meeting and just clicking buttons in YouTube? I mind when it doesn't work, but I don't mind Yeah, I think when I say take it over I mean like we do YouTube streaming issues someone If they're on vacation, they've got back up like full full ownership. I'll be right.  Should I just just forward Messages I already have someone in mind. I just want to have that conversation with them. But like okay tomorrow Yes, we'll have that person and they'll have 30 days to figure it out. Okay. We'll do. Thank you Do you want to wrap it up Eric any parting words for us? I? Think I think that's the big action item is let's You know, we made a bunch of changes this meeting I think those worked and now it's it's at another inflection point. So the big thing to do is to Sort of redefine the purpose of this meeting and change ownership and kick it off again All right. Hi everyone


This week the chief of naval operations signature behavior number six is grow both personally and professionally every day Dr. Robert Keegan a psychologist from Harvard University Who specializes in adult development and learning uses the following simple math problem to help us understand how challenging this might be? It goes there are 14 frogs sitting on a log three of them decided to jump off. How many were left? Yes, it's a trick question because 14 frogs remained Wanting to or deciding to accomplish a goal is much easier than completing If growth is our desired behavior at the end of each day We should be able to describe how we have done so if we can't we're probably still on the log So how do you get yourself to jump off the log here are three steps for you to think about? one humility First of all leaders must embrace humility and acknowledge. There's always some element of ourselves that can use in growth To commitment this behavior starts with the Navy core value commitment Leaders must take ownership of their growth commit themselves to doing it every day thirdly accountability Sustaining personal and professional growth requires leaders to find a way to hold themselves accountable Lead well this week


So, guys, your idea is already recorded in our last section, right? So, you don't need to completely go through your idea again.  Because you already have video of the idea. So, the idea for our application today is to let users inform whoever they want, where they are, and what kind of environment they are in without their interaction. They need not initiate any operation like something like Twitter where you are updating yourself, where you are in. You are checking in Facebook. So, something like that need not be required from the user's part. The amount of sensors we have, we can always get that data. So, that's what we are trying to achieve. We are using a couple of modules here. One is this small sensor device, which is a temperature reader, humidity, altitude, accelerometer, gyroscope, paradigm, etc. So, this one is going to give us some information that no smartphone can give, which is temperature, humidity, and altitude. And this information, we may use of it to identify what kind of environment the user is in. Another one is we have taken this Nexus device. This one actually uses Bluetooth low-energy, which is supported by this device only, and this device needs to be routed. So, which we have done today after coming here. So, to unlock the Bluetooth low-energy module. And another one is this apparatus, which we explain later anyway. So, this one is used for displaying a small tool-tip information for any user if necessary. Those who don't have access to the internet or anything, they can always look up for this. So, with the application... The first going on, we have to do the registration with the user name. And the threshold value is the value like the compass value. Like when you exceed this value, we will be started with communicating with the sensor device. It will show like, just go ahead and switch on the device now. So, I am going to register it. I have registered it, and it is showing this device. This is where I get my data. I have just updated my data right away. And in the server, you can see the updated data. There you have it. This is like the time stamp. This is the latest stamp. This is the time stamp. And the humidity value right now. And altitude is... And longitude and latitude, it's the DLF altitude and longitude. And we move ahead. Direction, pace and temperature. Direction, pace and temperature is 27 degrees. This is all life values. What you have just got from the meter. I have uploaded within a second to my server. And now this happens on activity. So, if there's an activity on the device, it's completely registered with the device when it is away from the device's threshold value. So, what we mean by threshold value is that each user has a preference. So, if he chooses that after something like 30 kilometers, he wants the device to switch on and try to send all the necessary data about his tracking or his travel mission along the way into the main database, he can do so. So, this is completely user's choice. But what we would actually extended this to children also where parents do want to have control over where the children are going or at least know if they are safe or not. So, these values would not make any sense if this device was used similarly. But since it would go through an android device into the service and then go to somewhere else with this device that we have, we would have meaningful sense of what this information actually means. So, why we had to dismantle this? Because it was part of our apparatus near the lamp house. But I just need a brief explanation of what this is. This is an Arduino board. It's along with a dedicated business chip that performs the Ethernet capability. So, what we have here is an IoT Internet of Things device. So, when the internet will be connected to this device, this device will have a polling mechanism where it will try to reach out to the server and try to find out what this particular device, like if somebody is having this device with them. So, all these necessary data, especially the distance from the start and the temperature. So, these are the two things that we feel that are important for a parent to know about a child or some tracker to know about a particular location. So, these are two things that are very important. So, these are the things that we don't get from a smart phone basically. Yes. And why we went for such a device was that because these are very, very low cost devices. So, when you have these devices, these devices can run for almost like five years with a single charge of DC up to two battery. And they are at throwaway prices. So, you don't need to have a costly phone to do this. You just need a normal Android phone and this tab to give you a very comprehensive data set about your typing machine. So, this is what we want to do. And this is an extension of the data that we have here and use it meaningfully for someone who cares about their person. So, this will be a code. This will be with the person who is traveling. So, we want to create that abstract. So, this is what we plan for this product. So, I think we can also say this product will help. Yeah. So, I've been about connected with this LED, multi-color LED here. Full color LED basically. And what we have is, every time there is an update to the server. So, this Arduino board is going to pull the server every time. And it will get the distance from the start and location, current location. By that, we can actually calculate how far he is from this central location, which will be marked the first time he starts using it. So, from that central location, if the threshold value is say 30 kilometers, if he starts moving outside, so then until 30 kilometers, this light will glow green. And if he starts moving outside, it slowly starts moving to orange. So, the calculation that we have right now is, if he reaches 60, probably what I'm saying is, if he reaches 200 percent of the threshold, it turns non-clear, which means he's way outside the moment. So, that's the logic that we have right now. What we were planning was have some sort of an external display that will take this distance and take the location, plot it on a map view. So, this may just be fine. Do you have any questions? So, what other sensors do you think will add value to this? Right. So, one thing that we haven't used yet is gyroscope. So, you saw something like, you saw something like direction-facing, right? So, direction-facing is something, right now we've calculated based on, we've tried to calculate based on what the data is given by the device. We weren't able to, so right now it's already a smartphone, from the smartphone, the tablet, but we weren't able to complete it. So, right now it shows not all the time. But ideally, using the magnetometer and the gyroscope, by using a sense of fusion, we should be able to identify the value, which direction is moving. So, any person who is looking at that information will know which direction he's going. So, he'll know whether he's coming in or he's going out, because this update is going to be every, not frequently. Any other questions? No. Okay. So, who wants to go next?


Good day, fellow investors. I recently analyzed a company, Visa, as I was going through a list of growth stocks, compounders, stock that constantly reinvest money and grow at a very high rate. Then I thought, okay, this video won't be just a Visa stock analysis. This video will be about a tool, the Delta of the Delta tool, how to analyze growth stocks. And you can apply this to pretty much each growth stock and then you can see, okay, what is the risk and reward for investing in such growth stocks? Because it's not just about whether the stock grows or doesn't grow anymore. It's all about how much is the change? How big is the change in the growth rate? If the growth rate accelerates, the stock price exponential increases, and vice versa, if the growth rate decelerates, the stock price falls down. What you'll be learning today is this, the Delta of the Delta, how to analyze growth stocks, what happens with growth versus expectations and what is the outcome. By the end of this video, you will perfectly understand what this means and you will be able to apply this tool to all your future growth stock analysis and better understand the risk and reward when it comes to investing, thus protect your portfolio. This is especially an important topic as the last decade was the decade of growth stocks. If we look at the NASDAQ Compositive Index, it went from 1,500 points to 8,654 points over the last 10 years. That's a 6X increase, that's a phenomenal performance, but did those businesses perform as well as their respective stock prices? Let's see Microsoft, which is one of the top five constituents of the NASDAQ Index. So Microsoft's price earnings ratio increased from 7.5, unbelievable but true, in 2011 to the current 30. Such an expansion in valuation means that investors' expectations considering growth have also been constantly growing in comparison to what they expected at the beginning of the decade. Similarly, Visa's price earnings ratio expanded from 15.5 in 2010 to the current 33.5. Such valuation expansions increases signal that investors became exuberant about the growth rates in the future and expect constantly higher, higher, higher and higher growth rates, higher and higher earnings that justify paying higher and higher stock prices with higher and higher valuations. Now when it comes to, that's the definition of growth stocks, higher and higher growth and higher and higher valuations, the key to investing those is to analyze, okay, what's the risk, what's the potential, what is the biggest factor that influences the stock price and thus your investment returns because the dividends are usually small. And that's the change in the growth rate and I'll show you how you can apply and how it influences the stock price. So the delta of the delta tool is the perfect tool to do that. But before discussing the tool, let me give you an overview of Visa so that you can even better understand the great business it is, the great growth it enjoyed and how to analyze it. Please consider subscribing. It means a lot to me. It supports the channel and please click that notification bell as I do a lot of various videos so that you don't miss out on those videos that are really important for your financial success, always long-term. Thank you, thank you, thank you. Visa is the ultimate compounder. Revenues keep growing, earnings and cash flows follow. This leads to constantly higher dividends while the market for Visa simply keeps increasing thanks to global economic growth. I have two bank accounts, one is Visa, the other is MasterCard. I think if you open your wallet, you'll probably find a Visa card so when you look at Visa, what they did in the past, it's simply amazing. Over the last decades, revenues more than tripled, net income quadrupled and the dividend was increased by a factor of 10. That's really, really crazy and as the dividend increased, the dividend yield even decreased and consequently the only outcome for a stock like that, a growth stock like that is to skyrocket. So Visa was $16 in 2008, now it is at 180 and Visa shareholders have been really, really rewarded. Now, except for the amazing past performance, there is also a risk. Visa comes at a high valuation and a low dividend yield of just 0.66%, below 1% dividend yield. So what's baked into the price is constant future growth. Fortunately for Visa stockholders, the company just keeps on giving and giving. They have a low dividend payout ratio of around 20% because they can reinvest capital at rates above 20%. So that's best for shareholders. The company has all what you can dream about when it comes to investing, growing revenues, high margin, high return on invested capital, alongside constantly growing distributions to shareholders. Apart from the dividend we already mentioned that increased 10 times, the number of Visa stocks outstanding fell from 2.2 billion over the last 10 years. That's almost 30% less than the number of stocks outstanding in 2009. Visa's growth comes from their strong mode that is also reflected within their extremely high net profit margin. If you look at their profit margins, net revenues are just 6 billion for the quarter and net income is 3 billion. That's net profit margin just shy of 50%. Not non-gap net income is above 50%. This means the company has a huge moat. And the outlook is also simple when it comes to Visa. For as long as the company can keep growing earnings at 15% per year, the stock will follow. The management expects the company to continue to grow at mid teens, 15%. And therefore, this is also baked in the stock price. However, when it comes to investing, it all depends not whether Visa will grow or not, whether Visa will stick to the 15% growth that the management and the market expects. Let me show you a few earnings models about what happens depending on that change in the growth rate, the delta of the delta. And then you'll understand better how to analyze growth stocks. If earnings continue to compound at 15% per year, the future price earnings ratio that is now 43 in five years will be on the current stock price just 16.82 because current earnings per share are 5.42 in five years earnings per share compounding at 15% per year will be 10.70 and the price earnings ratio will be of 16. If growth continues at 15% over the following five years, then earnings will reach 21.52 and the price earnings ratio will be just 8.46. That's extremely unlikely to see such a low price earnings ratio. Therefore, the stock will simply follow earnings growth at the valuation that the market decides is good for growth stocks. In this case, price earnings ratio of 43. And if Visa continues to grow at 15%, the return to shareholders will also be 15%. The questions are, will Visa continue to grow as fast for a long time? What happens in Visa's growth is in the low teens or in the high teens? How does that affect the stock price? The answer to these questions will be given by the Delta of the Delta tool on how to analyze growth stocks by looking at the change in their growth rate. For example, if Visa's growth that is expected to be at 15% going forward falls down to 10% per year. Everything changes from an investing perspective not from a business perspective from an investing perspective. So this is counter-intuitive because 10% of yearly growth is still amazing but it might not be what is baked into the stock price. If Visa's earnings grow at 10% over the next five years, earnings per share would grow from the current 5.32 to 8.71. And not to 10.70 as it would be the case with 15% growth. Then the market will likely re-rate the company from a price earnings ratio of 30, 43 for 15% growth to a price earnings ratio of 20 for 10% or slower growth or slower trending growth. Then when you multiply 8.71 times 20 the likely stock price is to be in five years is 174 that's equal to the current stock price. This is really counter-intuitive. You say, okay Visa continues to grow at 10% but the stock price doesn't go anywhere but the business is still growing. And here it comes to explains and this explains the biggest risk when it comes to growth stocks. The change in the growth rate, the delta of the delta tells you whether the investment will continue to deliver great returns or be a 0% investment in this case. If earnings growth goes lower goes to 5% then the price earnings ratio as we have seen them in 2009 might fall even lower 15, 10 and then you might see also a big decline in the stock price. That is why these growth stocks are often very, very, very volatile but this is how it is and this is the risk reward you have to think about when it comes to investing in growth stocks. The same works on the upside too however if Visa manages to grow at 20% per year earnings per share would go from five to 14 over the next five years and the market would probably value the stock with the price earnings ratio of 40. Therefore the stock could reach an incredible $568 over the next five years and then even higher over the next 10 years. This is the magic of growth stocks and this is the risk reward of investing in growth stocks. So the key when it comes to investing in growth stocks is the rate of the growth, the change in the growth, the delta of the delta and that's something you have to put into perspective before investing in the company. So for the risk reward analysis to conclude on growth stocks you have to ask your question what's the probability for Visa to grow at 20% at 15% at 10% and lower what's baked into the price and what's my investing risk reward ratio because when it comes to growth stocks it's not that much about business it's more about the valuation and the stock price. Amazon did grow amazingly over the last 20 years but it took 15 years or something like that for the peak at the dot-com bubble to be surpassed in this new growth stocks cycle. So the business growth took more than a decade to reach the stock price expectations and growth and that's something you have to think about compared to all other investing options out there. So to summarize the delta of the delta growth stock analysis you have to see okay does growth match expectations if the growth matches growth expectations the stock will likely grow at the same rate of growth. If the growth rate beats expectations if you can find the stock that is likely to grow but the market doesn't see it then you have a winner because what happens higher growth and expectations will lead to a higher price earnings ratio to higher valuation and higher stock price growth exponential. This is what can happen to Visa if the growth turns higher towards 20% Visa can be a $500 stock easily. Growth rate below expectations is what you want to avoid and this is usually what happens with exuberant stocks and this is what happened in the 2000 dot-com bubble. If the growth falls below expectations all the exuberant feelings quickly turn cold the market gives a much lower valuation and the stock consequently falls. This is why investing in growth stocks is considered risky and why investors expect a higher return. Visa investors have been rewarded with double digits returns over the past because they are taking the risk that the growth eventually or somewhere slows down or stops or goes even down if you have a recession. If this helped you when it comes to your investing please subscribe or enroll in my free stock market investing course where I put many and I will put many other investing lectures, videos about tools, mindset and everything that's really important when it comes to investing. If you want to see all my real investments if you want to save money by having me doing the investment research for you check my stock market research platform you have my portfolios you have everything that I do for less than a dollar a day. Thank you for watching looking forward to comments and I'll see you in the next video.