Well, hello out there. Good afternoon. Good evening or good morning, depending on where you're joining us from today. Welcome to Engineering for Change, or E4C for short. Today we're very pleased to bring you the latest in our 2017 webinar series on the topic of excuses, optimism, and complexity navigating impact measurement in social innovation. My name is Yana Aranda and I'm the Director of Programs here at Engineering for Change. I'll be your moderator for today's webinar. If you're following us on Twitter today, I'd like to invite you to join the conversation with our dedicated hashtag, hashtag E4C webinars. I'd like to take a moment now to tell you a bit more about today's webinar. Measuring a pact of social innovation projects can be approached in a variety of ways. There are many competing opinions for what can be measured, what can't, and why. As there is no set of regulations for social innovation practice to date, practitioners must decide how to measure impact ethically to ensure that interventions are helping rather than hurting communities. Today, we are joined by Lauren Weinstein and Chris Vanstone of the Australian Center for Social Innovation, or TAXI, who will help us to understand social innovation measurement techniques that aim to accelerate learning through the design and implementation process. I'd like to welcome both of you and thank you for joining us today. Before we get rolling, I'd also like to thank the E4C webinar series team. If anybody out there has questions about the series or would like to make a recommendation for future topics or speakers, we invite you to contact the team via the email address visible on the slide. Webinars at Engineering4Change.org. Today's webinar is part of the E4C professional development offering. Information on upcoming installments in our series, as well as archived videos of past presentations, can be found on the E4C webinar's webpage, as well as our YouTube channel. Both of those URLs are listed on this slide and can also be found on our platform. Before we move on to our presenters, I'd like to tell you a bit about E4C and who we are. E4C is an knowledge organization in the global community of over 1 million engineers, designers, development practitioners, and social scientists leveraging technology to solve quality of life challenges faced by underserved communities. These can include access to clean water and sanitation, sustainable energy, improved agriculture, and more. We invite you to join E4C by becoming a member. Membership is free and provides access to current news, data on hundreds of essential technologies in our social libraries, professional development resources, and opportunities such as jobs and fellowships. E4C members enjoy unique user experience based on their site behavior and engagement. Essentially, the more you interact with the E4C site, the better we will be able to serve you resources aligned to your interests. We invite you to join E4C's passionate global community and contribute to making people's lives better across the world. Check out our website to learn more and sign up. E4C has two webinars coming up in February. Our next webinar will be in collaboration with the Impact Design Hub on Thursday, February 23rd at 11 a.m. Eastern Standard Time. We will be discussing development engineering practice as part of our topic of supporting development actors to practice impact design. A week later, we'll do a technical deep dive on the topic of the role of robotics in global development with Raj Manavan, who is the founder and CEO of the Humanitarian Robotics Technology. Check out the E4C professional development page for more information and re-registration details. If you're already an E4C member, we'll be sending you an invitation to both webinars directly. Now, a few housekeeping items before we get started. I'd love to see where everyone is from today. So in the chat window, which is located at the bottom right of your screen, please type your location. If the chat is not open on your screen, you can access it by clicking the chat icon in the top right corner of the screen. So I'll get us started in actually my location. Coming to you all from New York. There we go. I see folks are already answering in the Q&A window and I have folks from Indiana and Pennsylvania. But again, we'd like to encourage everyone to use the chat window to answer this question so that you can get accustomed to it. See all over the states, Florida, Pennsylvania, North Carolina, Indiana. Of course, we have folks from Australia. Phoenix, Arizona, Costa Rica. Again, please do use the chat window to answer. Denver, Germany. Lovely, lovely. For those of you who use, again, don't see the chat window. You can click on the icons in the top right-hand corner of your screen like this chat window. We'll pop it open. Any technical questions and administrative problems or just comments should go into the chat window. You can find a private chat that you first see that way and you can find us located there in the dropdown. You can also use the chat window to type any remarks. But during the webinar, please use the Q&A window, which is located below the chat, to type in questions that are directly for their presenters. That way you can keep track of them and not lose your question in the mix of chatter. If you are listening to the audio broadcast and you encounter any troubles, try hitting stop and then start. We also want to try opening up WebEx in a different browser. Following the webinar to request a certificate of completion showing one professional development hour or PDH for the session, please follow the instructions seen at the top of the E for C professional development page. Again, the URL is listed right here. So thank you all for entering your locations. Great to see folks from the UN in Australia and all over the United States and beyond. We're really glad to have you here. Now with this, I'm going to go ahead and move on to introduce our presenters. We have two wonderful presenters today. Chris Vance Jones is the Chief Innovation Officer at Taxi. He leads the innovation at this group. He started his career as a product designer, designing biscuits, cameras and razors, but has spent the last 14 years working with interdisciplinary teams and communities to co-design solutions to social problems. And he is joined by his colleague Lauren Weinstein, who is a senior social innovator at Taxi and leads co-design and systems change. She's a multidisciplinary designer with a background in sociology and social design. Her experience ranges from ICT development in Nigeria to disability service innovation in Australia. We're very excited to have all these fantastic speakers join us today. And with that, I'm going to turn it over to them to share their insights. Good afternoon, everyone. I'm Lauren Weinstein and I have Chris Vance Jones here. Hi. We're really excited for the opportunity to present to all of you today a little bit about our journey in monitoring and evaluation. We work on an organization called Taxi, the Australian Center for Social Innovation. And I'll be handing over to Chris to introduce you a little bit to what it is that we do at Taxi. But first, I just want to talk about some of the things that inspired us to explore the value of monitoring and evaluation in our work in social innovation and some of the things that we were running up against as we tried to evaluate the impact of our work at Taxi. So when we started to look at what was the actual impact we were having on lots of different types of social innovation projects, we ran into a couple of different assumptions that either we were having or our partners were having or some of the other organizations in the space were having. We found that people often thought monitoring and evaluation was a real check on the progress that had happened to date in a project, more of a project management approach. Or the final decided on whether or not a project should be continued or not or that final assessment. Is it good, is it bad, does it work, does it not work? We also heard a lot about how evaluations would be the content you need for a pitch for future funding. So if you've got the evaluation saying the project's good, then surely you'll be able to fund the project moving forward. Another thing that we heard a lot about was a gold standard in monitoring and evaluation. So there would be one type of monitoring and evaluation tool or mechanism or approach, and that would be the one that you would need to use and you could use it for any kind of project or at any stage in a project. And that would be the bar that you would really want to look to, for example, maybe in RCT, something like that. We also had this assumption ourselves a bit at the beginning that monitoring and evaluation is something that would restrict the innovation process, that it would hold us back from iterating and coming up with creative ideas, that it could constrain the types of more disruptive work that we wanted to do and systems change. And lastly, we've heard this across lots of different practitioners. I think lots of people sit in different camps on this, but we've heard many people say that it's not possible to measure social impact, that you just can't know how people are exactly affected or how people are benefiting from different types of design or social innovation projects, because these projects are so interrelated and context is always changing. We've learned a couple of things about each of these things. And I think that this is what really set the stage for taxi to go on a learning journey, because we felt it was important to at least find a way to think about how we can understand how to improve our impact or understand what impact we were at to begin with. But we'll talk a little bit more about what we've learned across all of these things, but first I'll hand over to Chris to tell you a little bit more about taxi and what we do here in Australia. Good morning and afternoon, everybody. So we're coming and broadcasting to you today from Adelaide, South Australia, and I want to recognise that we're on the land, the traditional lands of the Ghana people and pay our acknowledgements to Ghana Elders past and present and into the future as well. So taxi is the Australian Centre for Social Innovation and really we were set up by the South Australian government, although we've always been independent of government, to find new solutions to long-standing social challenges. We help organisations get insight into problems and opportunities using a human-centred design methodology. We design and develop new solutions, so often that services, but also policy solutions. We help organisations build their innovation capability and we take on much more ambitious projects which are about shifting, catalyzing innovation across systems for the greater good. And of course you can read more about our work on taxi.org.au. Our team, as you would have got a flavour of, is very much multidisciplinary. It's drawn for people with backgrounds in social science and design, but also in frontline practice in policy development and in business innovation. We focus our work in three areas. On work with families, particularly in the child protection space, where we're really trying to catalyze Australia thinking differently about child protection and what it takes to enable all children to thrive. We work with older people. We've got a particular interest there with the baby boomers and we're currently running a big systems change project that's looking about home and housing for people, for boomers in particular. And Lauren will talk a little bit more about some of the work that we've been doing in disability where we're really trying to realise the promise of a big recent policy change here in Australia called the National Disability Insurance Service which is promising individualised funding for all people with a disability and a shift in that market setup. So we're really trying to help organisations develop products and services and build capabilities so we can actually realise those ambitions and the ambitions of people with a disability. We work with NGOs. We work with state government. We work with federal governments. We work with full-purpose business and increasingly we're working with foundations and philanthropy as well. So it's quite broad our work, but it is all situated in these, mostly situated in these three focus areas and all situated in Australia in tiny bits in New Zealand for Robert from New Zealand. So I want to say a little bit about our approach to innovation and I think you guys will be familiar with the sort of standard sort of four-stage design process and this is how we think about it and just to give a bit of a context because this is going to be the framework that we use to talk about the different kinds of monitoring and evaluation and learning that we're doing and we're exploring at each of these four stages. So we think about it as in an innovation process. Really you're starting with a great deal of uncertainty. You might not know what the problem is. You might not know who your beneficiaries are or who your customers are or what they value, but then over time a good innovation process, whether you're taking a human centre design process or another one, it's really about reducing that uncertainty. So you've got triangle one going down over time. So we talk about it as four stages, the discover stage, which is really about identifying opportunities. This is typically where on the ground field work is happening, an ethnographic approach, as well as a sort of review of the systems in which we're working with. The design stage where typically we're prototyping new kinds of solutions, be they policy or services. The trial stage and this is sort of this lack of two stages more traditionally where the kind of conversation about monitoring evaluation is the trial stage where you're trying to develop an evidence base for a particular solution and the spread stage where you've got something that works but you're trying to spread the impact by spreading to other sites or scaling up depending on your approach there. So really simple model that we use and we're going to use it to introduce to you the different kinds of evaluation and monitoring and learning approaches we take across each of these four stages. And so really the purpose of innovation for us is really then about testing assumptions. This is just another diagram that we often use. We often think about our workers in the office, in places where we are now naming and framing the assumptions. What are the things that we think might be true and then getting out of the office to test those assumptions in the real world and it's an iterative loop. And I suspect this will be really familiar to lots of you. So this loop that you see here, it's something that we iterate on throughout the entire duration of a program cycle. So from that discover phase all the way to spread. And it really informs the way that we learn across projects. And those could be projects in any of the sectors that Chris talked about before. And we're also working in some new sectors as well, including homelessness and youth employment. We've even worked in health as well. But fundamentally our main priority at taxi is really to see improved outcomes for people. We want to see people living their best lives. And for a long time we knew that the families we were working with were really benefiting for the programs that we were running and the services that we were designing that they really enjoyed them. They would tell us stories about how they had increased social networks or they were becoming more confident or some families had less relationships that weren't so positive and they were moving on to better work opportunities and schooling opportunities. These are the kinds of things that we wanted to be able to articulate, but traditional monitoring and evaluation approaches didn't quite capture all those stories. A lot of the times we couldn't find the right mechanisms to really celebrate the nuance and the complexity of how these projects were running. And so in a way that the families and the communities that we work with and that our partners and that our funders could all appreciate as well as our own staff to understand what exactly was the whole point of doing this kind of work. And so while we recognized that monitoring and evaluation was really important, we often found that the evaluations we were using were kinds coming at that later end of the process that Chris was talking about. And some of the recommendations we were hearing about projects were really valuable and we thought, well, this has been actually quite useful to integrate into the project design much earlier. We know that it works, but maybe there are some things that we could have tweaked or iterated on much sooner. And so today we want to tell you a story about how or why we've kind of abandoned this idea of monitoring and evaluation and moved to the idea of monitoring evaluation and learning. We think that this is, we think that there's a real opportunity to think about what monitoring and evaluation and learning looks like as a process and parallel with innovation and something that can inform our work even at the earliest stages of what we do. We are really starting to address this more in a meaty way just now as we're a pretty young organization. So we're on a learning journey too to understand what exactly does it mean to do really vigorous monitoring, evaluation and learning in a variety of different projects in a variety of different contexts. So we're not necessarily experts that we want to share with you. A lot of the things that we've found to be really useful and also the types of things that surprised us along the way because we believe that measuring impact is really a way that we can improve the types of outcomes that we deliver for people as well as accountable to doing the better work for the people that we serve and the people that we partner with. So back to this diagram because this is going to be a little bit of the structure or the framework for how we describe some of the different things that we've tried in monitoring and evaluation. So we basically, we've done a lot of work in taxi across all of these four stages but a lot of times, of course, our projects start in the discover phase and sometimes even funders ask us to just do the discover work or just discover to design. And that's not typically the place where people are asking you to do monitoring and evaluation. And we're starting to starting to feel like it would be a bit too risky to wait to evaluate or understand our impact or understand just how good the project was or if we had really done things we set out to do three years after we started the project the project had already come to a trial phase. So we've been working with an organization called Clear Horizon in Melbourne which is really a human-centered focused monitoring and evaluation organization who's been helping us think about what are the flexible ways to do this what are ways to really understand how do we hold ourselves accountable to the things that we set out to do and discover phase in a way that keeps the door open for us to explore again what all the opportunities are. I'll share with you an example from one project that we're working on right now in the discover phase. So this is a little bit about what Chris was referencing before. In Australia there's been quite a big shift towards the national disability insurance scheme which is going to be giving individuals and families choice in how they spend their disability pensions on what services they want from which agencies they want and this is really putting the control back into the hands of the people who are going to be benefiting from services and so we're supporting one larger nonprofit organization in Australia to think about how they can develop three new innovative services that really speak to the needs and the wants and the values of the people who would be benefiting from them. So people in Australia with disability across different age ranges across different types of disability and complexities of disability and what we're exploring in this piece of work is really what would radically different disability services look like if we actually designed them with for and by people with disability and what I mean by that is that we've brought on people with disability to be part of our research team and also the co-design team so we're researching what people with disability and their families would really want in services in supports that help them reach their goals and ambitions and we're doing all of that all of that is being informed by people with lived experiences either caring for someone with disability or a person with disability and throughout this work we realize that it's incredibly important to understand what the questions are that we're setting out to answer even before we get into that design phase so in a lot of projects that I've been in before we have a set of questions and we go out and do a bunch of qualitative research and it's quite hard to know how you're tracking on the types of questions you're setting out to understand what we think we think Mel has a really important role in this space in the discovery phase before implementing anything just to really help you structure and track your research progress and rigorously know which assumptions you're naming which assumptions you're testing to know just how much you've learned how true those learnings are and what the gaps still are so we have come up with different sets of questions that we think are really important to answer in terms of monitoring evaluation and learning in these different phases so in this phase what we're really trying to understand is do we even design the right project and so we would have hoped to have named that in the beginning of the project but we're constantly checking that because we know context can change and our learnings are going to change over time so we may have had some assumptions about what the right approach would have been at the front end of the project but as we get into it we want to make sure that that's still right we want to make sure that we're starting to understand what the barriers are and what new opportunities are and we want to be able to hold ourselves accountable to the intent for this project so for us it's really important that we're going to be able to do research with and design new services with people with disability and so we need to make sure that we're really holding ourselves accountable to including the people that we say we want to include and we also need to make sure that we are checking back in with the respondents that we've taken with us on this journey so we want to make sure that ethically the families that we've engaged with are still feeling okay about the stories they shared with us we also want to make sure that the way that we have understood the things that they've told us and the ideas that we've come up with are still articulating their stories with integrity so we go back to the people that we've spoke to at the beginning and check in with them about how do they feel about these ideas are these the things that you were explaining to us that we get it right I'll show you quick examples what some of these frameworks would look like so now this is just kind of a boring table but actually what it helps us do is check back in every day after research to understand if we're making progress and so basically have three lines of inquiry and we're trying to understand what users want in that first row and we're also trying to understand if any of these services are actually financially viable will they be sustainable for the long term and every day when we go out and do research and have interviews and use generative research tools we want to make sure that we're actually answering the questions we set out to answer that if we have new questions we're adding them in here where if we're not answering certain questions what is it about our approach to research that's creating that gap in our knowledge so that's one small way that we're starting to kind of structure and think about just how much we're learning in a discover phase we move more into a design phase I want to share an example of a project that I've been working on in the child protection space so this project is called rethinking restoration and it's funded by the Sydney Meyer fund it's a three year project and we're partnered with a government family and community services agency in New South Wales and we're also partnered with an academic research team and a monitoring and evaluation team and so in this project what we're really trying to understand is how we could potentially redesign the child protection system so that helps more children live at home with their families and thrive over the long term and what we've found in the spaces of course that is quite a complex space there are entrenched practices within the child protection system there's lots of socio economic and cultural factors that come into play here it's not a real simple answer we can't just break off one part of the system and say fix that piece and then the rest of the pieces to fall into place it's also we have real people with real lives at stake and there are really big risks associated with trying to test new things with families and their children so monitoring and evaluation is incredibly important to us in this project and we want to make sure that we are monitoring and evaluating before we even begin to pilot and we didn't understand exactly what that might look like which is why we asked that organization Clear Horizon to support us with that because we knew that we wanted to be able to tell from the earliest stages of the design as we were prototyping what it was that we were learning and what those early indicators were that we had the right idea for what we should be doing and we have the right hunch around our theory for how we're going to create behavior change for people and that we're protecting the people that we're working with at the same time. So some of the things that we're looking at understanding during this kind of phase is what are our assumptions about how this design will actually work and behave and that might be within the service or the system or the program itself or amongst individuals. We really want to test the logic of our design. So if we say people are going to use these three services to help them build capacity in these ways and then ultimately they're going to end up living happier, healthier thriving lives, we want to make sure that all of that is not just an assumption on our part that it's actually going to work so that needs to be back to evidence and we also need to try things in the real world. And then we also want to make sure that we are collecting data that indicates early outcomes. So for this kind of project we're not going to be able to see within a really short amount of time lots of children returning home and living safely with their parents once they've been separated but what we can see are really small indicators that things are starting to get better. Because we want to know at the earliest stages that things are starting to improve, don't want to wait until five years later and then say, oh well that doesn't work, we're sorry. We want to make sure that as we're testing and iterating that we're learning from each of the activities that we do and each of the elements of the prototype. So for this project this is just a small picture of a theory of change that we were trying to map out for one of the pilots or prototypes that we were working on and so what you'll see as you can see the quite tiny writing is that all the way at the top we've got some really high level broad goals and outcomes that we think this type of thinking can contribute to and then below that masking tape line is actually the end of prototype outcomes. So these are the types of things that we know we can be held accountable for within this project and then you see those little yellow dots those are things that we've named as things that we want to be able to measure and we've come up with strategies to identify exactly what is the data we would need to collect to measure those different things so like our children happy and thriving and indicating attachment with their families and are they showing that they're having lots of healthy productive play our families building some of their social capital working towards higher education or having behavior change in terms of what they think good parenting is surrounding themselves with positive role models all things like that and so for each of those yellow dots actually there would be a different way that we would collect that data and some of it might be from the people who are participating in the project themselves some of it might be from us some of it might be from our partners and some of it might be through just us hearing anecdotes and some of it might be more quantitative data but that's all dependent on what is the question that we're trying to answer so what we'll do is collect data all throughout the prototype and continually say well this seems like it's working this seems like it's not why do we need to check in on what do we need to iterate and change for the next the next piece of this work so I'll hand over to Chris to talk a little bit about what things look like in the next stage of a design project but first I'll probably introduce that a project that Taxi's been working on for quite a long time that's more in the latter stages of that design and innovation program cycle Thanks Lauren something that's really interesting about what Lauren's just been talking about is we're using we find ourselves now using a mail approach in the early stages of the process that's really where the primary stakeholders of that process are the teams that are doing other taxi teams that are doing the work and so it's not something that we're doing to sort of satisfy funders, it's something that we're going to do that we're doing to kind of improve how we do our work at the very earliest stages but I'm going to talk about the latter stages where yeah of course then you start to think of some other different stakeholders that are the key audiences for mail work so really I think what I'm going to share sort of adds on top of what Lauren's just been talking about in that you still want to know are we doing the right kinds of projects and you still want to know is the design of this thing still right So we're talking a little bit about family by family and you can read more about this online at familybyfamily.org.au and this was really one of the earliest projects of taxi about six years ago and it's been designed through human sense design methodology which really started with the question how can we enable more families to thrive and fewer to require crisis services it's really working in that child protection space which is a very hot topic in many places but very hot here in Australia and essentially through that process we developed and in response to that question we developed up a model where we find families that have been through tough times and train them up to support families currently in tough times so it's very much a peer-to-peer support model and the professionals are in the background supporting the families to make change and so in this project we actually didn't do any of the mail work that Lauren's just been talking about in the discovery stage or the design stage certainly not with the sort of rigor that Lauren's been sharing but we did in the trial stage and it's probably been in that trial stage for the last three years so we're just on the verge of that next stage so really what's because we've taken whilst we didn't do it with such rigor but because we've taken that approach really thinking about how can we build in ways of monitoring into the program itself so there's this particular nice tool which originally started on paper and an iPad that enables families to self-identify the changes that they want to make in their lives and then track progress against those changes so it's something that we developed in that design stage primarily for families so families could see change in their own lives but now we're using it to collect data and aggregate that data so we've got the data on the impact of the program but so that's one thing that we're collecting in this stage but of course then we also at this stage are trying to develop up an evidence base for the potential funders of this ongoing funders and investors of this work so we found ourselves looking at some different kinds of things so people are really interested in things like unit cost they're really interested in does this actually increase usage of services where people want to see them increased and decreased usage of services where they want to see them decreased how does this compare with like programs and what's the cost benefits of this particular approach so if you want to dig into the details there's a lot of all those are online at familybyfamily.org.au and really some of the stuff that we did to get that sort of data in here was some some comparison between a like sites work which didn't have this intervention to understand were we actually making a difference in service usage it turned out that yes we were but that wasn't necessarily sustained as long as we'd like to see it we're able to extrapolate from that reduced service usage in this particular case reduced notifications of child protection issues compared to a cost saving and quite a conservative cost saving so we know for family by family or quite a conservative estimate so we know for every dollar you invest in family by family $11 is saved for government through reduced usage of crisis services child protection services and we know that it compares favourably on a unit cost with other programs but I think there's a really so that's sort of not perhaps surprising stuff when we talk about measurement and evaluation we often start here but I think what's been an important caveat to all of that is I think particularly in government systems just because you've got great data doesn't mean that people want to invest and so we've been doing a lot of work more recently to really try and understand what are all the other things that we need to package up for the value proposition for investing in family by family because political decision-making processes are not certainly in Australia are not rational processes they can be quite emotional it's about linking together all sorts of different political agendas, timing is really important so there's a whole bunch so I guess the point I wanted to make is great to have evaluation but that's not necessarily going to be sufficient to create a case for an ongoing investment process and now we're just on the edge of that spread stage with family by family so very recently we've just created the family by family global hub which sounds very exciting but it's just two people and we're supporting service delivery in two sites in Australia but also in conversation with Canada and with New Zealand to support the growth of the program and to other states in Australia as well I guess the crux of the conversation here when it comes to measurement and evaluation has been how can we actually build this is a bit of background and so taxi is currently delivering all of these all of these programs but our ambition is to transfer that to not-for-profit service providers we see ourselves as very much as an incubator of new service models we think we've kind of done that and so now we're looking at different kinds of structures to get investment into this to get shared ownership of this and to get the model itself spreading nationally and internationally but we've been thinking really hard and it's not a question that we've answered yet but how do we set up a really good approach to monitoring and evaluation and learning that really enables local sites to do a number of things so to see are they delivering the program as designed is that creating the intended impact and if not does that mean the design of the program itself needs to change is the global hub providing an appropriate kind of support as well as aggregating the change across all of those different sites and that gets quite complex in terms of the systems that you need to be able to do that efficiently and effectively so I think I'm going to hand back on to Laura so across all of the work that I've done before taxi and that I've gotten to do at taxi I think what really rings true is that it doesn't matter how good your intentions are how much you want to make an impact for people how much good you think you're doing at the end of the day really need to know what kind of change we're making and we need to know that with quite a bit of rigor and we need to understand what that impact is so we can continue to make more of that good kind of impact and elevate the work that we do over time and what we've come to see in this type of work is really that the monitoring and evaluation and learning is really about getting clear about what it is that you want to achieve and acknowledging what you know and what you might not know being able to collect the right data to demonstrate that but then most importantly reflecting and learning on that data over time over the course of the entire program cycle and what really stood out to us is that some of those assumptions that we had at the very beginning and going through this project and kind of coming up with this trialing this more monitoring evaluation and learning approach is that we have a bit of a different take on some of those assumptions now so I think what we've come to see is that monitoring evaluation and learning has a role at every stage of the process it doesn't need to just be in the trial and spread stage there's lots that can be done in discovery and design evaluations are really just one piece of the funder pitch there's lots of things that funders are going to need to know there's lots of things that they're going to be curious about and we shouldn't do monitoring evaluations and learning just for the funders we need to do it for ourselves and for for our beneficiaries in the communities that we work with as well that monitoring evaluation and learning works best when you draw from a portfolio of different approaches and that when you choose the methods that match the purpose so there'll be a time and a place for an RCT for most significant change for for baseline assessment for being able to gather those anecdotes about stories and what people are experiencing in terms of change over time but that all depends on the question that you're trying to answer and the type of work that you're trying to do so tailoring it to what's most appropriate what's going to help you learn the most about the impact of the project we think that monitoring evaluation rather than restricting our work actually helps us accelerate the rigor of our learning because it helps us name what exactly is working and not working at really early stages and then gives us some data to be able to pivot and iterate on and then above all I think social impacts are definitely measurable it might be an excuse to say they're not something that they are just have to find kind of the right ways and approaches to be able to identify what it is that you want to measure and how so I think we'll just, I think that's all time so we'll just leave it there and I think open up for questions so thank you so much to both of you for a really fruitful and deep discussion so one question has already come in I'm going to kick it off with that one this question is regarding root cause analysis and specifically the listener says that they didn't hear about root cause analysis in the process does that enter the approach and if so can you speak to where that's not an approach that we have used in our work it's not something that we felt that we needed to use I think in the early stages we're trying to understand what contributes to what contributes to particular social challenges as well as what can contribute to better outcomes but as a method it's not one that we've used I think what we've tried to do a lot of is in that discovery phase is understand what exactly is the issue at hand and what's the complexity of other factors that are contributing to that at a variety of different levels so what's happening at the community level what's happening amongst services and institutions what's happening and more strategic policy level that might be contributing to that what can we learn from existing evidence to say these are some of the things that we should be exploring I think yeah I think that as soon as yeah I think we were really open to using lots of different methods and this is kind of a learning journey for us as well and so when this time and the place is appropriate I'm sure we'll be exploring something like root cause analysis as well got you so on that notion of using a variety of approaches in order to really understand the picture and what's really happening can you mention the use of anecdotal data as part of the mix can you give us a little bit of a sense of do you have some guidelines or some best practice that you've already developed around a balanced mix of approaches at any one point is it like 30% anecdotal 20% quantitative can you give us any insights regarding that I think that's something that we're trying to work out right now as we sort of engage in this media approach to mel across all of our work is yeah what is the right mix of methods and approaches at those different stages and yes in generalising in the earlier stages you are well it also depends on the kinds of projects right you have to generally have more anecdotal data at the start but then there's also I wonder if that's it's also possible to turn anecdotal data into something that is more statistical or something that can give you a kind of picture across the board of impact with using things like most significant change approach yeah and I think in terms of things like family by family that was a lot all that anecdotal data was how we came to understand that it was really working for people so we would hear stories about how you know things were really tough before family by family but family by family is the one thing that changed you know the family's life was better and that they don't know where they would be without it and they can talk about specific things around what their link up with their sharing family did was a better place but yet when the government see an evaluation those weren't really the things that they were that were going to be able to help them make the case that they should fund it for another year and so while those things were incredibly valuable to us internally to help us understand what was working for people or specific things that people didn't like often we would respond to things that people said okay you know this is this is not really what we want and then iterate based on that became more of an I guess our way of gauging what needed to change and iterate but we were I think we're just now trying to improve our sophistication around saying okay these anecdotes are actually really valuable things that government and funders and external stakeholders need to hear as well we can do the types of evaluations that you think are necessary but these but anecdotes are really the way that you can tell the story and provide texture around what that real experience is for people got you and pulling on that thread a little bit and I apologize if anybody out there is not hearing me while I see you one comment about my audio maybe being not that great so we'll check that out but at this time I have no other alternatives so I'm going to continue with respect to collecting anecdotes or stories or insights considering that we are here on engineering for changes platform and I think many of us are curious to know how how you approach that you mentioned during your talk that you used iPads with questionnaires and other methods can you speak to us a little bit about how you ensure that you collect that information from what I imagine is a spread of families or you know participants in a way that allows you to also organize it you know analyze it and do whatever else is necessary in order to tell the narrative quickly yeah so I think how we do that looks different at different stages and so yeah certainly in those latter stages it's thinking about what are the sorts of systems that you can build into the solution that can collect that anecdotal evidence and systematize and aggregate that and with family by family hopefully we'll be doing that across multiple sites in multiple countries so practically family by family the tool there is something called the bubble diagram where families fill in a bubble at the center of the page where now on an iPad where they say what they want to achieve the contributing factors to that is sort of a mini theory of change really and then they progress on a 10-point thermometer scale from beginning middle sorry before, during and after a link up and that gives this data on the kinds of goals that families are looking to change and their assessment of progress against those goals in the earlier stages the anecdotal data collection is it's a lot less well it has structures but it's different I think in some of the earlier stages but we try to name some of the indicators that at least people are feeling to say for example if it's in a research project we would want to know that people are feeling comfortable and comfortable and engaged in interviewing with us and that's something that they want to do and they feel that that's voluntary we want to know that some of the stories that we've heard of that to them are we're describing them with integrity they're the types of things that they would have felt comfortable communicating outwardly so it takes a little bit more of an accuracy and an ethics strategy and I guess some of the ways that we've done this and I'll just reflect on the first project that I talked about that we had two quite long interviews with families and then we analyzed the data that they shared with us and I went back to them with summaries of that to get their feedback on that and just kind of check if those were the kinds of things that they were really communicating to us and then would pull out some of the key quotes that we felt needed that we felt really described some of the I guess the pains and the gains or the things that were helping them and some of the things that would indicate that there was an opportunity to do something differently and so that yeah and other projects that I've been on that might be categorized quite rigorously in the spreadsheet and we would have maybe different categories of topics that we wanted to collect that anecdotal evidence around I think in in the design phase we would need to name all the indicators that we're looking for and be able to collate the data that we're collecting from families also from different services and from government agencies and be able to analyze that and show that more widely with our agency. Right, and how do you manage the associated risks for example, you know, participant exhaustion or this can be both in regional projects or local projects but also international where folks feel like they keep getting asked the same questions over and over again by different agencies and it just eventually just kind of refuse to talk about it or kind of over it so to speak. Yeah I think that's a really good question so there's a couple of ways that we do that one is if it's in a design phase of a sorry, a trial or spread phase of the project we try to make sure that that's built into the experience so the bubbles that Chris was talking about that's very much part of families experience in participating in that service so rather than feeling attractive to them that's part of what they do yet we also use that data to understand how well the program is operating so we try to double up to make sure that we can embed the questions that we need to ask in part of the experience for people in interview stages we make sure that families understand exactly what they're committing to before we even get started so to say this is actually going to be three interviews this is the amount of time these are the kinds of questions that we are going to be asking of you is that something that you'd like to commit to at any stage you can drop out and we make that really clear and give them the option to do that one of the things that happens in the child protection space is that families are often asked to tell their story over and over and over again to different service providers and so that can be not only exhausting but traumatic and so we try to make sure that the way that we ask people to share their stories with us is what we would call potentially therapeutic and empowering so we find different kind of maybe paper based drawing strategies or different kinds of safe ways to communicate a story that really helps people end on a high and have a real conversational engagement with people so it's not just us extracting information from them I think another part that plays a role in that is the fact that we often get to move these projects beyond research and into design which means that people have the option to start to turn their ideas into reality into some sort of design opportunity and so they tell us this thing is really bothering me and then we can work on how might we make that better and work on that together so it doesn't just feel like we've come in and asked you some questions and then we're never going to see you again that actually if you wanted to be a part of this over the long term you could and we found that that's been something that people are really excited about I think we're also in Australia we're quite lucky in that there's not a ton of other organizations that are also asking the same people the same questions so usually this is kind of the one opportunity that some of the families that we're working with get to do this so not experience so much of that fatigue but we do try to be aware of that as the outset I think it's really about being clear about what people's commitment is I know that I've experienced that in other projects internationally and I think one of the ways that we try to do that best is to really embed the data collection in whatever the design is so we can kind of reduce that fatigue over their engagement with the project definitely I think managing expectations early on is just really an important part of it that speaks to how critical it is to plan early and really understand what your strategy is going to be around MEL so we have one question that I have from a participant that I want to make sure we address before we close out and it is have you considered using relational modeling techniques in your approach I haven't tried that before but I'm really interested to look into it if there are some suggestions or experiences that other people want to share through the chat we'd be really keen to hear that Oh that's lovely and we definitely encourage our listeners to connect with the speakers as you can see their email addresses are listed on the slide in front of you and we're also welcome to reach out to the Webinar if you'd like to make a recommendation anonymously or something to that effect but it's good to see that there's a dialogue happening here and we welcome that dialogue at all of our webinars with that we are approaching time and I just want to go to that question slide a little too late but I would like to thank everybody for attending participating today's webinar and thank you for seeking your professional development hours for this webinar please reference the code listed on the slide when applying for your certificate if we didn't get to your questions or you have questions that arise after this webinar is complete please feel free to email us at Webinar at engineeringforchanged.org and of course we invite you to become an E4C member to get information about upcoming webinars with that I'd like to thank Lauren and Chris thank you so much for joining us today for your busy morning to help us understand a little bit more about what you are doing at Taxi and how Mal can be integrated into the practice of all social relation projects thank you everyone have a good morning, good afternoon or good evening wherever you may be and we'll catch you on the next E4C webinar bye-bye


Hey y'all, welcome to what Chelsea eats. Thank you so much for joining me today I am going on a grocery store haul to my favorite food store, which is Whole Foods Market A lot of you guys know that I shop there and the reason that I shop there is because That the food just tastes better I'm not saying that you have to buy your food from Whole Foods in order for you know Your body to heal from reproductive issues, but it just happens to be my favorite place in the in the area in which I live to buy my food So if you would like to see what I got on this grocery haul, please stay tuned Oh, and if you have not picked up your herbal blends to help you to heal reproductive issues Please go to my website at whatchelsieeats.com Click on herbal blend so that you can see what herbs I have available for helping you on your healing journey You can also click the link down in the description box of this video for more information Okay, I'm gonna share with you what I got from Whole Foods today I got three bags that are pretty packed and I think everything came to about $90 which was a lot and Food is just getting ridiculous, but I'm gonna share it anyway Here's what I got from the store a lot of the same things that I always get But I love to share these with you because you seem to like them This time I got a 50-50 blend baby spinach and spring mix for my salads I was going to get head lettuce, but I have a busy weekend I knew that I would be lazy about cutting and washing my lettuce so this week I'm gonna go with Just the spring mix and then I always buy Bunches of bananas so that I can sit them on my counter and let them ripen so that they can be ready for smoothies Next I got an organic cucumber the organic English cucumbers are my favorite cucumbers. They are delicious. I cut them up and make them And put them in dip or a salad dressing and eat You know just alone Add them to salads and didn't you did you know that you could actually cook? Cucumbers, I know it sounds ridiculous. We don't really do that here in the United States, but people Overseas in the UK. I believe do a lot of cooking of Cucumbers, but I don't cook them. I have once but it wasn't my favorite thing I would rather cook a zucchini versus a Cucumber and I got some aloe vera. You see that big long stem of aloe vera I love using aloe vera in my smoothies So when I do that, I peel the skin off. I take about an inch so I would do about this much Cut it and then peel the skin off and then add it to my smoothies My absolute two favorite fruits to put in smoothies Are jackfruit and dragon fruit. I absolutely love these two fruits This bag will go with two smoothies So I'll split the bag in half do two smoothies and I think this might get Three smoothies out of it.  I am addicted to The organic broccoli florets from Whole Foods for whatever reason they taste so good I could just sit there and eat them. They don't need any dip. They don't need to be cooked. Nothing. I love them And then same thing goes with the organic cauliflowers florets. They are delicious They don't need any dip nothing. I put them in my salads I put the broccoli and the cauliflower in my salads, but they don't need anything. I Got a little bit of a box of winter berries winter strawberries I'm not sure if they're gonna be good or not, but we'll see Strawberry season is like March April May June-ish and that's when they taste the best to me, but I Was in a mood for some so we've got some so just as a mix for my salad. I got some arugula I love putting arugula in my salads because it just adds an extra depth of flavor And this here are these are limes. I Love limes in my water. That is what I use to drink my water like this morning when I first woke up Well, not first work up, but the first thing I ate or drank was Two limes and one liter of water. I absolutely love That it helps me to feel hydrated. It helps me to go to the bathroom first thing in the morning It's just amazing and then the lemons I bought a bag of lemons because I love Putting them in my salad dressings or recipes they and also lemons and limes also help with recipes If you're trying to cut down on the salt that you're using they actually help to negate needing salt It doesn't replace salt, but it helps it And did you see I got my Christmas tree last week, but it's not decorated yet Do you guys decorate for Christmas? Anyway Then I got a bag of organic chopped Kale and what I've been doing with this lately is like for the last two weeks. I've been making Kale chips with half the bag and the other half of the bag. I've been Um Putting I mean they putting them in smoothies if you would like to see a Kale chip recipe video Please let me know in the comment section and I will show you how I make kale chips Next I've got a mango. They were $1.99 each. You got two apples. I have two avocados a head of garlic two tomatoes and Some almond milk unsweetened and some almond milk creamer Now I usually don't use this stuff. Normally I will make my own Almond milk and I may not even use a lot of it I don't use almond milk very much anyway, but sometimes I like to have it in my smoothie or Sometimes I have a recipe that that calls for a little bit, but ordinarily I don't drink store-bought almond milk But if I am going to drink it, this is the brand that is available in my store Local to me. That is the cleanest That's the thing you want to look for is there junk in your almond milk So I like this brand and it's unsweetened. That's the other thing you want to look for is Unsweetened you can sweeten it yourself yourself with with dates with honey with if you use honey, you can use Stevia that kind of thing and sometimes I like to make lattes if you have my seven-day meal plan Book number two volume two. There is a recipe for Cafe capo mo in it and what it is is a coffee replacement. So sometimes I'll make coffee cafe capo mo and Then I will use this creamer as the creamer and it will be a latte So if you have that e-book make it, it's delicious It's the seven-day meal plan. I have two seven-day meal plan e-books and if you Purchase an e-book it will you don't have to eat the recipes as like breakfast lunch dinner snack as a matter of fact I think it's way too much food for some people for me is sometimes too much food for me But there are there's people out there that like to have Breakfast lunch dinner and snack options for themselves and that's why I wrote the book So there's two volumes of that and then there's also a raw food e-book at my website You can get those in the description down below. There is a link or you can just go to my website Whatchelseaeats.com and click on e-books So this is what is in what I brought home from the grocery store today and I'm really excited about this food I already have some food in my refrigerator. So I will combine this with what I have and I will share Well, it's actually just me eating this week. My husband is traveling. So this is my food this week I won't eat it all but we'll see how it goes.


What's up everybody, I'm the Mangus, you were awesome and we've got huge news coming out of Omidus Studios with their Paragon successor project called Peratecessar. I'll not beat around the bush here, they've added Steve Superville as an advisor to the team. Steve motherfucking Superville. If you don't know who that is, he basically created Paragon. It was his vision that got all of this started. It was Steve Superville that thought, hey, wouldn't it be nice to have a MOBA that actually looked like the gameplay trailers? I usually wouldn't call the addition of an advisor huge news.  Ameda now has the guidance of the godfather himself, and I consider that to be huge. A little background info, Steve was the creative director of Paragon from August of 2013 to May of 2017. Basically the timeframe for when I think the game was at its best. He then parted ways with Epic under circumstances that I personally find questionable. It all looked voluntary and friendly on the surface, but it seemed to many of us that he was swapped out for Donald Mustard in order to make Paragon lucrative for Epic at the urgings of Tencent gaming. I have an entire video explaining all that somewhere, I'll link it in the description. It was after Steve left that we started seeing a focus on faster gameplay with the monolith map, skins locked behind loot boxes, and a tendency to attempt to balance via the introduction of new hero kits.  So what does adding Steve Superville as an advisor mean? Well, if nothing else, it lends a massive amount of credibility to Ameda Studios. Let's do a classic food analogy here. It's like if several people are trying to recreate one of Gordon Ramsay's recipes, but only one of them actually has Gordon himself giving them advice. There's still no guarantee that the person is going to make the best tasting food, but most people are going to trust the cook with the OG chef in their corner. Having Steve's name attached to the project in any way gives Ameda a significant amount of clout with the Paragon refugee community. The pair refugees isn't going to start calling us. As far as what he'll actually be doing though, I have zero goddamn clue. He has real experience with game design, he's not just a figurehead idea man, he's not just a leader. Steve Superville has real game creation chops and I'm not sure if the advisory role entails helping with specific problem solving or just general advice on game direction. Maybe he'll just offer advice on how to lead a team through the rigors of the development. I have no idea. I have no idea what he'll be doing specifically. I'm just happy to see Ameda Studios advisor on his LinkedIn account. I do want to take a step back here and point out that Steve Superville's edition may not be a good thing for every pair of refugee. I wish I had more information on how much influence he had on the monolith style gameplay so that you could better decide for yourself what you think of his addition to the Ameda team. I fully understand that my opinions of when Paragon was good may differ from yours. Many people enjoyed the monolith iteration of Paragon much more than legacy and I have zero clue what input Steve Superville had on monolith. I do think it's safe to say that he didn't have anything to do with the V42 patch. That's when they switched the entire economy and card system. You can decide what you think about that. I personally hated V42. I look at that patch as the nail in Paragon's coffin. However, that's just my opinion.  If you're in the camp that believes that Paragon is but a base to be used to build something better or maybe you didn't like the original legacy iteration of the game then maybe the addition of Steve Superville to the Ameda team can be looked upon as a bad thing depending on how much influence he'll have. My personal opinion though if you can't already tell is that it is fantastic news for Ameda. The Paragon that Steve Superville created is the Paragon that I fell in love with. Yes, legacy Paragon had problems that needed fixed but the creation of a spiritual successor is the perfect way to keep the spirit of Paragon alive while also improving upon the base. Even if the advisory role is only intended as basic development guidance it still gives me a warm fuzzy for Ameda Studios that the Paragon progenitor himself is involved in any way. Like the video if you enjoyed it sub if you want the option to become a channel member is there if you want to support what I do financially. But for now this is the Mangoo setting off, you guys have a good one. Mangoo!


As the Independent National Electoral Commission, INEC extends the date for the collection of PVCs. Some ABC stakeholders in Benway State have discouraged violence and character assassination in the policy during the general elections. In an interview with Plus TV News, Senator Alcandida, Titus Zam, said he was mobilizing supporters to collect their PVCs before the expiration of the extended time. Well, that has been ongoing, we have gone around the entire district, and for us who are running for various elect positions, we have spoken to our people to go and collect their PVCs. But that campaign is still ongoing, and from the records available to us, people are actually doing so. Moreover, we are talking to INEC to go to those hinterlands and give the people their PVCs. We are a very peaceful political party, we are a very peaceful family, and every member of ABC has taken it as a matter of duty to ensure that we do not encourage or participate in any form of violence. And that is our creed, we are a peaceful political party. Plus provided us a motivation and indeed the rationale for mobilizing our people to go collect their PVCs. We are indeed totally committed to emancipation, and we know that this is where it begins. So we have not taken things for granted. A lot of opposition has come to us, but we have stood very firm, and have mobilized our people in their droves to go and get their PVCs. The virtue of our disposition as priests, Reverend Father High Centalier, Reverend Frederick Iker, we are priests, we have not been brought up in that manner of abusing people running derogatory campaigns. No, we are not after that, we are after campaigning that deals with issues, that the issues that we are putting on the table. By the time the Lord help us to gain power, it will not be those statements of derogation that we will be putting on the table to work on. Hello, hope you enjoyed the news. Please do subscribe to our YouTube channel and don't forget to hit the notification button so you get notified about fresh news updates.


As of June 23, 2020, the World Health Organization reported a total of 8,993,659 confirmed cases of COVID-19 globally with 469,587 deaths. There are now 4,437,946 confirmed cases in the region of the Americas. The NUSHA currently has on record 19 cases of COVID-19. The last case was diagnosed on June 4, 2020. This individual has now recovered fully and has been discharged from the hospital, giving the country a 100% recovery rate. As such, there are no confirmed cases of COVID-19 currently in care. Testing results received on June 24, 2020 indicated 27 negative test results, a total of 1,619 tests have been carried out to date. There are now 306 people in quarantine. Most of those are nationals repatriated from cushions. All persons in quarantine are doing well with no symptoms of COVID-19. The Ministry of Health, we note the continuous increase in global cases of COVID-19. So though at a national level, we've been able to manage this epidemic, we remind everyone of the need to remain cautious and to maintain behaviours which will reduce the risk of spreading the virus. Be reminded that in addition to the hand hygiene and cough etiquette, with the use of the mask and maintaining physical distancing requirements, self-care is also necessary and an important component of our prevention efforts. Through the combination of increased daily consumption of fresh fruits and vegetables, regular physical activity, avoiding harmful products like tobacco and the excessive consumption of alcohol, a stronger immune system is built. By building your immune levels, there is increased ability to fight off COVID-19 and other infectious diseases. For people living with chronic conditions, these actions are of particular importance and will add great value in preventing further complications with their condition. You may also visit your closest community wellness centre or speak with your private health care provider for further guidance on actions to assist in the prevention of ill health. They remain available to guide and support you in decisions that promote health and well-being. The Department of Health and Wellness, we will continue providing you with regular updates on COVID-19.


Well this past month the Minnesota State Patrol has been endorsing their seat belt enforcement campaign. As an example of how important it is to wear a seat belt they presented this saved by the belt award today to Daniel Eckstead who was recently in an accident. If he had not been wearing his seat belt it may have cost him his life. On October 13th Eckstead was re-rendered on highway 210 while slowing to wait for oncoming traffic prior to completing a turn on the county road 28. His Ford F-150 sustained extensive damage but luckily Eckstead was belted. He had not been wearing a seat belt the state patrol believes he would have sustained serious injuries or death from the impact. I responded to Mr. Eckstead's crash and just looking at the totality of it and all the factors involved it was a clear cut case where if he had not been buckled up it would have been a definite different outcome. Eckstead suffered just minor injuries. The campaign has ended for the month but the Minnesota State Patrol would like to remind drivers to always wear a seat belt. If you've enjoyed this segment of Lakeland News please consider making a tax deductible contribution to Lakeland Public Television.


I think what is in and we know we we don't want to necessarily personalize the discussion around personal or other ambitions these are the forces that make cities these are the issues that this is personal for me no no this is very personal because we have suffered from the evil in cities from the immorality of cities and states but and money the last two days the last two days have been about also trying to unpack and take out the layers so that this discussion can actually happen think of the last three hours I'm also intrigued by hearing what we've just said what how this connects to what Vernon Henderson said yesterday morning and it connects totally to I think what is being said here which is the issue of productivity and density right and you can abstract these notions or you can give it a very real sense which can be controversial we've heard that in the room but on the other hand the deep connections between a spatial solution the quality of life but also the quality of work and all that is absolutely central I think that's also what you're getting at and I don't think that's necessarily challenged by what has been said now we are coming up to unfortunately the end of this session but can I ask parks if you want to just reflect on anything and Zibong we haven't come back to you for any further thoughts just two points I wanted to reflect on the first is that as we speak we also need to realize that some of what we discussing as solutions also present themselves as threats so in an environment like in South Africa where electricity is a revenue generator for local government of great solutions are a threat to the local authority where the petrol levy a share of the petrol levy is part of the revenue that goes to metropolitan municipalities when you're talking about electric cars you're talking about a revenue threat to municipalities so you do need to think about it in an integrated way and manage a transition that is just that sustainable and that enables you to achieve your objectives without undermining the reality that it could potentially if you don't plan in an integrated way present as a threat that's the first point the second point which I think the discussion covered to a large extent is that there possibly is the need to continuously keep particularly in an urban development space the linkage of the urban land systems starting from land ownership to spatial planning to land use management to property tax to infrastructure investment and to being able to then generate the revenue from those investments to then thinking about I think part of what Sam is saying is how do we then leverage through tax incremental financing mechanisms land value capture mechanisms where public infrastructure investments enables us to then leverage additional taxes from the investors that enables reinvestments into the city so there needs to be almost a complete cycle of the land development and land use management system in the city that's linked to revenue and taxation thanks I think I've listened to what the other panelists have said and I think that when it comes to funding you know infrastructure in in local government areas there's a lot that still has to be done and it's going to be difficult to do that without private sector contribution I think it's very essential and very important because if you want to increase you know your revenues and we are looking at property taxes as a possible area over which you can increase the revenues you need properties alright this is not to say that there are no sensitive issues around property ownership around land issues and but I think the private sector the public sector can find common ground where the cities would actually develop where revenues would be generated but ultimately where the private sector the public sector and the citizens work together to make this happen in cities across the continent and I'll take a case the case of Cameroon for example it's very difficult to to sort of develop properties and if you've been to Cameroon you'd notice that and one of the challenges we're having is funding high rising buildings for the simple reason that the regulations are a bit tough unlike in other cities on the continent where those buildings are sort of you know propping up but the bottom line of what I intend to say is I I think strongly that you need the private sector you need the private sector to be able to to sort of develop you know the infrastructure and the buildings on the basis of which the local government would be able to fund infrastructure development so I stand on the wall and I think private sector important communities and their personal and sort of their feelings need to be taken into consideration as well but ultimately we need we need common ground to be able to to move on so thank you that's the end of what I think was an extremely interesting discussion Ricky ceded to me to perhaps summarize what I think was was fairly complex discussions but I think I can summarize it in in five points that I hopefully will come in the will reflect what people said so I think what we know from the past few days and this is the first point is that for the cities that are already there and the cities that are yet to come we need finance I think that's relatively clear and a relatively agreed upon point I think what Tunde very well said and that's my second point it's there it's around the corner but then what Sammy and and Zabong were talking about is that it actually needs to be unleashed so even though it's there we haven't figured out how to unlock it yet and I think as Sammy was talking about from the land perspective Zabong talking about the property perspective there are there are other perspectives and then I think the fourth point which I think parks I'm just going to quote you because I think you said it so well is that we've got to remember that the solution is part of a threat and that was reflected in Jennifer's comments right so we know what Jennifer knows what she wants to do but she can't do it because it's seen as a threat and then I think the fifth point sort of bringing now from from Zadeke's perspective perspective is that when we think about how we're going to unleash and unlock these financing potential for cities we need to think about doing it in a way that improves the ability but not at the expense of the city dwellers so I'm hoping that that summarized relatively the discussion so let me end by thanking my co-chair who did a great job and thanking the panelists but hold on two messages two important messages you now have a very short coffee if any of you have lost anything there is a lost we'll go to the front desk apparently someone's without a blue jacket but you know lost property at the front and it has been alluded to but in the next couple of weeks most of the presentations that you've seen will be available online as PDFs on the urban age website so I've seen a lot of you taking pictures of slides which is great but you should be able to actually have the full recordings but also the PDFs of the PowerPoints on that note thank you again and see you in 15 minutes


So, this is the last question before we open it up to our great audience questions. The Wiser Diplomacy Center that you're helping to launch is really committed to training the next generation of international affairs leaders and experts in the United States. If you look out at the next 20, 25 years of challenges that they're going to all be facing, what are they? What should they be working on? What should they be thinking about? And how should they be best prepared to be the kind of leaders we're going to need for the next 20 and 30 years? Great question, and we'd probably be here until breakfast with all of us talking about it, but I think just a few points. First of all, I love what you're doing at the Ford School and the Wiser Center and everything that is being supported, what the Wiles have done, all of you who've seen the importance of this kind of investment in our next generation of leaders. And the conversation we had over at the school, which was just with the students, was very revealing based on the questions they asked because it wasn't just how do I get prepared, what do I study, where do I work, what do I do, what are the values that should guide me as I think about becoming a leader who wants to make a positive difference. And one of the questions was what is the role of empathy? And I am a huge believer that if you are a leader who wants to make a positive difference rather than just feather your nest or stroke your ego, but you wanna make a positive difference in people's lives, empathy is key. You can't really help people unless you can relate to them. When I went to Bangladesh and to India and met women who had gotten these loans, that's what got me committed. You can read about it, you can go to a lecture about it, but you see the difference that it makes in their lives. So from my perspective, we've gotta get back to listening to each other, empathizing with each other, working with each other. We cannot solve our problems here at home or around the world if we continue to be so divisive, so divided, and so mean to each other. And whatever we can do to try to break out of that, that doesn't mean we're gonna all agree. I mean, part of being in a democracy is you have disagreements and you have the right to disagree. But we've gotta start showing that democracy can work again. We need to have debates that actually lead to decisions being made and actions being taken. And we can't afford paralysis and gridlock. We can't constantly be looking for the political advantage. We need to say, hey, what does America need and what does America need to do in the world? So if you look out at all the problems, we have none of them can be solved by us alone. But if we don't lead, I can guarantee you they won't be solved. If we're not in the forefront of trying to figure out what we do about climate change, what we do about conflict, what we do about the spread of disease which is only gonna get worse because of the climate change, disease is moving north and we are not prepared for that. How do we try to help manage the rise of China? They have every right to rise but not at the expense of their neighbors, not at the expense of concentration camps filled with Uighurs, not at the expense of suppressing the rights, freedom, and dignity of their own people. How do we work with that? How do we deal with a newly aggressive Russia? How do we deal with Iran that feels like the constraints that were put on it by the Iran agreement are gone. So they basically can pursue that nuclear weapon that we put a lid on under the Iranian agreement in the Obama administration. So yeah, we have a lot of big, big issues. And we need leaders who are going to put country before party, country before personal interest. I'm not saying it's easy. I plead guilty to the times. I didn't, it's very easy to kind of get into the frame of mind like you're right and everybody's wrong. But we've got to save ourselves from that. And it's the next generation of leaders who are going to have to model the best way to do that. That's great.