Okay, I think this works better. Good afternoon. Very welcome. My name is Eddie Morse. I'm since 1st of July Rector at the Institute's IT Delft. And I would really like to welcome the Excellencies here. I would like to welcome the family. I think we have a very nice representation here of the different students. It's also of the colleagues from IT as well as the invited guest. But besides that I would also very much like to welcome all the students and other purists around the world who are also performing this event live through the internet. So welcome to you all. And for me this is the first time that I have the honor to open the academic year of IT Delft. So for me it's also a very special occasion. And I'm happy to see so many known faces but even more happy to see so many unknown faces. And with that I would for most really like to welcome all the new students that are coming to IT Delft this year. So very welcome. And I hope that you are going to start with this day a very exciting year and a half to come. And I think also looking at the faces I've also seen the list of where you're coming from. I think we have a very very nice diversity and with diversity I mean from different countries where you're coming from. So you're bringing here us I think a treasure of different nationalities which different cultures with different behavior with different ideas. And I think with that you're going to enrich our institute further with this diversity and also with your ideas about how to look at things but also about solutions. We at IT Delft are very much looking forward to help you to discover what this diversity means and to see also how you can use that in your education and training but also in how you can use that to support from the mind. So I think that's an important site but on the other hand what we also try to do at IT Delft is we try to use this education and training that we're providing to further develop the world. Now important on the political agenda at the moment are the sustainable development goals. And I think with those sustainable development goals we are meaning that we would like to see how we can really implement the measures and the strategies that are needed to bring them a step further but also how can you monitor and follow if the goals are being achieved. And with that I think it's also good to start introducing one of the main lectures because you will have two today and the first lecture will be given by Rob van Tulder and Rob van Tulder is a professor of international business at Rotterdam School of Management from Erasmus University in Rotterdam and he's co-founder of the Department of Business Society Management which is a world leading department on the issues surrounding sustainability and sustainability I think is the connecting word both between what we do at IT Delft but also what Rob is going to talk about. But maybe to inform a little bit more on the background Rob is also at the moment an academic director of the Partnership Resource Center where they bring together leading NGOs, firms and governments in the study and management of cross sector partnerships for the social goods and again one of those social goods is working. He's also founder of SCOPE which is an expert center for Erasmus University in international business and sustainability developments and one of the things that they do at this institute is together with UNTAP that they list actually all the international and transnational corporations worldwide which is always posted and published in the world in investment reports and maybe that's another topic that later on during the receptions I think it's good to have a discussion with Rob van Tulder because what we also see is one of the challenges is how can we get the investments in such an order that we are also able to implement the measures and strategies that are important to achieve those sustainable development goals. Rob is also a teaching executive courses for measures and academics on international strategy management and of course he published a lot of papers and books but I just want to mention one because I thought that this is a very interesting one because at IT Delft we are also very much engaged with that and the title of that one is Solving Wicked Problems Through Partnerships and first of all I think water is one of the the wicked problems but what I like is this addition of partnerships and that means that actually you can't solve wicked problems by single use so you need these partnerships so I'm very much looking forward on what Rob has to say about that and the lecture of Rob for today that he will present is called May You Live in Interesting Times which I think is I'm not sure if it's a wish but if it's not then let me translate this into a wish and I wish that all the students of today will live say an 18 month period that will be so interesting that they will remember that throughout their lives and I hope that that's also the stepping stone towards a new future. So welcome again and I would like to invite Rob von Tilder for his keynote speech. Thank you very much for the introduction. The Erector, Academic Staff, the Mayor, Your Excellencies, External Guests, Friends of the Institute and of course in particular all those students who are called the inspiring students present today. Yes May You Live in Interesting Times. This is an English expression and it seems a blessing but actually is also known as the Chinese curse. It is actually always used ironically but the clear implication that uninteresting times of peace and tranquility are more life enhancing than interesting ones. Interesting times usually include disorder and conflict. At the beginning of the millennium the US military introduced an interesting acronym to further define the nature of these interesting times. They observe we are increasingly living in a so-called FUKA world. A world in which volatility, uncertainty, complexity and ambiguity is the new norm. A world of competing powers, unclear societal models, increasingly intertwined and facing sizable societal challenges. Note that the FUKA concept was introduced by the Americans one and a half decade before the Trump administration. A FUKA world requires different mindsets from everyone involved. Why does this imply, what does it imply for water? We can take two positions, one in which we stress the negative change and one in which we focus on positive change. So a negative frame. Well nearly a billion people worldwide lack clean drinking water. Unsafe water is the leading cause of sickness and death. Half of the world's population of the world's hospital beds are filled with people suffering from water related illnesses. Farmers fight for water in order to water their crops. In 2015 2.4 billion people did not have access to adequate sanitation facilities. We have an abundance of water in the form of tsunamis while at the same time a lack of water as the result of droughts and mismanagement. Water becomes bottled as a private good which makes it a potential public good and a universal need into a commodity problem which people can be excluded also. Critics talk about manufacturer demand and confront individual consumers in particularly western countries with the irrationality of some of their choices. For instance with the fact that tap water is up to 500 times cheaper than bottled water. Water becomes a political or a contested good. Water wars are fought between local communities and companies. Conflicts are over water usage developed between upstream and downstream countries. But there are also positive friends. In 2015 for instance 2.4 billion people globally used an improved sanitation facility which was a major advance in comparison to the past. Water is what we also call a married good. These are goods or services whose consumption confer benefits on society that are greater than those for individuals. Water has many so-called positive externalities. It makes people better and more productive. For every one dollar invested in water and sanitation the United Nations Development Program estimated the return of up to eight dollars. Getting clean water to rural villages is the most effective strategy to help the poor. Water is an investment opportunity. As a club good, the club good is the swimming pool. I heard the IHA wanted to make a swimming pool but not yet so but invest in it because it's fun and then water becomes really a positive externality. As a club good, as a married good, as a source of hygiene and sanitation but also as a sort of innovation and a public good. As a source of life of course, water has many identities but that makes it also typically a full god phenomenon. Everly contested issues are also known as wicked problems. The vector also referred to that. And a wicked problem in water also can be referred to as a tragedy of the commons problem. We know that we have to take either individual or collective action because we see the problem but we do not act upon it. This is also known as the bystander effect. Psychologically speaking, the bystander effect is also known as the choice paradox. When confronted with complex issues, we tend to get paralyzed rather than take action. The rabbit on the road. Maybe you can see that. When realizing that he's crossing a road with heavy traffic, rather than running away, the rabbit freezes and probably gets killed. So negative frames and doomed scenarios only add to the paralysis. But in this complexity actually lies also the solution. Let me chew on the skin side a little bit more. There are simple, complex and wicked problems. Wicked problems do not only resist solving, they even resist defining. Technical and organizational approaches are always part of the approach but the real approach lies in the societal road. Water is a wicked problem because it is public, it is private, it is a social good and it is not at the same time very often. So no one size fits all solutions and many of the solutions lie beyond the realm of public, private or social provision of water. So what to do? Don't deny complexity that is one of the topics. Find positive approaches and get directly involved stakeholders that is the system into the room. Wicked problems cannot be solved. This is one of the most frustrating conclusions I had as a scientist because I wanted to make a sort of quantitative analysis and then solve it and then everybody just had to quote me and then it's okay. But they cannot be solved but they can be approached. Wicked problems require an open and inquisitive mindset, a positive and action oriented frame, no ideologies, no fixed road maps or technical solutions only. So you might ask if you still follow my story is that possible? Yes, I believe so. We are living indeed in interesting times. And to the sustainable development goals. They were issued in September 2015 with a positive frame to address the systemic problems of the world. And they were based on three years of multi-stakeholder involvement in which companies, civil society representatives, government, knowledge institute set up an agenda of action. The STGs signal a paradigm breach with the past, for instance, compared to the millennium development goals in which only governments were held responsible for the world's most complex problems. And also I would add they are based on a much better understanding that positive frames, mind you, not nightly frames, but clear goals are more energizing than negative frames and doom scenarios. So the STGs are actually based on the latest psychological insights for which Richard Thorne, you can see his picture here, just this week or last week received a Nobel Peace Prize for economics, behavioral economics. We might not have a fixed solution but we can distinguish between better or worse approaches. Well, 17 goals with 169 sub targets. I would say complexity in the room. Water thereby as a wicked problem can also be considered a wicked opportunity. It is related to sanitation and with clear ambitions. As you can see, 6.1 universal and equitable access to safe and affordable drinking water for all. Nobody left behind. But also, for instance, the reference under 6.5 to management issues like water resources management. And this is the best place, of course, to study those issues. But they're also related to other issues, either as input, as consequence or as condition. Again, in the complexity lies the solution. Water is the next issue. It can bring together people, companies and governments in addressing related issues as well. Water, therefore, is highly context dependent, knows one size fits all. This is also acknowledged by this institute that you are studying now or have studied. I read in one of the brochures of the institute that water cannot be seen in isolation and it is often a pre-condition for other goals. Therefore, together with the partners of IEJ, also they contribute and they quoted also to other STGs. And you quote a number here in the first year like Zero Hunger, STG2, Gender Equality, STG5, Affordable and Clean Energy, number 7, Sustainable Citizens and Communities, 11 and a number of others. So I study the brochure very well and I have an advice. I would advise you to also look beyond those and connect with other STGs, in particular poverty and income inequality, because I think actors to clean and save water is strongly related to unequal income and the distribution of income. And of course, it is linked to one other topic. Maybe you've seen, if you study this, it's very easy. It should be linked to quality education. But this might seem obvious, but I think it's worth mentioning, nevertheless. Finally, the United Nations also formulated five basic principles that feed into all the STGs. This is something that has been not generally acknowledged. And there are four, for instance, for peace, people, planet, prosperity and peace. And this already provides a much better basis for understanding, but also for checking progress in all these goals. Now, maybe you considered, I could quote, professional bias, but I'm happy to see also that the central position of these is fifth in our partner. It is condition, but it's perhaps also a goal in itself. So if you have a look at this, I suppose you understand this, complexity, we are full circle back to the adequate approach to the problems in the FUKA world. You together, and I would say then, water is not a public or a private or a social good. Our proposal for today is water is a partnering good. Combine public and private and get all the stakeholders in the room. Otherwise, the goals will never be reached. This especially applies to water. In order to manage the many potential conflicts around the issue, the UN, for instance, concludes that the issue of water and sanitation cannot be solved by any of the societal actors alone. They state, and I quote, effective water and sanitation management also depends on the participation of all the stakeholders, global as well as local. So my final advice, see water as a partnering good more than anything else. Go beyond public, private or social. And luckily, as you can see in the slide, this is acknowledged throughout the world. With water operated partnerships, of course, this institutes the PPP facilities in the Netherlands, a variety of partnerships, hundreds of them we can count. So finally, of course, what does it mean? Water as a partner, as a partnering good. It requires collaboration between states, governments, local, international, national markets, first multinationals, but also local companies and value chains and communities, all of NGOs.  Or put it differently, if you want to go fast, go alone.  Working together is not a luxury, as many people would say, but it's a necessity. There's no alternative. We also call it the Tina principle, initiated by Shell, by the way, at a certain moment, they were heavily attacked on their environmental policies. There is no alternative. But that requires, say, well, we should work together, so we should trust each other. So one of the big issues next to a whole list of issues that we can address is the trust issue. And I can tell you this, if you have different interests, why would you trust your partners? Why would you trust yourself that you are consistent in your own policies? So the issue is not, it's about trust, but actually we have to return it. We have to say you don't partner because you trust each other, but you trust each other because you're a partner. I hope this is deep enough there. This requires, of course, learning about complex problems, a safe space to discuss and research. I think this would be the safe space. So, concluding, we are living in interesting time periods, so I wish you lots of insightful collaboration. Good luck. Thank you very much, Rob, for this very interesting speech of you and also for introducing us into the fukar world. The good news, of course, is that this institute definitely will not educate its students to become bystanders, and definitely will not let them reside in the treasured commons, but will offer you a path of partnerships. So thank you for that, for sharing with us your insights on this day. Then, it's my pleasure also to have another energizing part of this program, because I would like to invite to the stage the African Partnership Drum Band, and that means I would like to have a talk with Michael, John, and Salom. Are they coming? Okay, yeah, give them a round of applause. From Ghana, Charles from Jamaica, Jeffrey from Kenya, and accompanied by Isaac from Ghana again, and Zad Dele from Swaziland. Give them a big applause so that we can hear them. I consider that we're opening our classes with an exercise like this that we just showed. A very energizing moment, I think, for better results and greater impact. Then it is also my honor now to invite to the stage the President of the Student Association Awards, Mr. Juma Mdeke. Are you around? I'm expecting you. Oh, Mdeke, from the United Republic of Tanzania. I'm serving as the Student Association Board. I'm here having a small speech, welcome speech, for the new MSP students. Here you go. Your Excellencies, Rector, Professors, Distinguished Guests, IHEDA staff, fellow MSP students, participants, ladies and gentlemen. I am extremely honored and privileged for getting this opportunity to welcome you all who are here in that first in the auditorium this afternoon, and especially the new MSP students for the 2017-2019 acclaim here to our Christian's very important Institute, IHEDA. You are welcome. On behalf of staff, I'd like to welcome all of you to IHEDA Place where water professionals meet. This gives us an opportunity with social life to interact with one another from different continents in the countries with great cultural diversity. We have new students from about 40 different countries, and the number is more than 100 students, so you can see the diverse culture we have. IHEDA is a purely multicultural environment. There is a Swahili proverb to say that, by definition, water is life. So water connects us all here. I here congratulate you new students for successfully getting a seat in the reputed and Christian's water institute in the world. This is truly the first step towards following your dreams and achieving your goals as water professionals. And since for the next 18 months, you are going to be part of the Institute. I heartily wish that you invite the best knowledge and experience from here. Since I have known IHEDA, it gives me immense pleasure to inform you that the lecturers have been impacting quality education since inception. The development of a quality education system laden lies on the committed members of the Institute, quality infrastructure, supportive administrative staff, large pool of learning resources, and last but not least, hardworking and brilliant students. You will be glad to hear that IHED primary focuses on making students good and successful water professionals through strategic teaching of both theoretical and practical aspects during the course of education. I am highly encouraged to share that many of the graduate students who have graduated from IHED are now occupying higher position in several remote organizations all over the world. A good example will be seen soon, Dr. Satieh Murwanto from Indonesia who will address us in this audience soon this afternoon. They have succeeded in many respects and I am very certain that all of us, current students, as well as you who are new students, will also reach the same peak of the success and even higher. Apart from educational betterment, there are opportunities to participate in extracurricular activities here in IHEDA.  Remember that as we said, we have more than 40 countries this year. Within years, we are more than 61 countries. Assume one country is one culture. How many countries we have? The assumptions might not be good, but assume one country is one culture. So we have more than 40 cultures plus that 61 so we can see how diverse IHED is. Starting from November, next two weeks to come, IHED usually reserve courts for volleyball, basketball, and football. So for the sports ladies and sportsmen, you are highly welcome to participate on sports, as we believe that most of the sports become, it's because it's physical activities and also keeps you fit and make you a mentor balance. I'm certain that you will find these 18 months at IHEDA, the most inspiring times of your life. I hereby wish you all a very happy and academically fulfilling journey ahead and outstanding stay in IHEDA and the Netherlands in general. Again, I wish you all success, successful rewarding time here at IHEDA. Karibuni Sana, in English, you are warm and welcome. Thank you very much. Thank you Juma for your warm welcome words and also your the lining of the diversity agenda. I would like to invite now Maria Laura to the stage with our alumni officer because she will start the introduction towards the Alumni Awards ceremony. Thank you very much. Distinguished guests, alumni, participants, new students, and colleagues. I would like to congratulate all new students on the commencement of their studies at IHEDA. But today we celebrate also the Alumni Day because many professionals, our alumni, also started their studies at IHEDA one day in October, like you. IHEDA has more than 15,000 alumni worldwide and they've formed the biggest water professional network in the world. They are our best ambassadors and we are very proud of them. In this ceremony, we have the pleasure of awarding one of our exceptional alumnus with the 5th IHEDALF Alumni Awards. The award is given annually to an alumna or an alumnus who has had an illustrious career and has been a role model for other water professionals. 28 alumni nominations were received this year and they should remember we're very impressed with the overall quality of their work and proposals. Three made up a very strong show list and they are from Sri Lanka, Danish Bunatileke, who started in 2005. From Mozambique, Professor Dr. Álvaro Carmovas, who started in 1981. And from 1997, Ms. Wurri Ramana from Sri Lanka. Congratulations to all of them and I would like a little applause. But now the moment has arrived and I would like to invite to the podium our rector, Professor Eddie Morse, to announce the winner of the IHEDALF Alumni Award 2017. Thank you, Maria. And I think the real secret has been spoiled a little bit. But still, I think it's something worthwhile to stand still for. And I have the honor to say something and a couple of words actually about that. But before I do that, I think I would like again actually to welcome all of you. But in this case, the award winner is Dr. Ari Sidianti Morwanto from Indonesia. But before I hand you the award, I want to say a few words if you don't mind. And then later on, we would like to hear also something from your side. But I think we prepared this award winning and I think what was very nice is that Dr. Morwanti didn't come alone. But I would like to also welcome his wife. I would like to welcome his family members. And I would also like to welcome very much the delegation from Indonesia that he brought with him. And so I think it's nice that such a big community can celebrate a prize like this. So very welcome. And then Dr. Ari Morwanto is at the moment director general of highway engineering at the ministry of public works and housing Indonesia. And he's the former director of water resources management. He completed first hydraulic engineering here. And at that time it was still an 11-month course. We had a discussion yesterday. I think there is still a wish to actually have this 11-month course returned here. We'll talk about that later. But that was not enough. So Dr. Morwanti followed that up by doing his MSc degree here. And that MSc degree was actually in what we call at the moment hardware informatics. I think Professor Dimitri sitting over here who is now leading this topic. But I think that was say the ground for him to have a very ambitious career and just to say a few words about that. And he has been working as a civil servant at the ministry of public works and housing since 1986 and has held several positions at the ministry. He has a consistent proofing track record of professionalist responsibilities integrity and commitment to the institution where he's working. His commitment to improve the living conditions in his country his academic performance and professional leadership in Indonesia are very highly respected. Dr. Morwanti has accomplished important projects in Indonesia. And I just name a few of them. It's not a full list. One is he included an integrated research program which covered technical and social aspects related to development of urban areas in Indonesia. Some examples are in Bangor area, Simarunga and other cities. He collaborated on the writing of guidelines on urban polvo development in Indonesia, one of his specialties. The impact of land subsidence in sea level rise mean that Poles are one of the options to be considered to solve the flooding problem in coastal cities. These guidelines are used by practitioners in Indonesia and also today. And I will come back to that later on as well. His latest contribution is the design of traffic management system along the highway on Northern Indelpa where as a result there were zero accidents during the last Eid holiday in comparison with so many victims in previous years. And I must say that one of the worries for me was to learn that he was moving to another ministry and especially the Ministry of Transportation. But then yesterday we had a sort of pre-talk a little bit and what I also learned is that I think one of the very nice things that the term is implementing at the moment is actually the first multi-purpose dike in Indonesia. And that dike is I think it will come along one word to visit of all of you to come to Indonesia to look at it. But also the interesting part is there that what he's doing is from his position as the Ministry of Traffic he is working at a solution for the traffic but he's also looking at sea level rise and how this dike can be used to protect the area for sea level rise. So he's trying to solve two problems and as if that's not enough and the other part that comes into there is that behind this dike there will also be a poll the area which then can be used both to prevent floods for the city but also enlarges actually the capacity to have food production in there. So I think it's a very nice example where not only the present position that he's in but also his knowledge from the other positions especially at the Ministry of Water Resources is being brought together to come up to those solutions. Though I think you need to discussion with Rob later on if it's really a wicked problem but I do think this one approaches it very much and I do think we're also working for solutions so then it falls off the list of being a wicked problem but then it becomes a complex problem which is I think an interesting one to be solved as well so congratulations. Then if that was not enough I think what's also interesting is that under his leadership many staff members from the Ministry of Public Works and Housing were encouraged to study at IHE Delft and we really appreciate that. So as a result IHE Delft has many successful alumni who are professionals and professional leaders at the Ministry of Public Works and Housing. Indonesia is in fact the country with the highest number of IHE Delft alumni in the world and many of them are working at the Ministry of Public Works which I think is also nice to see that people that are trained here and I think there's also an invitation to the present students sitting here is going back to the professional reason where you're coming from and contributing actually to doing that and I fully wish that all of you will follow the footsteps of our present alumni winner and also your predecessors there. So clearly Dr. Moranti is an excellent ambassador of IHE Delft often leading the collaboration between IHE Delft and Ministry of Public Works and Housing in the field of research and capacity development on water and I hope that can be continued. So congratulations from IHE Delft on your remarkable achievements during your career and thank you for being such a low ambassador of the institutes and I do hope that we can continue and I do hope that you are going to make some future steps into this. So with that I would like to offer you a small gift. So this is the price. But he is convinced that balance in difficult solutions is sometimes there. I think it's a safer hand. But what I would also would like to say is that having somebody doing a career like this is something that you come to alone and for that I would really like to thank also your wife for allowing her to have you here but also to have you be aiming you to all all these steps. So I would like to hand over the flowers. So with that I would like to give the floor actually to Dr. Moranti for his his speech. Excellencies, Rector of IHE. I'm a Seder of the Republic of Indonesia all professional all new student of I think master's student of IHE distinguished guest ladies and gentlemen. It is a great honor for me as well as a big surprise for me to have this award. I never imagined before if I may back 29 years ago as professor Moranti. I joined a short course program with the help and with the support of the NUFIC scholarship. I choose the branch deep as far as I know. Just remember it is concerning about the computational experimental and computational on hydraulics. Once I finished I got an additional scholarship from Lamingha Foundation. With that scholarship I finished my master degree. I stay here only 17 months but it is a great time for me in shaping my career after that. It gives me confident knowledge and experiences and these experiences always inspired me until now. For example, I do agree with the lecture. We have a problem with the flood. We have a problem with the traffic jam too much and too dirty water but I'm confident to face it because I gain experiences here at IHE. If I may share my experiences to all my colleges, new ISE students. MSc degree is important but you may gain more than that. As the president mentioned here we can learn about culture because here we together have students for all over the world. Within 17 months I learned how to discuss and how to negotiate with several or various students with the difference culture and it makes me never afraid when we discuss with them until now. And we know and I could discuss and find an agreement as professor mentioned about that but partnership it is a great time a great time for me. For all of my achievement I have to say thank you very much for the ISE to all the professor and to all of my colleges here. I bring my family and my colleges from Indonesia if you don't mind please stand up because one also they learned yesterday they went to Del Paris a ferry from an institution that I work for six months there while I'm doing my MSc. It is a great institute and I want them also to learn and I also asked them to go to Rotterdam harbor because we will develop many new port in Indonesia because we have more than 17 000 islands big and small in Indonesia. Once again thank you very much I will never forget this moment thank you very much. So I think that here Dr. Muvanto I would like to really thank you for very nice and I think also very personal speech so thank you for your kind kind words here and what I would like to do is I would like to use this opportunity to officially declare an academic year as open so I hope that all the MSc students have a really good start and actually to celebrate that a little bit there are a couple of things that I would like to ask and one is that here in the room we have the number of investors from the different countries from the students or representatives of the MSc so what we would like to ask the students from the different countries so if you go out to the room here there are a number of tables with a small flags of your country there so if you find a table with a flag there please go there it's not only for the students it's also for the seniors plus the fellows plus the staff and please have a meeting with the ambassador or the representatives of the ambassadors. Also I know that there are a number of ambassadors and representatives of the MSc's who not yet have students here or who have had students here but there are students less at the moment I would like to invite them to one table where's the UN flag because I would like to have a short talk with them how we can change the situation so you're very welcome and then all the other people are here also of course not left alone but I would like to invite them to go downstairs and go to the restaurant area where there are all they've been waited for to join us in a reception over there I can promise you that I'll also bring all the ambassadors and the other people also downstairs so we'll join you shortly so please leave something to drink for us as well so with that I would like to thank you all and I hope to see you downstairs another day thank you okay it was a good deal so we'll enjoy it


All right so there have been amazing advances in the past few years and what machines can do as you read about in the news headlines like this machines can recognize people in images it can transcribe speech and translate languages they can drive a car diagnose diseases this just came out last week they can even tell you you're depressed before you know it based on what you type and scroll how you type and scroll but why now like the AI has been around for a while machine learning why suddenly all these big advances and I want to argue that it's it's not about the algorithms it's actually all about the data and if you think about it the top 20 contributors to open source projects on github among those are google facebook amazon microsoft IBM uber alibaba most of the biggest players in the AI space are open sourcing their AI pipelines but what are they not open sourcing they're not open sourcing their data because it's their number one asset the data so while in 2017 a lot of the headlines looked like this there's a really big year for AI now we start to see a lot more headlines that look like this right so so biased AI is leading to racial discrimination and policing and criminal convictions gender discrimination and job ads headlines about racial discrimination and image recognition and film recommendations and these are all data problems they're not algorithm problems kathy o'neill has made a very good argument that we need more transparency in unpacking the algorithms especially deep neural nets but again I want to argue today that many of the problems we're seeing in the solutions to them are really about data and not algorithms and not just data like training data for models but the entire data ecosystem so why do I care about this a healthy AI depends on a healthy ecosystem and I'm an ecologist that's my background so I like to think about ecosystems I've been studying complexity in nature for about 25 years I used to run an institute in Yosemite national park that where we did work on alpine ecosystems and it was very data heavy we compiled 30 years of satellite imagery data blended that with a lot of hard-earned data on the ground to validate models and and to build and train and test models to help predict where endangered species are living in the park and how to best prioritize decisions for how to save them now these are things where at the time we're very aware of concerned about potential unintended consequences because if something's going to disappear off the face of the earth we don't want that to happen now I work at racketen intelligence part of racketen and I work more in economic ecosystems where I work on e-commerce data and stuff and I'm becoming much more aware also of the potential unintended consequences of how our personal data is used by algorithms so if we want to understand this let's use an example for an unhealthy data ecosystem to understand what goes wrong this is the Russia Today news channel on YouTube I don't know if you guys have seen it it turns out it's the most watched news channel on YouTube in the United States so how is it that a Russian news channel is the most watched news channel on YouTube in the United States similarly if I type in Syria news into my browser and YouTube three of the four top results are Russia Today or Russian news channels one of them actually in Russian even though Google knows that I'm searching from a computer in San Francisco California in English how does that happen what's happening well the algorithms are doing just fine they're doing exactly what they're supposed to do the problem is a data not the algorithms and so I want to unpack this problem about the about the data behind it so let's just think about a traditional simple machine learning pipeline where first we need training data to fit a model and predict something that's how it starts and then we need additional validation data to maybe tune the model or pick amongst many models which is the best one with the goal of minimizing the error and maximizing prediction success and then we have independent test data to independently test the model and evaluate its accuracy and then once we've done that and have our tested model we put it out in the wild and it goes wild so what happened with RT news well if you go back into the history of their their YouTube channel they actively seeded the training testing and validation testing data with clickbait viral videos if you zoom into those they're really this is a news channel so these are videos like horror footage shocking video of a plane crash kid dies from falling from Ferris wheel whale hits and smashes yacht surfer fights off shark attack live on tv so these are just like salacious clickbait videos to drive high engagement in the site because they know that the models are trying to predict engagement and they're optimizing for that so then the algorithms flag the RT news channel as a high engagement channel and then lo and behold their new they put their news in the search results and all the recommendations which then leads to higher engagement than any other news channel on youtube this is a classic case of biased data leading to biased outcomes so a classic data problem where RT news actively created a biased training data set to game the models and it's a virtuous cycle for RT news because the reason the outcome results are then used for more training and testing and and off we go in the virtuous cycle just because it's not big data doesn't mean it's not biased it's a it's a big problem and again the algorithms are doing a great job they are doing a great job of engagement it's just not the right thing so there's a second problem a data problem in this ecosystem that i'd like to look at too let's look at not the input data but the outcome so they're trying to predict engagement and that that's sort of what the models focus on trying to minimize the error on and when the models deployed if people are recommending viral videos of course they click them and they watch through the whole thing they comment on them etc so it looks like it's doing great the ad revenue is rolling in so nobody pays attention because it seems like it must be working but the goal was actually to in theory recommend good quality content relevant content that's good quality and engagement is just a proxy for that that we can measure easily and optimize for so since there's a mismatch between our proxy for success and our actual goals then we end up recommending propaganda instead of high quality content um and and again there's nothing wrong with the algorithms they're just they're working great for engagement and ad revenue but not for predicting high quality good content this is this problem on the other side is a mismatch between our outcome metric and the goal so meanwhile the the algorithms doing a great job at actually really predicting the wrong thing and the key problem here is a data problem that we're often missing outcome data data on real outcomes that's independent from the engagement from that one metric like engagement metric so um so for example we rarely have good data on like who got recommended what just big picture data and did it is it what we intended we don't often get to see that big picture and without alternative outcome data we'll never know if we actually optimized for the right thing until it's too late again this is not an algorithm problem it's a data problem and it really boils down to two very simple data challenges one is bias data in is biased outcome out and the other is wrong success metric wrong outcome they're pretty trivial in retrospect but we miss them a lot um so the question is how do we better detect and correct bias how do we get real outcome data so that we can check our results and gut check things and how do we optimize for the right thing or prevent accurately predicting the wrong thing so there's two core additions to this data ecosystem that I want to that I think can help a lot and that are emerging right now and it's really great to know about one are data marketplaces and the other is data interfaces and I'm going to go through each of these so let's start with data marketplaces there's a lot of really interesting movement happening in this space to improve the health of our data ecosystem just a couple weeks ago tim berners lee the the creator of the worldwide web launched this project which is a decentralized personal data marketplace where you can have your own pods personal online data stores and where you can own and control all your personal data in a personal data marketplace this really interesting project the linux foundation here last year just launched the community data licensing agreement to facilitate sharing of open data not just open code because remember it's not the algorithms it's the data that's really important here oasis labs in berkeley uc berkeley just raised 45 million including from anderson harwitz to make it easier for us to actually share that data without losing control of it to prevent another cambridge analytica type of scandal from happening again ocean protocol just raised also about 45 million to kickstart a decentralized data marketplace that's focused specifically on data for ai and machine learning and and here's an example nebula genomics just recently was funded to take on 23 and me to build a decentralized personal genomics data marketplace which lets you own your genomic data control who gets to use it and for what and even get directly rewarded for sharing it all right so last summer martin gillies said that made a case that we need to reign in the data barons to restrain their market power but i think that it's possible with all these emerging open data marketplaces will just make them irrelevant that's sort of the goal so decentralized data marketplaces are coming and it's really great news they're trying to solve some really important challenges around ownership you know and how do you how do you set licensing how do you control who uses your data and for what purpose how do you have secure systems for sharing data but without losing control of it transparency to see who's using your data for what and how to have aligned incentives between the data provider and the data user it's all really exciting but even if we have better and more diverse data we also need better tools for thinking about how to gut check what we're doing and this is the human side of the data ecosystem and it's one that i'm really interested in um let me give you some examples in response to all the recent press about ai bias there's been some interesting activity facebook google ibm microsoft all in the last few months announced that they're launching tools to detect bias in algorithms and what's really interesting to me about some of these that have seen like here's the the one the google what if tool it's called code free probing of machine learning models there's two things worth noting about it one is it's not a data visualization tool even though it's visual it's a visual interface for probing and discovering it's an interface it's not just a data viz it's also the second thing is it's code free which means it facilitates just spontaneous one-off exploration rather than intentional scripted um visualization these are really important for discovery interfaces uh my company that i that i co-founded vibrant data created this one and we were we were recently acquired by racquetan and i'm really excited to announce that we just open sourced it openmapper.org and it's it focuses on exploration of complex networks and i want to give you a quick example of how some researchers at national geographic um used it recently for um some of their machine learning processes. So this is an image of one of my study sites in the Sierra Nevada which is a pretty nice place to be and i'm really thankful that i get to go to places like this and it turns out that some of the researchers at national geographic are learning that even just imagery of nature can have calming effects just like not not maybe quite as good as being there but they do have real effects on the brain and they're wondering whether they could try to understand if it'd be useful for places like this where environments where people have no access to nature and no hope for it you know maybe could images help and if so which ones are best so they launched a research project to try to find out they're analyzing thousands of data of images from the national geographic instagram feed and they they gather in this preliminary around they gathered a few months of data and measured attributes of every image and tagged them according to whether there's um like a person in the image or not whether it's urban or nature whether there's a mountain in the picture it's a distant view is it from above or below is it a close up far away etc and then they're trying to use that to build models and predict which which types of images have the best responses. So to explore that preliminary data set they just uploaded in a map where it's a cloud-based tool right now and they just upload it as a CSV and then once you upload it OpenMapper can generate a similarity network to find structure in the data immediately. So here you know it automatically detects high dimensional patterns in the data every node here is an image and then they're linked to one another if they're similar if they share similar image attributes and then similar images automatically cluster together into groups that are auto interpreted auto labeled based on the features that are the most common in the group. So this is a group of images that are distant they tend to be distant unobstructed views of snow cap mountains and then if you look on the upper left there it turns out that's the biggest group of images so right away we can see in this high dimensional space that there's a there's already a bias towards these kinds of nature images in the data set not that it's bad but just so that we know that it's there. So here's another cluster of images the next biggest one is focused on oceans and pictures of water and animals in oceans kind of and they all have I think like low consistent low hue in them. Here's another set of cluster of images that are close ups of animal faces that have high edge density and high fractal dimension so so the cool thing is that just by having even the images render in the nodes you have instant like gut checking on what are these images what do they look like you can zoom out and then zoom in to individual individual data points really quickly. So we can also zoom out and we sort those things and scatter plot let's say just see which images are high engagement here they're sorted vertically by the emergent themes and then horizontally by engagement and off to the left we have distributions of all the attributes so we can see here just as an example on this urban natural gradient the we can see there's a really heavy bias in this data set towards nature images which is not surprising but at least it sparked an idea to say oh there's all these other ones with humans and urban scenes in them what does look like and are there high engagement ones in there as well so you could just quickly take the filters and have a look see who they are urban images that have relatively high engagement and then subset those and dive in and look at them and see what they look like so there of course we have some really nice unobstructed distant views that are sunsets a lot of sunset images that people liked with with cities in the foreground but also some really interesting cultural landscapes as well and then of course we have people seem to like panda on the on the lab bench and then this last one struck my attention because you got a tiger in a cage it's kind of scary and I thought you know it's a high engagement image but probably not great to put that in a prison right if the algorithm automatically recommended it and and of course it's obvious now but if that was just the image ID some random ID number I just wouldn't have thought to you know wouldn't have known that so now we step back and it just encourages to go back and look at the data now and just go find other metrics of responses so they also measure instead of engagement they measured valence which is a sense of the mood like what's do you have a positive or negative emotional response to the image and also arousal which is the intensity of your emotional response and so now with this we could look and say well let's look at all those negative emotional response images and ones that that also had a high intensity of a response dive into those see where they land there's high engagement ones there as well and look at that and see where they are and well that was suddenly we found all the predators and all the the shark attacks even a bloody killer baby polar bear and and these are there's plenty of these in the data set and so we could go back and look look at the other examples of high mood and high arousal and see what they look like these might be a little bit better to put in a prison and sure enough these are what we are the warm and fuzzy creatures that you kind of expect right and what was interesting here too is that there's also some interesting human scenes that were part of that group as well so let us to think that maybe we should try to include more human and urban things in the data set that might also elicit positive emotional responses so that's just a you know a rough view of the data the this view for them really helped them just exploring the data it helped them find errors it helped them identify biases in the data unintentional towards certain types of nature imagery help explore the unexpected value of maybe some urban and human scenes they hadn't thought about before to help them think creatively about alternative outcome metrics that might better match their goals and and also help them spot and fix errors in the data they couldn't have done that just by staring at the data like this I don't think it's possible okay so data and data interfaces are not data visualizations they're not data dashboards they are tools to facilitate critical thinking that allow you to easily go back and forth between a big picture view and and dive into you know point level details they're because they're code free they allow us to follow our curiosity with one-off spontaneous questions so while a lot of artificial intelligence is focused on training machines to be smarter to spit out predictions data interfaces use machines to help make us smarter so we can increase our understanding of the data okay so I'm just going to wrap up here and summarize how this all fits together into our data ecosystem so in our current system real outcomes are generally a black box it's rarely is our data to see the big picture of who got served what ad or who got recommended what video or what product because of that it means that it's really hard to track if we're actually achieving our goal or if we actually are optimizing on the right thing meanwhile a lot of the training tuning and test data are biased they're hidden behind closed doors and this situation makes it really right to have a model that is very accurate but without knowing whether it's actually achieving the goal that we wanted the emergence of these distributed data marketplaces are critical for providing better data and increasing the accessibility of that data and the transparency of it they're also going to be critical for providing independent data that brings transparency to the outcomes of machine learning models from other companies the data interfaces are critical for helping us gut check whether or not the outcomes match our goals and they can help us be more creative about evaluating this this the success metrics that we use to evaluate the models so they're more likely to match our goals and finally those data interfaces can help detect bias early and help us reward people particularly for providing data that's going to eliminate that bias or fill the gaps this to me is a healthy data ecosystem and that's what it should look like and we need we really need to invest in these and we need healthy data ecosystems if we want future AI headlines to look more like this and not like this thank you very much


Welcome to ToffeeTV, it's the final words Manchester City 3, Everton 1, we're joined by Sarah. This video is sponsored by One Football, One Football's app makes it easy to keep up to date with transfer news. Score start in one place to download the One Football app, click the link in the description below. Do we? Do we? Yeah, so Man City beat us apparently. Apparently. Feels ages ago, it's done, it was early give us on a Saturday, feel one time ago. They're the best, they're the best. It was a weird one though, isn't it, because it's nice to just kind of, we were saying this before, have it over and done with and just be able to crack on with the rest of your weekend there. I think we headed to City on the back of what were two very, very frustrating draws at home to sides that we should be beating. So there was people getting a bit techy and it put a little bit more pressure on the game.  That said, we had opportunities in the game, they I think still dominated the game, but we had a go at them and had we taken our chances we might have had a very different outcome, but much to, well it's been our problem for much of the season has been that we've not been clinical enough when we've had golden opportunities, we've not taken them and so we lost the game. I mean that's about the size of it isn't it? I mean going into it, I think if we'd have you know, tried the Derby game or if we'd have beaten Newcastle and Wofford or even won one of the two games, I think everyone felt a little bit. I don't know, less pressure or more, I don't know, more looking forward. I wasn't particularly like, it's not one of those games City away, never as good as they are, and they're fantastic.  City was a different, you know, mindset I suppose but obviously the outcome was not great. Yeah, it's a difficult one isn't it? I don't know, I just, you wish you had that mindset with every away game down, you're almost like, well we can beat these and if we don't, I suppose if you don't you, I don't know, I suppose if you don't it's not, not it doesn't matter because of course it does but it's like, you never want to usually expect. It's a weird game because it is, because they are so good you are, well you think well if they play well they'll beat you. And on the flip side as I said before you go into the game you're not worrying too much about it because you're thinking well we have done these before so it is a weird one to approach but as you mentioned the two games before I'm not getting six points out of those two games really. Not the stuff on that. Yeah, left us onto a bit of a hard to nothing really because there was always, you know, if what happened, which what happened is what happened, what is expected to happen, happens you are, you think well that's another game. So you're right, you know, you win those two games before and we all go into it and we go, we'll see what happens today, play well and Evan and I go, we'll sign, we're moving in the right direction. It's just that because we haven't won for last four games, we haven't won. It's just, and then you look at like well we've got spares away now and then we've got a couple of tricks. Suddenly the two away games become tricky away games. Suddenly there's the mist starts to descend on a few people and that's what makes it, no but I, you know, I understand that to a point because it's not in the way we're playing or anything, it's just that. Again because being in a decent run before we went into the derby and you just think well all right well see what happens in those away games but the other games we've got to win and obviously we haven't won them so it does change the pressure slightly but we went into the game and obviously no garner which meant well I don't know if it did mean going to three at the back but we did go three at the back and were you comfortable with that Baz? Yeah, well honestly I was because I just, I didn't see anyone. Maybe Tom Dave is going to come in so they may feel me could have played with a flat three but Sniarland's too slow so they wouldn't have been any points important even because they just passed and ran round them. So I can understand why he went to three at the back, we've got three very good, no we've got three good centre backs and I thought and it did it did kind of work, it allowed us to get up the pitch with not so much common but with Luka Dino and the other side we were allowed to play higher up and as I've done on my tactics show last week I highlighted the space in behind the full backs and that was the area which we exploited and when we did exploit it we looked very dangerous so yeah that was okay with the three at the back and now a lot of people don't like it but I was okay with understanding what he's trying to do you know let's see how we go with it and I thought for the most part I thought we don't okay. I think it was individual errors which I said after the game individual errors cost us the game not only the system cost us the game you know pick for that to make a brilliant save from Michael Keane but just that part of the clearance and he had a save from Ria Maras which was close to him it was a good save other than that they didn't have any chances in the first half really just got the goal and which we gifted them with which we give away so I think if you look at the game overall they didn't have a lot of chances in the game so I think the system did work I think it worked. Yeah I mean there was a few changes wasn't there obviously that's the main one going with the three centre backs in the team and it was of course because Garner had had the late injury didn't want to risk him so yeah I think that's kind of the natural go-to as you said maybe Tom Davis could have come in but you still want Guilfe on your side although didn't really do anything to be honest to him and he's been quiet love Guilfe he's been great the season but the last few games he's gone missing so yeah I'm with you a little bit on this one but I think actually it's been individual errors that have cost us in the game you know Jeri Mina the first goal that shouldn't be happening and you know City don't you know pass pass goal and that's how that's what they'll do to you so you can't afford to make silly mistakes you might be able to get away with that one against other sides but you can't do that against Manchester City you know Richarlison should score and Port is in front and I know I say should score people might say that's a bit harsh but I think we should target at least keep it safe really safe yeah but you know and I and there was one we've done really well to get ourselves on there I'm skipping a bit ahead that we've got about two one at one point have to go two behind they then make it three one and almost instantly after that you'd say Richarlison probably should score that chance where who cuts it back to him now Luckman Luckman come on did really well and and wall cut as well as a chance that he blasts over from always hits into the ground and it goes over from about six yards out and I just think yeah don't get me wrong I'm not saying that you know City we went there and we puffed our chest out and we you know we've equaled City but I don't think City were at their best I don't think we were necessarily our best but you know we definitely had opportunities to to make sure we left the Etihad with something I think the way we've I'm encouraged because the way we've played now Faraday perceived top six away and I don't think we've been we haven't been batting any of the games we've we've matched every single team Saturday they had a lot of the ball but he didn't really do much with you know and that's testament I think to what we did and I think the good thing is we went there and we tried to just play our normal game and okay they were better than us well they are better than us there's no point sitting here going we're better than them and we shouldn't have because we're not better than them they're better than us but we still had a a right go go we had it and what's the bit me me making me dad and me mates few minutes trying to play out from the back but what's the point in changing the way we play to smash it long for the because the minute it leaves your foot and goes up near it's a 50-50 so we start booting it long and then next week try to pass it out from the back how are we ever gonna learn you've got to learn how to play yes you have to be quicker yes you have to take a bit more care of course you do but the only way you're gonna learn as a football team is to do what you do every week man City under Guardiola first season finished four at a win a lot of games at the end of the season to scrape forth the amount of goals they give away from Arsenal but with the back because that's how we wanted them to play now they're fantastic are they still give it chances because we got the ball back every time so it is what it is stick your guns you look and like you've got a I thought man city could have put eight pastas on Saturday I really do I think they could have scored anytime they wanted to and I'm not saying that I'm not saying that's that's down to us they're just I just think they could have stepped up anytime they wanted to for me the system would only only would only have worked properly if we had some command in midfield and I don't think we had any command in the centre of the park like you said I think Gomez he tried to get on the ball but he was he was so deep at times because I think with a three I think it's it's fine when you can push up a little bit but the way we were trying to play and I think it showed on their face goal is meaning to get to the ball in that own box and then where does he go because they're so good at pressing yeah where does he go and to not have anyone from midfield to almost protect that three or I just I just thought that was the that was the position we were let down in was not having someone in midfield who could just protect he would have you he would have you'd ask them to you though because you can get really he can't have you seen him do it Tom can get around the pitch Guilfee plays higher up and I don't think Guilfee can do it don't think Guilfee is going to drop off and ask for the ball in that position Gomez was but I just thought city's press was so good that he just don't give you any time and I thought that showed and our players are just so weird and I slightly disagree with you what you say about going long because I think man city what is so good that is going long I think what man city brilliance that is sucking you in and then when the and this this is because they've got the no matter what they say it's because they've got the best goalie in the Premier League it's because their goalie can get the ball and put you know it's someone 60 yards on his on his tie if he wants to be so good at it so I think they can go long and I think that's what makes city so good and some dangerous as they bring you in bring you bring you in and then come along well I think I think we've got a lane to be able to go long now in the same way I no no I think we should be able to lay in that that role I think you've got no you I think city have shown that at times you have to go to smash the ball off in the back right no it's not smashing the ball we've got a goalkeeper we've I am listening we've got a goalkeeper well I am we've got a goalkeeper who I think is is exceptional as feet but is a ratter because he just gets like almost the head of himself at times but we've seen that when he wants to he can hit anybody when he wants to and then that's a skill that we've got a lean out of out to out to use is that it's you don't always have to play out the back and when I'm saying when city do it when they go long it's long in a brilliant way it's like pinging it to people that's what I'm saying they drag people in and everyone everyone goes oh these are going short so we'll press and you're absolutely right about what you're saying about Man City by the way in the first season absolutely spot on they were getting caught because they go keep it was shit yeah and every time they try they give the ball to like John Stones people would press on them and they give him it back to goalie and the goalie would make a mess of it yeah but now they've got this goalkeeper he can he just dragged them in and he just goes oh I'll just knock a little cheeky chip over and that's what I'm saying I think that's that's an evolution he's on pick foot then isn't he well pick foot's got to get better at that because there's a kicking but I'm what I was trying to say but if you're and this won't happen so it doesn't matter if we agree or disagree because the man will want us to play the same way everybody remember city beat Wofford 6-0 at home last year at Wofford and he would go home to Chelsea the week later in the commentator it was like you're gonna have to change the way you play football and he was like well never change the way you play there's no matter we've lost there we'll keep doing it until we get it right which is which is how you coach yeah but I'm talking if you're gonna hit a ball long you've got to have a centre forward you can actually get hold of it and knock the people about and Dom don't know right there's no question some people if you look on social media some people will tell you he was horrendous and he wasn't no he definitely wasn't horrendous but he's still not good enough to play that role on his own and be able to take balls down and knock people about he doesn't do it do you know what I mean but you still I disagree with you saying they can score at any time because I think if a team is that good they would I just don't believe that teams haven't got it in them to go step up a level now because they couldn't have stepped up a level they're trying the best to get that game wrapped up early and they couldn't do it they weren't capable of doing it because they didn't cut us open the goals they scored were a mistake they never once went bum bum bum and wasted it because we let them that because do you let themselves that yeah they never get the chance to do that and again it was our mistake you know as I said Sterling comes on scores ahead of that he's no right to be anywhere near within the first goal the first goal is us playing it short now what mean it should do him your right if he gives that back to pickford because pickford tried one I don't know whether it was nil nil or won it out of his hands with great ball to the charts and he just a little bit over it and he was one of the first half and he's like jumping going because he almost had them in he almost had them in that you're right that's probably what we should have done a bit more was just kept it until Labour right on us rolled it to pickford and let him bang it to the what happened on that one would mean that for the first goal is you're passing it mean his touches a bit heavy with section back into our box and then straight down the middle it's back into play but I suppose you have to give the credit to Rouge close and then he blocks off this pass so you're right you have to make sure you connect with it properly and he doesn't he scoops it and then zoom it gundo and takes it zoom it has to move towards the ball he doesn't he stands often and two passes it's a goal isn't it and you're like the game is the game wasn't even because they had a lot of the ball but you weren't doing anything I think at that point when they score as well psychologically the damage I think it does when you go to a ground like the Etihad and you've had a golden opportunity to get yourself in front and we started the game brightly this was like within the first sort of 15 minutes I think and we should as I say in my opinion I might be saying now it's hard to say you should score I think we should take the lead there with Retarleton I think you should bury it with them on the look 15 minutes played and we've got something to play for I'm not saying look City are unbelievable and I get what you're saying as well pet that they maybe they could have turned it on a bit more they I've had people messaging saying they were there and it felt like City were in second gear but I'm also with you and thinking you know at one point when it's 3-1 as I say before Sterling scored which you shouldn't we had an opportunity straight away after that and we'd be 3-2 again and then they're thinking well maybe they did just I don't know did we coast against Newcastle no no did we just poor night okay did we coast against Wofford because we are so superior to those two teams yeah if we want if you can turn something on like that you'd never lose your football game you can't it's people can go they'd step up well they might if it gone 2-2 maybe they would have stayed I don't know but they weren't capable of stepping up at 1-0 or 2-0 they couldn't step up anymore they have to rely on us to give them their goals if they cut us open and go well I cut us in last year they were 3-0 and you're right they could have put 8 past us that day they literally did go like that this foot off the pedal it doesn't matter now I don't think they did that in saturday I don't think they were capable of doing it saturday are they really done well did he even post your man was absolutely fucking well clashed by the way my field finandino oh my god everything they did just come through everything he won shackles he passed it he got it back he was up and down and we you're right we didn't have anybody who could do even a shadow even a shadow it's the energy you have to master it I don't think we had anyone in the centre of park who could master that energy I think Ghana was you know he's a massive miss he's the pivot point for everything I think that was a huge miss and start an area where we where we really have to be looking for we've got to but the other parts of the pitch and we you know we haven't even spoke about this really is you go on three at the back you will lie heavily then on your wing backs she must call me again man listen I'm not gonna sit here we all love him no we're not gonna sit here playing well but the thing about it is right he's not playing well right and I've said this a couple of times I think we both said it is but it's so obvious that there's no one on the bench that can replace that then you then automatically that says to me that they don't feel like there's anyone near them they don't feel like John Joe Kenny's anywhere near them they don't feel like hogging anyone near them and obviously there's no one I'm not even alien with anyone coming through so that's gotta be and you know listen if you if you listen to people outside the club who don't watch us they probably wouldn't know they're asking their elbow you ask Paul Mason Paul Mason would probably say he's having a fantastic season because people don't understand the way I look at it is it when people say there's it's like like we've got everything in this world there's like black and white now isn't it if you get a size James Coleman for having a bad game or having three or four bad games well he's the new whipping boy he's not the new whipping boy there's never a whipping boy feel woke up wasn't the whipping boy if he's not playing well you can say he's not playing well you don't say we're not winning games because he's not playing well the same with James Coleman the way we've got to look at it now with James Coleman is and that not having that person on the bench says to me we have to be looking now to bring somebody in who can go in and try and replace him yeah that you know whether you think James Coleman is finished or if you think no no he's just having a blip he's coming back whatever my heart hope he's you know coming back my head says something slightly different because of the injuries but we've got to be prepared for life after that's the same for every single position and it's these moments that there's someone everything's good you're like oh is he's boss oh he's boss oh he's boss you don't when you're having these moments you go no we we could rip this whole team up and start again because that's sometimes what your mind says what they'll be saying is Marcel Brands and the manager is right we need to be looking at that position seriously yeah Guilfee Siginson Seamus Coleman Garnett anyone who's around 30 you should be looking anyway yeah you should be looking and going who's who's going to replace him if we could get a player better than the charlison yeah you should be getting a player better than i love the charlison we all do but if there's a left wing you come on now and he went well he's amazing but it might mean the charlison has to battle to get in but you've got you've got four there haven't you've got you've got Theo you've got Seamus you've got Guilfee Siginson and you've got Garnett players all around 30 who are supposed to be at the peak some might have gone the peak but you've got to be look that's what Marcel Brands job is now is to be looking at replacing those four players really it's even it's even having people it's even having people who can battle for that position properly so if like if if i don't play as well as a candy pet replaces me because he's at the same quality it's not a fact of like just because he's saying we need another right wing back who's or a right back who's as good as Coleman who can get take Coleman's place for it that doesn't mean Coleman shitting he's finished and he's gone forever that might just mean this lads wrestled the position of and the same with Guilfee the same with Walcott i think Walcott's got loads to offer do i think Theo's playing well enough to guarantee a place every week no i don't i don't do i think look i don't i don't think look one can play that role do i think the charlison can possibly if we had something better than in the middle doesn't mean i think Theo needs to go now that's it you can't you see people on saturday yeah they mean that shite what the hell are we doing fucking pop doom is miles better than you like you loved me in the two weeks ago all right he hasn't had the greatest week but he's just come into the team it's gonna be it's gonna take time mean me and there has has been uh somewhat it was it was ropey on saturday and i think you could probably say similar for maybe the the previous two games as well but he's like he's not played enough get anywhere near enough games and you know you want yerry meaner and keen playing because they're our players and we've spent a lot of freaking money on them um zuma i really like zuma i would i would like to see zuma come in to be honest i haven't said that on on recent form um you'd probably want to see zuma come back in but look yerry meaner i've got every chop every faith that yerry meaner is going to turn out to be a good signing but he's he needs to work but michael keen wasn't brilliant on saturday and neither was neither was mean well what's the common what's the common thing between them because they're playing in a three for the start yeah you're changing their positions normally with meaner picks that let's just say normally meaner picks that ball on bright day he's got he's got a left back next to no no we might come and get it off him and then give him it back and then you're changing the point of where you come out you've dragged someone into to dean if they were higher up dean gives it back to him and then you switch you change team rad and then you've got keen white next year in this system he didn't have dean dean's up the road he's around the corner and he didn't even have colman's where colman's up the road so it's it's those little things that can make a difference and if you've just come in to the team and you're bedding with new players anyway all those things can matter but isn't that i i look at that and then think well he'll look at that obviously because we're looking at it the manager will look at that and go well all right well we might want to play this system again what have we done wrong in this system with the and it's about leaning if we're three years down the line or two years down the line we're still making them errors then yet you start going do you need a striker and a right back and a midfielder but preferably a really good striker then a right back then a midfielder in that order in that order for christmas please mr browns i mean technically you technically you cut salmon because we called we just couldn't unveil them until well i've seen all the teams unveiling but yeah wasn't there a christmas tree involved in that wait did the puttikus receive a dangles knowledge would you have a dangles knowledge would i have them i would have happened two years ago when i was buzzing when i was like no what do you have on now it's like i'm alone you'll find that answer out on patron so tune in over there also subscribe click the bell for alert also say this youtube channel what's it called oh yeah so it's the bird is blue i think he's off actually i can't see i have shit there's loads of like so it's like loads of asmr that's your and then some always like a little bit or a week without a chair i'll always gonna say maybe if you you weren't doing an as this is the match preview get involved in the asmr i'm telling you it would make you it's coming well on that bombshell we'll see you later see you soon