So, Christina, to sum this up, my final question is, what are the future challenges that you see in avoiding misconduct and ethical issues, say, in the next 10 years or 20 years? I just think the ethics issues will probably always be there, and how we detect them may have to change as technologies change. We may be using tools that are too old at some point, or we just have to keep moving with the times to make sure that the tools that we use are going to detect the ways that people may manipulate data in the future. And in terms of some of the writing issues or publishing articles multiple times, data duplication and things like that, it may be somewhat easier as more eyes are looking at papers. And often, now that we do have some blogs and websites, even PubMed Commons allows you to make comments about articles. If somebody raises a concern, it becomes a public knowledge very quickly, and then more eyes look at a paper that's been flagged. And so errors might come out even faster than they do now. And so in some ways, technology is fantastic for helping us identify problems. In other ways, it may slow journals and other guardians of the literature down a bit as we try to make sure we're up to date on how to assess potential problems.


For more videos on people's struggles, please subscribe to our YouTube channel. Hello and welcome to People's Dispatch. Today we're joined by Kwesi Prath Jr of Pan African Television and we're going to be talking about the situation, the political situation in Ghana. Thank you so much for joining us and last month we talked to you just before the elections where you mentioned how the context was expected to be tried between the new patriotic party and the NDC which is the main opposition party and like you said it was a very tight contest both the presidential and the parliamentary elections and one of the things you also highlighted was the essential similarity these days between both of them. So we now see that last week President Nanakoffaro has been sworn in for the second term, very contentious election. It has been contested, John Mahama the opposition candidate has challenged the results in court and there was some violence in the aftermath of the election as well. Similarly last week in parliament again quiet riotous scenes where you know members of parliament where there was a scuffle if I'm not mistaken the army was ordered in and a lot of questions being raised about the future. So we wanted to talk to you about some of these so maybe could you first throw some light on the immediate aftermath of the elections especially the claims of contestation that the opposition NDC and the candidate John Mahama they've raised. So maybe talk to talk us through what are the basic claims and what is the kind of action happening on them. The results of this election clearly point us to increase polarization political polarization of Ghana. In the presidential elections there were 12 candidates which contested 11 candidates representing political parties and one independent candidate. Most of the votes went to two political parties you know two political parties had more than 90 percent of the total votes cast. In fact if you take the national democratic congress and the new patriotic party each of their presidential candidate had a little over six million you know votes leading and that shows the extent to which this country is polarized. The election itself resulted in eight deaths eight people died as a result of this election which is unprecedented in our history I mean not since the Fourth Republic of eight people died in one election. There's a lot of violence the deployment of extra you know police forces and so on and the results are contested they are still being contested in a number of constituencies. As things stand now the new patriotic party has been declared to have 137 seats in parliament and the national democratic congress has also been declared to have 137 seats in parliament with one independent candidate. But the election results have been contested in four six different constituencies and that's very significant. In the last parliament the new patriotic party had a majority of about 69 it is now 50-50 to the extent that the Ghanaian parliament today there's no majority and there's no minority and all the parliamentary rules have been written on the basis of majority party and minority party so we now have a new situation we have to contend with you understand. Now what is worrying is that all of this dispute all the discourse in parliament and around parliament is about rules and regulations and so on. We are not paying attention to the fact that parliament like like any of the state institutions like the judiciary like the executive and so on is not there for its own sake it's there to achieve clear objectives. What are the rules if they don't lead to improving you know the living conditions of the people? What are the rules if they don't lead to a situation where people you know are able to express themselves and to participate in the political process? What are the rules if in the final analysis it has not delinquent the national economy from the colonial metropolis and so on but these are issues which are not being discussed we are discussing rules for rules sake you know without taking into account the people's interests which are to be central in all of these you know discussions. We've also seen some violence you know not just at the national political level but also in the chamber of parliament and for the first time in our history members of parliament were actually exchanging blows you know in parliament and we had a situation where all the allegations which were made in the general elections were displayed in parliament. We had incidents of ballots snatching where a member of parliament actually went and snatched ballots and tried to run away with them. You had instances of attempted stopping of ballots. You have instances where the rules and regulations were not obeyed. You had instances where security personnel and security personnel were introduced into parliament in order to resolve issues and so on. Now the situation is troubling, it's exceedingly troubling and the former president his excellency John Romani Muhammad has actually filed a petition in the Supreme Court. Now this is a Supreme Court, 11 of whose members were appointed by the current administration and that raises all kinds of issues about whether or not the Supreme Court can be trusted or not trusted and so on and we are waiting to see what is likely to happen we understand. The electoral commission itself has changed election results six times already. The first result that they released did not make sense mathematically because they released results of an election which was in excess of 100 percent which is a mathematical impossibility you understand and thereafter they changed the results indeed six times already. So it's not clear what is likely to happen. What is clear is that we are now in the midst of confusion total confusion about the figures we are in the midst of total confusion about who won and so on and we're also confused about the future of this country you know what is going to happen with the election petition what if the Supreme Court decided one way or the other that's the crisis that you are in now. Absolutely right and in this context I wanted to ask you a bit about the kind of situation you have mentioned where parliament is almost completely split in half like you said it's an unprecedented situation and the speaker of the parliament is of course from the opposition party which I believe is again for the first time and we have a president who has come to power in a very controversial manner so does this there is there a possibility of governance or even basic governance itself grinding to some kind of you know slowing down considerably because of the polarization as well that you mentioned. Well the opposition has said very clearly and that was yesterday that they do not recognize the president as president now that means a lot I mean they don't recognize the president as president how is he going to be able to present a budget you know and whether or not that budget is going to be approved his ministers are supposed to be vetted by parliament and so on there are so many issues and if we don't recognize him as president there will be limitations to how he can exercise his power as president especially as the opposition controls parliament you know the opposition has demonstrated you know a certain practical superiority they got a speaker elected that they nominated but the speaker is not a member of parliament then they got the governing side to accept the position of first deputy speaker which means that the governing side has lost one member of parliament anytime he sits in the chair he can no longer vote and then they got the independent candidate to also accept the position of second deputy speaker so that vote is also lost to the government you know so through this tactical maneuvering the opposition now controls parliament and if they don't recognize the president he does raise you know a number of issues and normal problems now I think it's important for us to also understand clearly that Ghana has very serious economic problems exceedingly serious economic problems as we speak the government of Ghana owns independent power producers in excess of 1.7 billion dollars we understand and the independent power producers are actually threatening to shut down electricity supply now if they do shut down electricity supply everything grinds to a halt education help everything grinds to a halt now you need some kind of consensus to get over these kinds of problems and yet this is the situation we have so it is predicted that we could very soon you know end up in total darkness across the country and that would affect industry to affect everything you understand now beyond that Ghana now is spending two tenths of total national revenue on on on redevelopment of debt and and and debt servicing that means very little in fact what is left is not enough to pay public sector and monuments alone there's a huge crisis there's a huge hole you know in the national economy and this political crisis does not help us in any way at all i mean Ghana is obviously grinding to a halt and i'm really worried and frightened about what is likely to happen and just going back maybe a bit to the results of the elections themselves in terms of we talked about we talked last time about the campaigns that both the candidates have mounted and the kind of promises they've made so do you see any particular trends or patterns either nationally or regionally that emerge with respect to how these candidates promises or agenda has been received well the vast majority of people know that these political parties do not keep their promises i mean in the in the 2016 election the governing party promised everything one factory per district you know one dam per village everything they promised everything and they could not deliver of course the state of the national economy said that these promises cannot be delivered they are only made to entice people you know to vote for one particular party or the other again the fundamental problems for a country are not featured in these promises one of the main difficulties we have is that we endowed with natural resources we endowed with oil and gas we endowed with diamond with manganese all kinds of things one of the fundamental problems is that these resources are not owned by the people of Ghana and are not exploited you know for the purpose of solving the problems of the people of Ghana and these do not feature in the election promises made by the two main political parties the two main political parties appear to be satisfied with the status quo with giant companies from from the west control all of our resources and in fact the beneficiaries of the exploitation of these resources and so on so the promises they make are usually very unrealistic promises i mean if you promise free university education you've got to be telling us about how you are going to finance free university education free university education has to be financed you understand and for as long as you don't control your natural resources for as long as major economic decisions are not made in country but are made by the brettan wood institutions imf and the world park and so on you are not able to fulfill these promises even though some of the promises may be lovable and so on but at this point of time whether something again we discussed the last time whether foreign countries especially from the west you mentioned the abundance of resources whether there is the risk of uh say backroom interventions by diplomatic channels or anything of those lines as well well we do know for a fact that the Israeli intelligence community played a key role in pushing us to the stillness indeed there were Israeli intelligence people working for the governing party and there were Israeli intelligence people working for the opposition party and how one intelligence group decided to divide itself into true and to support both sides is is interesting um we know for example that the situation in western sahara would have some manifestation in what we're doing here because morocco is keen on joining the economy community of west african states is keen on building an outpost in ganna in order to deny the people of western sahara you know their right to self-determination and and they played a key role in in 2016 supporting the the governing party and so on of course the united states itself is in turmoil it's so confused that uh one is not sure what it's likely to do internally not to talk about it's likely to do externally and so on but all kinds of interests are also at play and uh again for us radical forces revolutionary forces and so on the question must always be the living and working conditions of the masses of our people that should be at the center of the discussion of foreign policy it should be at the center of the discussion of internal policy it should be at the center of the efforts to to resolve the the impasse which now exists and finally just wanted to ask you a question about at this point of time what uh trade unions radical movements and progressive movements in the country what is the kind of response in the time the period since the election what is the kind of response that they've been thinking through in terms of the next step to sort of address the political crisis that you're seeing and the social crisis well gonna have to be a very peculiar country i mean the midst of all of those our trade union movement is silent absolutely silent and that's very very strange you understand um fitbit institutions are silent they are not speaking very much you know um people in the in the legal profession are silent and so on and the only persons making loud noises are still people in the traditional political divide and that doesn't give us hope at all i think that the way forward is for radical organizations revolutionary organizations left organizations to increasingly stress on the interest of the people and to organize around the interests of the people which is nothing you know exotic people's access to water is critical forget about the rules and so on all of that what does it mean to improving people's access to water which is vital for human survival everybody needs clean water to to cook to drain for survival so water becomes a very important issue we understand housing is a critical issue for everybody especially for the underprivileged people in our society so all of this what does it mean for people's access to housing quality housing and so on education health and so on these are the issues that we need to focus attention on and to move people in that direction yes there's a polska crisis this polska crisis how does it reflect on people's aspirations and how that the resolution of the polska crisis lead to improving the quality of life of people this is the direction this is the direction absolutely right thank you so much for talking to us


Hello and welcome to today's episode of the International Daily Roundup by People's Dispatch where we bring you some of the top stories from around the world. Let's take a look at today's headlines. Thousands participated in 2022 People's Rally in Seoul. Vigils held across Ireland after murder of Ashling Murphy. Over 8,000 Kroger workers on strike in the United States. And Brazil records drastic rise in deforestation. In our first story, we go to South Korea where a mass rally was held on January 15th. 15,000 people gathered for the Surprise 2022 People's Rally in Seoul's Yooi-do Park. It was organised by the National People's Action Movement which includes progressive workers and farmers groups. Among them is the Korean Confederation of Trade Unions or the KCTU which has been mobilising workers in a broad front. These groups have argued that inequalities have been aggravated recently. Saturday's rally raised slogans against growing income inequality and a vested two-party political system. It also followed months of strike protests and sit-ins by workers across different sectors. Most recently, delivery workers at CJ Logistics went on strike. Outrage grew following reports that at least 16 workers had died due to overwork in 2020. Over 40% of South Korean workers are considered irregular with little to no labour protections. Labour organisers are also facing threats in the country with several having been arrested under the pretext of COVID-19 rules. The National People's Action Movement has passed a resolution with a set of demands. These include the application of the Labour Standards Act to all workers and abolition of irregular work. The movement has also demanded the strengthening of public housing, medical care, education and transport. Other key demands include an end to joint military training with the United States and the suspension of the Trans-Pacific Partnership Agreement. National People's Action has also urged for an anti-discrimination law and a repeal of the National Security Law. In our next story, vigils were held across Ireland on January 14th following the murder of Ashling Murphy. The 23-year-old teacher was killed on January 12th while she was going for a run in the town of Tullamore. While the police have released limited details, they have said that she sustained serious injuries consistent with assault. Her murder has sparked outrage and calls to action to address misogynistic and gender-based forms of violence in Ireland. Thousands of people gathered in Tullamore's town park on Friday to pledge solidarity and support to Murphy's family. Gatherings were also organised in Northern Ireland in cities including Belfast, London Dairy and Neury. One of the biggest demonstrations took place in Dublin as people gathered outside the Irish Parliament. According to frontline organisation Women's Aid, 244 women have been victims of violent deaths in Ireland since 1996. Out of the resolved cases, 87% were perpetrated by a man known to the victim, 13% of the killings were by strangers. Women also formed over 30% of victims of homicide in Ireland in 2021. Women's Aid CEO Sarah Benson has said that killing of women is the extreme end of a spectrum of abuse that is experienced every day. The group has called for a zero tolerance to all forms of male violence and measures like investments in education to change attitudes. Ashlyn Murphy's murder follows months after the killings of 36-year-old Sabina Nessa and 33-year-old Sarah Everard in the UK. We now go to the United States, where workers across 80 Kroger-owned King Soopers grocery stores are on strike in the state of Colorado. Organised by the United Food and Commercial Workers Union, over 8,000 workers walked out on January 12th. A pre-strike vote was passed almost unanimously after the UCFW filed an unfair labour practices suit against Kroger. The charges included the prohibition of union activity and attempting to bargain with workers directly. Kroger has also hired temporary outside workers. The strike is pushing for a $6.00 an hour wage increase for all employees. Meanwhile, in its quote-unquote last best and final offer, the company offered a hike of $4.50 to limited workers. The deal also included a $16.00 an hour floor, which is only 13 cents above the local minimum wage. It contained other concessions including a shorter leave period and the use of non-union gig workers. Kroger is among the largest grocery store chains in the United States, making over $2.5 billion in profit in 2020 alone. Meanwhile, an economic roundtable survey of over 10,000 Kroger workers found that nearly 80% were food insecure. 29% of the workers were either at or below the federal poverty line. 45% of workers said that they could not afford rent and 14% were currently or had experience homelessness. The strike launched this week is going to last until February 2nd.  In the third year of Bolsonaro's term, the Amazon rainforest suffered like never before. According to data from the Climate Observatory, since the current president ascended to power, Brazil's Amazon deforestation surged to 76%. Between August 2020 and July 2021, there were 13,000 square kilometers of destruction in the world's largest rainforest. 2021 was also marked by the advance of illegal mining in indigenous peoples lands and the dismantling of the environmental agencies. If we look back, the Bolsonaro government fulfilled all its campaign promises which were to end the so-called finance industry. But nobody imagined that the promise of ending the so-called finance industry would cause all this destruction of the environment. And all this is mainly of the institutions that have the power to control and combat it. 2021 was also a year to debate actions to reframe the advance of climate change. However, at COP26, summit dedicated to this issue and hosted in Glasgow, Scotland, the positive points to Brazil were the delegations, debates and the strength of the young indigenous people. This group of countries showed themselves at the summit, and it was a positive point of Brazil's participation. The government, in its turn, got the negative points as expected. But expectations the world had on Brazil's government were low too. People actually thought, if Brazilian government didn't disturb, that's quite good enough. He signed some papers with commitments as the methane, pledge and zero deforestation, which we know that under no circumstances the government will fulfill. The current government prevents us from accomplishing the potential of Brazil's climate agenda. It's precisely because of so many dismantling and expectations that it will take a time to rebuild what was destroyed, especially in the environmental area. To the environmental area, what we need is to show the world that the new government will perform a bootleg turn. It will change 100% of its environmental policies. It isn't a circumstantial change. They must change absolutely everything because we are in 2022, after three years of Bolsonaro's term, and there is nothing. I repeat, there is not a single positive act from this government to protect Brazil's environment, to protect our forests and to build a healthy image of Brazil on this agenda around the world.


You can just behind me. Hi, everyone. Welcome. My name is Tom Zick. I co-own the AI governance working group with Maroucha Lavec here at the Berkman Klein Center. Today, we're delighted to present you with a conversation on algorithmic fairness with Justice Bruce Leabella and Professor Martha Minow. We want to start by acknowledging that Harvard is located on the traditional and ancestral land of the Massachusetts tribes. The original inhabitants of what is now known as Boston and Cambridge. We pay respect to the people of the Massachusetts tribe, past and present, and honor the land itself, which remains sacred to the Massachusetts people. With that in mind, our speakers need no introduction. But today, I have the dangerous task of selecting a few highlights among their impressive careers. So here goes. Justice Leabella's career is one of firsts in Canada. First refugee to become a judge as she was born in a displaced persons camp in Germany. First, pregnant person appointed to the judiciary at the age of 29, and first Jewish woman appointed to the Supreme Court in 2004. She's been a trailblazer and a pioneer throughout her career. She coined the term and concept of employment equity, which resonated all over the world and has played a pivotal role in defining the Canadian substantive equality approach. She has written over 90 articles, written or co-edited four books, and has received numerous awards, including 41 honorary degrees. She is also a member of many honorary societies, such as the American Academy of Arts and Sciences. She has held positions in several law faculties, including this one, where she is now the Samuel and Judith Pizer visiting professor, leading seminars on equality on the law and literature, and on the role of judiciary and democracy. You can find out more in a recently released documentary Without Precedent, The Supreme Life of Justice Abela, which I cannot recommend enough. Martha Minow is the 300th anniversary university professor at Harvard Law School, where she's taught a wide range of topics since 1981 and served as dean between 2009 and 2017. She's an expert in human rights and advocacy for members of racial and religious minorities and for women, children, and persons with disabilities. She also writes and teaches about AI and legal issues and about how societies transition from war and atrocities to regimes committed to democracy and justice. With 70-plus named or endowed lectures, fellowships of many honorary societies, including the American Academy of Arts and Sciences and the American Bar Foundation, listing her achievements and recognitions will take the entire hour. Let me highlight that she currently chairs the MacArthur Foundation and is a board member of the Campaign Legal Center and Carnegie Corporation and GBH. She also co-chairs the Access to Justice Project at the American Academy of Arts and Sciences and the advisory group for MIT's new Schwarzman College of Computing. These highlights barely scratch the surface of the breadth and experience and depth of decades-long thinking our speakers bring to algorithmic fairness. Finally, we're lucky enough to have my co-organizer, Marusha Lavec, moderating the discussion. Marusha is an SJD candidate here at the law school and has direct experience with the topics we'll discuss today from her previous work for Quebec's Public Inquiry Commission on Electronic Surveillance. So without further ado, I'll turn it over to Marusha to kick off the discussion. And hello, welcome. So let's just kick off the discussion. Professor Minow, you have an illustrious career advancing equality matters in the US from desegregating Education Post Brown to more recent involvement, thinking about fairness in the context of AI. What prompted you to look north towards Canada's conception of equality? To get us started, can you say a few words about how you came up with the idea to write about Justice Abella's equality jurisprudence? Why is this relevant to US debates interpreting equality generally and specifically in the context of algorithmic fairness? Well, I do believe that the digital revolution is the newest frontier for equality and civil rights, both as threat and as possibility. And I've been lucky enough to learn particularly about Canada and Canada's treatments of equality and always admired them. And at the core of those treatments is this wonderful person who developed a notion of equity that started with statutory analysis but has swept into charter rights and imbued constitutional interpretation generally. And what matters about it is to understand that people are each accorded in law, respect and dignity and yet come from places and have situations in society that reflected inequalities that are structural. That seems so right to me and it is not the way that the US proceeds so I of course was drawn to that analysis and very much want to figure out how to learn from it. In thinking about the digital revolution, whatever limitations we may have in the United States in interpreting the constitution for example, we have a new terrain with private sector developments and we should be looking at the best ideas, not be limited to what are the dominant views just in a particular country. Thank you for this. Now let me turn to you, Justice Abella. You're the architect of substantive equality in Canada, a diligent gardener planting its seeds in the seminal 84 employment equality. You're the living tree. Exactly. I love where these metaphors are going. And so you cultivated it all the way to a core norm that really animates constitutional equality rights through your 16 plus years at the Supreme Court. So you've articulated this idea that facially neutral laws can in practice operate as built-in headwinds against protected groups. So could you tell us a bit more about how you conceived the right to equality and non-discrimination and perhaps the trajectory of substantive equality from the employment context to constitutional protection of equality rights? Absolutely. And when we finish on Friday morning, there'll be a task. I wanna first say what a great thrill it is for me to be here at the Harvard Law School. And one of the reasons I'm here is because of Professor Minow. I will let you all in on a secret. The thing she hates most in the world is when people pour compliments on her.  Professor Minow is one of the most extraordinary polymathic thinkers I have ever met. And it's such an honor for me to be in the same law school, let alone on the same platform. She's never gonna speak to me again after I do that. But I want first to tell you why I don't feel worthy because I'm not. When she did this paper, it was for a conference at the University of Toronto Law School did in just kind of a retirement symposium. And she sent me the paper that she was doing and it was called Equality and Algorithms. And I sent her an email, this is September 2022 and said, what's an algorithm? Just so you know, I'm an expert in replies and then forward and that's it. And so I bow to the scope of Martha Minow's interest in equality because she's taking it to the next frontier. So let me briefly explain how Canada got to a theory of substantive equality. Our equality theories were non-existent before Canada had the Charter of Rates and Freedoms in 1982. And in 1982, when we entrenched the charter, the government put the equality section on pause for three years because it was going to be very complicated and they wanted to give governments a chance to re-examine their own laws to see if they could comply with a yet undefined concept of equality. Into this picture, the government was being pressured by women's groups who wanted affirmative action in Canada because they had seen affirmative action in the United States, there was none in Canada. So the Canadian government did what they sometimes do when there's a problem, they're not sure how to address and they want it to go away. Apparently they kept going to business every year and saying women want affirmative action. Is this something you would be ready to do but business kept saying it's not a good year. Do you mind coming back next year? So they kept coming back and there was never a good time. So they put it on pause by creating a royal commission on equality and employment. And just to give you an indication of how seriously they took it, it was a one-year, one-person royal commission to look at women, barriers to employment for women, indigenous people, persons with disabilities and non-whites, visible minorities. One year, $1 million. While a multi-year, seven-person royal commission was traveling across Canada to examine the problem with baby seals. So I knew that this was going to be something that maybe universities would take seriously but it didn't strike me as anything that was ever going to be implemented. Who was the one commissioner? Huh. So I was a provincial court judge asked to look into this 60% of the population. What were the barriers in employment? I thought before I do this, I need to figure out what equality means. And I did it as a good judge would do it by traveling across the country and listening to the four groups. And I had two hour meetings in each of 16 cities with the four groups, plus business and labor in each community. And listening, not from the top down, which is what people tend to do, but actually listening to what they were telling me led me to understand that they were all different, that there was no homogenous approach that would make sense. And I also had in my head the American jurisprudence. I read every case decided under the 14th amendment. You see, in Canada there's no aversion to comparative law. Like we happen to think you can learn from looking at what other countries are doing. Interesting. You don't have to follow what they do, but what's wrong with looking at how other jurisdictions in democracies are examining the same kind of problem. So the only country that had interpreted equality by 1983 was the United States. So I read all of these cases and I read every philosopher who had ever talked about equality. Aristotle and then Hobbes, Locke and Hume, the possessive individualist. And I understood that the American approach to equality was rooted in a theory that traveled across the ocean from King George III's Crazy Brow into a theory of every individual has the same right as every other individual to be free from an arbitrary state, from an unreasonable state. It was a theory of equality as sameness. It was the civil libertarian theory. Like vis-a-vis the state, there's no difference between the head of the government and the person who cleans the floor for the government, although we'll see what the Supreme Court says about that in a couple of weeks. So that notion struck me as useful for civil liberties, but it made no sense when you're thinking about how different people are. And again, I had these voices in my head and their differences. And I thought if we treat everyone the same, the person in the wheelchair doesn't get a ramp.  Persons who are not white don't have recognition for the fact that they experience racism. And indigenous people don't have recognition of their entire history of subordination. So I thought equality really is about difference. It's not about sameness. Civil liberties is about sameness, but human rights, which is the post-World War II approach to rights that we developed because of World War II in the Declaration of Human Rights and the Declaration of Civil and Political Rights was this theory that you could not just be the individual who was the King George III descendant philosophically. You could also be an individual who was treated a certain way because they were a member of a group. And that's what human rights is about, the way you're treated as a member of the group. So that was the formulation that came into the 18 pages that were the definition of equality that I made up essentially by listening and reading and thinking. It took me three months to write the report, which was 300 pages. The first 18 pages of what equality means took me a month. It was really, really hard. And then I went into what the actual barriers were. So it was the theory that said, you have to look at what the barriers are for each of these groups and understand that unless you get rid of the barriers, you can't treat everyone the same. Unless you get rid of the barriers that these groups experience, freedom from discrimination, you can never have equality. The American approach almost entrenched inequality because it ignores how different people are and ignores the fact that they need different remedies based on their differences. So I wrote the report. Five years later, the Supreme Court of Canada in the first decision interpreting equality rights, section 15, took the definition of discrimination and equality and made it Canadian law, which was quite extraordinary to me because I mean, I was 37, that was 40 years ago. And then the next 40 years, we just kind of went our way towards refining. It was a back and forth, but we ended up accepting that systemic discrimination, the impact of acts rather than the intention is what counts and that's disparate impact and that's what substantive equality is. Formal equality is seamless, it's procedural, has nothing to do with human rights. Equality is about human rights and getting rid of discrimination, which is the opposite of what goes on here where every distinction is considered discriminatory. By definition, well, that's ridiculous because you have to make distinctions in order to take those differences into account. But here they think the court thinks discrimination means making any distinction. But then how do you get rid of discrimination if every distinction is discriminatory? Like it's circular, right? It doesn't work. And then in Ricci, as Martha says in her brilliant paper and it is a brilliant paper, which is the human rights case, the firefighters in New Haven, they completely merged the concept of the 14th amendment which requires intent with the title, seven jurisprudence, which doesn't require intent and added intent to the human rights requirement, which completely destroyed the possibility, I think, of getting any human rights jurisprudence under title seven because it's now tethered to the 14th amendment approach. Otherwise, I've nothing to say. Well, perhaps if you'll allow me, since we're sort of in comparative law land here, the idea of built-in headwinds, this really vibrant metaphor that you use to capture the essence to me of substantive equality which is something subtle, yet deeply shaping one's trajectory, something you can't really see from the outside but that has a really real effect on people. That appears in earlier U.S. employment discrimination case law. So we talked about the difference between the Canadian and the U.S. approach, but it strikes me that there's also some cross-pollination at least from the statutory context. So I'm wondering if you have any thoughts or any conceptions on the mutual influence between Canadian and American equality. I stole from Griggs. It is in my very first chapter. When I read Griggs, I thought, Bingo, this is it. This is the human rights approach. It was Chief Justice Berger in Griggs who said, there are built-in headwinds. Intention doesn't matter. Doesn't matter what the purpose is if it has an impact that is disparate on these people, then that means it's discriminatory. I thought Griggs was a fantastic decision. So I absolutely borrowed it. So for us, for Canada, equality is a human rights anti-discrimination concept in the United States. That's why I'm so sad about Ritchie because it eviscerated the beautiful language of what he said in Griggs. And he had that metaphor. Am I right about that or is it in Bakke? Or did Blackman do it in Bakke? Well, he used the fable of the stork and the fox. Do you know that fable? It was Bakke. Was it Bakke? I'm not sure. It doesn't matter. Anyway, it was all about how you can't treat people the same. And that was Anatole Francis' line too. The rich and the poor in majestic equality have the same right to sleep under bridges, steal bread and beg in the streets. So he used, I've never seen a fable used by a Supreme Court judge before. The fox invites the fork very cleverly, gives him food, but the stork can't eat it because his beak doesn't fit. The stork invites the fox over, invites him to have something, but he puts it in a long canister that the fox can't get. So it's all about how you can't treat people the same and say that they've got the same access. So yes, absolutely. Your human rights jurisdiction and jurisprudence was crucial in the development of equality in Canada. But then it stopped being relevant. I don't honestly know how many democratic Western Supreme Courts look to constitutional jurisprudence in the United States anymore, rights jurisprudence, because you've gone, it's become sclerotic. Like most of us see the role of a constitutional court as being the expansion, the ever-increasing expansion of rights as awareness tells you whom you have left behind so that you include more. And the Americans appear to be in a shrinking mode. So you're going against the international great, so far.  But we used to borrow heavily from you. We learned a lot about what to do and sometimes what not to do. Perhaps turning now to the algorithmic fairness component of your piece, Professor Minow, it draws attention to competing and mutually exclusive technical implementations of fairness. For example, you mentioned that the compass recidivism score used in bail, sentencing, and parole proceedings was calibrated to convey the same risk across racial groups, but it also overestimated the risk of black defendants and underestimated that of white defendants. So the takeaway for our purposes is that developers, system designers, make explicit editorial choices when they choose a fairness metric. And so I'm wondering, how can Justice Abella's conception of equality inform these choices on the ground as technologists are confronted with those choices? Well, I think you can see why I was so drawn to the Canadian perspective and Justice Abella's really transformative understanding of equality, I think has a lot to offer the development of algorithms where I think very good research is now coming out about how there are competing conceptions of equality and the use of classifiers and even down to the level of what kinds of comparisons are fair and what kinds are not. And people who are far more mathematically sophisticated than I am have demonstrated you cannot satisfy mathematically multiple conceptions of equality at the same time. It's just not possible. So there are inevitable choices and the choices, it seems to me, are human rights choices. They're choices that are gonna deeply affect people's lives.  They're being used to decide should a child be removed from the parent's home. They're being used to decide where police go, whether someone should get bail. They're being used to decide the most weighty burdens on people's lives and huge opportunities. Those are social justice human rights issues and they should be analyzed in my view with the deepest awareness of the consequences and commitments to make the judgments true to some idea that can be defended on the human rights grounds. That's not always happening. And indeed it's often obscured because the discussion if there is one is put in mathematical terms or it's treated as well we can't satisfy these different kinds of criteria because we have to satisfy this other criteria. So the first step is to make it explicit where are the choices, what data are being used, that you mentioned the compass scores, such an interesting example where just a factor is selected. It seems very neutral. Use the likelihood of re-arrest based on past arrest record as a prediction of whether someone is going to get into trouble and therefore they should have bail. They should not have, they should have to pay money in order to avoid going to prison. Well, one of the things that that measures is where has the community decided to put police? The likelihood of being arrested is most related to where they put the police. And if the police are being located in communities that are disproportionately African-American, no surprise. There's higher rates of arrest there but that's obscured by the use of the algorithm that makes it seem like this is inherent in the human beings. These are people who are more likely to be arrested. That's the kind of choice that has to be made explicit. And it does require looking at, is it substantive or substantive equality? You have to tell me. Substantive. Substantive equality. So the Canadian. That's a substantive conclusion. So however one pronounces it, substantive or substantive equality, it does require looking at the effects. How does this behave? Who's going to be affected in what way? Rather than what was in the intention of the person who designed it? I think it's transformative. Now, if you'll allow me a question that is completely off script, so apologies in advance. This made me wonder about judges sitting, sitting sort of three years later looking at these questions if they're ever reviewing this post facto. What could be the role of judicial notice to questions the things that are not within the four corners of equality claims? For instance, the fact that the data itself was warped. I'm asking this question in an open-ended way, Justice Zabella, just to get your censor reactions on, what is the broader role of the judicial as they are going to be called to review these matters more and more and the training that law students have received so far often doesn't really capture, doesn't really capture or cover these questions. So just wondering if you have any thoughts on this. Well, my first thought is, I don't think the judiciary or the country, any country is ready yet for the idea of judges taking judicial notice of anything to do with algorithm. I admit that I'm particularly backwards on questions of technology, but if I didn't know what an algorithm meant two years ago, judicial notice is really only something that is so obvious that it requires no evidence. I think we're far, far away from that, but I think the points that Professor Minow raises that are really important about algorithms, as I understand it, is they're rooted in a concept of neutrality and equality as neutrality. In other words, the idea that these are the same, these are figures that we will use that are facially neutral. It's a loaded term, neutral. What does that mean? And facially neutral means often if you apply it across the board, it's going to affect some people differently depending on who they are, where they live, what their race is, what their sexual identity is. And so as I see it, the added complication of algorithms aside from the scientific complications is exactly in the area that Professor Minow identified. What data goes into the creation of an algorithm that will ensure that it maintains, if it's going to be used, that it represents a fair outcome and eschews this obedience towards a theory of neutrality, which often works against people who are not in the mainstream. And the whole purpose of equality is to make sure that more and more people get into the mainstream. So I'm nervous about the term neutrality, although it's thrown around all the time. I don't know what you think, Martha. It scares me the term. Well, I'm worried about that. I'm worried about deference to something that looks technical and then reluctance of many people, including judges to second guess what looks like it's an expert judgment. When often, I mean, even the word algorithm, that's just a fancy way to say of precise formula for a decision. I mean, why do we call it algorithms? Because it has more syllables. I mean, honestly. That sounds very important. You know, machine learning, let's be more specific. An algorithm that actually is directing computational capacity to look at patterns and then amplify those patterns. That's a lot of what machine learning is. If the pattern, if the inputs are themselves biased, they're skewed, then the discernment of patterns is not only gonna repeat those patterns, it will amplify the patterns. It will make them even more pronounced. Well, that should be a judgment. That's not, certainly not neutral. There are decisions that were made about how to design the algorithm, what data to use, what it's going to be used for. Those seem to me questions that have social implications, political implications, certainly legal implications. I don't know about judicial notice, but I think it shouldn't be too hard to say that there are choices being made behind something that looks like it's just automatic. It's not automatic. In fact, I think what you're pointing out is that there's judges should require explanations. If they're going to use an algorithm, they need an evidentiary foundation for why that algorithm is productive, constructively productive. And the choices that were made to produce it, and they're now, of course, when we go from machine learning to generative AI, there's another leap forward. You can ask the generative AI chat GP team for or whatever, please explain what you just did. What's so remarkable is you can ask it tomorrow. It'll give you a different explanation. And so the basic fundamentals of verification are in trouble. If you can't replicate the activity, that's the kind of thing a judge should ask about. Now, I want to... Can I just ask for a second? I'm old enough to remember when they brought DNA in the courts. Oh, yeah, wow. And how skeptical judges were. We would have these sessions with scientists, and they would explain DNA, and we would say, they said, come on, you're kidding. Really? I'm gonna be able to tell who somebody is by taking us a piece of hair or something. But over time, as we learned what it was and how it was developed, and as its technicalities were improved, it became increasingly reliant. We're at the frontier, I think, for algorithms. And before judges used them routinely, especially in sentencing, deciding about somebody's liberty, and I'm shocked to hear they decide children being removed with an algorithm. How does that... I mean, I did that for seven years. That is the most personal judgment call that you could make. I can't even imagine how an algorithm would help. So we're a long way, I think, from the routine use of algorithms. I think even though they're being used that way, I'm not sure that's a reliable source of deciding the most fundamental legal questions, like liberty. You know, look, compared to what has to be the question, compared to what? If the alternative is human beings, human beings aren't always so great either. So we need to actually... No, but judges are. Judges are always great. Judges are always great. But I'm most interested in the hybrid. That is, how can the human beings be assisted being shown with the biases about your sentences go increase after lunch as opposed to before lunch? I mean, that's an important fact for judges to know. But also, I think humans in the loop is essential for anything that fundamentally trenches on, right, of other human beings. Now, I'm tempted to pursue this line of thought because you said, and just judges are, but I think there's a kernel of truth in the fact that we have chosen judges through some sort of vetting process, some sort of legitimacy process, where there is going to be a zone... You had it at vetting. There's gonna be a zone of discretion, which we are fine as democracies to put in people who have a track record. So we can't necessarily probe that full inner reasoning, although we have obviously reasons, but there's a zone of sort of lack of interpretability or lack of explainability in anyone's thinking that we're fine in putting in judges because they have been politically appointed by people who represent democracy, which we don't have when those decisions are made by algorithms who are often developed by private companies who don't have the same kind of legitimacy. So I suppose my question is, when judges integrate algorithmic decision making in their process, is there a risk that they are not fulfilling their constitutional duties as Article III judges in the US or forgive me for not remembering what the equivalent would be in Canada, despite the fact that I'm a Canadian attorney? So the gist of my question is, when decisions are offset to algorithms, judicial decisions are offloaded to algorithms, are judges not doing their jobs if they don't understand how these algorithms actually work? You know, I think the major use right now by algorithms is not in courts, although you and I are working on a project looking at particularly how the Brazilian courts and some others are turning to integrating algorithms into their decision making. But it is being used widely, widely, widely in public and private bureaucracies. I mean, it's already happened. So we are then, I think, compelled to ask, is that comport with the mission, with the authority of those entities? If it's administrative agency, if it's a school, a university that decides to do admissions by algorithm, I think that there are huge questions about legitimacy and fairness, and they deserve to be asked. As courts increasingly are turning to using some of these techniques, I think it should be disclosed. I think it should be evaluated and assessed. But it's again, compared to what? It's not as though judges are free from bias. It's not, I'm sorry about that. I know you meant excluding the people in this room. Exactly, yes. And so, you know, in some ways, I think it's about how do we improve the accountability of all the institutions around us? One thing that I very much admire about computer scientists is the precision.  I think that actually working side by side, lawyers and computer scientists and community members who are affected by what both are doing will produce better answers than any one of those groups working alone. Now, in your piece, you discussed the tension between disparate treatment and disparate impact doctrines in U.S. jurisprudence through the Ritchie case. Can you touch on how you see that tension constraining the choices that system designers can make? Do you see a path beyond this tension? Well, just as Isabella touched on this subject, and it is one that has preoccupied me for some time, indeed the first hope I ever wrote was totally fixated on this dilemma of difference. If you live in a society that has made certain markers of identity matter, do you ignore those markers? Or do you focus on those markers? The dilemma is, if you ignore them, then you risk reiterating, repeating, even increasing the impact of those markers in the person's life, in their chances to succeed in the workplace or the schools or whatever. If you focus on it, however, you also risk making that defining, that characteristic define the person. So that's the dilemma I was focused on. What happened in the Ritchie case? This is an instance where a public entity, the firefighting department, New Haven, Connecticut, decided that it really follows from the Greeks' test, that giving a paper and pencil test is problematic as a way to measure who should become a firefighter. There's not a perfect correlation between doing well on the test and being able to haul somebody through a burning building. But to put that aside, there was definitely a racial disparity in the outcomes of the use of the test. And having given the test, the department looked at the results and said, you know, this is not good. We're gonna throw out the results and start over. However, doing so then meant that they were taking race into account. And taking race into account is a problem under the United States 14th Amendment. They were consciously taking race into account. So here's this agency that is caught in this terrible location where it's not allowed under Griggs to take a seemingly neutral test and use it where there's disparate racial effects. And it's not allowed to correct it under the Constitution if that means being aware and conscious of race. That is a collision course. That is, I guess I can't say it in public, but it begins with F and it rhymes with Puck. That is a mind that. So you got what that is. That is impossible. That is an impossible situation to be in. And it's created in large part because human beings in the United States came up with a way to interpret the 14th Amendment Equality Clause to forbid any awareness about race. So I think that we should look for other ways to understand how to correct the impact of race in people's lives. And Canada looks like an awfully good place to look because I don't think that you'd have that problem. I think one of the things we had going for us, aside from the fact that we weren't American, was that our constitutional bargain at the constitutional table, as opposed to the fact that there were indigenous people living in Canada before anybody else, but the two groups at the constitutional table, two groups were the French and the English, and the constitutional bargain was you could be different, but equal. They didn't use those words, but rights were built into the BNA, the British North America Act, to preserve the distinctive character of Quebec. And so it's not a stretch for Canada to say you can be a hyphenated Canadian. You can be Italian Canadian. You can be a Greek Canadian. You can be a French Canadian. Hyphens are comfortable for us. You have the melting pot, which is required assimilation. And I mean, if you want a fun read, the 1906 play called The Melting Pot, by Israel Zangville. Yes. Is this mythic? We're all fused into one here in America. We're all one person, which leads to color blindness, which means nobody's different, which means everybody has the same rights as everybody else, and everyone is the same. It's myth. It's all based on the myth of melting pot, which came from the idea that everybody is the same, which was a good political theory vis-a-vis the state, but makes no sense in the context of respecting who people really are. So Canada's approach is assimilation if necessary, but not necessarily assimilation. We're integrationists.   So this whole approach to equality is eliminating the barriers that came from systems designed for white able-bodied males, Christian males, and so that the mainstream became accessible to anybody. And for years we heard its reverse discrimination, right? That's because the American approach is that any distinction, if you read Roberts, if you read Ritchie, distinctions are by nature discriminatory. It's discrimination not to take them into account. Well, you were so right to turn to equity as a way to talk about this, because when we talk about equality, equality has been hijacked into treat everyone the same. Now, you also were right to look to Aristotle because Aristotle says treat likes alike, not treat everyone the same, treat likes alike. So then the question is who's alike and who's not, and for what purpose? And I think that equity, when developed well, recognizes that everybody's unique, everybody is distinctive, and law and other sources of power can be adapted to the distinctiveness of each person. Each of us are in the intersection of all the different sets that we can be drawn into, any characteristic that we're gonna use. Short, film lover, lives in Cambridge. I'm in different sets. I am in the intersection. I thought you were just grabbing me. Yes, we are in that too. But I think that the danger that we have is there's a fear that if we actually open ourselves to all the different kinds of difference will be overwhelmed, and also the people who currently have privilege really are not very interested in giving it up. So there's a cartoon that circulates widely on the internet to try to explore the difference between equality and equity, and it shows a fence between an audience and people who are trying to watch a ball game. And the people who are trying to watch the ball game are of different heights, and I guess I identify with this because I am not exactly very tall, but so the people who are relatively tall can see over the fence, no problem. The people who are relatively short cannot see over the fence, so that's equality, right? Because everybody's behind the same fence. Equity is, there's a kind of a box for the shorter people to stand on so they can see over the fence. Now, I suppose we can go one further step and say let's get rid of the fence, but then we won't be able to pay the ball players, and that wouldn't be very fair. But that also gives the other example that you mentioned. You are treating all the short people the same, and all the tall people the same. That's the Aristotelian notion, which means what was your case, Godoldic in the United States, where all pregnant women were treated the same as other pregnant women. This is not helpful. Oh, Godoldic is an unbelievable, it's a pretty poor, the United States says it is not sex discrimination to deny benefits for people who have pregnancies. People. People. Because the class of people who'd never get pregnant includes men and women. So it's not gender discrimination to draw the line between those who get pregnant and those who don't. Well, yeah, no comment. So as we're slowly coming to a close, what is the next frontier for equality, perhaps for the aspiring or newly amended or not, lawyers in the room, looking ahead, what is the challenge for tomorrow's lawyers as we increasingly see AI driven discrimination or inequality challenges? What should we be on the lookout for? How should we approach our profession? Well, there's so many challenges and opportunities. I do think generative AI is gonna raise a set of questions that I haven't been able to think entirely through, certainly, and I'm barely getting a handle on machine learning. But with generative AI, when you have the designers unable to explain exactly what is going on, who are astonished by the results, who can say, well, we know that it's using weights, but why it came out with a different answer we don't know or it's confabulating, which is another word for lying. We can't explain it. I mean, I'm not entirely sure what to do about that, but I think that's a new frontier, an important sort. I also think that the merger of AI and genetics, you mentioned DNA. I mean, there is now this production of new chemicals using AI and also there's gonna be genetic engineering that combines with that. So, I had a presentation recently about the liver on the chip, the brain on the chip. It's just remarkable and exciting, but this is a new frontier. And what I think above all, we need people who can talk across these disciplinary differences, who can at least have the curiosity and openness to say, what do you mean by that? Do we mean the same word, the same thing by that word? And when you say that this is treating people the same, on what way is it treating people the same? And when you say we can actually solve this problem, what do you mean by that? So, I think interdisciplinary collaboration is absolutely essential. Justice Ibella, you have the last word. First of all, I agree with everything Martha said because I don't understand it. And I'm glad that she's there thinking about it because the next generation of lawyer is gonna have to explain it all to judges. But what I see happening, and it worries me a bit, is that we seem to be receding back to the simpler times where we're gonna end up with the same kind of stereotyping that resulted in the exclusionary practices with these facially neutral algorithmic AI metaphors that are unsophisticated because they're new and they're going to reinforce what we spent 40 years trying to get away from in other countries. So, I'm just telling you as a judge what it feels like when you're confronting something new, which is many cases, because none of us is an expert in everything. I think the legal profession has a huge job, the future lawyers in being able to both understand and then explain to us why what you're telling us needs to be taken seriously or why what the other side is telling us should be discounted and why. Because I see another 10 or 15 years ahead of working out the wrinkles in this, but we don't have 10 or 15 years because it's happening so quickly, it's really true. So the challenge is time, expertise and communication. We better get to work then. So we'll now turn to our Q&A. We have two microphone people that are gonna be circulating mics in the audience. And if you're joining us on Zoom, you can use the chat function as well. So the floor is yours. Just raise your hand. Just on this last point, I remember once saying to a judge that I knew, why are you allowing a jury to hear all of this mathematical evidence relevant in an antitrust case? And the judge said to me, you think I would understand it? We need lawyers who will translate, whether it's to the jury or to the judge. Oh good, we've answered everybody's questions. Anybody have any examples of problems or questions? Oh, here's one. Can you say who you are? Hi, I'm David, I'm at 2L. Closer, you can't hear me. Hi, how's that? That's better. I'm curious that it seems like a lot of the points that you make are completely correct in the deficiencies about formal equality or what you called the Roberts approach there. And then we need to be more open to substantive equality, which takes account of these differences. I'm curious how you think about the limitations of when you open that door that allows the government to treat people differently based on these characteristics, you ensure that that treatment is what we would maybe call morally desirable. So it seems like we come up with a lot of obvious examples that would be morally desirable and would not be possible under the formal equity approach. But you could also, once you allow people to treat people substantially differently based on those characteristics, a government of the majority could treat minorities in an undesirable way on those characteristics. You put very well, what is that dilemma that kept me awake at night? Because if you allow for the use of a difference to justify differential use, that could exclude people and deny people opportunities. I guess I think we have to get behind these shorthand labels and talk about both the context in which the problem is arising, the person's situation, what their background is, and whether the decision that's going forward is gonna be one that's going to elevate the possibilities of opportunity and sharing in the same kinds of treatments that other people have and results, or is it gonna foreclose that? So I think we just have to be more explicit. And using formulas like the only way to end discrimination is to stop discriminating, that doesn't get us anywhere. And I completely agree and much prefer the formulation that Blackman had in Baki where he says, to get past racism, you have to take race into account and to stop people being treated differently based on race, you have to treat them differently, not to exclude them. So there is, I mean, the Ricci is a perfect example of the fact that every time you address discrimination about one group, someone is going to feel that it's unfair. So when I said people think of it as reverse discrimination, you have to really think about it in terms of reversing discrimination, that it is case by case, group by group, there will always be people who feel that whatever approach you take by bringing in more people who were formerly excluded means that some people aren't being treated fairly. The white firefighters in New Haven, 100% of whom succeeded on what Ruth Bader Ginsburg, I think, compellingly described as irrelevant tests and therefore they failed the business necessity requirement that Griggs had set out, all felt excluded by New Haven rightly ripping up the results of something that disparately excluded Black applicants. And so if you're asking, is there a way to think about equality that doesn't result in some people feeling they're being arbitrarily excluded? I will only tell you this, there is no way to do it, but I can also tell you that this is why the system stayed the way it was for so long. People said, give it time, attitudes will change, it will all happen. And if you ask someone who was a Black person in America how patient he felt or she felt they felt about Plessy versus Ferguson excluding them and maintaining segregation and having to wait 60 years to be included, I would say that's a perfect reason why you cannot wait with these things and you don't wait for the attitudes to change. And if you ask many people in the South who are white today, if they think Brown versus Board was fair, they'll say no. And so my answer to your question is every time in law you make distinctions, somebody feels that the distinction isn't being fair to them. And so what we've done with treating equality as a substantive equality measure is to ensure that those who had been previously excluded for arbitrary reasons are now given access. And that means people who used to have hegemonic views of their entitlement to access are gonna have to make room for people they didn't necessarily think they had to make room for. And if you ask me, is every single person who's in every position as a result of affirmative action or employment equity the best person? I don't know, but you'll have to tell me what best person means. You know, I'm looking for something we can disagree about, so I'm gonna try. I think that maybe every decision will inevitably make some people feel like, well, what about me? But my hope is that what law is about is then there's another chance to challenge it. So let me give you just the example. When we started to have signs reserving, harking for people with disabilities, I remember very well hearing from a friend saying, I wish that didn't happen because then I would have had that space right there. This is a statistical mistake. You would not have had that space. It would have been filled up long ago. But this idea that if there is a quota set aside or there's affirmative action, those who previously had an easier access, you'll thought, well, that's taking it away from me. I think that the challenge is, well, where did you get the sense that you had an entitlement to it? So I would add that to what you've said. I would also say there are some kinds of retrospective actions by judges that will never be as good as a design thinking going forward. Where you can try to take into account multiple perspectives. Judges are understandably presented either or questions. And I don't like the result in Ricci, but I understand it. There were groups of white people who studied for this exam. That was what they were told was they had to pass in order to get the promotion. They did what they were told to do. And then it was yanked away from them. I understand that was unfair to them in a way, but there was a larger unfairness for the people who were given a test that had no relationship to what they were actually being asked to do and had a historic deprivation in their opportunities to prepare for that test. I do think when you look at design thinking, you know, the creation of curb cuts at the sidewalk for me is such a good story because if you use a wheelchair, a curb is a terrible experience to try to get over that curb and into the street. And during the time that the light is changing, it's just nerve wracking. Curb cuts make it possible to slide. It's also great, it turns out, for people pushing strollers and many people with other mobility issues. However, if you are visually impaired and you use a cane, where is the curb? It actually turned out to be very difficult when curb cuts were first introduced into sidewalks. Well, guess what? Design thinking architects came up with a way to have the curb cut over to a side so the person who's visually impaired and using a cane can find where the curb is and the person who is using a wheelchair can go to the right and use the curb. That's design thinking. It's iterative, it requires inclusion, and you're not gonna get it right always, but it can be more inclusive over time rather than, you know, we're just taking turns who's left out. We have time for one more in audience question and we'll move to the Zoom. So Zoom people, prepare your thoughts. Okay. Hello, my name is Kai Machado. I'm a Brazilian lawyer working with machine learning fairness at the Harvard Seas. And we ran into a challenge, which I'd like to share. You asked examples, and maybe you can enlighten me. We're looking at fairness in content moderation algorithms, so algorithms governing online speech. And we detected that there's something we call algorithmic arbitrariness, which is basically the algorithm producing random outcomes. This isn't error, we don't detect it in accuracy, but it's a coin flip. And the only reason we detect that is because we have like the structure of Harvard, we can develop multiple algorithms and compare that. And the challenges I wanted to bring is first, what sort of standard should we bring when we want to detect arbitrariness because we were only able to develop state or close to state of the art models because we had Harvard, right? Which is still almost close to the companies. And a second thing, a second even theoretical challenge is that this randomness does not occur equally throughout society. So we did map that the coin flip occurred more with specific social groups. And I think that poses a challenge of, okay, what is the harm? Is randomness a harm? Anyway, this is where we're at, and I wanted to hear your thoughts. Thank you. Wow, that is so fascinating. Some people think randomness is the best solution to a lot of fairness questions. And one of our colleagues here, Robert Manukin, actually proposed somewhat seriously that when there's a child custody matter, there should be a coin flip because it's more fair than a judge deciding is it the which parent, I think he pulled it back. But it was an interesting thought experiment. Randomness, it's interesting, you're saying that Harvard, because it has compute capacity that's so great, was able to allow running multiple versions so I think that this suggests that the companies that are developing the platforms that are doing the content and developing the content moderation, they should have an obligation to make their compute power available to civil society, to academics, to others who are supposed to be in a position of critiquing and holding them accountable. If the EU AI Act is calling for auditing, I don't know who's gonna have the capacity to do the auditing. So there has to be some way to redistribute some of the resources to make it possible. That's a short answer as to what's fair and finding that there's different, there's randomness for some populations and not others. Well, that already sounds like a problem. Oh, not a chance. Then we will move to our Zoom questions, so. So I think we just have time for one. Machine learning support for decision-making will be needed before we are ready with all things discussed tonight, writing from Stockholm, since the other side will use technology to file, for example, for example, fight parking tickets at a scale we haven't seen before. The courts will be flooded. Oh, I see. For example, Joshua Browder's projects. How can we find a balance between a need of handling a flood of complaints and maintain a rule of law? You wanna comment? I wasn't fully paying attention to the entire question, so I will answer the parts of it that I picked up on, which is that there is an inequality of arms in who gets to use AI systems to contest certain decisions. So the robo lawyer example that was mentioned is interesting because it does democratize in some ways the use of AI systems to get access to the courts. And we know that not everyone has enough financial resources to do that. So there is an element of AI systems that could make it more accessible, but will the quality be the same as a human attorney? I think that's the real question we should be asking ourselves. It's such an important question, both about equality, inequality, inequality of access to resources, but also about legitimacy and the rule of law. The institutions that we know of that are courts, agencies, legislatures, understandably are human scale. What AI offers is something that is way beyond human scale. Just as an example, in the United States, notice and comment is a procedure for ensuring public participation in development of rules in all of the agencies. The development of AI powered comments, flooding the agencies, they do not have the human capacity to read, much less analyze all of these comments. And who has access to that? Well, it tends to be imbalanced. It tends to be corporate power has access and consumer power does not. This is a challenge of a profound nature if the whole point of the notice and comment procedure was to make sure that there's input from the public, but only some people have the ability. And then the government doesn't have the ability to process it all. I think this is just an example of the problems that we now have to face where it's not just equity, it's reliability. Is this actually made up stuff? Is this garbage? Is this coming from another country? We do not have the preparedness for what is already happening. This is why we need everybody who's in this room, who's on the Zoom to be involved in the process of connecting these great possibilities from the digital revolution to the ideals of human societies. So I think if I can just add my voice to the access to justice component of it. It's where I lay my hope that AI algorithmic intelligence will help solve what to me is the major problem today for justice. And that is the denial of access to it by most people. We still do civil justice the way we did in 1906 when Roscoe Pound wrote his article on public dissatisfaction with the civil justice system where he said the public was complaining about it's too adversarial, it's too expensive. Too toxic, consuming. All of those complaints, that was 1906. When people went to his lecture, probably in horse and buggy and doctors were still using leeches and we had child labor, everything in the world has changed except how we resolve legal disputes. And the idea that doctors have experimented with life in order to find better ways to save it and the legal profession has been able to cling to a paradigm that works for it, them, but not for the public for all of these years. No other industry profession is the same as it was in 1906 except how we resolve disputes. So I just throw that out as the challenge to the technological geniuses of the future, figure out how to create access to justice because that's a perfect, we're gonna get flooded and we can't even deal with what we've got, let alone the unknown of AI and algorithms. So a call for us to evolve that all the time we have for today, so to stay in touch about our future events, you can head to cyber.harvard.edu slash get involved. You can also submit questions and comments at cyber.harvard.edu. Now please join me in thanking our guests as well as the fabulous BKC team, including Tom Sick, Ciarondo, Jess Weaver, Rebecca Tavasky, Patrick Goulart Suarez, Chris Pink and Nadia Shahid for the stellar work behind the scenes and finally you, the audience for such engaging questions.  Thank you. Okay.


The Kia Tamata Pi study is a cluster randomized controlled trial that evaluates the effectiveness of an oral language intervention, enrich, and a self-regulation intervention, engage, with early childhood teachers and parents for children's oral language, self-regulation, and academic functioning. The study involves approximately 140 early childhood centres in New Zealand, with children assessed at baseline at age 1.5 years and approximately every nine months to age 5, and academic performance at age 6. Teacher-child interactions will also be videotaped each year in a subset of the centres, and children's brain and behaviour development and parent-child interactions will be assessed every six months to age six years in a subgroup of volunteers. The study has been approved by the University of Otago Human Ethics Committee and will disseminate results in international and national peer-reviewed academic journals and communicate with local, national, and international organisations serving early childhood teachers, parents, and young children. This article was authored by Charles Nelson, Ran Wei, Richie Poulton, and others.


I guess on a personal level, I was working for General Motors years ago and I had my family on vacation. I took my kids to Disney World in Florida and we heard on the radio that there was going to be a shuttle launch. So we looked into it and found out and we went down to the beach and it was like going to a rock concert. Basically those were the days of people having boom boxes and everybody did the countdown on the beach and as it turned out it was the initial maiden voyage of the Challenger. Just a few years later I was working down in Florida, working for Pratt Whitney and unfortunately I did see the demise out the window of the second store building with all my coworkers of the Challenger disaster. I was very remorseful to the whole situation and I guess that's the key thing that keeps me driving in the passion of the shuttle program. I'm getting goosebumps. My first engine test was at Kanoga Park up on the hill at Santa Susana and the shock waves that came off the engine, the power that came off of our engines was so amazing. It just filled me with an excitement that I can't even share with you in words because you have to feel it. And I felt that when I've been at every SSME launch and it's never changed. I think it has a major effect on how you look at the job that you have to do. I'm still filled with excitement and energy and that's what's important here. To support shuttle you have to be energized and you have to be motivated to do that job just the best that you very best you can. One of the things that stand out in my mind when we first ran our fuel pumps, the gases that went through the turbine was exhausted through a orifice that was ignited and put a big flame out the side of the hot gas manifold and then the hydrogen that was pumped went up a stack and they actually had to call Palm Beach International Airport every time we ran and reroute commercial traffic around the area when we were going to do our runs and I was pretty amazed about that, that the heat from the running could go that high to possibly interrupt a commercial flight. A group of us were at KSC and we had the good fortune to visit the Columbia room where they store the recovered artifacts from the Columbia accident. Well, our group was in the VAB waiting on our tour guide to arrive and we were all just kind of standing around talking, laughing and joking around and the mood was very light. When our tour guide arrived and took us to the artifacts room, she opened the door and you could have heard a pin drop. As we saw the displays, it was a very somber, very quiet moment and I think the magnitude of the tragedy really sank in with all of us. I think together we've all done some wonderful, awesome things working main engine and working on the space shuttle program and so we celebrate those things but at the same time we're very mindful of the sacrifices that some extremely courageous people have made throughout the entire history of NASA to get us where we are today and we will always remember and honor that. I think the most memorable time in my career working on SSME was in the early 90s when we had the on-pad aborts that we had. We had actually four of them within the span of two or three years and I had been an engineer at the company for four or five years when those happened so I was just getting my feet wet. During hours and you spend a lot of time, you learn a lot is what I'm trying to say and those experiences working for those aborts when the eyes of the world were on you, that's something that's pretty memorable to me. I came to SSME in around December 2005 so the first launch that I saw working for SSME was in December 2006. My husband and I took vacation and took both of our mothers and a lot of our great nieces and nephews down for the launch so we were out in the causeway and it was a night launch. Oh it was fantastic, it was beautiful and as after the launch and you're watching it you're going to watch it as long as you can and it's so exciting and so then the guy comes over the intercom and says three main engines operating nominal and I'm going whoo whoo whoo and then the launch goes out of sight and my great nephew came up to me and patted me on the shoulder and said good job Anna Lisa and you know to me just fantastic. In the 80s we had a major engine incident and we were supposed to fly nine days later and we literally worked around the clock to make sure that we could clear that engine and we had different failure scenarios that we were working we didn't know exactly what it was but we had to make sure for any of those failure scenarios that were possible that the next flight was not going to experience that same problem so that's one of those fire drill memories that you have. The other memories are just I love working with the folks around here you know just working with true rocket scientists you know people that are experts in their field passionate about what they do really dedicated to keeping astronauts safe we get to talk with astronauts and get to know them so that's just kind of a day to day pleasure to work here and the folks we get to work with. I think one of the saddest memories that I have is when we decided to move engine assembly out of Kanoga Park it was a business decision at that time and it was a good decision to do it because we weren't building that many more engines but one memory we had is we took a picture of it and we were all waving goodbye to the engine as it was the last engine that left the engine line so that's that's one of the sad memories that I had of the engine line but there's tons and tons of other good memories of successful launches and great accolades for everyone that have done good things here at Rockadine so there's a there's a whole archive of good memories across the board. I had a recent experience that I think was really pretty special to me it changed some of my perspective I took a class in ground operations for the shuttle at KSC and of course during this class they're talking about the whole flow from the day of shuttle lands and all the steps that they go through to get it ready to launch again and they have schedules literally down to 15 minute increments during the flow of everything that has to happen to that shuttle and in all of these flows they're just this little tiny part about the SSME and it basically is a little block that says install SSME or remove SSME and I kept thinking wait a minute we're like the most important thing on the orbit or why are they only spending a couple little bars on all these flow charts and after about three days of this I finally figured out you know why we aren't showing up on that because we are always there ready to support our hardware is ready the folks doing the flow at KSC they don't even have to think about the SSME because they know we are going to be there ready to support yeah we're the SSME we're there we're supporting our customer and they don't even have to think about us I remember when I was a little kid probably about 12 years old and I was excited about space program I remember writing a letter to NASA and I didn't I don't know what I wrote but I think it was along the lines of dear NASA please send me stuff and I remember getting an envelope back from them a big old brown envelope and for all I knew at that time it was sent to me by John Glenn himself and I opened it up and it was pictures of the Apollo 8 program and the the decal about circling the moon and circling the earth with the big eight and that's truly why I got excited about the space program I remember the excitement that I felt and admittedly I was probably only 11 or 12 years old but that really had an impact on me and at that point in time I decided hey I want to be part of something bigger and I thought the space program you can't get any bigger than that and that's why I'm here today starting here at the test stands they had the burn stacks you get the burn stacks going first and the flame the hydrogen flame that we shoot into the air 5000 feet a lot of the tests were late at night seemed like you got things done during the day and tested at night that's historically true for anybody but you were so close you could feel the heat and then right before the the start sequence would be enabled the valves would start to creak ice would start to fall and that that sense of what's going to happen next just built and then when the pump lit off the roar the sound it was just incredible it to be so close and so much power at the end of the day when I walk away from the space shuttle main engine program one of their most memorable or rewarding parts of working on the program were the people that they worked with there's not a lot of people in the world that have the opportunity to work on rocket engines and so you become very close I think when you leave SSME or leave or retire you're going to miss the people the most always remember one time I decided to take my wife to a launch and I decided I would just enjoy the launch with my wife and so we were at the viewing area on on the banana river and and I remember that you know I was on the cell phone constantly with the guys in the launch control room asking them for data and they would feed me numbers and ask questions and we went back and forth and and finally the launch went off right on time which was kind of special in those days and I always remember we were sitting in this large grandstand of people and you know everybody was cheering and yelling as the shuttle took off and then when you finally couldn't see it anymore everybody started leaving of course we were sitting there still glued on my cell phone as because the shuttle engines were still firing and and by the time we hit Miko my wife and I were the only ones sitting in a grandstand everybody else was left and was already partying I guess at that time but you know it was always special those missions to hit Miko and the thrill of that was just something special and a lot of us got together and it was my first time actually going to Stennis I'd never been to Stennis before I've seen pictures of the test stands and whatnot but I'd never been on top of them I decided I was going to make a little paper airplane just to see how it was stand up to flying off the top of the test stand I really didn't tell anybody that I was doing it so who knows I probably could have gotten a little bit of trouble doing that but when I first got up there I was probably like anybody else I was a little scared because it's a little high up there when nobody was looking and I turned to the side went over there walking like I was looking at the trees and trying to see what else was out there I threw it and needless to say because of the wind and everything that paper airplane didn't fare so well that's my little special story dealing with SSM. The controller software lab used to be in Canoga Park California building four and in 1994 there was a decision to bring the lab closer to the Marshall Space Flight Center customer and there were a number of of us working in the Huntsville that were integrated with the Canoga Park team to facilitate that move. A crew of three of us and Kevin and Bob and myself we moved the lab from Canoga Park over here we spent a lot of days underneath the floor I remember a funny story because Bob that we sent him underneath the floor and he would disappear the only thing we could see was his feet and then Kevin and I when he needed to get out we would pull him out by his feet out of the floor spent four days underneath a raised floor with about one foot of clearance you know I go underneath there at eight o'clock and come out for lunch and dive back in there again pulling cables you know all kinds of stuff we found underneath there and packing it up and sending it to Huntsville. A lot of hard work went into that move and you know we worked hard but we had a good time doing it and I think we did it very well and that makes me proud. I think the most fulfilling piece was watching the first fuel pump fly I mean but the lockspump was exciting too but I went up to launch for the for the first fuel pump is STS-104 I believe was and it was a 5 a.m. launch so we all went up the night before and we were lucky enough to take a family member with us and I brought my son who was five years old at the time and we stayed up all night and five o'clock in the morning is awfully early for a five-year-old but he saw the shuttle launch it lit up the sky and he said dad that it looks like it's morning time and then the shuttle left it was dark again but he was very excited seeing that launch and that really gave me a lot of pride not only in what I do but for my family too. One of our jobs here with the project support group is to transfer files back and forth when the NASA customer needs data whatever since we aren't compliant back and forth through our servers we serve as that conduit so Kenoga Park will put or West Palm whichever will put their charts in flight ops which is a server that the SSME team uses myself I have a folder it's called Marcy and over the years that server has been set out there for years and all of our guys that I work with with the different product teams you know they know that that's where they're supposed to put the files so at Kenoga we were sitting out there one day when I was visiting with a big group of turbo machinery people and a new guy came up that I had never seen before and he has this amazed look on his face like wait a minute Marcy as in the Marcy folder he said I thought that was not a real person he said I just thought that was a folder I had no idea there was somebody who actually took care of that that that was your folder I think the strangest thing I've ever had to do on the program was actually non concur with the change that I wrote and the way that came down was when I was at the Cape the engineers up here called me and told me that we had got an action from the program to change a requirement well I immediately knew that whoever gave us the action did not even understand the test so I told them that we can't do it we can't complete that action so I told them I would call back to the CM guy back in Houston and telling that that action wasn't when it needs to be withdrawn because it wasn't appropriate so I called the JSC guy and he said they don't have a mechanism for withdrawing actions and so he said my only option was to submit the change and if I didn't agree with it non concur which I did I wrote the change and it went through the change process then I wrote a non concur to the change that I wrote it went to the board and was rejected because we didn't concur with it and that closed the action and caused this twitch the shuttle is hugely important to the space program the space program is one of America's crown jewels and the shuttle is the centerpiece of it two things really stick out in my mind that that I just absolutely love number one is seeing a launch that's a very very moving experience and until you have experience that you can't really describe it there's nothing really that prepares you for that experience the other thing is in my family we like to look on the website for when the space station is going to pass over again and I take my kids outside and we look at the space station go by and to see the brightest star in the night sky cross over and you can tell your children that the people that you worked with helped put it there that's quite special very very gratifying in october I was at a suppliers it was one of his open house events and I think it was a 20 year celebration and it was the first time I was getting the opportunity to go and be with an astronaut and the astronaut was Robert Hoot Gibson and I remember it very well because I when I showed up I had a lot of anticipation and being able to meet him talk to him get to know him and I remember that when I was introduced we had a quick little conversation and then he said well I'll get back to you and talk to you later well later never came because of the fact that we were so busy with the events and everything so after everything was over I went back to the hotel and I thought jeez I would have loved to have talked to him and shortly thereafter the phone rang and I picked it up and he said Lee and I said yeah he said this is Hoot, Hoot Gibson he says how about meeting me downstairs in the lounge and let's have a couple beers and I thought kind what a great thing to have happen he showed me he's a real person he was talking about his family his goals in life what he wanted and I think from that I took the fact that this is really for the astronauts and we need to be very much aware of bringing them back safely for their families


Yeah. I'm the one. I'm the one. I'll win. So, most chess and football together. And then a little bit of magic. Yeah. See how I'm going to do it. Um, perfect. Perfect. I'm all up on that. Good other guy there. Yeah, they're two. Okay. Yeah, I'm gonna go difference. Uh-huh. Yes. Yes. Yes. Yes. Yes. Yes. Okay? Yeah. Okay.