Hi everyone. I hope you had great lunch. My name is Vaniefti Mover-Bellinger and I'm your moderator and MC for the afternoon session on women, peace and security and curriculum development. I'm a member of the strategy and policy department here at the Naval War College. We will start with Dr. Joan Johnson-Freeze, who is currently lecturing at Harvard Extension School, but until recently taught here at the Naval War College. As a reminder, you can find the presenters full biographies in the virtual program accessible through the posted QR codes, that thing. And they're all fantastic presenters, so I encourage you to do this. The presentations will last about 20 minutes after each. After each I will open the floor for questions. So Dr. Johnson-Freeze. Well, thank you, Vania. Thank you to the Naval War College for inviting me back. It's nice to see my former colleagues here and to have the opportunity to talk about women, peace and security, teaching women, peace and security. And this is going to be done based on eight years of teaching two classes a year through Harvard Extension and summer schools under a full in-person format through a full zoom format through a hybrid in-person and zoom format. And then variations of the course curriculum in different venues, including security cooperation, two-week courses, three-day courses, one-hour drinking through a fire hose type courses, and a variety of others. So what I'm going to give you is kind of what I've learned, best practices, what works, what really doesn't work, and challenges. I only have about six or seven slides, but they're kind of dense, so I'll try and go through them quickly. I have three learning objectives in the course and I use them according to how much time I have. If I have an hour or three hours, I try and get through number one, just understanding the relevance of gender equality to international relations and global security. And as we heard this morning in the polling that was done, there are some skeptics. There are those who just, it's a hurdle to get past that. And one of the key elements of getting past that we have found repeatedly is data, data, data. And very often it's data that's very difficult to get. So it's like, for many years in teaching PME, I would say, well, how do we show the value of PME? Well, that's a tough question to answer. So metrics, everybody wants metrics to show the value. But again, it's a problem. One of the things we can do, and I stress over and over in the course, is whenever there's an opportunity to get gender aggregated, disaggregated data, get it. If I have more time, I try to get to a working knowledge of the needs for primary components of and implementation challenges of the WPS framework. I call it a framework. Most people call it an agenda because I've had too many people say agenda. So there's something hidden in it. What are you trying to do? It's nothing nefarious. It's just, again, we had a presentation this morning, language matters. So I just take agenda out to make it easier. And third, and this is, I think, the one that is actually very critical for military students is being able to generate gender and foreign policies and crises response. But that takes time. It's nothing you can do in an hour. It's nothing you can do in three hours. And it's certainly nothing you can do online on your computer while you're actually doing something else. And that challenges the title. The course I teach is called Women, Peace and Security, and inherently people think it's a gender studies course. I jump on soapboxes saying this is a government course. It's an international relations course. It's a security course. But until very recently, the component, the class component was 90, 90% women, 10% men. That's jumped a little bit recently. We're up to about 30%. But that's, I think, largely because it is perceived as a gender studies course. There are courses, by the way, international relations through a feminist lens. Some universities will offer those. Too often they are through gender studies programs, which further makes it difficult to see these connections. There is friction and resistance. Friction, of course, happens when something new is introduced and can usually be addressed through structural adjustments. Resistance is just, I don't buy it. And that's hard to get over. And again, data seems to be where we're at. I had a student recently say, you know, I resent it that we have to show data to show the importance of gender. And I said, I feel your pain, but that's where we are. So we need to, we need to get over that and just do it. Performative allyship. We hear there's a huge gap between policies, talk and action. There's a big gap between policies, talk and budget. If you believe that people prioritize, if you could look at a budget and see what people prioritize. Well, the women peace and security budget is still in the realm of what I consider coffee money from the Pentagon. WPS is seen as a nice thing to do, but not imperative. So the good thing is, I have found from students over eight years and countless different, different venues. Once you can see the connection between gender and stability, you can't unsee it. And once you get there. It's no longer just a nice thing to do. It's imperative. I said, usually I start up to audiences when I'm trying to convince them of this by saying something to the effect of in Afghanistan where men pay bride prices to basically buy their, their bride. It was found after a considerable amount of time that when bride prices went up. Taliban recruiting went up as well. They were able to recruit. That means paying attention to gender can tell you something about what's going on in the country. It's not just a nice thing to do. It adds to the potential for your strategy success. And forgotten in favor of real politic. And I think I'm going to come to in just a minute, something that I've recently come across that I think addresses that. So this is the outline of my course. It covers the topics we go through. I would argue that the first three are essential. I could do that, or I have done that in three to five hours. The first five allow you to really have a working knowledge of women, peace and security. This morning I heard lots of concepts being said that unless you understand them. There are meaninglessness. Intersectionality, even gender, you need to understand the concepts before the details can really be gone into in any meaningful way. It also covers the three pillars. It gets into how are they relevant in areas like China. I forgot to put on the sign, but as part of number two, dealing with masculinities. Absolutely essential. Once we get through the first five, then we can go into specifics, showing examples, but without that contextual knowledge, you are still dealing with issues as ad hoc separate events. As you'll notice, I don't get to women in the military until nine, and that's because I want the students to understand the context of what they're talking about. Otherwise, you're talking about things like physical requirements. And that's not really a women, peace and security talk per se. It's an element within just as DEI is. So this is what we go through. We do have a tabletop exercise that is critical. We've run it only twice. Once is a beta test and once in the class. For the beta test, one thing we found was we ran it into two parts. The first was to have an environmental crisis and divide students into groups to deal with it and they did very well. And then we inserted an element of hard security. We had terrorist attack and nuclear power plant. And what we found all the gender stuff went right out the window. And that has raised some questions to me that I've been exploring and with my military students because I don't have a military background and we've come up with or they've come up with some interesting considerations that I'll get to in a minute. The second time we ran it with the students. It one of the most interesting things was and I have two people who are in my currently in my class here so if you want to hear the student perspective they can speak to them was after about 10 minutes. One of the military students in the room said, can we talk to each other. And the answer was, yes, we expect that and once that got going. That's why we ran out of time. They were all talking to each other so much it got great. There's a lot of material, there's a ton of it, and I certainly don't expect anybody to even be able to read those but it is available. The problem that I found immediately when I started teaching this course, they are all excellent most of them are edited volumes without context. They aren't as effective as they need to be. So, I wrote a textbook I wrote women peace and security 101. And that's what I use as the primary text in the class. And I'm very pleased and honored to say that it's been so successfully used that I've been asked to do a second edition and the second edition will be out in January of 24. And it's much better because I learned so much from the students that I work with and others. This is a huge field. And people specialize. One of the things I'm very pleased to hear that the Naval War College is making their, the book that will come out of this available online. The bottom bullet there is women on the frontiers of peace and security. It's from NDU press in 2014. And it's really good for page articles from practitioners that it's available and students can read it. And we need more of that, but we also need context. I have my students read both books by Valerie Hudson, six and world peace and the Hillary arts. No, I have them read the first political order and and the Hillary doctrine. But without context, again, they aren't as meaningful as they really could be. I also use a variety of movies. And I highly this is just a sample. And these movies, most of them are by fork films on organization Abigail Disney is behind and I had a student tell me that the first night she was going to watch a movie. Her husband was sitting there and she said, well, I'm going to watch this movie. I hope it won't bother you. And he said, no, no, I'll read. And the next day he said, so when are we having movie night again. They're very enjoyable and educationally useful films. I also do guest speakers, but I'm really fussy about my guest speakers. I've been very fortunate. Mary Beth Leonard and Greta Hulse, the Chancellor of Ndu have been excellent as women ambassadors who can talk about women in foreign policy and they will talk candidly. David Smith, of course, who has written about the importance of men mentoring women and of allyship has talked to the class Stephanie Foster who's been with State Department. This semester in class, I had a panel of mostly gen ads, women gen ads talking and it was great. It was really very impressive. I got really smart last night at the reception have already committed Jane Stokes to teach to my summer class to lecture to my summer class. This is Catherine Lucy, the founder of solar sisters who talks about women in development and the importance of franchising for bringing up economics which allows me to bring in the importance between gender economic or gender development economics and stability. And just as an example of kind of the creativity and the, and how the students get involved. The top figures woman named Hanifa Nakayama. She is an acid throwing survivor from Uganda. She speaks to my class, every session. And one of the students a French woman who's an interpreter at the food and agriculture organization did an entire series of chalk artwork, which she now has as part of a book talking about issues regarding gender violence. So there's many different ways that again, this can the problem can be addressed. Best practices and to do. I'm going to start with the upper the graph in the upper corner, probably about, I don't know, six, seven, eight years ago, Admiral Harley, then President Naval War College, asked me to go through the curriculum of the three core departments and count how many of them were by women or co authored by women. And there was a great variation between the departments one department is I remember it had about 2% the other one had about 5% and one had about 7%. Nothing ever heard of that again, it kind of went away, but this year, one of the students in my in my women peace and security class, who's here, John is here, did the same thing he repeated it. At the joint forces staff college and came out with pretty much, not much different. I did two data points and two institutions, but I think it would do everybody all institutions in PME be a good thing to do to just look and see how many of your readings are at least have a co author a woman as a co author. If you don't have women in your curriculum, it sends a message. It says they are not involved. So what works ground students in the basics and this is where it can't just be online training. It can't be one lecture. It can't be disparate training. It has to be. It has to be a certain amount of education of the basics. We have to move beyond. Well, when the peace and security, it's really only relevant for coin, we're in, we're in great power competition now. No, we have to just get past that it is relevant across the board in many different ways. Stories movies are speakers work group exercises work tabletop exercises. One of my current students is here and said, I want to do that tabletop again. I'm just figuring out what I was doing. Now I want to do it now that I know what I'm doing. I want to do it again to do. Okay, this is my wish list. We've heard a lot about what's going on at different organizations Marine University is doing this need for war college is doing that. It could be a great service to everybody to have a primer on women, peace and security that doesn't say how to teach it. But what needs to be included. Just, are you talking about these various elements so that we're not, we're not all doing it differently. I don't think we should include more readings by women. Here's the here's the one that's going to kind of probably get me booed off the stage. Integrating mainstreaming women peace and security is about leadership. But it's also about middle managers because they're the gatekeepers that keep women from getting into higher positions. And it's really the ground level people who are the future leaders.  Nobody likes to teach what they don't understand. You asked me to teach fundamentals of flying a helicopter, and believe me, I am going to gloss over it as quickly as possible. If you ask somebody who has no knowledge whatsoever of women, peace and security to please integrate it into their curriculum. The same thing is going to happen. Military institutions project themselves as professional institutions more like a business school or a law school, not not a liberal arts institution well accountants lawyers doctors, they all have to have continuing education. I had my way, I would require all PME faculty to take a 12 hour course in women, peace and security. That is the only way it's going to ever really be mainstreamed into PME for the teachers to understand it. I would encourage those who are experts in the field to co author with others. It's a good way to learn about it. I think it's important to network this is what this this event is all about and I've had great conversations with people and I hope to have more, because we need to to make this more than a side thing. We need to have it grow tentacles that that go into all aspects of the organization. And as was pointed out this morning, do the state USA ID and DHS are the lead implementers in the United States. Well, this is one of the bumper stickers for the for my course, you can't implement what you don't know about. And my first question to all the audiences I speak to is how many people in the room feel they have a working knowledge of women, peace and security. And it doesn't matter if it's room of 10 people, 100 people or 500 people and it doesn't matter if it's a military institution, a college, whether it's in Addis Ababa, Japan or Reading, Pennsylvania. It's consistently 10% of the audience. So if you don't know about it, you can't implement it, and you are in charge of implementation. I think, yes, that's my 20 minutes, I will be looking forward to questions we're going to take. All right, everyone. Our next presenters are Dr. Susan, you should have joining us virtually, and Dr. Grace Hoffman who is here with us. Dr. you should have and Dr. Hoffman from the American console on women, peace and security at a think tank, advancing liberty opportunity and human dignity for women and girls worldwide. Good afternoon, everyone. Thank you, Vanya. Hi, I'm Grace Hoffman and I'm joined here by my colleague, Dr. Susan Yes, there she is on screen. We're here from the American Council on women, peace and security and I'm going to pass it over to Dr. Yes, to get us started. Thanks Grace. Great to be back in Pringle. Great to see some former colleagues want to first of all thank my friend. I will show chat field for her leadership during her tenure here she's off to great things in Europe. But she certainly is a great supporter and I'm sure that this venue has benefited from it. Also want to thank siree amin who's taken on the 20 hunt chair, and from all accounts just looking at the lineup and what we've seen so far this is just a terrific event. Thank you to my co-panelist and former colleague Joan Johnson freeze, and of course our esteemed moderator by yes so it's great to be here. And American Council on women, peace and security is a relatively new think tank started at about four years ago, and it grew out of policy development, really the need to have in Washington a policy development team that could do both the academic research side, and also really bring Congress and the administration together, who had a deep experience at the UN, doing the international WPS work and have to say it's. I guess I got my start in 2000 when I was up in Boston working on a PhD and was over at the Harvard Kennedy School and Swanee hunt had started the women waging piece and I, I think we've come so far from there so it's great. To see how this is integrated into PME. You can see my screen. So let me just see if I can advance this. And while I'm doing that I'm going to let Grace Hoffman introduce herself. She's part of the ACW PS team that we've put together. And this, this team of advisors has done four things really in the last few years and one of them is curriculum development and part of what we do is mentoring young talent coming up. And so we bring in folks from think tanks that are national security oriented, and basically bring them on board with WPS so they can be, you know, the next generation of advisors. Shortly after we were founded I got a call from country intelligence group that had worked with Defense Security Cooperation University for many years on their certification program. If you don't know security cooperation, it fluctuates between 15,000 to 20,000 personnel we've just started our first civilian run security cooperation office up in Ottawa. And we are under the leadership of Dr. Celeste vintner at the university who is really bringing us up into certification as a graduate school. It formally did a lot of training so we are at the intersection of training certification and graduate education it's an exciting place to be. And when they decided to take on WPS I got a call to bring in a team and design that curriculum and so what we're going to do today is to show you how we went into a training and PME institution, looked at what their unique needs were and tailored our approach to them. So it was during COVID 2020 got the call in February 2020 I think we started in August of 2020. So the first thing we did was create micro lessons online and this was because much of the security cooperation workforce is out on the pointy end scows are inside embassies all over the world so they're integrated into the country teams, and, and they do need to keep up on certification so we created micro lessons so that we could immediately get them a WPS 101 and a gender analysis 101 for their certification. That's the first thing we did and the second thing we did is integrated mainstream it into the curriculum. So now in the third phase of this contract and I am working on a graduate elective it's going to be a three hour graduate elective 14 week elective so it's great to be here and great to get ideas from everybody who's teaching. So we integrated the first thing we did was look at the setup of the school now here at naval war college you guys have three different areas and three trimesters we have a core course for scows scows those officers who go to that security of operational organization and the embassy are the main the heart sort of of what we do. They work very closely with the country team with the country and with the combatant command. So we integrated WPS into that six week flag course first we had about three hours, including a tabletop exercise and we tried a couple different ways we started at the very beginning of the course so that they could mainstream WPS throughout. And now we're more in the middle when we're working on capacity building so we're still working this out and finding the best place for it. The first course was really important because really the movement in DoD is to get WPS into planning it should be in the planning staffs at the at the major staffs major commands. It should be in that theater planning it should be in campaign planning contingency planning all kinds of planning and so I'll let Grace talk about how she did that but really we took the planners course and integrated it in there. The MOTAs are now called they're not called MOTAs anymore we still refer them as MOTAs. Those defense advisors have been embedded there's a civilian advisors, we took a little bit of a different approach there and we brought in panels who had been MOTAs because this is kind of an elite group of advisors and so we thought the best approach was to bring in people who had been there and done that, and who could also talk about WPS believe me this is a very niche field but we've had some fantastic people had some good results there. International partners. We worked a lot with Congress. I've worked with Congress on the law in 2017 and then worked again on the strategy and implementation plans. But Congress if you look at the NDAA is very much interested in measuring what we are doing with international partners that's the part that's mandated for reporting every year. So we looked closely at this international partner course and one of the main things is the basis of their mandate is very different from ours right ours is the law. Everything we do is the touchstone goes back to the law and there was a lot to the left of the law, you know there was the international UN Security Council resolution. There's a lot of international law, some of which the United States is not party to. So we really look at the law as the foundation and what flows from the law. So for international partners it's different. So we're very careful with international partners, who's going to be in the room, what country, what treaties have they signed, did they make reservations to those treaties. I mean a lot of work goes into teaching of course to international partners to be respectful of what their mandate is, because we're not imposing the mandate. So first we also want to make sure that they understand that this mandate came from countries like Rwanda and Bosnia and countries that had experienced conflict and really demanded a seat at the table if you will and the Security Council gave it. The other piece of what we did is injected WPS into advising by creating scoping tools. So the Defense Institute of Legal Studies here in Newport where you are. I'm actually in LA, but you're in Newport. They advise nations on things like laws of armed conflict, op law, operational law, human rights law, they have to vet them, do lehi vetting if we sell arms to them, which is part of security cooperation. So we integrated it two ways, a set of scoping tools that we could pilot in six countries, and then also going through all of their resident courses to inject WPS where necessary and WPS doesn't belong everywhere. I mean some places it goes neatly and nicely, but let's face it if it's everywhere, you know, so what right so it has to be very relevant and and so we really looked closely at a few of those and grace can tell you more about that in the Q&A. And lastly, we do have doctrine. This is a joint publication on WPS from published last September. And I recommend it as your go to source if you've never done WPS before pull up this joint pub and it's, it's got a nice neat set of tools for you it's got relevance for you. It's got why women in the military so the gender integration piece it's got the security cooperation piece, the planning piece. And so I recommend that. So, when we were looking at this joint pub to tailor to security cooperation of course you have to do that in a certain way so we just took a few. So let's, let's look at this piece which is equities, we just pick a few equities like civilian harm mitigation protection of children and countering and traffic in persons. And you realize, how do you do that without women in the security sector, and that moves you into a set of capabilities like professionalization, gender integration, recruitment and retention. And then how do you recruit and retain women if, to the left of that you don't have some way to keep them safe right in countries that might have issues with sexual harassment and abuse so by looking first at that and state or outcomes and then looking at those capabilities or those outputs. That is a way to frame it in some of the classes that we're teaching from there let me turn it back over to Grace Hoffman. Great thank you Susan. So I'm going to speak a little bit about how we analyze curriculum and I'll touch on the hallmarks of our integration the things that we always try to hit when we're working on these courses. So one of the big things is, of course, as coming in as WPS subject matter experts. It's really important when we're working with faculty and their courses that we develop a really close working relationship with the faculty. And of course, there's many reasons for that one of one way that we do that is in many of the courses that we're coming in as means. We come in as students first and we take the course, the whole course if it's possible, so that we can understand both the student experience and also everything that the faculty has to communicate. So what are they on just WPS what are their overarching goals and how can we insert WPS and help the faculty to understand why WPS is relevant to their those topics that they're touching on. Another thing that we try to do when we're developing those relationships the reason is because we found that really at the end of the day, the faculty who own the courses are going to be the best educators of WPS in those courses. What Joan was saying before about having training and understanding WPS as faculty. Once that's done, we found that the faculty they're the ones who are experts in those topics that they're talking about, and they're able to bring WPS and ask really in depth questions that a WPS me can't go as deep into, you know a question about cybersecurity at the surface but once we've talked with and develop those relationships and that understanding of WPS, the faculty can really hit the ground running and go even beyond what a WPS me can do. And then also I think that when the faculty is engaged in WPS. It also gives a lot of weight and validity to WPS for the students are in the room. Of course, we bring in guest speakers which are great, bringing in a WPS me can be a great way to integrate or begin to integrate WPS into the course. But if the faculty themselves the instructors who are there every day, teaching every other class are not touching on WPS. Or if they do touch on WPS it really hits home a lot stronger for those students, because they understand that the instructor sees the relevance of WPS to everything that they're talking about in the course. Other hallmarks that we focus on is we do try to stay aligned with us law for our students. But pairing that with an understanding of the international framework and what the international community is doing, as well as the differences and similarities between partners that every partner has a different way of implementing it. And that helps students to understand all the different perspectives of WPS and also helps them to work closely with the international community and partners. First important things like all of you will know here at the Naval War College high centers of scholarship, being open to academic debates, and also presenting different theories and perspectives that really underpin WPS is something that we always try to do and also interactive pedagogy. Of course, Joan spoke about this in her course she brings in tabletop exercises. So if we don't have exercises that aren't WPS focused. We also try to incorporate WPS into those tabletop exercises. And so I'm going to pass it back to Susan who's going to speak a little bit more recommendations specifically for the faculty here. Great grace. We really do think we were given a mandate actually when we got to DSU to get we have when you have a contract, you have to get in and get out and deliver products. And so we were instructed to make sure that we were turning over our product or deliverables to the faculty, so that they could continue it. And I think that's a great market way of doing something that's what OSD wanted us to do that's how they funded the contract which meant we had to create faculty. We had to intensely train faculty, but it took a while I have to say a couple of years we did a really terrific 90 minute offsite on WPS and had fantastic results is a lot of buy in and I think it shows how much we've learned about security and communication as much as they've learned about WPS. And yet it's still something where, if you're not an expert you don't feel comfortable so it's a true partnership. It really is a true partnership it's a weaning period if you will it's not going to happen overnight. But that's why also, it's important to leverage it, what you know, look, I joined the navy in 1982, I've been doing WPS for I only want to know how many years I could probably do that in my head but I was an English major, but I've been doing WPS since before WPS right. And yet, you know, I am not a specialist in the Middle East, for example, and so if you asked me to speak to there I'd have to bring someone else in. That's perfectly okay. Looking at JMO and national security affairs I taught in the national security affairs department for a few years. My husband taught that strategy and policy for 10 years. And just looking at the different ways that in different objectives of each of your departments it's easy to see that an integration approach works would work beautifully especially in your exercises. So this is a target rich conference for JMO. I mean if you didn't go to the first panel influence I recommend looking at it online. Again my background is in developing law and policy working on legislation hammering out going into the late night, you know, pitched battles over inches of text so when you talk about how you design and implement policy. That's sort of our sweet spot at the American Council and how decisions are made and how that affects and then how you get back into the do loop and refine it. I think your faculty is so expert that it would be a great contribution to WPS to get JMO and NSA faculty to become more expert at it conversant as john said conversant at it. And this goes to my faculty and students that it's really going to be they who have gone through it gone out to the point in for three years in a scope and then come back, who are going to be improving WPS for the next generation, it really is an iterative value added. So I'll turn it back over to grace. So I think the next slide when you get it. Yep. So I'm going to talk about WPS and historical cases I know that there are some historians in the room and that some courses here deal specifically with historical cases. The reason I wanted to talk about this is I'm a historian I come, I received my PhD in history from Trinity College Dublin, where I studied rebellion and conflict in an Irish and British Empire context. So I came from that context and then jumped into the WPS world. And so just to speak to the historians in the room the skills that we have as historians really allow you to learn WPS I know sometimes we talk about the complexities and nuances of WPS. But of course you all know that history has many nuances and complex complexities as well. So what I wanted to kind of focus on is that WPS can benefit our historical cases and our understandings of historical cases, and also history can really benefit WPS. So as historians, of course, we're always after new knowledge, we want to understand historical cases, we want to ask new questions on new questions always lead to new knowledge and new ways of thinking about historical case. So when you're engaging with WPS and bringing it to courses with historical cases. Think of it from the perspective that this is really going to help you to get at that new knowledge that we're always seeking as historians. And that really is just looking at WPS understanding it having a understanding of what WPS is, and then forming questions yourselves. I'm bringing that to those historical cases and I think that's been an encouraging thought for me, as I try to see how WPS and history can relate to one another in my own research. And that WPS really opens a new area of questions that maybe we just weren't thinking of when looking at a historical case. On the other side, of course, history can really benefit WPS. Of course, history and historians have very robust academic rigorous academic skills, really focused on clear sources and evidence and they're also really aware of nuances that sometimes discipline other disciplines make broad claims, and historians are the ones that come into the room and go up it wasn't the case in this specific instance that we can find evidence for. There's also a way of putting this into perspective. WPS, while it's new in the way that we understand it came in 2000 at the UN Security Council, the US has a law in 2017. The concepts and principles of WPS are not new and they're not novel, and we can find evidence of this going back centuries. I think historians can, if they start to engage with WPS, it's going to really make WPS more robust and also understanding that that this isn't new and that's a good thing, because we can really learn. There's much more to learn from than just contemporary modern examples. The example of that really is a historical case that I've been looking at in post World War Two Japan during the Allied occupation that was led by General Douglas MacArthur and writing a chapter that's going to be part of an edited volume coming out in a little bit. What I found is that these WPS principles as we understand them today and as they wouldn't have talked about it of course in 1950 Japan, but they were present and General MacArthur actually recognize this in some capacity of course we can get into the nuances later if we want to get into Q&A about this. But MacArthur from the very beginning when he was going into Japan and wanted to establish a free democracy and form a strong alliance, which today we know is one of if not the strongest alliance with the United States. One of the first things he wrote down was that women need to be given the right to vote, and they need to be enfranchised in the Constitution. I think that's really helpful for us looking at a case like that because MacArthur was a strategist, he wasn't a WPS person by any means. And so we can look at a historical case and see that WPS was recognized as a strategic advantage, not just as something that we feel like we have to do because it's a good thing. I'll stop there for now. I just put up a few other topics that I think lend themselves easy easily to being having WPS included in them so if any of your historical cases might touch on this. Of course this isn't an extensive list but just to get your brains thinking, and I will leave it there and thank you all so much and pass it to Susan for closing remarks. So I'll commend Grace for being our historian on this book project that I'm leading its, it really does look its heterodox in its approach on theory because really there is no one theory that underpins WPS, you know as you said, at Neighbor War College you look at different theories that underpin foreign policy. But when you are, you know, advising policymakers and trying to translate a theory into an idea of change and foreign policy, really do have to connect it to to national security priorities. And what we're doing it in this project, this research project, is tying it to not theory but to principles. Principles of American foreign policy, like a strong military as the foundation of statecraft, like liberty as one of the chief values that United States has always promoted liberty and equality of opportunity, for example. WPS gives us as a research idea, a niche way to test democracy promotion in great power competition, right. Certainly there are volumes coming out about ideas in great power competition, certainly with China we have an exploited ideas. They certainly do exploit ideas right so. But WPS offers that kind of rich case study and case studies which this volume has on how those values can work one way or another. And when you look at security cooperation. Look, as John said, it's peanuts it's budget dust when you look at $6 million for WPS activities and FY 22, that doesn't seem like much, but a $300,000 WPS activity in a nation where you're spending billions on foreign military sales can make a difference. And one of the things we do in security cooperation is am any or the measuring and evaluation piece of it. Which again is something that we're developing but in WPS. We asked the question, what would happen to this activity, whether it's border control or F 16s to do whatever whatever whatever your activity is, what would happen to that major activity. If you didn't do gender. If you did not look at women at all if you did look at the gender issue. What would the risk be to that larger activity and I think that's one way of looking at the value of WPS and a very small way. And yet, that's the beauty of teaching and PME. Right. This is not theory, right. We have to make it relevant, but at the same time that relevance adds value right back into WPS. So it's just been a real pleasure. It's been a pleasure working in this space and being part of the WPS community and we're looking forward to your questions.


The Screen Directors Playhouse sends its heartiest congratulations to Radio Station WTIC in Hartford, Connecticut. Tonight, celebrating its 25th anniversary. Here in radio, first in recorded music, first in television, proudly presents... The Screen Directors Playhouse, star Rosalind Russell, production, this thing called love, director Alexander Hall. Hollywood Screen Directors present something to laugh about. Tonight, for the first time on the air, the motion picture comedy, this thing called love. Starring Rosalind Russell in her original role of Anne. Rise, Collins, aboard the SS Cruciategna in route to Rio de Janeiro and New York. To Mrs. Anne Collins, statistics department, amalgamated insurance company. Darling, stop calling yourself a kissless bride. Stop. Women who marry mining engineers in Rio shouldn't sail from New York the same day. Stop. I love you. Stop. Coming home, stop. Put the soup on. Signed Tice Collins. From Mrs. Anne Collins to Tice Collins, SS Cruciategna. Engineers who marry business girls in Rio shouldn't go hunting Peruvian gold mines for three months. Stop. Did you say you loved me? Don't stop. Welcome home. The soup is simmering, signed Anne Collins. Darling, docking in two hours. Stop. Missed you in the jungle. Stop. You're much cuter than most crocodiles. Stop. Keep an eye on the soup. Love, Tice. Oh, good morning, Gordon. Isn't he wonderful? Listen to the way he signs this telegram. Love, Tice. Very original. Oh, he wants me to keep my eye on the soup. And do your old boss a favor. Let's get back to business. Business? Remember the amalgamated insurance company? You're supposed to be the head of my statistics department. Oh, and Gordon Daniels, I have a plan that may well revolutionize your entire business. You mean I can make more money? Exactly, Gordon. Do you realize that we've had hundreds of thousands of dollars worth of insurance canceled because of divorces? Sure, but what can we do about it? I'm getting to that. Do you realize that according to my statistics, most of these tragedies occurred because there was no practical plan for marriage? Yes, yes. Well, I have provided that plan. The entire thing is outlined in this pamphlet that I have just had published. Now, what do you think of the title? A sociological, psychological and statistical approach to marriage as an institution, subordinating the emotional to the intellectual relationship by Ann Collins? I'm overwhelmed. Well, of course there is a shorter title. What? Look before you leap.  You go to Rio for five days and come back married. Ann, how does this plan of yours work? It's very simple. Every marriage should begin with a four month trial period that will eliminate the usual emotional hazards. The husband and wife will have separate rooms, separate lives and, well, their relationship will be purely platonic. Talk? Nothing but talk. Just because you wrote all this down in the pamphlet, it doesn't mean it's going to work. Gordon, let me tell you something. I am going to prove that it does work. How? Tice and I are going to test my planned marriage theory ourselves. Oh, no, he can't be that dumb. Not after three months in the jungle. Tice is an intelligent person. And he agreed to this? Well, not exactly. I haven't told him yet. Oh, I'll have to hurry if I'm going to meet that boat. The ship is about to dock, Senior Collins. Senior Diastro, do you know what it means to come home to a bride after three months in the jungle? Senior Collins, do you know how many children I have? Ten.  Oh, I'm sorry. You're sorry. The marriage with that baby, Senior Collins, is nothing, nothing. Right. It's like an undeveloped gold mine. Now, about those Peruvian ore deposits I own, we were discussing alone, Senior Diastro. I apologize, Senior Collins, but have you seen my little ones? Your children? Well, Silvio and Juanita are in the cabin, and Mario and Pablo are with your wife. And where is she? Well, she's looking for Pedro, Rosa, Rita, Nina, and Sam. What about Francisco? Well, I saw him crawling out of a porthole in the Gulf of Mexico. No, I remember. He is with Mama, and they are so excited about a vacation in New York. About the loans, Senior Diastro. You're the wealthiest man in Peru, and I thought... With ten children, Senior Collins, I have to be the wealthiest man in Peru. Yes, yes. Well, my lawyer will meet us at the dock, and perhaps we can discuss the loan. Julio? Julio? Coming, Mama. Apologize, Senior Collins, but I must go cut my little ones. I will talk to your lawyer. Tell Mrs. Diastro they're letting down the gangway. And Mrs. Collins... Well, I suppose I should ask you what's new in Peru. I'll kiss now, ask later. Oh, tights, darling. Now, don't look now, dear, but just behind your shoulder... Yes, dear? There's a blonde drooling at you. What? Oh, Charlotte, Charlotte, honey. Hey, lover. Got a kind word for your legal eagle? Charlotte, honey, this is my wife, Anne, honey. This is Charlotte, honey, my lawyer. Hello, Charlotte, honey.  Oh, no, no, no. Charlotte, no. Break it up, break it up, mouthpiece. You said cement, not reinforced concrete. Welcome home, Ty. Charlotte, why don't you find Senior Diastro and see that his family gets settled? They have 10 children. You can talk business. With 10 children, I'll be scared to talk about anything else but business. I'll see you later. Ty, who is Senior Diastro? Oh, he's the man who's going to finance my gold mine. What with? Baby bombs? Come on, Anne, I can hardly wait to get home. Darling, there's something I want to tell you first about us and our marriage. Oh, is it a surprise? No, a shock. Oh, but I guess it can wait till we get home. This is where we're going to live. How do you like it? Oh, it's wonderful. Oh, you'll adore it. The two bedrooms have a view over the lake. I love a view over the lake. Oh, that's nice because your bedroom has the best view. Oh, darling, that's awfully considerate of you. What do you mean, my bedroom? Well, it's part of my plan for a practical marriage. Well, how practical can you be? Well, according to my statistics, 26 and two-thirds percent of all marriages end in divorce, and 78 and seven-tenths percent of all divorces are due to incompatibility, and 92 percent of all cases of incompatibility are caused by over-emphasizing the emotional side of marriage. No, no, no, wait a minute. Will you stop throwing those numbers at me? When your eyes light up like that, you look just like a pinball machine. Well, after all, we are practically strangers to each other, and we only knew each other for five days when we were married, and I seal for New York the same day. We can't let our lives be ruled entirely by emotion, can we? What are you trying to say? Well, it's just that I've given this a great deal of thought, Tyson, and since in my work I've written a pamphlet on the perfect marriage, well, I feel it would be best if, for our first four months together, we... we... Oh, no. Oh, no, you wouldn't! But Tyson, you'll be pioneering a whole new concept of marriage. You should feel like... like Daniel Boone. Well, I do, and he's been dead for over a hundred years. Oh, treachery! Well, it's better than TC flies, isn't it? I have never met a treacherous TC fly. Well, I'm just asking you to keep an open mind. All you have to do is leave yourself open to persuasion. Well, this isn't persuasion. It's invasion. Oh, I'll get it. Oh! Yeah. Goodie, goodie, gumdrops. Where's your husband? Oh, hello, Charlotte. I thought you were with the deestros. I am. They're getting their bags out of the car now. Bags? Bags. You've got overnight guests. The deestros left their children with a cousin in Flatbush. They won't be able to get a hotel room till tomorrow. And you brought them here? Business pet between your husband and myself. You wouldn't understand. Oh, yes, I would. And I'd like to break your little arm.   They can't stay here. We've only got two bedrooms. And according to Anne's plan, they can't stay. Because if they did, Anne and I would have to... We'd have to... Well! And send your deestros. See your colleagues!  And send your colleagues. How do you do? Welcome to the bedroom which awaits you. A nice, fresh, uninhabited bedroom. I have been scuttled. Yes, haven't you, dear? Well, have fun, kitties. You aren't leaving. Oh, yes, my work is done. Oh, but I have a wonderful idea. Why don't you stay overnight with us, too? Little old me. My darling, I'd love to. Wonderful! Now we can discuss the long with Ms. Farrell. But Anne, where am I going to sleep? What's wrong with the bathtub? Oh, I've just been scuttled. Yes, haven't you, dear? You are listening to the Screen Directors Playhouse production of This Thing Called Love, starring Rosalind Russell and presented by RCA Victor. There's a new subject almost as popular as Love in America today. This thing called television. And that means your RCA Victor dealers is the most popular place in town. You'll see why when you feast your eyes on RCA Victor's fabulous 14, 14 brand-new 1950 television models created to meet the needs of a complete cross-section of purchasers. Take the new tele-ensemble. That's your set if you have about $230 to spend. The tele-ensemble is Deluxe 12.5-inch RCA Victor television that has everything. A smart maroon cabinet, a matching support, a built-in antenna, and of course all those maximum values in pictures and performance which make RCA Victor first in television. Some day soon visit your RCA Victor dealers. Find out about the wonderful RCA Victor factory service contract. Study all 14 new models. And set sail on the television way of life with the RCA Victor set that was made for you. Now back to the Screen Directors Playhouse production of This Thing Called Love, starring Rosalind Russell in her original role of Anne with Steven Dunn as Tice. After his return from South America, Tice Collins' first breakfast with his bride Anne would have been pleasantly intimate.  More coffee, Mrs. Diastro. I made it myself. Oh, no, no, thank you, Senor Collins. Mr. Diastro? No, thank you. Charlotte, honey? Yes, yes, I'll have some. Really? I thought you'd prefer gin for breakfast. Tice, darling, you look horrible. Would you spend the night hanging from a nail? No, no, the bathtub. And I'd like to get my hands on the guy who tried to take a shower at four o'clock in the morning.  Hmm, I feel like I've been bundling with a water buffalo. Oh, speaking of water buffaloes, how did you sleep, Charlotte, honey? Well, I kept having nightmares. Twice I dreamt that I went to the bathroom for a glass of water, and both times, something bit me. How exciting! I've got business to talk over, so I think I'll show Mrs. Diastro the guy. Oh, please excuse us. Well, Mr. Diastro, Ms. Farrell and I are ready to sign the loan papers anytime you are. Senor Collins, I must explain. My investments I make not only in the proposition, but in the man. Well, I'm a man. Mr. Diastro, doesn't my client's record in the mining business speak for itself? Forty is so young, so uncertain. You see, I know I have ten children. A family is the only incentive for a man. A family? If only there was one little baby, maybe. Baby? Baby? Why, Mr. Diastro, that's wonderful ties. Go ahead and tell him, Mr. Diastro. Tell him? Well, you know, Ann, the baby? The baby? Oh, the baby! Well, Mr. Diastro, I thought you knew Ann and I. No. Yes, and a more opportune infant I've never heard of. There's just one thing, Senor Diastro. I wouldn't mention this to my wife if I were you. No? No. You see, she doesn't know about it yet. She doesn't? I mean, she doesn't know that you know about it to see, and well, she'd sort of like to keep the secret. Wouldn't she, shall it? I think I'll be running along now. Oh, no, you don't.  No, but do you think exciting happened while we were gone? Yeah, but you'd never believe it. Mrs. Collins, your husband told me not to mention it, but I must say something. I must tell you, Mrs. Collins, how happy I am for you. Well, I'm afraid I don't understand, Senor Diastro. Your husband told me of your wonderful plans about a new arrangement in your family. Oh, that. Oh, well, it's really nothing. I did it all with statistics. Statistics?  It's very simple. I just waded through the records, indexed and cross-indexed the files, and when I finished digging through the entire thing in the archives, bingo, 84%. You know, I'm beginning to feel giddy. But even... You know, so am I. Oh, really? Mr. Diastro, I don't deserve all the credit. The girls at the office furnished the figures. I think Mama and I go to our room now. We come back later and start all over. Look, I seem to be a little confused, too. I think I'll go upstairs and lie down. Ties, dear. There seems to be something going on that I don't know about. Well, it's just that... Well, it's just that you're going to have a baby. That's all. Well, if that's all it is, but I thought you know... You know, for a second, I thought you said I was going to have a baby. You did say I was going to have a baby. Now, don't get hysterical, please. In this case, it's sound business practice. But I'm not going to have any baby. The Diastro only lends money to family men. I had to tell them I was going to become a father. So you lied about me. You blackened the name of a good woman. Darling, you've got to see this thing through with me. Think of my reputation. Think of my loan. What about my pamphlet, my marriage plan? Well, you can pretend you're going to have a baby, can't you? I do as much for you. Mr. Collins. Oh, please, darling. Yes, Mr. Diastro? Mama and me, we go to our hotel now with Ms. Farrell. Yes, that'll give us a chance to wind up the loan ties. Well, I can't tell you how much we've enjoyed your visit. It's been so... so unusual.  Oh, you wait a minute. Oh, don't excite yourself, dear. Remember your condition. Goodbye. We send you a little something for the baby. Senora Diastro, there's no hurry for that. Really, there is. Goodbye, everybody. Goodbye, Charlotte. Say goodbye to Charlotte, honey. Goodbye, Charlotte, honey. But why, Gordon? How's that marriage? Oh, wonderfully. Tice and I are so happy. He's reading my pamphlet now. Tice, he's suffering terribly from a hangnail. Oh, my gosh. Well, I'll talk to you when you get here. Goodbye, Gordon. Just listen to this. Only the Anne Collins plan can make the universe safe for marriage, democracy, and a woman's right to eat crackers in bed. Oh, good lord, Anne, you can't believe this stuff. Every statement in that pamphlet has been statistically verified. But you can't reduce marriage to numbers. Look at the birds and the bees. They've done all right without arithmetic.  Oh. Oh, it is. Well, for your information, I don't intend to have anything to do with this fiendish idea. All I am trying to do is make sure that we have a happy marriage. Well, I'm not happy. Well, I am. Hello, Anne. Anne, I admit I was wrong.  Women's clubs all over the country are raving about it. Oh, Gordon, this is my husband, Tice. Not now. Women, hundreds of thousands of them. And all they want to meet is you. Now, I've arranged a lecture tour. You'll represent amalgamated insurance all over the continent. Oh, Gordon, that's wonderful. My entire organization has been assigned to back you up, Anne. Now, start packing.  Now, just a minute. I've got something to say about this. I'm her husband. In name only. That's the plan, isn't it? What difference it make if she goes away for a few months? None. None whatsoever. As far as I'm concerned, she can leave right this minute. That's just what I intend to do. Oh, it's perfect. Perfect. Every penny I have is tied up in this.  Can't miss. Amalgamated sales are going to boom. Oh, don't move. I'll get the door. Hey, Mac, you the guy that's gonna have the baby? No, nobody here is having a baby. This is the Collins' house, ain't it? Yes. Mac, you ought to keep up on these things. Move over. I'm delivering this stuff for the baby. Now, Gordon, I can... The lecture tour. The women's clubs. I'm ruined. This stuff was sent by a Mr. Diaz. Everything I have down the drain. But I'm not going to have a baby. And... There's one bassinet, one dozen booties. Two dozen baby dresses, three dozen diapers. But it isn't two, Gordon. Somebody must have sent us a care package by mistake. And be proud of it.  Say it. No, don't say it. I've heard enough. Goodbye. So, if I sign here, you've got a complete layout. Lay yet. Lay yet, may yet. I'm on leave from the plumbing department. Oh, this is the Collins' nursery. This is Charlotte, sir. I... Oh, good work, Charlotte. That's all I want to know. Bye. Charlotte, can I... The loan's gone through. Well, I guess that wraps up our marriage. I see. If we won't be needing all this baby stuff, might as well phone the department store to come and pick it up. The... the bassinet and everything? Well, it won't be much good to us. I'll straighten out things with Daniels.  But, Tice, I can't possibly do that. Why not? Well, because I'm a statistician. And our own case indicates that my plan is in error. Somewhere I've left something out of my calculations. What? Well, statistically speaking, one bassinet, one dozen booties, two dozen baby dresses, three dozen diapers. Better make that four dozen diapers. Oh, no!  That was silly of me. Because I love my husband. You do? You know, I think I'll write a new pamphlet. I think I'll call it a statistician's approach to this thing called love. And we'll write it together. Well, you know, we'll have to do a lot of research. Well, I'm the greatest little researcher in the business. Well, now let's see. It should start like this. Marriage is an institution based upon emotion. It functions best when wives are frequently kissed. And kissed. And kissed. Oh, darling, maybe you'd better write it. You have just heard the last act of this thing called love. Our star, Rosalind Russell, and our guest screen director, Alexander Hall, will be with us in just a moment. In future weeks on Screen Directors Playhouse, you'll be entertained by Betty Hutton, Jane Russell, and Bob Hope. And next Friday, our guest is another great comedy star. Our story, for the first time on the air, is, it's in the bag. And recreating his original, hilarious role will be written with screen director Richard Wallace. Now, here again is tonight's star, Rosalind Russell. Rosalind, I'd like a word with you about your young son, Lance. How does he like that wonderful Christmas present you gave him? That RCA Victor 45 automatic record changer. Oh, he just loves it, Jimmy. And so do all his pals. He's appointed himself disc jockey for the first grade set for miles around. Well, a 45 is in safe hands, even with a whole crowd of six-year-olds. It's the simplest automatic record changer ever made. And the tiny, non-breakable records are practically indestructible, wouldn't you say? I would. In fact, I'd give the whole 45 set up my highest compliment. It's boyproof. Very well put. Say, Rosalind, what kind of music do Lance and his friends go for? Long hair or short hair? Well, not exactly either, Jimmy. They seem to prefer the cowboy numbers. They're mostly duets for Roy Rogers and Trigger. I'd say they go for horse hair. Well, that fits right in with a natural picture. RCA Victor can hardly keep the horse hair records galloping out fast enough to suit the first graders. And the same mad rush prevails in the long hair and short hair departments, too. People are buying over 2 million 45 records every month. I'm not surprised, Jimmy. Personally, I'd like to own every record in the 45 catalog. Oh, that's a fascinating book, that catalog, Rosalind. It certainly is, Jimmy. Not much of a plot, but oop, what a cast. Yes, they're all there on the RCA Victor 45, the world's greatest artists, and the stars who make the hits. Over 2,000 titles. What's more, prices are as low as 46 cents on the records, and only $12.95 on the record changes. No wonder the 45 is weeping the country. Get in on the fun.  Ladies and gentlemen, when a girl's director runs a turkey farm as a sideline, anything can happen. After all, she's making pictures for a man who turns out 25,000 turkeys a year. Fortunately, all of them are feathered, and none is celluloid. I think you'll agree when I tell you that you made such great films as Little Miss Marker. Here comes Mr. Jordan and the great lover. Now I would like you to meet him, my director in this thing called Love, Alexander Hall. Thanks, Roz.  Why? Well, we made three pictures together. My sister, Eileen. She wouldn't say yes. And this thing called Love. And all of them, we had a running feud of practical jokes.  No. I'm sorry, Roz. Oh, well, Al, let me assure you that tonight I wouldn't think of playing a practical joke on you. I just want to thank you for being one of the finest directors an actress ever had. Thank you, Roz. Well, you're not worried anymore about practical jokes, are you? How could I be? Oh, that's fine, Al. Because when you get home tonight... Yes? Well, tell me, do you like strawberries? Oh, I'm crazy about them. Oh, goody, I'm glad. Because you're going to find 100 pounds of strawberry jello quivering in your bathtub. Good night. That's right. Good night, Al. Good night, everyone. And good night to you, Rosalind Russell and Alexander Hall. Remember next Friday, Fred Allen in It's in the Bag with screen director Richard Wallace brought to you by RCA Victor, world leader in radio, first in recorded music, first in television. This thing called Love was presented through the courtesy of Columbia Pictures, currently releasing the award-winning production All the King's Men starring Broderick Crawford. Rosalind Russell will soon be seen in the Columbia Pictures comedy, A Woman of Distinction. Alexander Hall's latest production is the soon-to-be-released 20th Century Fox Picture, Love That Brute, starring Paul Douglas. Included in tonight's cast were Stephen Dunn as Tice, Harry Lang, Joan Banks, Stephen Chase, Margaret Brighton, Paul Dubov, and Frank Barton. This thing called Love from the stage play by Edwin Burke was adapted for radio by Richard Alan Simmons and original music was composed and conducted by William Lava. Screen director's playhouse is produced by Howard Wiley with dramatic direction by Bill Karn. A portion of the broadcast was transcribed. And from screen director's playhouse, a reminder that the strength of our youth is the strength of our country. This week our country salutes two million of its finest young men, the Boy Scouts of America, celebrating their 40th year of character-building and citizenship training. This is Jimmy Wallington speaking and inviting you to listen again next Friday when RCA Victor presents Screen director's playhouse, star Fred Allen, production that's in the bag, director Richard Wallace. It's Jimmy Durante with Don Amici on NBC.


The last presentation is Rami Gabriel who comes from I come from UC Irvine It's actually a COA prior to medical school. Is that correct? So he's in my clinic refracting patients I was shocked and then I realized he had had all this prior ophthalmology experience So we're grateful to have him come rotate us with us on this month on rotation and turn it over to Rami Thank you, Dr. Jarnian So I'll be presenting on machine learning and it's applicability in OCT and geography I know Becca Gentry kind of gave a topic similar a while back. So hopefully I won't bore you guys too much So the objectives understand a little bit about machine learning Learn about what Google brain is doing an ophthalmology Learn about OCT and geography and how it works and then discuss some of my research. Hopefully you can use some of these tools in your own research as well So what is learning besides being avoided by medical students? so machine learning is basically a way of acquiring knowledge and you can do it through experience Or you can do it through study machine learning is solely through experience So there are three main categories of machine learning you have unsupervised learning And so that's where you give it data without any answer to the data So say you give it farm animals and then it groups it by those farm animals However, it kind of finds fit so it could group it by color instead of the animal itself like horse sheep And then you have supervised learning and so that's where you give it data that has an answer And so it learns from that data and then it learns to choose it better You have two different types now. We're going to be focusing on supervised learning for the majority There's classification and so that's different categories and there's regression and that's when you Have more of a linear kind of data. So age cost Things like that. The bottom one is actually how I first got involved in machine learning. It's reinforcement learning That's mainly for games and more real-world kind of applications. It has a high-level Goal and so something like chess and so alpha zero from Google beat stock fish, which is the engine for chess Which was amazing So what is Google doing an ophthalmology? The first these are two of the major studies the first one on the top left top right top left for you guys is Basically looking at 128,000 fun disc photos And assessing diabetic retinopathy and actually did a really good job at whether it should be referred or not referred The sensitivity and specificity Are both up in the you know high-middle 90s And actually it did a really good job Predicting the stage of diabetic retinopathy as well. And this is actually FDA approved as a referral for sending to retina specialists The second study Borrowing from Catherine should really be called fundus photos more than meets the eye So it looked at fundus photos and it assessed things that really we didn't expect were To be able to be learned from fundus photos. So one of those is age Gender blood pressure and so it did a really good job predicting age between An age range of five years had 78% accuracy But as ophthalmologists you guys know fundus photos is really just scratching the surface No pun intended. So we have OCT where we can go into the layers of the retinal and specifically we chose OCT angiography OCT angiography is similar to other spectrum domain OCTs It runs the a scans lot faster. The Heidelberg runs around 40,000 and the CRS is around 27,000 And how it works is basically It sends multiple Scans and light and then the amplitude coming back is what's measured For the angiography the SSAD a which is split spectrum amplitude Decorrelation algorithm basically looks at the change in the amplitude. So Tissue that doesn't move should have a constant amplitude But tissue that's there then not there will have an amplitude that varies and so the decorrelation is basically one minus correlation So if the amplitude is all the same you won't get much of a signal for things moving But if it's very buried then you will get something that moves and so you can see on the far right on the bottom image You can see some of the superficial vessels and you can see the Corio capillaris And that OCT is amazing. You can get an in vivo histology And so that we are looking basically at two capillary plexus in this data the superficial capillary plexus and the deep capillary plexus I'll look at it in the nerve fiber layer and the internuclear layer respectively And this is what it looks like At its end product the superficial capillary plexus at the top and then the deep capillary plexus at the bottom right This is actually from our lupus study And so the lupus is on the right and then normal is on the left and you can see some kind of rare refaction in the vessels All right, so our OCT a data we had about 1800 scans. We had About 900 patients and the mean age was 70 But we had quite a quite a large age range from 8 to 99 And then the majority of our patients were macular degeneration. They're all diseased in the In the prior studies with google. Most of them also had diabetic retinopathy So this is just a correlation heat map. You can see if something's highly correlated Then you will get A lighter color and so these are L1 and l2 are just superficial and deep capillary plexus respectively and then the whole image or the Or the hemisphere and separated by different sections of the OCT a image This is a box plot. You can see age with age over 70 and under 70 You can see somewhat of a downtrend These are all just box plots, so it's not significance here and then gender Kind of similar but not as big of a difference So let's apply our machine learning. What exactly is it? So we used a multi-layer Perceptron algorithm and so basically what this is is The thing on the far left those x values are inputs and so we had 19 the Different quantitative values from the OCT a and then the second is the layer And so you basically assign a weight to all those inputs and then you assign Those weights into the middle node and so you kind of create this network And then those weights then go on to the final output And so that's where kind of neural network came in is that each one of these is like a neuron for predicting gender We did a terrible job. We got 53 accuracy So we kind of gave up gender pretty quickly and then for age we had 74 accuracy, which was actually pretty good This is a confusion matrix. This is actually what it's called But don't be afraid It's actually very similar to what we have with true positive false positives and so forth And so we got the sensitivity and the specificity of our study This is box plots With age and so basically by decade and so you can see A trend as well in the loss of vessels in the superficial capillary plexus and deep capillary plexus with age So after separating it into decades we then tried another classification algorithm And this time we got 35.9 percent separating it by different decades And so that's a little harder to do. We had nine different decades Options that I could do so it was still better than chance, but not as good So we were up against giants here Google had 67,001 of its studies and then the age range was 40 to 59 So a lot narrower and a lot easier to decide And then the ipax is actually just a little bit about it is actually a tele-retinal service And so they service over 300 clinics worldwide. And so it looks at all those images Their mean absolute error was small So the mean absolute error is predicted the age and then it was off by plus or minus three years And then for us we were off by plus or minus eight years, which was a lot less than standard deviation Which was about 14 So just to prove that OCT angiography will not prove but show that OCT angiography was probably the best study to use This is a saliency map and so where the algorithm that google used focused its attention and you can see The age really focused on the vessels and most ophthalmologists agreed that that green area was kind of focusing on the vessels all right, so OCT angiography um actually has been shown in other studies and it's kind of been debated in the past But it has been showing a rare refaction in the vessels or a decrease in the vessels almost annually by 0.4 percent the reduction in perfusion can Can contribute to other disease entities and so understanding that is important For us our sample size was a limiting factor I know 1800 doesn't sound like a limiting factor, but it was and then Just using machine learning as an analytical tool. I think can help drive a point So I want to end with this is a quote from shakespeare. The eyes are the window to your soul I don't think we've found any evidence for this yet But the growing body shows that perhaps it is the window to your age gender blood pressure Maybe even severe Thank you So there's no question artificial intelligence less machine learning is going to be a big part of our future Again increasingly being used and I think that A lot of physicians kind of fear that area, but there was a very interesting study Done in pathology in which When you have a whole series of large screenings That artificial intelligence did better than the average pathologist, but What was the best of all is if artificial and it was dramatically better Picked out the five most atypical areas of every specimen so definitely look at these And so what you do is is that When when when you're trying to pick a needle out of a haystack, we only have five pieces of hay That's much easier than if you have thousands of pieces hay and when you're screening a lot You sometimes go into this mode where where you're kind of numbed over you're not thinking and so By by honing in and just saying these are the places. Look it dramatically improved better than than any diagnostic criteria So I think they'll be an interesting symbiosis And a lot of mundane things will be removed and a lot more serious will be passed on But there's a lot of stuff that's going to be taken care of. I mean for most skin lesions The artificial intelligence is already way better than the average dermatologist and picking those things out But when it comes to actually treating it, I mean, that's that's where dermatology obviously is going to shine Yeah, I agree with you. I mean, I'm not an evangelist for AI I don't think it's actually going to take over but combining the two can be quite powerful That would be a very big part of us. No question. I mean, I mean already we're talking about a project now We have in which we're going to use this Program because frankly for a diabetic one of our biggest problem has they're just not getting screened In the best time to catch them when they see their primary care physician And the picture is taken and AI looks at it And and it says you need to be seen that's where the sensitivity is what's really strong Not not classifying it but making sure that all those people Get it and get in and get seen when we when it says that there there is retinopathy Because like I said the sensitivity you said was like 96 97 percent I think those are the kinds of things we'll see extremely important in our future Yeah Yeah, that's that's a great question So I guess one of the things that we did is I guess we were a little more nimble So the input variables for google was 22 million where ours was 19. So we kind of chose OCT and geography because we really thought it was related to age And so I guess being more nimble and kind of choosing your battles can help Very good. Thank you Yeah, it's not too bad. I actually picked up machine learning Um these past few years and most of the programming for this was actually done here. So Thank you


While traveling in a vehicle, especially in an emergency situation, we all need to get to our destination safely. It's not worth it, and it's not wise to take unnecessary chances just to gain an extra second. So you will be ready to travel safely. Here are some guidelines to help ensure your safe arrival. Each day, make sure your headlights, sirens, horns are all in working order. Make sure your vehicle is in safe operating condition. Have a morning briefing to discuss any safety issues. Store all tools and loose objects in appropriate storage areas. Never overload your vehicle. Maintain an appropriate speed to avoid rollovers. Drive for the weather, road and environmental conditions. When responding to an emergency in your vehicle, always stop at marked intersections and make sure the way is clear before you go on. Minimize the use of two-way radio talk. Drivers should avoid the use of cell phones. Don't forget to follow the current drive and rest rules. So remember, everyone, get to your destination safely. Drops up. Loaded.