Felly, ydych i'n peirlo pan arbennigion gweld gweld y pethau, cram am y cyfnodd o'r gwahrodd ar gyfer y cyrraeth ar gyferhowb y mae'r gwahodd o'r ang�el o'r ymlaen yng nghylchol mewn ymgyrchonol i'r leishio. A'r tyn y pethau ar wneud, efall nhw ar y cyllideb yn gynnig y pethau a ffantafau gweld ei wgwygon sy'n ei rhaid i ddweud yw pethau i'r gwahodd. Mae yw Lark. Yn'r gweithio yn colli'r Lark, hyd yn bwrth o'n gweld. I don't think it's a hugely popular app, but it's a step counter and activity tracker for the iPhone. And as you can say, it uses this conversation based interface, which is different from most of them. Most of my quantified self apps look more like this. They're very sort of, you know, here's the data, I'm very objective. And note that word objective because I'm going to return to that. They're objects, right? And this is serious stuff and you can trust me because I'm just the facts. I just have the numbers and these numbers are true. Whereas lark, as you can see, is all like, hey, Jill, hope you're enjoying your afternoon. You don't actually have very many options in this. The only thing I, as the human interactor, can do is click the button at the bottom. Gotcha. It's a fairly limited sort of script I have there. But sometimes I get three options, so you know. And most other apps that I've had are similar to this. One of the first I used, 2008, it was before smartphones really existed much. They weren't very, I didn't have one anyway. It was a baby napping tracker where you had to click a button on a website to say when your baby went to sleep and when it woke up. There's much more automated ways of doing this now. But even back then it was a very sort of like, just data only sort of interface.  Here's another one here which has a different way of presenting it. But both of these, this one's much more visual, but none of them really speak as if they have agency or subjectivity, right? Now, let me see if I can get the sound happening here. I think it was supposed to come in a couple of minutes. We just passed 30,000 amplified songs on Capsule FM. All of these are shared and enjoyed by your fellow listeners. Connect your music service and keep sharing your good taste in music. I'll just let you hear one more. So this is a robot DJ basically. And I need to capture some better lines from her because this was just what she was saying this morning. So this isn't exactly a quantified self app, although sometimes it is because it says you've liked 470 songs on Capsule FM. So sometimes it does the quantified thing, but mostly it's supposed to be something you listen to music on. But it very specifically has these robot DJ hosts who read you your Twitter. Like people have spoken to you on Twitter. Oh sorry, I meant to play more of that video a bit. Go and check it out yourself instead later. But this is another example. This is a very clear example of like an app that's really trying to speak to you. She addresses you. You can pick different robot voices, men, women, different languages, but they always address you by name. They always speak to you. And sometimes she really gets quite flirty. You know, oh Jill, I know you really love me even though you only paid $1.99 for me in the app store.  So it's very much sort of playing with the idea that this isn't artificial intelligence, but she's speaking directly to you. So this is a different sort of way of doing things. And it's also one that we're seeing, I think Facebook and the different big social media platforms are starting to try to use chatbots in order to let you access their services, which I don't know if that's going to work, but it's a sort of approach that's coming. So we're starting to see this a little bit in some quantified self-apps, which makes me think about how we think about our apps. And this is where perhaps this kinship or this relationship, because it is a very intimate relationship. You carry your phone with you everywhere. You wear it against your skin if it's a wristband, right? And what is this doing to us? The idea of the computer as artificial intelligence is not exactly new. Alan Turing, just after the Second World War, proposed this Turing test, which is like, okay, how could you tell the difference between a computer and a human if you're typing to them and you can't see which has a human on the other end and which has a computer. So people have actually managed to pass that test. Someone put a lot of money on it. And I think it was last year, the year before, someone actually passed it. But to pass a test like that, to write an AI that people can be tricked into thinking it's human, you have to have a very specific dialogue line, right? You have to have a very specific kind of human. Eliza is one of the first of these chatbots. Gosh, it's so tiny, isn't it? I wonder if I can make that bigger. Eliza was written in the, I think, was it the 50s or the 60s? 50s. A computer scientist. And she's scripted to be like a Nigerian psychoanalyst. So she says, hello, I'm Eliza. Someone tell me what to say. I'll rush right. I am at a conference. Did you come to me because you are at a conference? Yes. Are you sure? Would you prefer if I were not a computer? So she plays a very specific role, right? She just picks out some of your keywords and repeats them back to you, but adding them into sentences. And this works pretty well. I mean, there are all these stories of how people have sat down and spent hours and hours every day with Eliza. There's a novel by Louisa Alcott that came out last year called Speak. It's really quite good if you're interested in AI and also it's a fun read. And it tells you the story about a world not so far, you know, the near future kind of science fiction, where all the children in the world were given dolls that had artificial intelligence. And everyone thought this would be great because the kids could have this lovely intelligent company from their dolls. But the problem was that the kids were only interested in talking to the dolls. So they stopped having friends. It was like they really weren't interested in anything except the dolls. So the grown-ups decided to ban the dolls completely and you've got this whole generation of children who are just completely distraught because those most important relationships were broken. It's a really interesting sort of philosophical read actually. Okay, so that's a little bit about AI. Now, one of the interesting things about AI and science fiction, I've been reading about post-humanism recently and there's a lot of post-humanism that also uses science fiction and these science fiction portrayals of artificial intelligence to think through the relationship between humans and computers. And I think with quantified self-apps and phones, it becomes that intimacy, it becomes a really interesting point. It's technology and technology actually, I was going to say that this is an example of an early, it actually relates very directly to space and time here because this is from 1880. It was the first time people worked out what a horse looks like when it gallops and they worked that out because they had cameras, 12 cameras set to take photos, a second apart or something like that. This is what people used to think horses looked like when they galloped. They used to think that their legs were all out like that. If you look at newer drawings of horses galloping, they're going to look like one of these images. I was going to show you that this is an example of how the technology we use actually changes the way we see the world. But after listening to you, I'm thinking this really shows what happens when you spatialise time and movement. Because, and I don't have this slide in here, but there's this beautiful quote by Rodin, the sculptor, where he's interviewed by Paul Verilio in Paul Verilio's book, The Vision Machine. Rodin says, he's being interviewed and someone says, well, but photography is true, right? Your sculpture isn't true in the way that photography, this is what a horse looks like when it gallops. Rodin said, no, because in real life time never stands still, he said. And this is a really good point. There's these two different versions of truth here and I need to re-read Bergson obviously because he's obviously discussing similar questions. Because our apps, here's another quantified self-app that measures sex, but it measures it in the ways that an iPhone is able to measure sex. That is the duration, oh well, it measures, you put it on the bed and so it can measure movement, so it measures thrusts per second or minute maybe and the decibel peak. And then the duration is how long do the thrusting movements and the decibels last. So this is a very sort of bizarre version of sex, really, to most my, I mean, actually it's a sort of version of sex you do see in some kind of hardcore porn, but most people would probably experience sex differently, but this is how a phone at the moment is able to perceive it.  Josef van Dyck calls this dataism, she calls dataism as like this belief, it's almost like an ideology or religion where if it's in numbers it must be true, you know? And I think this is a really useful concept to have, to remember the sort of power in numbers and it's the same as what Rodin was arguing against by saying that no, life doesn't stand still, you can't tell all of life in photographs or numbers. Another writer or thinker I've been reading is Willem Flusser who writes about the technical image among other things. And he sees, so this is not him, obviously, this is a self-portrait by Jermaine Croll, but I use this because of the way the camera at that time was such a big thing that you couldn't really imagine, it's hard to not realise how much the technology means in this situation when you've got this large camera. Flusser sees the human as sort of more like an operator of the technology rather than a subject using the technology, right? So he sees the technology as so sort of power and the humans rarely really have a whole lot of agency or control over the technology and we're just doing what the technology allows. So that's a very sort of techno determinist viewpoint which actually I'm starting to lean towards these days the more the internet happens. Flusser does have a gleam of hope, true art can come when there's some more sort of equality happening. So this is one view of technology. We just do whatever technology asks us to do basically. That's it. This is a book by James Bridal which I think is also rather interesting. He's a designer, he came up with the term New Aesthetic some years ago it was revealed that the iPhone was tracking all our location data and whenever you synced it to a computer it would transfer it without, it wasn't being encrypted and it was not very good and so forth. Anyway, when he discovered this no one realised until then that the location data was all being tracked. Anyway, when this was revealed James Bridal downloaded all his location data and he made this art book which consists of maps of where he was. The title as you can see is an expression that he doesn't actually remember being all those places. So his take on this is this isn't actually my diary this is my phone's diary. That's an interesting point if we're thinking about quantified self or even the Nike fuel band on your wrist there it's pretty intimate yes but it's tracking its movement really, right? Okay, so this is me on breakfast of the morning I tried to write it out here so I went to Snapchat because they have good emojis so this is my attempt to just explain the main sort of points I'm trying to come up with here. Snapchat doesn't have very good emojis for basic human that's not gender or racially specific so I hope you'll accept this as my human representation. Okay, so now I'm sort of assuming most of it the phone could be other technology but so much quantified self stuff is the phone now so I'm just using the phone as our example. So you've got a human, you've got a phone, you've got these two things and usually we think about like this a human uses a phone, right? and if you think back to high school did you have to do this or was this just my, you know the human's the subject, user's is the verb and the phone's the object and I don't know in the 90s my literature professors are very easy about this whole subject version of the world that's clearly, there are clearly many many takes on that but there is this sort of assumption that we're the humans, we are in charge of our technology, right? So this is the sort of basic idea we act upon the phone and we use it and so then, oh maybe I wanted that one first, yeah okay so this is what I've been thinking about and I'm not sure whether it works so I'd love feedback here this is a fairly old, I think it's from the 70s Chapman, the theorist of like literature and film and it's his idea of, okay you've got the text so this is like, you know, a book or a movie or something like that and outside of the text you have a real author and a real reader, right? so let's say that movie about the dolls for instance she was writing, there's a real Louisa it can't be Louisa Alcott, she's from Little Women I must have got the name, Louisa Hall I think, sorry Google it you've got the real flesh and blood author clearly somebody actually wrote the book, right? and then within the text you've got an implied author and that's like what it sounds like actually my example in my draft was Donald Trump even though that's not literature or film because it's so incredibly simple to apply because clearly there's a real flesh and blood Donald Trump, who knows what his actual motivations are for running for president, right? and there's a real reader or viewer of his speeches and for this case that's all of us or it's many other people but it's also you and me, right? and then there's the implied author and that's clearly a person who actually is presenting himself as actually a legitimate candidate for president and he's wishing to position himself in certain ways which aren't necessarily the same as what the real flesh and blood person are doing, right? and his implicit reader is clearly not us he's clearly not speaking to educated Europeans that's sort of very obvious his implicit reader is somebody very different in America so you can sort of read that out of the text you don't need Donald Trump to tell us who the implied author and reader are you can figure that out of the text, right? but then there might also be a narrator in a narrative so when Trump speaks he says I he's clearly the narrator if he says you and he occasionally in a speech he might actually speak to an individual that case that's the narrative some positions aren't always present in a text anyway, so my question is does this work when thinking about this sort of assumes that everything is a narrative and maybe it isn't but I'm just trying to think about this in this way because if you do that then you could end up with like okay here's the medium in the middle, right? so now it's not just a person and a phone but it's a person and a phone and then it's someone real on the other side of it, right? when I'm on Snapchat or when I'm using RunKeeper I go for a run, it's just me and the phone but then I post it to Facebook because I want other people to see my results, right? or I look at the feed of my friends on RunKeeper so there is a situation where we humans use a phone just to get to something else and that's where it's kind of a traditional medium not that different from newspapers televisions, etc and you could think of that as me being a narrator and I'm speaking to I want to share my runs with somebody and that somebody is my narrative because I'm sort of speaking to them about my run, right? or you could see it as like a broadcast model like a fairly sort of traditional feud to many media model and say it's a speaker speaking to an audience and on Snapchat which I've been looking at recently you really see that there's an interesting division where some people who speak to the camera on video a teenager pointed this out to me actually or to my friend because my friend was speaking to the video and the teenager said can't do that, only celebrities do that which is really insightful actually because now I've been watching everything on Snapchat and it's true, you only speak video if you think you have an audience if I'm speaking to an individual it seems like maybe you don't anyway so the point is there's a situation where you're using it as a medium right? and social media kind of is that but in a loop so here it's not the broadcast model but it's like the human uses the phone to get to other humans and they speak back right so fair enough but we're still seeing the phone there as an object like sort of inanimate dead object right? okay but what about these apps? because with your Nike band well you can probably see the friends list if you want and you could share your results but most of your time is probably being spent just you and the app together right? at least when I never share my runs I hate that but I do track them you know and in this case maybe we're seeing our phones not so much as objects or as media but as companions and this is where I need to re-read Haraway and think about this kinship thing too and that brought me back to diaries because I love stories and diaries and things like that and this way we used to or still do sometimes address the convention of addressing the diary as if the diary is a person or a subjectivity of some sort right? and of course when we write Dear Diary we know that we're imagining it we're projecting it but it's like you cannot write without imagining a listener or a reader you cannot speak without imagining someone listening to it even when you speak to yourself in your head you sort of speaking to your Chapman would say that oh I'm not going there and so I think there's something there about intimacy on the one hand like there's something where thinking of our phones or apps as obviously not humans but some kind of subject actually makes us feel safer in sharing our secrets with them and so and I'm thinking that largely because I'm comparing it to the diary so I might be wrong there but also something about just companionship I mean we like to we don't like feeling alone nobody likes feeling alone but if anyone of you actually did keep a diary I only kept a diary when I was a angstful teenager but I mean I had people around me all the time my horrible mum and dad and my awful little sister but I like them now but there was no way I was going to share my secrets with them I wanted a diary because it's a pure reflection of me like it's only the things I want it to be and I think there's something there about the way we're thinking about our apps in the the other thing I did was I don't have a slide of it but I actually I'll just show you this Google books right they digitise almost I don't know I need to check exactly how a larger percentage of books but this is like you can go to Google books and search words in print books and they have a pretty large proportion of the world's books now so I did a search for Dear Diary and as you can see okay so that's like from 1970 to 2000 huge increase that's kind of interesting and then it drops after 2000 I think that's because we got the internet so we didn't need to speak to our Dear Diary anymore so I do find that somewhat interesting okay I think I'm almost done here there's a lot more to think about here and I really want to try to use more of the like the post humanism theory and think about these things but there's some really interesting stuff happening in this sort of area so I look forward to more discussion


Now, if I was going to reverse this, I would just reverse it exactly, right? I'm not going to try to rearrange debits on top, credits on top. I'm going to say, okay, what's going to happen on the reversal? Well, I'm just going to say accounts receivable. I'll copy this whole thing down. I'll delete this and I'm just going to reverse the debits and credits. I'm going to say, well, this is going to be a credit. And then I'm going to debit this and debit this. And then over here, I'm going to credit this and debit this, right? Because you don't want to really construct the credit memo in your mind in terms of what's happening from the ground up.


So, for today, for May Council, we've invited presentations on the CESAR program and the Mendelian Genomics program. Jim is here to present on behalf of the CESAR program. And of course, you know him as a member of the council. He's also a grantee of the CESAR program. And for the sake of people on the web, Jim is a member of the advisory, our advisory council, and the Bryson Distinguished Professor of Genetics and Medicine at the University of North Carolina. So, Jim, floor is yours. Okay, great. So I think this does flow pretty well from the last conversation, and I'm trying as best I can now to take off my hat. And this, the information here has really been the work of many, many, many people so I'm just trying to kind of present where we've been with CESAR and what the needs and challenges and opportunities are going forward. So, I wanted to start with the heat map, both because I think it, we come back to this all the time because it nicely summarizes the general gestalt of where we're going, but also to point out that as we move towards the right, I think we see a qualitative shift in the demands and the needs and the challenges of research. And what I mean by that is that we really, there's an inflection point somewhere when you move from basic science to clinical care because there are very different demands on it. There's no question that basic science is the foundation of medical practice, but the endeavors that the two things, those two endeavors demand very different approaches. Theory alone is really insufficient to guide clinical practice, and that seems a lesson that we should have learned a long time ago, but I am absolutely amazed at how poorly we oftentimes learn it. And the balance between premature translation and inappropriate delay in translation is a really difficult one to achieve, and the stakes are very high. On the one hand, when we prematurely apply things into the clinical sphere, we regularly cause profound harm. We cause it to patients and we cause it to society at a minimum through increased cost. On the other hand, when we miss opportunities and we don't translate things quickly enough, we obviously miss opportunities. And then finally, there's a big difference too because medical practice inherently involves individual values, which really can't be gained side in the end. And we have a long history of premature translation. So in the therapeutic sense, it wasn't too long ago that reflexic hormone replacement therapy after menopause was absolutely what was done. There was a time when we gave anti-arhythmics like IV lidocaine to individuals who were peri-MI, and we learned, of course, and same with strict glucose control and diabetes. These were all compelling ideas. They seemed like no-brainers, and yet we were killing people when we did them. And it wasn't until we went back and studied them in a systematic manner that we understood that. In screening, we have seen millions upon millions of men subjected to an uncontrolled experiment that we're only now realizing was probably not a very good idea. I would tell those of you who would think that whole body MRIs would be a good screening procedure to have. You probably don't want to do this. And I say this because I think there is, in our minds, oftentimes a really compelling rationale for the implementation of genomic medicine, and yet we really need data before we do that because we make very serious decisions when we apply genomic knowledge. When we are wrong and we give people false positive results, we subject them to unnecessary surgery, years of unnecessary screening, a premature end to a diagnostic pursuit, and therefore they cannot avail themselves of the real answer. And when we give them false negatives, we forego necessary preventive and therapeutic modalities. And all of these ills are complicated and amplified by the fact that genomics is obviously has to do with families as well. And they make decisions about family planning and abortion, and not to mention the psychological damage of misinformation. And finally, the other kind of qualitative difference that I think is really important as we consider what are the needs of a program that is primarily aimed at clinical investigation, clinical implementation, and ultimately clinical value, is that our values regarding the same genetic information vary. So I love asking this question to people, so let me see a show of hands. If you look at this list of really bad diseases, which I think their very existence has profound metaphysical implications, but we won't go there, if you carry a mutation that essentially guarantees that you will develop a severe, unpreventable, untreatable disease by age 60, would you wish to be told so who here would say yes, they want to know? Who here would say no? Who here doesn't know? I think that I don't know is have it, and you're actually right, because we see that people don't do what they say they're going to do. And the bottom line is we need to understand how heterogeneous values can be accommodated, because they are inherent to the clinical pursuit. So this all gets to what the underlying rationale of CSER is. And what I want to do is frame for a minute the opposing view. And it's a view that we were just discussing. I think that David articulated it, Jill articulated it, Eric Lander at our last council meeting articulated it. And really in a way it is, look, we have lots of sequencing going on. It's already being performed. It's getting really cheap. Why not just introduce it into clinical care and learn that way? And that's not an unreasonable position, right? But I think that there are some very strong arguments to not go down that road. And really that's what CSER is predicated upon. And it is that the unsystematic introduction of new modalities into clinical care, no matter how good of an idea you think it might be, generates poor and misleading data regarding its appropriate use, its utility, and its applications. It also shifts costs to an already constrained medical system. If we start doing these things as because hospitals are competing to do it and everybody expects their genome to be sequenced, we really haven't done the medical system any favors. And I would emphasize that nothing is free in the world of clinical medicine. So even if a test is free, it's very, very expensive if it's not the right test. It makes patients de facto research subjects, and that's not what our patients are looking for when they come to the doctor. And privacy concerns are especially resonant in this field. And finally it undermines the systematic collection and sharing of both genomic and phenotypic information, which is critical to understand. So this is from the original RFA of the CSER program to address critical questions about the application of genomic sequencing to clinical care. And really in the end, what we would like to do in CSER is establish best practices for the translation and the implementation of genomic medicine. So it's trying to sum up the major focus, the major goals of the CSER program, I think it's fair to say, that one would be to figure out what are the patient characteristics that signal potential utility of this test. This is a complex test. We don't get MRIs on everybody who walks into the doctor's office, nor should we. We have to figure out at some point when it makes sense to get an MRI, even if that MRI were free. We need to understand diagnostic hit rates in different populations. We need in the tumor arena to understand when somatic analysis is informative to guide therapies. How should we analyze large data sets in a clinical environment? Things like quality control, timeliness, confidentiality, those become exceptionally important in this realm where they aren't as important in a much more basic context. There are special considerations in different populations. For example, minorities and traditionally underserved groups, and that's not only because there are different values in their different social contexts, unlike Howard, I'm a big fan of LC. Different allele frequencies in different populations, they really matter. And I know from our Sino conference, we'll see an unusual allele, and one of the first questions we have learned to ask is, what is the ancestry of this individual? How do we deal with the plethora of highly heterogeneous, non-target DNA, incidental findings that have you, that are going to transpire when we perform genome-scale sequencing? And I would add that gene discovery is part of CSER, but it really is incidental, no pun intended, to the main goals of CSER. So turning for a moment to the aggregate accomplishment, CSER has been in existence now for I think it's two and a half years. One is simply the implementation and integration of genome-scale sequencing into a number of different clinical arenas. Secondly, the design and implementation of a variety of, and I put in parentheses, relatively efficient analytical systems and workflows. This remains though an inherently difficult and time-consuming and resource-consuming endeavor, and it's something that we really need to work on if the dream of using genomic information in any kind of routine way is to ever be realized. We've made progress towards open-source analytic workflows, the implementation of facile reporting mechanisms and formats to both providers and patients, because explaining this to both is challenging. On a more nuanced level, for example, the demonstration that Holoxon sequencing from formal and fixed paraffin-embedded tumors seems to be equivalent to that from frozen samples. And here are just some numbers. Total enrollment in CSER as of about two months ago is 1,500, with about two-thirds adults and a third children. You can see the racial and ethnic background that we do need to work on, I would say. And the total sequence that is as a subset of those enrolled is just over 1,000. The majority of those being germline-focused and a minority of those being in the tumor-specific efforts. I couldn't agree more with David, so I'll skip over how many presentations and publications there have been. Here is one representative sample of tumor results. And I think the really important thing here is to think about what these results mean. Only 2% of the case is there a slam dunk while there's a mutation in this tumor that is of established clinical utility. On the other hand, in about a quarter of patients, there are mutations of potential clinical utility. Now, there's a big gap between those two, and some percentage of these will truly be clinically useful, and some percentage will not. The return of results and the clinical relevance in the germline reveals that somewhere between a quarter and a third of these individuals have had positive diagnostic findings. That is, these are people who did not have diagnoses before, didn't know what they had or why they had it, or even necessarily if it was genetic, and whole exome sequencing gave what appears to be a pretty good answer. We see that the incidental findings that are generated are somewhere around 3%. If you use the ACMG list, if you use a little bit of relaxed criteria, you get up to around 5%. This is a representative sample in which one sees whole exome sequencing being applied in a variety of different clinical settings. What one can see is that we're beginning to see some divergence. For example, I think many of us have been somewhat surprised that cancer, that is, individuals who seem to have a dramatic predisposition to cancer, presumably because of a germline mutation, we're not really not getting a very high rate of answer. On the other hand, individuals with hearing loss and retinal disease, in about half of those cases, we're getting a likely reason for why they have those. I think there are some important lessons here for guiding the clinical use of this complex technology as we go forward, but we're still in early days of those results. I think that there has been a huge and important effort on the LC-related component of implementing this kind of information, and early results in this sphere include the whole issue of informed consent, really what that means, and there have been some efforts to really formulate what informed consent should mean in a genomic test. In addition, there are specific challenges related to clinical genomics, like what are reliable measurement tools, how do we develop ones that are needed, et cetera. The incidental findings, as Terry mentioned, have been a focus, and they're really a focus in a way, because of that question I just asked you, and the fairly dramatic divergence just in this room that was shown by the show of hands. That is, we've got to figure out what we tell people and what we don't tell people and what we look for and what we don't look for, and who pays for that when we do this kind of analysis. We know that between 3% and 6% of people will have what we consider at some level quite medically actionable incidental findings, and the degree of choice provided to patient has been a contentious issue. I would say that the CSER sites have been really instrumental in shaping this debate, and that the ACMG's recent shift in the policy or adjustment in the policy was really driven in large part by the CSER endeavor. We're beginning to accrue data addressing what patients really want to know regarding this, because in the end, with those things, that's an incredibly pertinent issue. If you just ask people, what do you want to know? They say, I want to know everything, but then if you put even minimal real-world kind of structures in place and ask them, for example, to make a phone call, that the desire for that information dramatically decreases. Like any economic question, right, it's really a question of competing interests, and we're always judging in comparison with other things. CSER's actively collecting data on measures of patient satisfaction, distress, et cetera. I want to get in the last few minutes to what the challenges and the opportunities are going forward, and the very first one, in the end, the only really, really important one is outcomes, and that's what we ultimately have to get to. We've erected this integrated infrastructure to implement genomic medicine, and it's been, you know, I think, very successful in that sense, but the central challenge going forward is to assess whether this actually improves patient outcomes. We need to answer that if it's going to be a useful quiver in our, you know, in our armamentarium, or arrow in our quiver would be the metaphor, I guess. So in terms of outcomes, what are we interested in? Well, we're interested in morbidity and mortality, obviously. We're also interested in patient satisfaction, values, their well-being, and we're interested in economics. Many people believe that prevention saves money. It actually hardly ever saves money. It's very expensive to prevent disease because it's cheaper if patients die, but of course that isn't the final arbiter of what we do, and we need to figure out not so much do we save money, because we probably don't, no matter how attractive it is to think we do, but we need to figure out how much do these improved outcomes cost, right? We need to explore those outcomes in diverse settings, including ethnic, socioeconomic, clinical settings, and I think that there is an important role for CSER and for the NHGRI as a whole in all of this because the market doesn't really focus on outcomes. The market focuses on uptake, and if you can convince people to have a PSA, if you can convince people to have whole genome sequencing, the market loves that, whether it actually improves outcomes or not. Going further on outcomes, we're going to need new approaches. We will need qualitatively different approaches. We'll need new cohorts of patients with ranges of diagnoses. Who is really going to benefit from this and who isn't? We need to engage in some version of comparative effective analysis. I don't really know whether it makes more sense in this situation or that situation to apply whole exome, whole genome, or multiple gene panels in a given situation. Again, when I say this, people immediately think I'm saying, oh, we shouldn't do whole genome sequencing. We should do lots and lots of whole genome sequencing, but as we roll it into the clinic, we need to be careful to roll in the right things and not necessarily assume it's going to be, for example, the most comprehensive test. And I think that at best, this kind of effort in CSER will then feed into efforts of things like ignite and emerge. We need systematic quantitative extension of existing cohorts. And this is a rather boring one, but nevertheless a very important one. You need a lot of patients to answer these questions. You need longitudinal follow-up of those with positive results. How did it impact their care? Was there dissemination of family members? You need longitudinal follow-up of those with negative results. Everybody who we give a negative result to, those are actually the interesting and the difficult results to give back to people because we have to try to interpret, did this negative result mean you don't even have a genetic condition or does it mean we aren't smart enough in 2014 to figure it out? We need optimal approaches to dynamic reinterpretation. Our patients do not want us to get a negative result and quit there. They want us to find innovative ways to reexamine the existing data and come up with an answer. We need to have outcome measurements in the LC arena too. And I just have to say I didn't mean to pick on Howard because he is very committed to LC stuff. I listened to his counsel. At least I want people to live. That's right. As opposed to me, let them smoke, right? So, analytical approaches are another huge horizon that needs exploration. We've kind of gone by mouse dictum, which I probably shouldn't say here in this time, let 100 flowers blossom. And that is each site has established inventive ways of analytical workflows and engines to analyze these genomic data. And we really need controlled investigations to determine the optimal approach. And it may not be the same in every clinical setting in which genomic approaches are examined. We're going to have to make difficult trade-offs between sensitivity and specificity. And a good example of that is, do we start with a gene list that maximizes specificity and that's predicated upon what we know about that patient's phenotype? Or do we take a gene agnostic approach, which arguably will maximize sensitivity but almost inarguably decrease our specificity? And I think that's likely to differ in clinical contexts. I think that in the realm of intellectual disability, one can begin to look at the CSER data and make a persuasive argument that a gene agnostic approach is right. Whereas in the cancer realm, we might be far better off with a gene list-driven approach. But we need to investigate those questions systematically. We need to do this especially because we have limited time and resources in the clinical setting that go far beyond just funding limitations. So variants of certain significance in my mind are the single biggest challenge to the implication of genomic medicine. And you see this over and over when you talk to people in the CSER site, when you look at Terry's Emerge presentation, when you sit in our sign-out conference. And I think it's because everything comes back to evolution in the end. We're evolutionarily predisposed to tolerate false positives. That's what we do as a species. That's why we see the man in the moon. And that's very, very dangerous in a space as large as the genome. Coincidences are going to happen all the time. And we're going to hurt patients if we don't figure out better ways to adjudicate these variants of uncertain significance. And if we don't maintain an appropriately high level of skepticism. Because if you give me a variant and you give me a phenotype, it's like six degrees of separation. I can always come up with a story that will connect them. Our protocols are inadequate. The stakes are very high. And what makes it especially hard in genomics is we rarely have gold standards for adjudication. If you get a newborn screening result that suggests that a newborn has, say, an enzyme deficiency, you can typically go and you can adjudicate that by, say, measuring enzyme levels. You can figure out if you have a false positive or not. We can't do that in genomics. And that's a huge need. And I suspect, because we're not going to be able to attack all of these things functionally, that much of the answer will come from statistical approaches like calculation to mutational burden and that type of thing. And thus, we're going to need large numbers. There has to be planned overlap between, for example, the clingent efforts between Caesar, between a merge. And we have to figure out which of those efforts is best designed to do what. We need integration and sharing in the future. The only way we're going to get real progress is through really seamless integration and sharing. And we have to develop formats that facilitate this among all kinds of different entities, commercial labs, universities, different clinical settings and vendors, et cetera. And we have to incorporate data science to meet this expected kind of crisis of scale that may occur as we get more and more information. We also have to do it while protecting privacy and complying with HIPAA. And I would argue that the market is really poorly equipped to integration and sharing. And in fact, as we've seen with the myriad story, it's often antithetical to sharing. And I think that that is a real problem if we don't address that in a proactive way. On the other hand, I think it is well adapted to a consortium type of model. We need to figure out how and when to integrate genomic data with other omic type data. I think we should do it where clinically promising in this kind of context. And that's a really tough question. It's in microcosm or in parallel really to the question of whole genome versus whole exome, et cetera. And we have to integrate with training programs if we ever hope to have people who will interpret this. We need rational and targeted expansion of the group sequence, new diagnostic categories of patients. And I think that while, so CSER has dipped its toe into healthy individuals, most of CSER has been largely focused on individuals who are sick. And I think that going forward, what we hear from CSER sites over and over is that there are opportunities to apply genomics in ways that may ultimately benefit outcomes of human health in the general population. For example, the Kaiser group is looking at carrier screening for interested individuals. We have a lot of interest and have a pilot program looking at targeted sequencing of selected genes in the general population that strongly predispose to severe preventable disease when mutated. And we need to facilitate the longitudinal use of this information through the lifespan. Someday we really will get to the point where you can get your sequence and it'll be worthwhile 10 years from now, 20 years from now. We aren't there yet. Think about, would you trust a sequence from 2011 versus one from 2014? The answer would be no. But we will get there at some point and we're going to need to figure out how to synthesize that. We need to expand venues and populations to ensure broad diversity beyond the academic setting when it's warranted. And we need to investigate the cascade impact on family members. And finally, I would just mention, and this gets to the point we were just discussing about, what do we mean by genomic approaches? And NHGRI is going to have to think about this hard and is going to have to grapple with this. It's my own feeling that clinical genomics does not necessarily equal whole genome sequencing. Again, I want to put up a giant asterisk there saying that, yes, we need to do whole genome sequencing on tons of people. And we need to do it systematically. They need to know their research subjects, et cetera. But in the clinical setting, focus testing is usually optimal. When somebody comes in with a headache and they need imaging, we don't get a whole body MRI for very good reason. Unnecessarily broad testing can lead to waste, defaults positives, and to downstream harm and increased cost. When I hear a lot, well, everybody's going to get their whole genome sequence because it's cheap. And it reminds me of that great financial, personal finance aphorism that an elephant for a nickel is only a bargain if you have a nickel and you need an elephant. And I don't think that whole genome sequencing is necessarily an elephant that all of our patients need. We need to do it in the research setting. We need to figure out what it means. But I think that NHGRI needs to be open to the idea that our genomic tools and massively parallel sequencing in particular may be useful for improving outcomes in targeted fashions. I'm not saying that's the case. I'm agnostic about that, and I think that we need to at least just simply keep it as a question. Cesar has appropriately focused on whole genome and whole exome sequencing. It's now well equipped to start to determine where the balance is. When do patients benefit from a more targeted or a less targeted approach? I think our early data probably suggests that it's going to be clinical context dependent. And then finally, I would just end with the observation that in all of our large scale sequencing endeavors, we're wasting some important information. We're not harnessing some really important stuff. We don't, it dismays me. I mean, I understand why, right? But I find it dismaying in 2014 that we don't even know the true penetrance for BRCA1 and BRCA2, the most sequenced genes in the history of biology, regardless of species, right? And there's a reason for that. And that's because we have ascertained those data in an extraordinarily skewed way. We have overestimated penetrance and we've underestimated new mutation rate for arguably every condition that we deal with in medicine. And yet accurate figures are gonna be critical to both the clinical and the public health application of this information. The good thing is we're collecting those data and it wouldn't be that hard to harness them by creating a registry for the reporting of off-target mutations. That is, when you found a BRCA1 mutation because you sequence somebody due to a retinal disorder, well, now that's unbiased ascertainment. And if you can get their personal medical history, their family history, and long-term follow-up, you can come to definitive answers about things like penetrance and new mutation rate. And I think that caesar and emerge are probably logical places to start such an effort. And it could be expand to other NHGRI mediated sites as well as non-research venues as well if those could be incentivized. So I will end there and I'm assuming I should sit down. Okay, all right. While we're transitioning, I can't help but tell a true story. And because... Oh, no. Because you may know it. So remember I told you in my director's report how there's been all these associated Smithsonian programs and the evening and stuff associated with the exhibit. And we did one that Jim participated in and happened to be one that he brought his daughter to, his grown-up daughter, and I met her for the first time and I'm sitting next to her during the event. And then Jim, in the middle of the event, did the thing he did and raised your hand and he gives all the different diseases. Would you want to know? Would you not want to know? So he did all that. And his daughter, it turns to me, said, you know, when I was growing up, he used to do the same thing at all my birthday parties. True story. I'm not a popular father. True story. So. Yes. Let's ask two quick questions. So the first is when you said you had positive result, possible and negative, what's your definition of possible? Because you threw that into positives somehow. And the second, just let me get my second question on them. And the other thing is, incidental findings, five to six people, findings five to six percent of cases, doesn't that seem like a lot to you? So let me, yeah, so let me take those in order. Okay. You touch on something really, really important and really difficult to define. And we've spent a whole bunch of time recently trying to define when you report out, when we report out a variant, okay? We really have these three categories. That is, we found the reason for your disorder, okay? We didn't find the reason for your disorder, right? Those are the two easy ones. The one in the middle is really hard, and that is we possibly found a reason. But then you have to break that down into what you mean by that. So that could be that you have a variant in a gene that you know if it was a deleterious mutation would cause that patient's phenotype, but you just aren't sure if it's deleterious. That's your classic VUS, all right? You also, however, see people who have a phenotype that fits perfectly with the recessive disorder. They've got a clear deleterious mutation in one chromosome, but you didn't find a second one. Well, did you not find it because you missed a deletion, et cetera? So that's a possible, all right? Another example would be, you have a clearly deleterious mutation. It's a truncating mutation early on in a gene. But you're just not sure if the phenotype that we normally associate with that gene really fits with that patient, right? So in other words, the very non-certain significance is a highly nuanced result. And what I was trying to represent there is that in that slide you're referring to is that it's kind of easy to come up with negative and with positive, but then there's that possible. And different labs have different standards. So one of the things that I think the Caesar groups have been good about is not inflating that. But you can imagine what we see in some of the commercial labs is they say, oh, well we have a very low rate of variance of uncertain significance. Well, yeah, that's because you're not reporting things out in an honest way. You're reporting things out as positive or negative when you should actually admit that you don't know. So your second question is, the issue of incidental findings, that was all, in some sense, everybody has an incidental finding, right? Because they're gonna have variance in genes that you didn't predict. What we're asking here is what percentage of people have what appears to be a pathogenic variant in a gene that falls into this category that is medically actionable. And the reason you see the variance from, say, two and a half percent to five or six percent is that different people have come up with different lifts. So there are some people who have a more expansive view of medical actionability. There are some who have a more constrained view. So it's all what you kinda wanna make of actionability. It's more the definition of actionability than the identification of mutation. Which turns out to be tough, right? It's not easy, yeah. I was gonna let this topic go, but you invited further discussion. So I agree with you, and I'm a strong proponent of CSER for implementation research. It's desperately needed. But then to take the step and commenting on Dr. Lander's statement and then going into a comparison with hormone replacement therapy, I think is just wrong. I mean, I think there's a difference between erroneous use of information. That would be the hormone replacement therapy versus maybe premature using, I think your work, premature use of information, which maybe hold exomes. Those are hugely different. Wait, let me finish. So I think, in my opinion, in terms of cost benefit or pain in the game, and also being an advocate for genomics going back to the previous discussion in Emerge, which I think we have to be responsible advocate for genomics in translation. I think there's little harm relative to the game of pushing these technologies into the translational setting. I think to hold back using, if we limit ourself to 100 genes, we're gonna make these grandiose conclusions about a very small proportion of the genome and we're gonna miss what is likely to be the most informative part. I think if you think- I fundamentally disagree with it. If you think we understand that the 100 genes are the, using your words previously, the most important genes, maybe we should rethink having the institute. Do we know the most important genes? No, no, no. No, we don't know the most important genes. I fundamentally disagree with you on this. I don't agree with you on one aspect. And that is- That's one of two comments, by the way. Oh, okay. Can I answer? All right. So wait. Go ahead. So I would say that you are overly optimistic about the responsibility, the level of responsibility that the medical profession has in its use of information. I think that there's an unbelievably seductive tendency to use information that we have to make more of it than we know. And think about the individual who is told that you have this variant and it causes X disease and therefore you need this, this, and that. And you're wrong about it. When you're wrong about it, you subject family members to unnecessary procedures, you subject that person. I agree with that. So I just, I don't see the- That's the reason we need better implementation research on the whole genome. I think what we need is we need research on the whole genome, okay? And when it comes to implementation, we have to be conservative about what we implement. And I think that we have to strike that balance.  I don't like characterizing myself as an advocate for genomics and medicine. I'm an advocate for better outcomes. And if we can demonstrate that genomics gives us better outcomes, then we ought to implement the hell out of it. But you know- So you think we're gonna have better outcomes in the medicine? Is the percent of the genome than 100% of the genome? No. But the problem is in clinical medicine, you end up hurting people when you implement things prematurely. No, that's erroneous implementation, not premature implementation. They're different. They're different. Well, but I would say premature implementation is oftentimes erroneous. And- I'll give you that. Can I just say, I think you're both right, but- You sound like my mom. I think you're both wrong. No, because James' argument about the whole body MRI whole body MRI is definitely correct because we MRI'd people all the time and we know what's in the other parts of the body and we're interested in the head. And the genome is a little different because if you can take the opportunity to- And again, I would say on the discovery side, we should do that. We should hold genome- Absolutely. In the implementation side, I think over time we will know better. But again, if we target just a few, then we want no better. So that's why I think you're both right. I think we need to target in order. In other words, I think we need to investigate the whole genome and we need to skim off what we know and we need to implement what we know and then we need to continue to skim off what we know. I just think it's, and again, this is just my personal opinion. I'm not speaking for Caesar. In fact, there are people in Caesar who would very much agree with Eric and not me. I just am, I think we need to be gun shy about what we do in the clinical arena because the stakes are very high. My second comment is not controversial. Oh, good. I just think we have to be careful about estimating penetrants from clinical-based samples. They're not necessarily independent of what we're trying to ask. You used the word independent. That's just not the case. Okay. I think we have to be very careful about estimating penetrants from clinical-based samples. Right. I'm just trying to find out where do we have relatively unscued ascertainment? I would say it's the population-based epidemiologic studies that are very deeply fined, but much more deeply fined. And that would be ideal, but I would also argue that maybe letting all these other data go to waste that could be useful, right? But with the limitations that you point out. So if I understood you correctly, you're basically working on the implementation side. You're not really working on the discovery side. So that seems to me right, that if you're working on the implementation side, you wait for the discovery before you do more implementation. I mean, that's, and as a consequence, I think you'll be able to discover what whole genome sequencing really costs. It's probably not a nickel right now. In fact, it's, because whole genome sequencing, the cost of it is not just doing the whole genome sequencing as we all know. It's all the sequelae that follow from it. And so you will get, and I hope insurance companies are interested in this, is a shot in time of how much it costs right now to do it in certain categories and how much it costs in other categories and what the benefits are relative. And then as more discovery happens, presumably, maybe it'll become more cost effective because the benefits will be much greater. But right now you'll get a slice in time kind of perspective. Is that accurate? Yeah, I think so. And again, I don't want to discount or artificially deflate the fact that discovery happens in Caesar. It does. I mean, we've found very cool stuff. We're expanding phenotypes and all that. But I think it's fair to say, and Lucia, correct me if I'm wrong, I think that the raison d'etre of Caesar is not discovery. It's figuring out how best can we use this new technology in to ultimately improve patient outcome. How do we implement it wisely? Because, I mean, that strikes me as much more similar to what some of us call outcomes research. Yeah. And so that makes, to me, perfect sense because outcomes research is very different from discovery. And that's why I put the outcome stuff in the last part of this presentation, which is, okay, what's the future? Because first you have to create the infrastructure and you have to kind of cut your teeth and figuring out how to analyze these things and et cetera. And then you have the opportunity to start looking at outcomes. The intellectual disability, the hearing loss and eye problems, I mean, those have been known for a long time to have huge amounts of genetic, heterogeneity. So what are you discovering or planning to implement that really changes what we already know about these disorders for the patients? Is it prognosis? Is it, it's not treatment, is it? Right, well, sometimes it is treatment.  And I think that what we in some ways have to settle for in a majority of cases is that diagnosis is important, it's a lynchpin of medicine that helps people with prognosis, it helps people with family planning, et cetera, et cetera. But if you're asking, does making a diagnosis, is it a game changer? Not usually, right? It's just that that's the reality we live with in the 20, I would say this entire, you know, we'll be living with this whole century in medicine. We do our best, we make diagnoses, sometimes that makes a huge difference. For example, in long QT, you sometimes, certainly knowing the mutation and knowing the gene affected affects the threshold you have for whether you put an implantable defibrillator in, whether you use medications, et cetera. We have a patient where, who had for 30 years been confined to a wheelchair and crutches because she'd been diagnosed with hereditary spastic paraplegia at very good places. And Holexome Sequencing showed a mutation in the GTP cyclohydrolase 1 gene, which is responsible for DOPA responsive dystonia. Six weeks after being started on Cinemat, she walked into her appointment with no crutches, right? So once in a while it's gonna matter, but the fact that making a diagnosis is not a game changer frequently, I think is more an issue of where medicine sits in the year 2014, not a germane criticism of genomics. We need better, better diagnostic modalities. We also need better therapeutic modalities and hopefully the latter will come, right? Once we're better able to understand these diseases. But Dee Dee and then Rick is gonna have a question. Yeah, so you mentioned the need for other omics data. Could you talk about how you see that being implemented in a seizure context? Yeah, I think that probably the best example of that is in the realm of tumor sequencing, where for example, adding RNA-Seq and that kind of thing could inform whether a particular mutation actually is going to cause increased susceptibility to this agent or that agent. The rest of what I'd have to say would be hand-waving and I'll leave it to investigators who know more about proteomics and know more about looking at epigenetic changes to figure out whether incorporating some of that information into these kind of things could actually inform us in meaningful ways about patients. But I think the one where we may be poised to begin to make a difference would be in tumors and looking at expression data. Because that can be a real game changer in whether a given agent would be expected to have an impact for the better on that patient. So that's the big one. Thank you. Terrific talk. We all have the experience of seeing patients who come to us as the nth court of last resort. And one question I have for you is making a diagnosis that frequently puts an end to that futile cycle. And I'm wondering how you capture that as an outcome and the value of that to the medical system and to patients. Yeah, that's a really good question. I mean, I think so the term in our field is that you can end the diagnostic odyssey. And that's such a great expression, right? Because these patients are really on an odyssey to go from doctor to doctor and have millions of tests. We have not scratched the surface yet in documenting and trying to really figure out the true value of that. We've begun to be able to assess through just talking to patients, following them up, surveys, et cetera, what it means to them in kind of a personal way. And that's not trivial. But I think your point's a really good one. It does arguably have a beneficial impact on, for example, economics, et cetera, when people aren't getting unnecessary testing, et cetera. And I think that's part and parcel with what CSER and these other efforts need to do in documenting whether what we're doing makes a difference, right? And one of those differences could be, yeah, they didn't need all those other tests that they otherwise would have got. All right, thank you, Jim. All right, before they run out of caffeine upstairs, we need to get you up to the cafeteria. So let's reconvene at 320.


Classroom Management in an International School in Shenzhen, China As a teacher of grade 2 at an International School in Shenzhen, China, my classroom management has many components. Educators require both teaching skills and classroom management skills because strong classroom management creates a safe environment for students to learn with joy. Setting up rules First, a classroom agreement is a component of my classroom management plan. At the beginning of the semester, students collaborated and agreed upon the rules. Such rules included, listen when someone is speaking, respect others, be caring, no running in the hallway or in the classroom and no shouting. When the rules were made, everyone signed their names signifying their commitment to follow the rules. Classroom safety Second, emergency cases are also very important in my classroom management. Some emergencies in my class are students bleeding, fighting during recess, headache, stomach ache or fever. As a teacher, my priority is to make sure I take immediate action to ensure the students are safe. Then I judge if I would need to send the student to the nurse, or call the parents. If the student is sent to the nurse, I would ask one classmate to accompany the student in need. In serious cases, I would seek help from another teacher or the head of the school. Considering learning difficulties Third, planning accommodations for students with learning difficulties is also a vital part of my classroom management. A few significant issues I had this year include students with attention problems, chatty students and those not listening when the teacher is talking. The student with focus issues demonstrated the following behaviors. He was lying down rolling his body while other students sat cross-cross facing the teacher, and he did not complete his work while other students were able to finish the task in time. To accommodate for this student with difficulty focusing, I collaborated with a guidance counselor. Our solutions included allowing him to hold a softball, letting him sit next to the teacher and providing him with a sensory cushion. When there's a task, he could work in a small, quiet classroom to avoid distractions. I also worked closely with his parents to understand his emotions at home. Both the school and the parents encourage and motivate him every day. After these interventions, he has shown much improvement. Reward system Finally, setting up the reward rules is a way of motivating my students. This is also part of my classroom management. I set up weekly star student rules and whole class reward rules. This is to motivate not only one student personally but also the class as a whole. When the stars reach a certain number, students are rewarded with a small celebration or prize, such as a lollipop, 10 minutes of free playtime, and so on. The students enjoyed it a lot. Do you want to teach English in China? Everyone has his own style of classroom management concerning of rules, emergencies, rewards, and accommodations. Each educator's classroom plan will be designed based on the needs of the teacher and the students. I am motivated to continually learn how to improve my classroom management because I am passionate about my current and future students. Speak with an ITTT advisor today to put together your personal plan for teaching English abroad. Send us an email or call us toll free at 1-800-490-0531 to speak with an ITTT advisor today.


Moving over to the Los Angeles side. We don't really know if Josh Johnson will play I think that he is less likely to play than Landry Jones is as of right now But I think kind of regardless Elijah hood is a pretty good option at $15 mostly because I feel best about his role Being steady played 71% of the snaps last week that was second on the entire week behind James Butler We'll be in the next game who had 12 carries and no targets the zero targets a concern But he did run 24 outs on 44 drop-backs. So I Want to spend up for Houston guys on this late Elijah hood helps me do that while ensuring I'm gonna have a player who will be on the field quite a bit. So I think Elijah hood I'd love him if Josh Johnson starts, but I like him a lot even if Josh Johnson does not and I think he's a pretty Standout value on this Sunday only slate. What about for you? yeah, I mean, I'm still projecting out these games and Figuring out where the value might be based on workload and Elijah hood is the number one I think running back value on a per dollar basis of the entire weekend. So therefore by default on the Sunday slate, so We're not gonna get based on what based on week one We're not going to get many workhorse running backs hood still wasn't that but you mentioned the routes were there Even though he didn't get any targets 12 carries the snap rates up I don't think that you can really ask for much more than a 70% snap rate for running back in this league unless things Unless things change looking forward hoods just in the best one of the best spots of the weekend