All right, thanks Colin for the invitation and also for setting people's expectations for a interesting talk. Hopefully I can meet those. So today I'm going to talk to you about identification of fitness genes and genetic interactions and cell lines. So mostly human and a bit of a surprise at the end for you. So when I first started my lab, I'm not sure if you can see my pointer, can you? So when I first started my lab we were doing a lot of genome-wide pooled RNAi screens in cancer cell lines. And RNAi was a useful technology but we found that we were getting really frustrated trying to validate things from our screens and also even QC the screens that we were doing. So we came up with this idea of building a list of essential genes and non-essential reference genes that people could look at when they were doing genome-wide screens and QC their screens. And so here's just an example of how that type of thing worked in the middle grafts, a precision recall curve where you can see a decent performing screen in black and then a mediocre screen in dark gray and then a relatively crappy screen in light gray. So we had large sets of screens about 100 at the time and we used about half those screens to come up with what we called a set of core human essential cell line essential genes. And we simply defined that set as whether or not a gene was essential or a fitness gene was essential in half of the cell lines or more. And you can see here this was 291 genes if you essentially added up those essential genes which are pretty small list for humans and pretty pathetic and this was back in 2014 but at least it gave us a start, a place where we could start to QC screens and sort of put everyone on the same map and against the same standards. So then came along CRISPR and we tried hard to keep up with the broad but we couldn't. They beat us to the first large library but we were not too far behind. We built a large CAST9 based library and started to do screens in human cell lines to see if these screens could outperform our RNAI screens and if they were better at predicting essential genes. And so the way these screens work is essentially you build a library into Lenti virus and this particular library had about 176,000 guides in it and this was targeting over 17,000 human genes. We packaged that into Lenti and then we infect cells so that each cell on average gets a single SGRNA expressing cassette and then we track those guide RNA cassettes over time and under different conditions or different genetic backgrounds. And we read everything out by sequencing so the GRNAs act as a barcode. We can further barcode those with a cell specific barcode but we don't find that that actually gives us a lot more information for the cost. And so the first set of screens that we did was in five different human cancer cell lines shown here and we also included a screen that was done by Feng Zhang's lab at the Broad by Omar Shalan. And what you can see right away is the PR curves actually look pretty good for all of these screens but we were shocked when we looked at the numbers of genes at the same FDR that we would identify with our CRISPR screens relative to the SGRNA screens. So we were identifying about 2,000 genes on average as opposed to less than 500 with SGRNA. So we were pretty happy with this and realized we're probably more in the ballpark for the number of essential genes that a cell line needs for growth, division, proliferation. And so at least based on model systems information. And so we came up with this idea of a daisy model for gene essentiality and sort of conjectured that if we screened enough cell lines then we could define a core fitness, a list of core fitness genes just as we had tried to do with SGRNA data. And so if you actually do that and you remove, if you take a fairly simple definition and say, okay, is the gene essential in half or more of my cell lines that I screen, you can actually look at that list and then associate them with various properties. For example, core fitness genes are correlated to high levels or increased gene expression. They're anti-correlated to variation in gene expression. They're correlated to whether or not your gene encodes a protein in a complex. They're negatively correlated to mouse Dn to DS ratios and deleterious mutation frequencies. And they're positively correlated with numbers of axons in genes. So these features are general and some of them you would easily have predicted, but we had numbers to be able to actually calculate these out now. So we used that data and we used additional screens that came online from other labs at the time to empirically come up with sets of rules to improve our Cas9 guide designs and we got to version three of our library, which includes about 71,000 guides targeting 18 over 18,000 protein coding genes. And when performing screens with this library, we do better than our original library and the properties of the core fitness genes from this library also hold true. So we named this second set of core essential human cell line essential genes V2 and we used that to actually QCR screens now. Most of the genes in actually not all of the genes in the version one set overlapped with the version two set, but if you go beyond 684, you start to capture the rest of the V1 set. So if you fast forward a few years from that, we're now at many, many genome-wide screens that have been done in human cell lines and even some mouse cell lines and even other species. So here's just a very short list of some of the screens that have been published and some that are ongoing. So currently we probably have over a thousand different human cell line models screened at the genome-wide level with some pooled CRISPR library or another. And so this represents a lot of information, right? So at the bare bones, say there were a thousand different cell lines, you've got 18,000 genes in the human genome, that's a fairly complex matrix to deal with of information. So how do you start to actually use this information to move forward with, say, better functional categorization of genes in the human genome? And so one way to do so is to sort of do targeted-based selection of cell lines that may have certain features that you're interested in understanding genetic interactions with those features. So we did, this is an example of a case where we essentially did some screens in pancreatic cancer cell lines that had RNA-43 mutations. So RNA-43 mutations were originally discovered by the Cleaver's lab in Netherlands, and they were predicted of whether or not patients had certain forms of colorectal cancer. And so it turns out that in pancreatic cancer about 8% of PDAC patients have RNA-43 mutations or ZNRF3 mutations, which is a paralogue of RNA-43. And what these RNA-43 loss of function mutations do is they render pancreatic cancer cells completely dependent on the Wnt pathway. So we actually categorized the screens that were RNA-43 mutant pancreatic cancer cell line screens in one bucket and compared them with all the other screens that we had that were a wild type for RNA-43. And you can see here that we read out a bunch of Wnt-related genes that were important in the RNA-43 mutant, but not in the wild type cell lines. What was interesting from this set of screens was that Frizzled V was the top gene by far. And what's further interesting about Frizzled V is that it's one of 10 Frizzleds encoded in the human and mouse genomes.  They must jump in for each other when one's not there, then the other ones can take over. In this case, this is not the case at all. Frizzled V was very specifically required in these PDAC-related RNA-43 mutant lines. We went on actually to confirm this not only with genetics, but we built antibodies that were highly specific for Frizzled V and not the other Frizzled receptors in the human genome. We were able to prove that by knocking out Frizzled V in these lines or by treating them with antibodies against Frizzled V, we could actually impact the proliferation of tumors and cell lines that were RNA-43 mutant. So that's one way to kind of start to distill the data from all of these genome-wide screens. But there's also a lot more data that you can look at. And so one of the questions is, is there more of an unbiased approach that one could take to start to kind of organize this information in a better way? So you can think of this pretty simply. So we've got a library that's targeting all genes in the human genome, and then a number of different cell lines. This generates a matrix of data, and when you cluster that matrix on the gene side, you start to find things that are coessential or co-functional, right? And so there are a number of papers that sort of describe this approach, and you can build a network once you start clustering these things together. So you have a big dendrogram on the gene side. You can also cluster the cell line side, but the challenge there is that you don't really know what the genotype is that differs between, say, cell line C and D that are driving a specific pattern. And so you get really interesting data just on the gene side, and I'll show you a snapshot of some of the debt map data that's available online at the debt map portal. So this is a large matrix of 485 different cell lines and 18,000 genes on the vertical axis. So most of that matrix is dark, it's black. If you're blue, you're more essential. And so you start seeing stripes of blue across this big matrix, and I'm just showing you a slice of that large matrix. So about 25% of the matrix or so is blue in some way or another. But you can see these very prominent stripes, and if you just zoom in on the right-hand side, you can barely make out some of the gene names right now, but if you zoom in just to this little square or rectangle, you can see that basically this cluster of stripes is all the histone genes. So it's pretty amazing that you have a matrix of 485 cell lines by 18,000, you cluster the gene side just based on fitness profiles, and all the histone genes fall out right next to each other. So that's telling you something about how those genes are functioning in a common way amongst each other. I don't think I have to convince anyone that all the histone genes are probably doing something very similar in the cell. So like I mentioned, there are lots of really interesting clusters on the gene side, and that's one way you could imagine cutting down, say, a family of genes and just honing in on specific genes that could represent a specific phenotype. But then again, one of the challenges also is we don't really know what the genotypes across all those cancer cell lines are that really drive the clustering. So one of the projects that we started a few years ago was to think about how we could actually do systematic double mutations in a model of human cell line to start to understand double mutant interactions. So this is sort of exemplified by this schematic here. So if we knew what the differences in gene mutations were on the cell line side, we could start to cluster things on both axes and then generate a good understanding of what genes interact with each other and how they're functioning in a cell. So in order to do this, we started to collect and make our own HAP1 knockout cell lines. And our approach was essentially to take a knockout cell line and do a genome-wide screen on top of that. And so we have about 30 or so wild-type screens we've done over the last three years. These are just HAP1 cells where we can essentially track all the essential genes or fitness genes in HAP1 cells. But then we have a number of mutants too that we've screened, and we're up to about 200 now. And so this is a collaboration with Charlie Boone and Brenda Andrews, who are yeast geneticists and built the first double mutant genetic interaction network in the yeast saccharomyces serviceae. So they were very keen to kind of move their concepts forward into human cells to see what we could find. And Chad Myers, who's a computational biologist at the University of Minnesota. And so here's just a single screen I'm showing it for some of the data that we get. So this was an arid 1A knockout cell line where we did a genome-wide screen on top of it. You can see here that the best negative interaction shown in this red dot is arid 1B, not a surprise. The arid 1A and B are paralogs with each other, so we weren't surprised to find this interaction and it sort of suggested things were real. So we kept on screening, and this is one of our early matrices where there's about 100 or so different mutants along the top. And then this is just a stripe of an interesting cluster where I've boxed in red a series of negative genetic interactions shown in blue that are driven by a fast end knockout. So if you just look at the fast end screen alone, you can see here this is the fast end screen on the vertical axis and the wild type sort of hap1 or parental hap1 screen on the horizontal axis. The things that are off the axes are either negative interactions, so they interact with fast end knockout or positive interactions. So in the presence of a fast end knockout, when you knock out, for example, Tata1, the cells grow a little bit better. So what you can see from the fast end screen are a number of things involved in lipid uptake and lipid regulation or cholesterol regulation, and that makes sense. So when you knock out fast end, which incurs fatty acid synthase, you can't make lipids de novo, so you rely on exogenous lipids for lipid metabolism. And so, for example, LDLR is a synthetic lethal with fast end and so are some other genes. One gene we actually uncovered here, which I'll just mention briefly, is this unknown orph called C12 orph 49. There were no annotations for this gene, so we actually followed it up and found that it was an important gene for LDLR uptake. So we called it LUR1 for lipid uptake regulator 1, and it turns out that two other groups also discovered this gene and found evidence for it involved in the Shrebev pathway. So this is a great sort of way to discover genes and their functions. So how do we keep track of all this data?  We track everything that we sequence. We track all the cell lines as much information as we possibly can. It's easy for people to go in and sort of look stuff up and even do de novo scoring within the database. And so all the scoring metrics and even different scoring metrics for the same data are available. And we also have a part of the web page that you can go in and you can look at different clusters of genes. So here's an interesting cluster where essentially all the genes in the heme biosynthetic pathway fall out beside each other. And you can see on the right-hand side of mapped out the heme biosynthetic pathway. The only genes we don't get in this particular cluster are two paralogs, Alice 1 and 2, and also this gene EuroD. So we're not sure why, but what's cool is you can, when you do this type of clustering, you often find genes like this red dot that have no annotation to them. But because they fall in that cluster, it provides an immediate hypothesis to go and test whether or not that gene is involved in heme biosynthesis. So I think this is a good way to start to fill in some of the unknowns and functional unknowns in the genome. But remember, this is only, you know, we're only knocking out two genes in this context. So maybe there's more than two genes that contribute to a phenotype, you're not going to find it. And we're only looking at fitness. So this is a single phenotype, but we're getting tons of information about how genes are talking to each other. We can also do other cool stuff we realized when we started looking at the data a little bit deeper. We realized that there were these clusters of genes. So if you plot out the genetic interaction scores by position on the genome, we often found these little clusters of genes that's denoted by this arrow that all pop up and they're all in the same region. So what it turns out that if you zoom in, you can see them, they're all here. So these are genes that, when you knock them out, it looks like they're growing better in the mutant. But what it turns out is that the wild type cells actually have a duplicated region in that spot. And the mutant cells don't. So the screens are so sensitive that they can actually differentiate between two cuts in one, right? So we're making a single cut in the genome, and that actually impairs your ability to grow just enough that we can see whether making two cuts is worse than one. So that's something to think about when you do CRISPR screens. So right now, we're basically thinking about how to fill in this double mutant interaction space, just probably not so different from how you guys are thinking about how to choose genes, right, to make knockouts. So if you think about yeast, yeast has 6,000 genes. There's 36 million potential di-genic interactions. These have all been mapped. There's a beautiful website. You can go and look at all the connections between two genes. In the human, it becomes a scaling issue, a major scaling issue. There's 20,000 genes. If we were to map everything, that's 400 million different interactions. So where are we today? So there's one group, the Jonathan Weissman's lab, published a paper where they looked at as a very, very small portion of this matrix, about 55,000 interactions, so you can see how that sort of lays out in the global landscape, 235 by 235 genes. Some of those are essential genes. Essential genes tend to give a lot of genetic interactions when you can screen them, but you can only screen hypomorphs because you've got to keep the cells growing. We're doing something a little bit different. So we're laying these sort of long stripes down. And so right now we've got, this is 150, but we're up to 200 now. So we have about 18 million tested di-genic interactions, and we hope to keep going. But we also have lots of other data sets, like this Brode data set and Sanger data set that represent many, many different cell lines of different genotype. And they're laying stripes down too, but we just don't know where to put those stripes in the context of double or multi-mutant genetic interactions. And we also have drug screens that can fit into this landscape as well and give us an idea of how the mechanism of a certain drug is working, and that works quite well. Now remember, we're just doing this by fitness. There's lots of other phenotypes. You can make a genetic interaction map for any phenotype you want. I would suggest that at least fitness is a good start. And then maybe some of the genes that don't have any interaction or show any signal in fitness screens, that's when you move to a different phenotype. I'll describe one later. So just like in the movie, unfortunately, no one can be told what the matrix is. You have to see it for yourself. So I think this is a product that hopefully, you know, we're doing this in Canada. And funding there is OK, not great. So we want to try to build this out and hopefully generate a di-genic interaction map for a model human cell line that can contribute and complement some of these other larger projects. Now having said all that, there are lots of limitations to the way that we're currently screening with CRISPR. And here are just a few issues that we've run into. So a couple of years ago now we started thinking about, OK, well, how can we multiplex this system to make it more efficient? And so many labs have been trying to do this. Our attempts at trying to multiplex SP-Cas9 were largely failures and very highly variable and uninformative and frustrating. The problem with most of these approaches right now is that they're all using SP-Cas9, variations of SP-Cas9, except for one called the big poppy system out of the road, which uses SP and SA-Cas9. But they're basically the libraries are built by random combinations of guides. And that restricts you big time in terms of how you can actually program libraries. And so the Zhang lab found this other enzyme called Cas12A. And this is pretty cool because you can multiplex guides and the Cas12 has two intrinsic enzymatic activities. It's got an RNAs and a DNAs. So the RNAs can cleave off all the guides if they're expressed as a single transcript and then load them into Cas12A, which is also known as CPF1. And the DNAs part of that enzyme can then go and in a sequence specific way find its target and cleave it in a double-stranded manner. Now the challenge is that no one's been able to figure out the rules for this or how to make it work in an efficient way. So the approach that we took was that we actually co-expressed SP-Cas9 and CPF1 or Cas12.  So a guide that contained both Cas9 and Cas12. So we can express that. And the way that CPF1 works is that it will cleave the CPF1 guide off, load it, and then you'll have Cas9 going to find its sequence target, Cas12 going to find its sequence target. The cool thing is that you can multiplex this too.  And so this project was a collaboration with a Blanko lab at the Donnelly Center and two postdocs and a computational biologist. So the postdocs called this system chimera because it was a chimera guide. And their acronym is CAS Hybrid for Multiplexing, Editing, and Screening Applications. And chimera is a mythical creature with the head of a lion, the body of a goat, and the tail of a serpent. So the problem when we first started this, we had a couple of these chimera guides that worked, but we had no idea what the rules were. So we spent a long time making libraries and doing screens to understand what the rules were. And we came up with a convolutional neural net that allowed us to predict highly active guides at 80% efficiency. And so I'm not going to go through all of that effort, but what I will show you are some of the applications that we were able to actually use with this system to show that it worked well. And so we actually made a large library against human alternative exons to look for alternative exons that contributed to fitness. And then we also built libraries that targeted the same gene twice because we felt that, you know, maybe if you knocked the same gene, or if you took a large chunk of a gene out as opposed to just making an indel, we might get more information, it might be more sensitive. And we also took our system and we looked at all human paralogs that are duplicate genes, so strict duplicates. And I'll just go through a couple of examples for two and three. So this was the first data we got. So the libraries we were making to test the system and show that it worked were mostly targeting essential genes because we knew what to target and we knew what the phenotype was. So what I'm showing you in these box plots, essentially targeting core essential genes which are the red box plots with either dual guides where only cast nine or only cast 12 target that gene. The other guide in those dual guide pairs targets an intergenic sequence somewhere else in the genome that we know doesn't make any effect on fitness. And then on the left-hand side are dual guides that target the same gene. So the cast nine and cast 12 guides target the same gene. And what you can see here is this log-fold change, a negative log-fold change when the essential genes are targeted once by either cast nine or cast 12, you get a significant drop that's consistent with what we see using single target and cast nine libraries.  So this gives us a better signal-to-noise ratio that we can measure. This is also true in RP1 cells. I think it worked better in half-one cells because we only had one copy of the gene to target. RP1 cells, there were two, it was diploid. But you can see that targeting non-essential genes doesn't really have a big effect, but happy to talk in detail about how we controlled for all of those events. If you simply just add up the number of fitness genes based on these data, you can see that you get a significant boost by having dual targeting guides in your library for the same gene. So we can go from just around 1,800 genes at an FDR of 5% or less to over 2,500 by dual targeting in half-one cells. We get a much better effect in RP1 cells, probably, because they're diploid and there's two copies of the gene and you get four shots on goal, essentially. So the other thing that I'll just mention briefly is our ability to target paralogs. So we designed a large library that targeted all human paralogs. And so here's an example of some of that data. You can see here for HAP1 cells or RP1 cells, for example, targeting SAR1A and SAR1B alone don't do anything to fitness, but if the double mutant has a profound effect on fitness, same with SEC23A and B. So these three top three genes are consistent in terms of their effect across HAP1 and RP1 cells. But I added a couple of interesting results that we found from RP1 cells. So for example, targeting TET1 or TET2 had this very slight negative effect on fitness. But when you target both of them together, it seemed to eliminate that. And again, here's something else, a positive interaction where targeting SDK38L or SDK38 alone didn't do anything, but the double mutant had a very strong positive effect on fitness. So here are just some numbers. There are 672 human paralog pairs, 90% of the predicted duplicate paralog genes in the human genome. And what we see is that 33% of those, or 219 pairs, have a non-additive fitness phenotype in HAP1 cells, 18% in RP1 cells. The majority of the effects are actually negative effects. So most of the effects we see by targeting paralogs have a negative impact on fitness. And so maybe this system could be useful for sort of going deeper into the genome for functional discovery. Now, we haven't forgotten about mouse. We've also made a mouse library. And we did this specifically because we were interested in genes that regulated cytotoxic T cell killing. So this is an important clinical phenotype. And so what we did was we took six different mouse syngenaeic tumor cell lines. And then we expressed antigens on the surface of those lines that rendered them sensitive to T cells that had transgenic TCRs targeting those antigens. So we took those libraries. And we actually performed two separate screens in parallel. We did a fitness screen. And we looked for mouse essential genes in each of these backgrounds. We also did a T cell killing screen to look for genes that sensitized or resisted to T cell killing. So I'm not going to go into much depth here. What I will say for this crowd is that the mouse library worked really well. We were super happy with the mouse library. We generated a test set of core essentials and non-essentials that we could use based on expression data from mouse tissues. And these are just the PR curves across the six cell lines. Most cell lines, you can see that the essentials and non-essentials worked extremely well. We were able to actually find all the essentials we were looking for in most of the cell lines. And from this data, we were actually able to also redefine the set of core essential mouse genes from these types of screens so we could have a better sort of functional set that's been validated. And I'll just end on this last slide here to show you that based on some of the dependencies in these mouse cell lines, very similar pathways to what we find in human cell lines, but they represent a diverse set of genetic dependencies that allow us to look at some of the effects of T cell killing in these backgrounds. And I'm happy to talk to you more about what we found in those screens if you're interested. But I think I'm out of time, so I'll stop and acknowledge everyone in my lab. The JIN team, which is the genetic interaction team, which is a collaboration with the Boone and Andrews labs and the Meyers lab. And I tried to acknowledge people along the way, so I'll stop there. Questions? So the paralog targeting is really interesting that you got some of the sort of counterintuitive effects, I guess. I'm wondering if you looked at whether there was any relationship with sort of the time sense divergence or the duplication of that original gene into those two paralogs. And if there was some relationship, do you see that switching from redundancy to new effects, et cetera? Yeah, that's an interesting question. We haven't really looked at where paralogs have come online in terms of the human genome and mapped that to our results. We're working in a weird cell line, which we always get criticized for, but we have to start somewhere, right? It's just if people argued over which yeast drain that should have been used in the 60s, they never would have started. So you got to start just like you guys are using C57, right? So we haven't done that, but it's a really good idea. I'd love to do that, but we haven't. The other question I had was sort of you noted at the beginning, and I'm just curious from a screen perspective how important the time course element is. And so I'm guessing within that you take cross-sectionally, you take, and you sequence, and you determine the depletion at time points following selection, how important is that in terms of information gained in order to define that course? So predicting essential genes, single-mutant fitness is really easy. Double-mutant fitness and genetic interactions is very, very hard. So we've spent probably two and a half years trying to score this data, and we've come up with ways of being able now to essentially match, time-match screens with the wild type so that we can actually answer that question. So almost all the screens we do are with multiple time points because we're trying to time-match things to predict genetic interactions. But for single-mutant fitness, it's easy. You don't even really have to do it. We can correct easily for single-mutant fitness effects. Hi. You mentioned something about a big antibody resource, basically, that you guys have created. I wonder if you could just talk a little bit more about that because you went through that really fast. OK, yeah. So actually, it was a U project that started many years ago, a roadmap project that was antibody-based project where there were two teams essentially that were set up to go against each other. There was the monoclonal antibody team that was run by Jeff Bucca. And then there was the synthetic antibody team that was run by Jim Wells, Tony Kosikoff. And then there were a couple of wacky Canadians in Toronto that were helping out with Jim and Tony. And so based on that effort, it was called the Recombinant Antibody Network. There's a website for it. I can send it to you. We made a whole bunch of different antibodies for various targets. That initiative was based on targeting transcription factors, which are kind of a bad set or class of targets to go after with antibodies. But we had a separate initiative where we go after self-surface targets like frizzles that worked much, much better.  And they're all listed on that site. But the self-surface antibodies were separate set. But I'm happy to talk to you afterwards about how we did it and what we've got. OK. That'd be great. Thank you. Hi. Thanks. Hi. The, you may have said this because I got interrupted in the middle of the talk. The synthetic lethals in yeast, have you looked at to translate that to what happens in human cells? Are they the same genes, orthologous genes? There are a number of relationships that are conserved, but not a lot. So we can't predict what's going to be synthetic lethal in human cells based on yeast. And even going from Saccharomyces cerviciate to Schitzel Saccharomyces pombae, there's only 30% conservation amongst genetic interactions. So it's a hard ask. But there are some very specific interactions that many people have published on that are conserved. But systematically, it's not a good predictor. And one other question was, if the scale is up to go after the 400 million interactions, is there other phenotypes you can look at at scale besides in this? Yeah, that's a great question. I mean, that's why our second phenotype was T-cell killing. And that took a long time to set that assay up. So I think there's all kinds of cool phenotypes one can look at. I wish we could accelerate the process. And even if you're looking at the transcriptome, if people have argued that the transcriptome is 1,000 phenotypes, if you can do single cell and you get the transcripts, you get 1,000 phenotypes, but the reality is you're just looking at the transcriptome. So it's another phenotype. How diverse that is, I'm not sure if that's going to get us to the end where we can build a very comprehensive and robust understanding, even one cell type. So we don't even have that for HeLa cells. I mean, we don't know what every gene does in HeLa cells. So I think we have a long way to go. A lot more. So is this all just non-adherent? Are you using non-adherent cells from robotic liquid handling? Actually, so the HAP1 cells are adherent. They're haploid. But then we actually converted them to non-adherent because it's easier to screen them. We can do it in spinner flasks. We can reuse the spinner flasks. We're using so much plastic. We started feeling really bad. So, OK, thank you.


And now, a tale well calculated to keep you in, in a moment, act one of Let There Be Light, starring Ivor Francis and written especially for suspense by Irwin Lewis. A little wild snow would fall, silent. Soon another winter would be my only companion. The heavy snow bits would make it impossible for Helen to come until spring. I don't think it would be anybody I know, whoever it is coming up. I'll go inside. If I knock, I won't answer. Maybe they'll think nobody's here and go away. But why? Why would anybody be coming up here? They're cutting through me like a knife. No, will you stop complaining. At least you're wearing a top coat. This fur piece of mine wouldn't keep a rabbit warm. Oh, my feet are frozen. Ah, this is a wasted time, Gloria. Nobody's fool enough to limit the tap of this hill. There's smoke coming out of the chimney. Well, gotta be it through that window, be anybody. Yeah, there's somebody inside, all right. Good. That's no example of Western hospitality. We're strangers. You should invite us in with open arms, kid, instead of just standing there in the corner. We're cold. You should ask us to warm up by the fire. In fact, if you don't mind, I'm going to take advantage of that stove right now. Half frozen. Coffee smells good. How about a cup, huh? Help yourself. Well, it's not being a gentleman, is it, Sam?  You talk too much. There's your coffee. No sugar, no cream. Don't get too comfortable. My name is Shelby. Sam Shelby. Bill Donison. Information, kid. Right, Sam? Well, I was here. I told you. I heard it crack. Take it easy. Now, listen, kid, I'll tell you how it is. You see, a friend of ours was flying that plane down to Mexico. We were supposed to meet him there a day after tomorrow, but something went wrong and he cracked up. He managed to get to that town in the valley and phoned it. When we got to the town hospital a couple of hours ago, they told us he died, maybe an hour after he phoned. Now, you see how it is? No, I don't. I told you I didn't see the plane. And I still don't know what you want from me. All right, let's cut the call. The boys had some... Well, he got something on the plane that belongs to us. We went over every foot of the wreck and it's not there. Now, there's nobody within miles of this place, so it's gotta be that you took it. I hand it over. I don't know what you're talking about. I didn't see the plane. I couldn't. What are you trying to hand me? You'd have to be blind not to see it. That's right. Sam, he's gotta be lying. Did you see the way he lit his cigarette and the way he gets around? I've lived here for five years ever since I lost my sight in a mine accident. I know every inch of this room.  There's one way to find out. Take off those glasses. No. All right, then I'll take them off. Don't touch me. See you around sometime. What are you taking? Your mac and law. Putting it on the table, kid. That'll buy you half a... It might be Helen Prescott. She's a girl I know from the town. Once in a while she comes up here, but I didn't expect her. I mean, I was hoping... Of course, coming up and somebody's on it. That in the back, Helen leaves the horse and there in bad weather. She'll be coming in the door. How do you do? If I'm interrupting anything, Bill... They were just leaving, Helen. Yeah, that's right. Thanks for the coffee, kid. Too bad you... Well, you know what I mean. But that's life, huh? Are you all right, Bill? Of course I'm all right. Why shouldn't I be? I was worried about you. When I heard the weather report about the blizzard, I thought I'd better get up here. Why? I don't need everything? I didn't mean it that way. I thought you might like company. My company. Why? Come on, kid. Sorry we couldn't do business, but you sure couldn't have gone to that plane. The wreck at the foot of the hill? That's it. Of course he could if he'd wanted to. Helen, what do you hand in me? You don't seem to realize that there's very little Bill can't do. You can get along as well as anybody in most things, even if I can only get him to realize. Helen. Well, Bill, you know how I feel.  Helen, please, stop talking. Hey, Sam, do you think... I don't know. This could be the craziest thing in the world, but we're not missing any bets. Let's take off that coat. We're not leaving yet. Bill, what are they talking about? I don't know. All right, let's have a little quiz game. I'll ask the questions and you better have the right answers. We'll start with you, lady. What do you know about that wrecked plane? Only what the town knows. It evidently crashed the night before last. The pilot crawled to town this morning. How he ever made it injured as he was was a miracle. He told the hospital he was the only one in the plane. With the storm threatening, there seemed no point in sending out a party for an empty plane. They decided to wait until later. What else do you know? Well, the pilot flown New York from the hospital. He told the doctors he was calling some friends. Then he died. I thought you two were going. Oh, look, I know this kind of weather. The visitor will get worse.  Just a couple more questions, kid. Told you before I couldn't see that plane. Yeah, that's right. But you didn't have to see it. You could have scrambled down that path like a mountain goat and poked around that plane.  And you could have found something without seeing it like you do here. Why would I do that? What do you want? I'll show you. Information.  He gets around. Of course he does.  Hey, it's getting dark. Is there a light in here? The oil lamps on the table. Helen, you know where the matches are. Now I can see it and realize how dark it was. Now let's talk business. Kid, except on that plane that belonged to me, give it to me. I'll make a way to you while. I don't want to get rough with you. No way. Take them back and on. Get out of here.  You're scum. Damn. Wait a minute. Now, Billy boy, if you found anything on that plane, why don't you give it to us? You'll be saving yourself a lot of trouble. Believe me. Leave me alone. Okay, kid. You had your chance. Now I'm going to pound the truth out of you. Keep your hand off him. You don't have to hit the kid, do you? What do you want me to do? Bump him. He went to the plane. How positive he did. Like I said, I didn't know what it was first, but I went down the hill. It took me a long time. By the time I got there, the pilot was gone. At least I didn't find anybody. But you did find something. Oh. I just made sure nobody was in the plane. Then I came back here. There wasn't anything else I could do. You're lying. You gotta be lying. There was $100,000 in uncut diamonds on that plane when it crashed. Diamonds. Yeah. They were in among Pete's effects. And they were in the plane. Now you admitted you went down to the wreck. So you found the diamonds. And I want them. No, I remember. I read about it. You stole the diamonds. That's right, baby. So what? They were part of a shipping from Bolshom. Before they got to the diamond cutters, we got them nice and clean. We had it all figured out. The cops were on to me, so I sent Peter head to Mexico with the diamonds. Glory and me were going to follow. That had figured great, all right. Except for the crack-up. This chance can count to three. And then I start taking you apart. One. He doesn't have the diamonds, can't you see? He's telling the truth. Two. Listen, kid, if you're smart, you'll cough up the stones. Sam can be pretty mean when he gets mad. Three. Oh, my God! Sooner kid, you were only asking for trouble. I would have given them to you right away. Other than me, but I was afraid.  Now why would we do a thing like that? Sure, kid, you didn't have to worry. I'll be a good boy and hand over the stones and we'll leave you two alone. We've wasted enough time already. It's dark out. We've got a long way to go tonight. You can't give them the diamonds. You know they'll get rid of you once you do.  What do you want me to do, Helen? Fight? That's a laugh. Should I punch the air and hope I hit somebody? Yes. Pity yourself, Bill.  Then everyone will say, poor Bill, wasn't it a shame and him so helpless? Such terrible people to do such a thing.   You're not going to give them the diamonds, Bill. I don't want them.  And I want you to be able to live with yourself again. That's enough now. I don't know what you're up to, sister, but we had enough talk. Bill, listen to the kitchen knife is at your right hand on the table. What? You know every inch of this room. Remember that. Blinder than you are now. He can't see. He's blind too. Blinder than I am, she said. I've got a knife.  I'll shoot her. You've got to see me first. Shelby, try again. I'm going to get you now, Shelby. I know where you are. Then still I'll hear you. Because I'll hear you breathe. You can't stop breathing, can you, Shelby? Can you hear me breathe? Because I know the diamond. Maybe now you'll come back to town. Maybe now you'll understand. It wasn't pity made me come here. By the way, Bill, do you really have the diamonds? Yes. And that's the funny part of it. He could have taken them all the time and he didn't know it. What do you mean? They're in the pocket of my mac-a-law. Calling Ivor Francis. And written especially for a suspense by Irwin Lewis. In a moment, a word about next week's story by Joseph Cavill. Heard in tonight's story were Terry Keane as Gloria and Jean Gillespie as Helen. Listen again next week when we return with Brother John, written by Elspeth Eric. Another tale, well calculated to keep you in.


So, so far we were studying what we call as learning with full information setup that is because in the case that we were interested in that is the binary classification online binary classification problem we said that when an instance comes or sample comes we get to see the predictions of all the hypothesis that are available right.  So, let me revisit the regret definitions we had in this case. So, how did we write the regret R n? We had another parameter here right hypothesis class ok. So, how did we write this was as supremum over h and super power. So, this was over n rounds and then we wrote it as summation what all for first term. So, this is my this is we defined as regret ok. So, just let revisit this definition a bit the way we defined what we said is whatever the sequence I am going to look I am interested in the best if I am going to apply single best hypothesis what is the how far I am from that hypothesis type. And the kind of when we bound this using our algorithms it the bound hold independent of what was the hypothesis and what is the sequence right. So, now let me ask you. So, instead of defining regret like this suppose if I have defined all my earlier bounds still continue to hold why yeah, but when I give the bound you took whatever h you took whatever sequence I was able to bound this quantity right. So, earlier the bounds I gave like if you recall they were like of the form 2 to the power cardinality h times and something like this right which was independent of. So, even if you think it like this. So, if you are going to say that. So, what is the difference between this metric and this metric here. So, here what you are doing if I write like this you the hypothesis which is going to maximize this is selected based on the particular on the sequence right it could change, but here what I am asking is I am asking one hypothesis that maximizes irrespective of what is the over all possible hypothesis sequences, but here this hypothesis could depend on what is the sequence you are looking at that is the difference, but still if I am if whatever the bounds I gave there that bound is still valid for this case also right because that is independent of what is h and what is your sequence. So, if you rewrite this quantity a little bit right I had just pulled this soup inside and it has become input. So, I mean we have already discussed this this is saying that ok given a sequence what is the best you could have given got an in hindsight right. So, this is the loss you incurred now you are looking at what is among my hypothesis which is the best one gives and now you are comparing that against what you got to what you got. So, even though earlier we bounded for this quantity, but basically our all the bounds were valid for this ok. And another thing we said this guy y t here did not be deterministic right y t is what y t is the prediction given by the learner in round t. We said that if he gives a deterministic prediction then he can be made to error in every round then we allowed this y t had to be random ok. So, y t have so then we say ok instead of this let us look at a expected regret right when we allowed this y t had to be random then we considered the expected regret ok fine. So, this was the setup we have looked into the case when we dealt with what I what I called as full information setting right. In this setup we gotten this bound using weighted majority algorithm and in the weighted majority algorithm we said that we get to see the prediction made by all the hypothesis in every round. Now, so we had basically we said that this using expert advice setting weighted majority we said that this one can achieve a regret bound of 2 identity of h square written for this setup ok. Now, slightly consider a case where my information structure is slightly limited ok. What I say my information see when we are doing this learning right what is that information we are getting by taking an action is very important. If we get more information maybe we can do we can learn faster right less if we get less information maybe we will get we will be slower in learning oh sorry ok thanks. In this setting we call it as now I want to move to something called bandit setting.  Earlier in the full information case whatever action you played you incurred loss that action, but you also get to observe loss of everybody else, but here that is not there whatever you play you incur loss for that and you only observe the loss of that. So, now we are going to focus on this setting. So, can somebody tell I mentioned about this brief in the last class can somebody tell example of full information setting and the bandit setting where this can arise. Previous Previous yeah whatever you had done so far for the actions you have played you can observe, but about the current setting I am asking. When I say full information and bandit information right this is about information what information you get in each round. So, exactly.  In that round you do not know what other machines would have given you the ones which you have not played you only get to see the one which you played that is exactly what we are going to call at bandit setting. Now, what is the example of full information setting? So, other example as I said also in the last class if you have let us say 10 routes to take from your let us say home to office and each of them gives different different travel time on a day if you take a particular route you only get to see what is that travel time on that route not about the other routes. But maybe this could be also full information setting why because let us say you are the learner you have turned on your radio in your car when you are driving right and the usually radio keep announcing right that much was the congestion traffic on that route was this much on this route was this much. Even though you are experiencing the actual traffic on the route you are travelling, but through the radio announcement you are getting to know what is the traffic that is been happening or being experienced on the other routes even though you are not there right. If that if you do not have that radio who is announcing this you only know on the route in which you are travelling. If somebody is giving you this information about other routes also then you have full information ok. And also the other example could be the share markets right like on a particular day let us say you have option to buy some hun-ten-stokes or shares you buy one share on that share you get to see whether you made money or not. You may not get to see the stocks of the values of the other stocks or shares, but maybe if you go and look into the newspaper they might have announced what is the loss that have been incurred by the other shares or stocks. So, in so far the setup is said it we somehow assume that I will get to observe the losses incurred by all the actions I have ok. Now, henceforth I will restrict that I will get to see losses of only the actions I observe and not about others ok. Because getting more information is always costly right like in the road example you need to have a radio for that or in the share market like you may have to go to newspapers or some web portals and get all these details about the other ones ok. Now, how we are going to how this setup is going to be different from the earlier setup. So, when it comes to regret definition that was our performance criteria will there be any difference in the definition of regret or do you think we should consider something else to evaluate performance with this setup ok. Let me make this bit more formal. Henceforth I will only talk about actions I will not talk about like hypothesis everything. Let us say there are k actions which I denote as in each round the learner is going to choose one of the action and when when he chooses that action he is going to only observe the loss for that action. Now, I am going to denote x t i t to be the loss incurred by playing action i t in round t. You understand this notation ok and observe maybe like loss i t maybe not from other actions ok. Now, let us specify the so, this is what the learner doing. So, here we what is the environment doing? Environment will assign. So, in round t environment is going to assign losses to these actions and player selects i t observe loss from that action whichever he has played ok. And this i t here this i t the learner is going to select like earlier it could be random. He need not select this i t according to a deterministic policy he could randomize it ok. So, if this is the interaction between learner and the environment now we are going to define he regret of a policy pi. Now, there is no hypothesis here right it is just like the environment is assigning this loss vectors. And let us say pi is some policy that the learner is using ok let us precise let us make what is policy pi. Policy of player is to select an action in each round ok and how he can select an action in each round he will select his action based on his past observations right. So, let us say h t is the history he has observed till round t ok what is that it could be let us say in round 1 he observed i 1 he played action i 1 and based on that he observed this and then in the second round he observed this all the way up to i t minus 1 e x t minus 1 i t minus 1. This is the history that the learner has right till round t you understand this i 1 is the action played by player in first round and this is x x 1 is the vector in round 1, but x 1's i 1 component is the loss he actually observed and similarly till round t minus 1. Now, learner's policy is to choose an action given. So, we are going to denote the policy to be in round t to be probability that i t equals to i is given x t. So, the learner has access to this history based on that whatever he is he is going to choose an i t in that round with what probability he is going to choose that is his policy ok. So, pi is this probability distributions that he comes up with in each round ok. Now, you notice that we are allowing i t to be random and he is going to choose it to be small i with some probability ok. Yeah it could be arbitrarily selected by the environment like the case we did in the expert advice setting also right. In the so, environment is just going to assign a loss vector to all the arms you have ok and that how he assigns it could be totally arbitrary and whether he will assign this losses such that the components across this arms are correlated or uncorrelated they are not putting any constraint it could be arbitrarily selected and then this is my learner he is going to select an arm i t he is going to observe loss i t ok. So, in this case whatever he observes this is what he has actually incurred. Now, we are going to define the regret of the learner with this policy. So, depending on how he chooses this i t that this probability that is going to define his policy right. Now, let us define that we are going to define regret of policy to be the one which he incurred by playing this sequence of i t's right. So, what is this x t i t t equals to 1 to n rounds this is what he incurred minus what is the best he could have incurred if he had seen this sequence for all the rounds. What is that? That is going to be x t i minimum over. So, if he knew all this loss vectors for all all the actions he would have chosen the action which would have given you this minimum sum right minimum loss. So, that we are going to compare that with this he is going to call as regret. Is this regret a random quantity because i t is random right. So, this is a. So, what we may be interested in instead of this instead of bounding this random quantity we may be interested in looking at the average performance of the learner and what is that that we can take for that we can take to be the expected value of this. What is the expected value of this to be? This is for a given sequence of x t i's yeah we do not have, but had we knew this is why we want to we would have like to select an i which would have minimized this right that is why this is what I get this is what I would have like to do I am comparing my with this and this is what I am going to call it as regret. We have discussed this right already for the full information case. Now, I can look into the expected value of this quantity then this expectation is now governed by this probability vectors right. So, I am going to call this as b t i and now what is this expected value is actually governed by my policy pi here ok and this is my expected value, phi. If you notice that this regret here whatever I have defined is actually same as this it is just that this has been defined for the binary classification problem. But here we have instead of looking instead of thinking about ok x t y t is the value that is coming in round t and if I apply hypothesis classes this is the loss I am going to incur instead of this, but they are just going to say that that value loss is simply x t i ok. X t i in this language you can think of the loss I incur if I am going to apply i-th hypothesis on the context x t whatever the loss I am going to incur I could just write that as x t i here ok fine. Now, we are going to see how to bound this ok. What we would like to do is we want to bound this by taking supremum of this it is over all possible sequence like the way we have done it right. So, we can make this to be this quantity to be we can we want to bound it is exactly this. So, we have just written the whole thing that the regret now when we wrote these things and these things we really did not worry about what is the information structure right. It is having full information and here if we are saying this we wrote it for bandit information, but regret definitions is still the same. Where that picture comes into whether what kind of information I have is in your algorithm when you are going to update because here this policy is only observing the losses for the action it played not for everything else not for everybody else ok ok. Now, let us try to see what is the algorithm we get.


Transformation is obviously incredibly important and getting more important with the fast-changing world. We all have a tendency to hang on to what we're doing, stick to the same things, and my own experience is that every time you step out of that and see the world from a new angle, you learn new things, but I think the angle into this with the experience and the stories is distinctive and distinctively different from the regular consulting speak about transformation. So that was very good. And I think back to where I said the different angles into the same topics with different people taking very different views at the challenges, I think it's important to demonstrate the kind of breadth and the complexity of doing and the requirements of doing good transformations.