Let's talk about Cuba quickly. Good news coming out of Cuba, not really good news, but good news in the sense that for the first time in memory, in a long time, Cubans are railing against the government, they're demonstrating against the government, they're being courageous and brave, and they're advocating for change, and they're going into the streets. The Cuban regime has learned that the way to deal with this, it's had a number of different lessons. It saw how Eastern Europe folded, and how Eastern Europe completely replaced its regimes and completely folded, and yet, and they've also seen how Venezuela has handled this, and the Venezuela example is the one that they've chosen. The Venezuela example is, don't give in, the demonstrations that they beat them up. Now come back, keep beating them up. People are poor and starving, let them get poor and starving.  Keep beating the demonstrators up. Don't use the army, pay thugs to do it. Use a mercenary force of the kind of thugs that that guy wanted to use against me, and just pound the demonstrators down and make them lose confidence that they can win, and since nobody will help them, nobody will support them, just keep at them until their world power is broken, as in a sense the world power of the opposition of Venezuela has been broken, and what you're going to see is an attempt by the Cuban regime just to hold on, to keep pounding. They don't care about lives, they don't care about the levels of poverty, they don't care, the only thing they care about, the only thing they care about is power, is maintaining power, is the communist regime in Cuba maintaining power, and it's not this power, it's not just that it's associated with a life of privilege, privilege in the proper sense, a life of some level of wealth, it's not about the money, it's about their power. These bastards are power hungry, they have at their disposals goons who will do their bidding, the regime in Cuba is evil and a monstrosity, and they will hold on to power no matter what, at anybody's expense, no matter how many people have to be killed or beaten or maimed, they will hold on to power, and they will not give it up no matter how many people go out into the streets. The only way a revolution in Cuba or in Venezuela can succeed is if force, you know, force is used, if violence is used against the regime, against the people holding on to power, that is the only way they will give up power. And unfortunately, both in Cuba and in Venezuela, the military has sided with the status quo, the military has not joined the people who were poor revolution partially because they're afraid of what will happen to them afterwards. So the military holds a balance of power, and so far the military has sided with the authoritarian brutes. And the authoritarian brutes know this, so they basically grant most of their wealth benefit of being authoritarian goes to the military, so the military generals make a fortune, nobody else does. So it's truly depressing to read what's going on in Cuba. You know, the Biden administration has been not bad on this, it could be better, but it's been not bad, it's condemned communism, it's condemned authoritarianism, it's condemned the regime, it's supported the demonstrators, it's condemned violence against the demonstrators, it has taken the right stand, again weak and not as authoritative as they should be.  I never expected him to, but he hasn't done that. I think some of you would have expected him. And he is as a consequence, you know, the Cuba is not going to get help from the United States, but neither the Venezuela and yet they still survive somehow. They still survive. I think right now, both Venezuela and Cuba are probably benefiting from, they probably benefit some from Iran, Iran probably sends them something, but given how poor Venezuela it is, and the fact that they don't have any oil, given how poor Cuba is, it's really going to be a challenge to see how these, how these regimes survive, just from an existential sense, just in terms of feeding themselves given the, oops, what happened? No, I got it. You know, that they survive given that they have no sources of income, zero. It's going to be, it could get really tragic where people are literally dying of starvation. It could be the case already in Venezuela. We don't know that much about what's going on everywhere in Venezuela. And it certainly could ultimately evolve into what happens in Cuba unless the United States intervenes in some way or another. What we need today, what I called a new intellectual would be any man or woman who is willing to think, meaning any man or woman who knows that man's life must be guided by reason, by the intellect, not by feelings, wishes, wins or mystic revelations. Any man or woman who values his life and who does not want to give in to today's cult of the spare cynicism and impotence and does not intend to give up the world to the dark ages and to the role of the collectivist man. All right. Before we go on, reminder, please like the show. We've got 163 live listeners right now, 30 likes. That should be at least 100. I figured at least 100 of you actually like the show.  There you go. Start liking it. I want to see that go to 100. All it takes is a click of a click of a thing, whether you're looking at this. And you know the likes matter. It's not an issue of my ego. It's an issue of the algorithm. The more you like something, the more the algorithm likes it. So, you know, and if you don't like the show, give it a thumbs down. Let's see your actual views being reflected in the likes. But if you like it, don't just sit there, help get the show promoted. Of course, you should also share and you can support the show at your onbrookshow.com slash support on Patreon or subscribe star or locals and show your support for all, for the work, for the value, hopefully you're receiving from this.  So, yes, like, share, subscribe, support. Like, share, subscribe, support. There you go. Easy. Do one or all of those please.


Hey everyone, welcome back to another video here on the Brulee channel. Thank you all so much for 1.125 million subscribers. Seriously, I love you. This video is about another backroom's level, and in this video I'm going to be explaining level 78 from the fandom wiki. If you like weird core, weird grassy expanses, strange eyes and text, and voluntarily dissociating into the backrooms, then this level is perfect for you. Without further ado, let's get into the explanation, shall we? So level 78, or the psychological planet, is classified as a class PSI, which means it's going to be unsafe and unsecure because of the mental hazards, and not really because of the environment. There are several levels that are within this classification that I might go over eventually and then combine them all into a series, but this level is the first one I'm going over. Anyways, let's not get sidetracked. The level is not supposed to be entered under any circumstance.  And that's just what the first sentence says, just I guess you should listen to it. But personally, I think I'm going to go by myself. The level has been described as a strange and otherworldly grassy planet that is suspended in the middle of an endless blue sky. So think of level 94 as grassy hills, except it's not infinite here and there's not houses like that. The level does have very rare suburban style housing though, and the entire place just stretches out for a few miles. Until it drops off into the infinite blue expanse of the sky. On rare occasions, mushroom-like entities have been reported dotted over the grassy landscape. They might be real, they might not, I'll get into all that later. The thing about this level is that no one has reached the actual end of the grassy plane. People get sidetracked due to the mental effects that it puts you under, and it's really hard to because your surroundings will start to warp. Again, I'll get into that later. So for right now, I'm going to go over the things that people have for sure seen, and then I'll get into some theories and some other things towards the outer edge of the level. Victims, I mean wanderers, who find themselves inside of the level will spawn outside in the middle of the field, surrounded by itchy cool grass for as far as they can see. The only noticeable feature around you is in the sky, directly up, and it is this off-putting smiling orb sun type thing. The immediate surroundings of this spawn area feel a lot like those old Windows wallpapers and those really old computers. That's the first thing you really notice is how it looks like that, and the sun thing in the sky above you. This piercing smiling sun never stops staring. It never blinks, it's always there, and it genuinely can terrify you if you let it. In fact, some wanderers just get terrified so much that it fills them with this huge sense of horror they try to run away. I mean, it's pretty ugly, but at least it's smiling. Whatever you do, do not run away from it, no matter how creeped out you get. If you choose to walk straight and explore the level, then about 6 kilometers or like 3.7 miles into it, the strange artificial suburban houses will begin to pop up and appear in front of you. They look lifeless and fake. Like they're not even in the grass, they're kind of just, they look badly photoshopped there. Around this time, the sun in the sky will begin to randomly clip and appear in different parts of the sky. Even when it disappears, the level stays bright, which means that that's not where the light comes from, even though there's no sun. Anyways, these weird core liminal looking houses are very interesting, and I'm going to dive into that right now. So if you enter them, they'll be completely empty of furniture and decorations, except for a few photos and pieces of debris on the floor. The photos here all are infected with photo-ocular scenarios, which is just the fancy term for the floaters or static vision you can get in real life. These pictures all have that effect when you look at them. When you do look at the pictures and when you're inside the house in real life, random things will begin to pop into your field of view and float around. Now, if you take the photos off of the level with you, this effect will still be with them. This can happen on any level if you look at the pictures. It'll normally manifest itself as bizarre lines of text popping up, or sometimes eyes will pop up and sometimes eyes with wings and sometimes other weird mushroom type things will appear. It just depends on where you're at. It doesn't end there though, because looking at the eyes and the text in your photo for longer than a few seconds seemed to manifest those lines of text and eyes in real life in front of you.  And a scary thing about the images that you take here is that the effect will continue to work until you leave, and even when you do leave, the effect will still be within the image. For that reason, these pictures are often used as a weapon to fend off its teaser people, because it would be kind of terrifying to see some guy with a bunch of eyes surrounding him. So you could use it to your benefit, or you could just not. Anyways, this effect is the most dangerous part of the level, because after a certain time of being here, you'll start to lose the line between what's in the picture and what's in reality spiraling into this weird core madness of not knowing what's floating in front of you. So about six miles or 12 kilometers into the level is where it ends, and it ends up fading into the blue sky. At this point, it's theorized that the ground itself will begin to warp and wave and undulate like it's water. Like every step you take will make massive waves in the grass, causing it to be impossible to keep going, and for this reason, people have never been able to get to the actual edge very easily, or at all, we don't know. This waving effect will be extremely disorienting and frightening to people experiencing it, especially if you just took some pictures earlier and went inside the houses and you saw all the eyes and stuff, and now you come outside and you see all the ground waving like water. You probably think you're tripping hard on something, but in this wavy grass part, the eyes and the sun will congregate and stare at you as well. And this is your last chance to escape with even just a drop of your sanity left. Just try to avoid the sun and the eyes staring at you. But now I'm going to do a little bit of a deeper dive into the weird creatures and entities that live here, even the ones that we aren't sure are real, but people claim to see them. So the smile sun is obviously the first. This is the biggest entity on the level. And like I said earlier, it takes the appearance of a large green sun with a very, very off-putting red smile on its front. The entity does not outright attack you, but after a prolonged exposure, it seems to cause your field of view and vision to get more static-y and unstable, and it makes your eyesight worse, eventually just becoming a grainy mess. So it's recommended to not stare at the sun at all. Shrooms. So shrooms are sentient beings that sprout out of the grass and inside of the houses on this level. Instead, the staring at the shrooms for long enough will cause them to develop eyes. Once you make eye contact with the eyes, you'll begin to feel the effects of being on shrooms. Like the hallucinogenic, you'll start feeling like that. You'll get dizzy, you'll be confused, you'll not know where you are, your vision will become impaired, and things will start to pop up again. Now shrooms tend to grow around people on this level who are full of fear, and they kinda seem to be reactive of how your behavior is. So if you're scared, the level knows it. The smile killer. So this is a very rare creature that exists here. It's been reported as a tall humanoid figure that's almost seven feet tall, and it carries a big knife with it as a weapon. It seems to have the ability to hypnotize those who look at it in its face, kinda like the sun in the sky does, but not really. The entity only appears in the houses on this level, and it can only be seen briefly when the sun in the sky disappears. So when the sun comes back, it'll be gone, but when the sun clips out and goes away, you can see it. And because of this, you never really know where it's at, it can be right behind you, and then the sun will just go away and it'll show up and it can slash you. Really creepy stuff, to be honest. Finally, the eyes. So the eyes are a very common thing on the level, as you've heard. They're in the houses, they're outside, they're on the sun, they're on the mushrooms, they're everywhere. And they are realistic human or animalistic eyes that just pop into your field of view on the level. Some of them are biological, some of them might be in your head, but they solely seem to attack the mental state of those who see them, which is bad, because everyone in the back rooms already has a bad mental state. This would make it worse. Some eyes have been reported to have these angel wings around them, and it doesn't even look 2D or anything. They look like a real eye with a real angel wing. It's physically there. The only way to get them to disappear is if you close your eyes, but then again, you can't really go anywhere with your eyes closed all the time, so you're just gonna have to kind of avoid eye contact in order to escape the level. These eyes are a common thing you see in weird core pictures from real life, and it's unknown how or why they appear here in the photos or in your field of view or in the sky above you. It's all just a mishmash, we don't know. To enter this level, you have to fall asleep on any back rooms level and then participate in a lucid dream. That's right, you access this level by lucid dreaming that's the only way to answer. So if you can't lucid dream, you should be good and you'll never get stuck here. But the problem with that is you're still technically in the level because you can get trapped in it forever, and if you do and you can't escape because the eyes are watching or the sun won't stop looking at you, you'll eventually just fade away and decay in real life because you're mentally stuck in this weird core world. So to make sure that doesn't happen, to exit, you can somehow make it to the edge of the blue sky and the grass and there'll be this door that appears and you can open it up and run through or you can just lay down and have a staring contest for that giant sun in the sky and go insane and be consumed by the mushrooms with eyes. It's really your choice. I would choose to leave though if I were you. That's it for the video. Thank you so much for watching. Hope you enjoyed. I love, love, love, love, love levels like this. Seriously, I love them. I find them so interesting, so fascinating. Hope you do too. Leave a like, comment weird core if you enjoy weird core. Leave a like if you enjoy weird core. I love weird core so much. Can you tell? Make sure to tell somebody that you love them because life is too short to not. I love and appreciate each and every one of you. I can't wait to see you in any of my next videos on any of my channels, whether it be on Brookly, Tugly, or Spookly. Nice little self promo there. Anyways, peace and love.


David Warden, absolutely incredible fight in the tie breaks. You fought like a lion. What a fantastic tournament But still a little bit of a heartbreak at the end. Share your feelings with us Yeah, of course now I'm a bit angry with this loss But yeah, of course in general it was a fantastic tournament for me and I guess I cannot complain I wanted to win the tie break too, but okay, he got who played well Well, I got good position, but okay, he played faster than me and finally I think that was that What give him the victory in both the games? Actually, you seem to have good position with white in the first round of the tie break you were doing well Even with black so you must have been happy at some point with the way the tie break was going Yeah, I mean I was happy I'm now even happy with with the games But yeah, I mean of course the the result finally is everything and I lost this this came with black So it's a bit Hard to lose. Yeah, right.  How were you? You had played a fantastic tournament already So you were very satisfied how motivated were you and tell us your feelings before the tie break Well, I just was motivated to win because I had the feeling I deserve it somehow Because I had better performance and I was leading the tournament. So I just wanted to win and I just Played the best chase the best chase I could and well, that's what I did But it wasn't enough That's exactly what you did, but still a great performance by you David What does this performance mean to you in your career finishing runner-up in the trade vice your brawl to chess festival? How important was this for you? Yeah, of course, it is very Important it is one of the best result of my career and well, it motivates me to to continue playing and well For the first time between the one hundred best players So that's motivates a lot and just to continue your performance in this tournament I've shown that you belong with the very best players in the world. What is your next event after this? Where can we see you in action? Yeah, I think I'm not sure still, but I think I will play in Dubai in Sharha first and then in the Dubai open That's my plan, but I still have to to manage everything But I will probably play there and will we see you back at the trade by Gibraltar chess festival in 2018 Yeah, of course. I mean as I said, this is one of my favorite tournament and I think I will come and next year for sure All right, congratulations and good luck for the rest of the year. Thank you


OK, let's start. My name is Hiroki Aramaki, working for the NetOne systems, one with the largest network integrator here in Japan. Today, my presentation title is much minding your OpenStack and the hybrid cloud. Before I start presentation, I want to introduce our company. We are NetOne Systems. We are founded 1988. And we have 2,500 employees here in Japan and headquartered in Tokyo Marunouchi area near by the Tokyo station. And we have the 12 branch office here in Japan and some overseas office. One is the Silicon Barrier for research. Another one is Singapore for business. And our customer is service provider and public sector and enterprise. Our strategy is to be a cloud broker. Currently, we help our customer build cloud, private cloud, or public cloud. And we want to connect this public cloud and private cloud and our partner service and provide cloud service to our customer, like a cloud broker. That is our strategy to be a cloud broker. And the next one is a NetOne cloud solution. We have already provided a legacy virtualization system using the vSphere from VMware. And this year, we start provide private cloud service with two options. One is for managed open-stack cloud solution. Another one is integrated model. But for managed model, we use a Cisco Metaport. And another integrated model is using a Red Hat open-stack. And if your customer want to use a public cloud with private cloud, we provide a Quick Cloud as a hybrid cloud management and management solution. Quick Cloud can provide a hybrid cloud management console. You can create applications from Quick Cloud to private and public cloud. You can migrate application from private to private cloud to public cloud and each other. But our open-stack solution, we have two type of open-stack solution. One is a managed open-stack solution based on Cisco Metaport. This is a tanking solution. You can easy to install and create your private open-stack on-premise. Customers who want to just want to use open-stack, this is the best solution for that. And we provide our solution with Cisco, this kind of solution. Another solution is integrated open-stack solution. Integrated open-stack solution, we customers who want to expand open-stack solution by using a third-party product, this is the best solution for that. We work with Red Hat, and we expand open-stack function by using a third-party solution. Next slide is a tell about our managed open-stack solution. We provide hardware manage and install solution. And Cisco provides software manage and install solution. And Cisco and we connect to customer on-premise private cloud using a VPN and manage and control customer private open-stack solution. Cisco also expands some horizon dashboard. One is a quick link. You can easy to spin up instance, create volume from quick link. And another horizon dashboard enhancement is instance utilization. You can see CPU network utilization for instance from Metapot dashboard. Unfortunately, currently, Cisco don't release Metapot here in Japan. But after release, maybe in this year, they release Cisco Metapot in Japan, we will support that Cisco Metapot with Cisco. Next one is an integrated open-stack solution. We are using a Red Hat open-stack for base system. We add some kind of, for example, network and compute block storage, a third-party product to that. About network, we have an option of, for example, Cisco ACI or big switch, big cloud fabric, or new-age VSP. About the block storage side, we have the EMC scale IO, X-ray IO, and the NetApp FFAS series. You can see that here is a menu of solution and third-party product. Then we found some program we're integrating this kind of solution. One is very difficult to find what is the advantage about the third-party solution. And another one is integrated shuntest is nightmare, because every third-party product have their own version. And Red Hat open-stack also their own version. And open-stack is upgraded every six months. And another third-party product upgrade monthly or three months or six months. Then if we test this kind of third-party solution for every version, it is very difficult to do that. To solve those two problems, we have two solutions of that. One is understand different integration, function, and performance for testing these kind of third-party solution. Another is integrated test automation using Jenkins about understand third-party advantage about network. We have already tested some network function with open V-search and relaxed bridge using segmentation type V-run and V-X-run. After test that network performance about OVS and relaxed bridge, we found OVS and relaxed bridge can provide enough performance for 10 gig plus 10 gig unique network per host. And if we use V-X-run for segmentation type, you can get only three to seven gig network performance if you don't use V-X-run off-road. Then we found you need to V-X-run off-road if you need more three or up to three, if you need more network performance over the three or seven gig PPS. And if you want to use third-party solution, we found network function or high availability and visibility is a key component for third-party integration. Next one is about storage. We already test storage performance about safe and secure IO. For OpenStack, LVM is a default storage solution. But currently, most popular solution is distributed storage system. And the most popular OpenStack-supported distributed storage solution is safe. And EMC released ScareIO in this year. And we compare these type of solutions. After test ScareIO and safe, we found that ScareIO is the best solution for hyper composite type infrastructure. Because under the high CPU stress test, we found that ScareIO CPU utilization less than the safe. Then we think that ScareIO is a better solution for hyper composite infrastructure. And about snapshot, if you take a snapshot about the OpenStack volume, we found the significant performance decrease for ScareIO and the safe. Then we recommend storage appliance if you want to keep performance after take snapshot. And if you use SSD for distributed storage solution, currently, we found the network is a bottleneck if you're using a 10-gig network. Then we recommend if you want to use distributed storage solution with SSD, you should use 40-gig network or 100-gig network. We have already created white paper for EMC versus EMC ScareIO. Sorry, this is Japanese only. But you can get this white paper in our booth. About snapshot, this is a graph for after take snapshot. The worst case, the decrease IOPS 23 times and the increase rate is in 455 times. Then if you want to use the distributed storage system, you should think of it after taking a snapshot. Then third-party testing integration automation. We have already implemented many solutions to our Jenkins environment. Our workflow, Jenkins creates the VMR bare metal-based OpenStack solution and connect these OpenStack to the third-party solution. After that, Jenkins tried to download test scenario from Git Red Poetry and apply that scenario to OpenStack test service really. Really test third-party connected OpenStack environment. And after that, really push back to the Jenkins performance report. And the user can see what is going on after third-party test. And here is our Jenkins screenshot. We have already implemented many of the solutions, big switch, net-out, ScareIO, and X-rayIO. And we already add some ScareIO or another solution in the future. Net-1 hybrid cloud solution. We are using Cricker for hybrid cloud solution for managing on-premise workload and public cloud workload. Cricker can manage hybrid cloud. You can deploy any type of application to any cloud. And you monitor and manage this application. And if you want to migrate application from one cloud to another cloud, you can do that from Cricker dashboard. You can also enforce policy to Cricker to application from Cricker dashboard. Conclusion. Net-1 provides a vSphere-based virtualization solution. And we add managed and integrated OpenStack this year. And if you want to control hybrid cloud and private cloud on at the same time, we can provide Cricker to our customer. And finally, our booth T38, please come to our booth. And one more thing. We also show the, sorry, this is my hobby, Susie-based OpenStack Horizon dashboard. You can create the OpenStack instance and volume from Susie style. You can also see this Susie stock at our booth who is coming to see and find your Susie. Thank you.


The chip's framework proposes that the hippocampus plays a key role in pattern separation, but that it is not the sole contributor. Instead, the hippocampus receives inputs from other areas of the brain, such as those involved in cognitive control, which help to resolve interference between similar memories. This allows for more efficient storage of information, as well as better recall of specific details when needed. This article was authored by Tarek Ameo and Lila Devachi.


So, I would like to share with you something that's actually very exciting to me because data integration is my area of research and this is what we do in my lab, we develop novel methods for data integration. I will share with you, well, we'll go kind of from the clinical data to the OMICS data to the data integration methods, but I will share with you first the kind of the state of the art in this field and what has been done before and how people have approached this problem and what we are doing now and where it's all going. And I will also talk a little bit about the survival analysis, just some intuition about doing that because that's a very important part of the kind of data integration and the valuation of clinical data and then you will do hands-on a lot more on that with Lauren. So, this is an example of the kind of clinical data that's available regularly and it's just a snapshot of a few variables, I suppose, but you will get race, sex, family history and the information about what kind of treatment they have, maybe some of the hormone therapy or the state of the proteins and the stage size and you also get a lot of information about the survival, well, first of all, whether it's primary or whether the tumor has recurred and then all the times that are associated with that. So the time of the original diagnosis, the time, the overall outcome or the outcome of the disease, right, and these are different because the patient might have died not due to the cancer but due to other causes. So these two times might be different and the status of recurrence and then the time to the recurrence. So there are actually a lot of publicly available tools that now take this data and can do inference with it. So this is a predict, it's called predict, a tool for breast cancer and it's available online for anybody who wants to try. You put in some of the information about the patient, including the age, the status, some of the kind of the chemo regimen, et cetera, and the grade. So the information about the tumor in the patient and what it does is it gives you estimates for this patient, how the probabilities of survival, how likely they are to survive after five years and after 10 years and what is the benefit of it in different kinds of therapies. And in this case, it looks like the chemo will be beneficial for this patient. I think the reality is that the situation is a lot more complicated and that's the reason why the field of integration came about is because it cannot, not all the patients with these clinical variables will have exactly the same survival and outcome. So that's the reason why a lot more data is being collected now. So what's being collected? For each patient, well, genetic information. So now in clinical genetics labs, I believe in a lot of the at least big hospitals, people are collecting at least exomes, sometimes whole genome as well. Transcriptome is being collected, also in clinical and in research settings, epigenetic data, usually DNA mutilation but sometimes some of the epigenetic mark data, thank you. MicroRNAs, proteomes or protein expression, then you have the clinical data that you have had before but then there's additionally for some of the diseases you have additional information such as extensive questionnaires. For newer psychiatric diseases, you definitely have this information. And I think there was a push to try to ask to have this general psychiatric evaluation for a lot of the patients who don't necessarily report because of the psychiatric disease just to have a kind of a broad understanding of the field and comorbidities and such. There's also, of course, imaging data, again, for newer psychiatric disorders it's very common. There's MRI for some of the chronic diseases as well, et cetera. And finally, especially in cases such as IBD or things that are related, there is diet information that is available. So I've actually seen all of this data, maybe not for the exact same patient but for a couple of different cohorts, I have seen all of this data in my lab where people come and they say, well, how do we integrate all of this data to make sense, to make it to help patients. Some of this data is actually publicly available. So TCGA probably has been mentioned before in this workshop is an amazing resource. So this is the cancer genome atlas and they have now, they don't have 33 different cancers. They have more than 500 patients and the cool thing is that they have all of these different modalities, right? They have collected this data and stored and made it publicly available. So they have the exome data. This one is protected, that's why there's a one. They have the SNP arrays, they have methylation data, mRNA, microarray, clinical data and they also have proteome for 180, 990 proteins also available for a lot of them, for a lot of these cancers. And I believe that in the lab afterwards you will be playing with one of these datasets. So why do we want to integrate patient data? Anybody wants to say anything? Why would we want to integrate patient data? Why is it not enough to look at their transcriptome if we believe that there is a regulatory problem? Yeah? Yeah. Yeah. It's exactly. Yeah? Yeah. That's exactly right. So actually a lot of times, at least in the research setting, the question that I've been asked by the clinicians and research scientists to identify subsets of the population that are more similar to each other, right? So we can try to predict the survival based on the general population characteristics, but if we knew that we have exactly the same set of patients for whom we already know the outcome, it would be a lot easier to make accurate predictions for this new patient. And so this is one of the ways that this data, I don't know why, is not necessarily the right question, but what happens with this data and what ultimately people want to do with this integration is exactly to identify the subsets of patients called disease subtyping and happens very often. So it's kind of leading to exactly the same thing as you said. So identify patients for whom we can predict the trajectory of what will happen to them later, how they will respond to drugs, et cetera. So here's a bit of history. So originally, of course, people have started with small sample sizes and single data type analysis. So if we had, in this particular case, this is a paper from PNAS in 2005, I don't think it's possible to publish in a high-profile journal with 20 cases unless it's a really rare disorder. But so GBM is a glioblastoma multiform, is a very aggressive and invasive adult brain tumor, and it's lethal. There is the standard of care, stemazolamide, which extends people's lives by maybe half a year or two a year, something like that, but they all die. So this is a very important cancer and has been studied a lot for a long time. And so this is essentially a standard pipeline of what has been done then and is still being done for a lot of the data sets now. So people have collected the gene expression, in this case, for 18,000 genes. They selected mostly varied genes, essentially because the genes that don't vary across the school population are not likely to be predictive of the difference in the outcomes. They perform hierarchical clustering, and I will show to those of you who have not seen how hierarchical clustering actually works, I will show in a little bit exactly how it happens. They identify clusters for the subset of this, for the population using a subset of the genes, the identified cluster. So here there are two clusters. There is a blue cluster. So every column on the right, you have a heat map. Every column is a patient, and every row is a gene. And it basically shows the clustering diagram. And so here they decided to split up right on top. So you have two different clusters. And you can see that the blue cluster has a very different expression pattern from the orange cluster, even though they're still quite different between each other in each of the clusters. They're definitely different, more different. There's more difference between the two clusters. So the way there is a kind of clinical relevance of these clusters to the way that these clusters are evaluated for their clinical relevance is people look at the survival curves. And the survival curves, what they show essentially is that there are two groups. There's a blue group and an orange group. And you can actually look at this curve and you can say, okay, I have years along the x-axis. I have the probability of survival along the y-axis. And as I go, for example, for year one, how likely is my patient to survive if they were to belong to group two? It's roughly 20% and if they belong to group one, it's roughly 80%. And so what then happens is if a new patient comes in, they use essentially this classifier with the genes that they have selected to predict whether this patient belongs to either group one or group two. And based on that prediction, they say, these are my survival curves and that's how I can predict and assess whether the patient is safe. So one more thing about these. These are the black dots here. Usually they're dashes, vertical dashes. These are censored observation. That means that the information about that patient is no longer available. And it's not known. It's just known that the patient has survived beyond the last point of observation, but the time to actually vent is not known for that patient. So what happened after? So this was a single data type analysis type thing. So then the next wave was integrative analysis that was based on a single data type. And what happened? So this is a very famous paper from 2010. They had their rocket all in cancer cell. They had 200 GBM patients. And they also decided to go with kind of the gene expression as the primary basis for decision about the clustering in the population. So what they did was they took the mRNA and they clustered the patients pretty much in a very similar fashion. And then they said, now we will try to either explain or add some of the genes that may be differentiating further between these patients. So these clusters were essentially, these clusters here, they were essentially dictated purely by gene expression, but a few more genes that were looked at for their predictive value of these clusters. So even though they had multiple different modalities of the data, they didn't really use them to make kind of joint decision. It was primarily driven by a single type. That's why I called it the single data type integration. And so what happened was that the paper was hailed because even though there was no real difference in the survival curves that are shown on the right here, even though there was no difference in survival curves, there was the clusters that they identified, they kind of made biological sense. So they were called this pro-neural, neural, classical, and mesenchymal groups. And this was based on the genes that were differentiating these clusters from all the rest. They didn't, no. So this is this plot I pulled from the supplementary. They didn't, they just basically, they talked about the biology of the disease, and they talked about how the importance, and they replicated, they had an independent set where they kind of identified the same clusters given these genes that are associated with these different subtypes. I think it was 80 genes per cluster. So in essence, it is, it does make sense. I've talked a lot to the clinicians about kind of the validity of evaluation by survival data. And it does make sense that if the biology of the individual is different, even if the survival is not necessarily different, they might react very differently to treatment. And that's a very important point for a clinician. So the biology might dictate the standard of treatment for a specific individual. That's what the value of this analysis was. Most of these mutation analysis that are done, the somatic mutation, here in these papers, not independently, were kind of associated with the clusters, not, yeah. So interestingly, in this paper, they mentioned that they had mutilation data, but they didn't find any differences. So it was mentioned in passing and as if the mutilation data, they didn't find any use for it in GBM. And there was a paper that came out just two years later where they did a similar analysis, but they let the mutilation drive the quastering identification. And these, then they found this hyper-mutilated cluster. So you can see that it's the first kind of band here is the DNA mutilation probes and most of them are hyper-mutilated. And this is now very well known in the GBM community as IDH1 mutation, GBM subgroup. So they looked at all of these patients that had hyper-mutilation and they identified that almost all of them, except for one, had this IDH1 mutation. And I think what's interesting is that the same mutation does not give the same hyper-mutilated status in leukemia. And it's present in leukemia in a lot of patients, but it doesn't give the same hyper-mutilated profile as it does in GBM. But in GBM, it's a very kind of a very significant and very obvious pattern. All right, so this is kind of up until 2012-13. This were the papers that were coming out in clinical literature that had a lot of different types of data that we're trying to use them, but using one of the data types to drive the analysis, not really doing it jointly. So around then in the last five, six years, people started looking at integration approaches. And I will only talk about the three commonly using integration approaches. One is this concatenation and clustering. And this is by far the most commonly used approach by Broad and by the TCGA community itself. The second one is iCluster, which is also quite commonly used right now in the literature. The method came out in 2009, but I think in the cancer community it started to be used later. And SNF is the similarity network fusion that I will also talk about. That's the method that was developed in my lab that was published in Nature Methods two years ago, which is also now used in TCGA analysis by the consortium. So the first in the simplest is the concatenation, right? You take the patient data, and the patients are now rows, and you simply concatenate all the measurements that you have for the patient. So it could be gene expression, methylation, it could be clinical imaging, whatever, you can just one big string. You might want to normalize each of them individually, but later it's just concatenated all together. And the only problem that I will mention, and I will show you the comparison between the performance of the methods later. And one thing that you can immediately think about is that the structure intrinsic to each of the individual data is kind of lost in this, right? Because you might have picked a thousand genes, and you might have picked 15,000 methylation probes, and now you have the signal with kind of unequal strings, but it's also a probe will not be as strong as a block of 10 genes, right? So it's harder to pick. Each individual probe was a very important and significant contributor, as you would pick like a block of, you have a block of 10 genes that are all strongly correlated. So the problem is that the structure of the data set becomes the, the one that is informative of what happens with the patients and the biology of the patient becomes very, very different and eluded. And that's, that's part of the problem of the concatenation of this data. So as I promised, I will mention the hierarchical plus strings. So this is essentially a similarity matrix of the six different patients. So you have patients A through F on the columns and the rows. So these are the same patients and the matrix shows how similar they are. So you could do a correlation, for example, Euclidean systems between them. And then you say, okay, patient A is similar to patient B with some point 71. And it doesn't really matter what the actual value is, as long as the relative values are known, right? So for example, in a minimum distance also called a single linkage hierarchical plus string, you pick the minimum distance from the whole matrix and you merge those first. So here you see that patients D and F have the smallest distance between them, so you merge them first. The, and they become kind of like a single patient. And then you update the matrix and you go further. So the next patients are likely to be merged A and B. And so this is what you see here. This is the, basically in this space, the A, B, C, D, E, F. And it shows how similar they are to each other. And on the right, it shows the usual hierarchical plus string. So what you see here with the height of these merges is which got merged first. So you can judge which one was merged first. It's kind of indicative of the distance, right? It's 0.5 from such a long distance. So after D and F got merged, this common plus to D, F, would be that merged third after A and B got merged, et cetera. And so A and B, this group was very, very different. And you can see it in this two-dimensional space as well. It was very different from the rest of them. And that's why this got merged into the other ones. And so when this hierarchical plus string happens, you start with every single individual being their own cluster. And you end up with one cluster for all the individuals, right? Where? These are the values, essentially, of these points. This is how you calculate how similar you are in space. This is the representation of them. Could be the projection. This is a, if A is a patient and they had two features X and Y, this would be the values of those features. So this is what happens.  And this is an internal question. And I have to tell you as a computer scientist that there is no answer to this question. There is no one answer to how many clusters there are. Because depending on what you care about and how you formulate your objective of what you care about each cluster to represent, the number of clusters will be different. So it's a natural thing, but it makes everybody's automation of identifying the clusters very difficult always. So here are some of the very, very standard procedures. So for hierarchical clusters, people do it by eye. Honestly, they most often do it by eye. And I'll show you an example why sometimes it works better than anything else. So it's hard to replicate that analysis in an automated fashion again. Then there's a silhouette statistic, which is also very commonly used. But again, it has benefits, advantages and disadvantages. EigenGAP is for spectral clustering. So if you have a graph, a new cluster, a graph, then EigenGAP is most commonly used. But especially if anybody knows PCA, then EigenGAP is kind of the coefficients that are associated with each of the vectors. And so you pick the biggest difference between the vectors and choose that as the number of clusters. And so there are many more. And there are reviews on all of these different statistics that I used to pick the number of clusters. These are kind of the most common in this literature in the literature of cancer subtyping. So silhouette statistic is from 1987, presented first by Russo. And it's very simple. It basically says, I'm trying to compare the distances within the cluster versus the different, the distances from each of the points in the cluster to all the other clusters. And so for each of the points, it can compute this average distance to all of it's as patterns, but it's essentially points or patients in the other cluster versus bi, which is the difference. So if bi is zero, which means it's really, this point is really close to every other cluster, then you will necessarily have a negative silhouette, which means my point, which is in cluster A, is more similar to cluster B than similar to cluster A. So maybe the clustering was not correct. So this statistic goes between minus 1 and 1, or metric, goes between minus 1 and 1. So 1 means it's perfect. All of the points that are in my cluster are more similar to each other than to any other point outside the cluster. Minus 1 obviously means everything is reversed, and 0, I guess it's a borderline. You have to look at it. So here's an example. You have, there was a paper that looked at four different scenarios. So three clusters in two dimensions, which is represented in picture A. B is the three clusters in 10 dimensions, and each cluster has 50 activations. There is no possible picture of the 10 dimensions. So for picture B and C, C is the four clusters in 10 dimensions with randomly chosen centers, and D is six clusters in two dimensions. And they looked at all kinds of different similarities, but our favorites are here. So silhouette. These are A, B, C, and D. These are the different scenarios that they had. So silhouette is this green one, and you can see that for scenario A, where you kind of have these different clusters, they're sort of separated in space, which is nice. A lot of the different metrics perform very similarly, and perform relatively well. For this D cluster, of course, silhouette would be three clusters, but not be six clusters. And the hierarchical clustering, if you did it by eye, and you knew that there were six clusters, you could have picked the six clusters. But this is what happens, because each of these clusters is easy to tell, but then for each of them to be far away, each of them are essentially equally far away from everything else. And so there is no real way to tell that these are all different clusters. It would just pop into one cluster. By eye, would you pick three clusters? Yeah, it would pick three clusters. You'd have to have a prior information that there are actually six clusters for this specific, because here you can see colors. If I didn't put colors, and just put those three different in all in one color, you would see the three clusters. K means, which meant there's not. So K means assumes some kind of Gaussianity. And so if your clusters do not follow, so here, this kind of problem looks as easily resolved with K means. But for K means, you also have to give the number of clusters. It doesn't pick the number of clusters. It's K means, it's K. K, you have K centers that you assume that they are, and then you figure out the question. There is X means that was developed in the lab when I worked as a PhD student, was more than 10 years ago. But there is X means which kind of just searches over the space and decides how many clusters there really are. But K means you have to give the number of clusters a prior. Could you, for instance, blood the data beforehand, take a look at it by eye, and then input whatever you think is the best number of clusters? So in cases A and D where you have two-dimensional data, maybe, but most often we are not working with two-dimensional data anymore. That's the problem. Yeah. So another important thing, if you ever do this kind of bioinformatics analysis, is to figure out the robustness, right? Usually you kind of get a sample and you cluster it, and you say, these are my clusters of the sample, these are my subtypes. But the reality is that a lot of the clustering methods, what they do is they will cluster every single point into some cluster. And maybe some of these points are outliers. They're just far enough from every cluster that by chance they get into some cluster, but it's not meaningful. And it actually destroys statistics a bit too. So what people have been using, I mean, this method has been published, but everybody has been doing it anyway. They published the paper and consensus clustering, which is kind of establishing the robustness of the cluster. So instead of just doing it once and having one clustering, you re-sample, say take 80% of your data, figure out whether two individuals are in the same cluster or not, and re-sample again, and cluster, re-sample and cluster. And you do it hundreds, maybe thousands of times, a thousand iterations, and then you have a matrix of how often patients have appeared in the same cluster, given that they actually had a chance to appear in the same cluster. So essentially this IG is, there's two patients ING, GAM-H is how often they have appeared given that they actually had a chance, right? Maybe they weren't sampled at the same time, so they were not actually in the same sample, so they couldn't be in the same cluster, right? So given that they have appeared in the same cluster, given that they were both sampled, did they appear in the same cluster or not? And so what happens is, you get this kind of the core of the cluster. You get the core, which you roughly believe in, and then you can threshold. You say, I want the patients who 80% of the time appear in the same cluster, and I only trust those. And the rest, I simply cannot classify. And so this gives you more robust statistics about the biology later, when you are predicting, trying to figure out which genes are associated with the cluster. You will not be also putting in the values for the patients that are these outliers. You will just be picking this kind of the core of the group. And basically in my law, we always do this kind of analysis for the robustness of the clusters. All right, eye cluster, I will not talk about in detail. It's a Bayesian method. It's a, if any of you are familiar with kind of the factor analysis, it's very similar to that. What they do is, the intuition behind this method is that you have some intrinsic true tumor subtypes. They're Z, they're hidden, they're latent. They're not known. But because you are working with the same population of patients, it's assumed that the Z is the same for all of these different data modalities that you have. So here you have this Z subtypes. And here you have copy number variation. It's possible that it looks very, very different, but you're constrained to push these people of these individuals into the same clusters as you would have if you had the epigenetic data. So what it does is it does this kind of iterative inference method to figure out which clusters that truly are given all of this data. So this is a truly data integration method where they are not concatenating, but they're trying to find this latent space that captures well the structure of all of this data set. So their original analysis and their original paper kind of said that they can capture the complementarity of the data as well in this analysis. But in our experience, when we did a lot of the simulations and tried to run different kinds of methods, we found that it didn't necessarily quite work for complementary data sets. So if you have some complementarity and you want to capture both, it's hard to capture it with this method. So usually if there's one strong method, say, modulation, modality that has strong structures, so for example, modulation and others don't necessarily have that structure, it might be driven. This analysis might be driven by the modulation data. So this method was like a serial supervised? This is unsupervised. This is really unsupervised, yeah. And the reason why it's unsupervised is because at no point do they have any idea about their clusters. They really are trying to find this latent embedding in this latent space that they don't see, which is common. So what they do is they try to infer common representation and simultaneous projections from each of these data sets onto that latent space. All of them happen at the same time. All of them happen at the same time, it's a, yeah. This method was also referred to as interclust in a Critis Nature paper in breast cancer. I don't know why, but it's the same method. So some of the drawbacks of the methods that we have discussed is that a lot of times they require manual processing, a lot of kind of feature pre-selection and sometimes they say we selected 1500 most variable features. We can do that, right? But if we have to replicate the analysis done in a paper, if they said we kind of picked this feature for this reason, this feature for this reason, it becomes very, very hard to replicate the analysis. And so the more pre-filtering happens before, the harder it is to use it again in a different context in some sense. There are many steps in this pipeline. So there's a lot of filtering kind of manual curation, maybe picking a number of clusters by eye. So it becomes hard to automate this analysis if you want to have this kind of pipeline in your lab. And if most of them, it's true, most of them look at kind of each individual feature, not combinations of features. So if there are combinations of features across different data modalities, then that might be lost. So given this, we have proposed a similarity network fusion approach. And this is to integrate data in a patient space. So the first step is to construct patient similarity matrices in this one slide. So the first step is to construct patient similarity matrices. And the second step is to fuse multiple matrices. So what's a patient similarity matrix? Well, patient similarity matrix is the same as we have seen before. We have a patient by mRNA expression. And it's kind of the same matrix that went into this hierarchical clustering that you saw, right? So this is the similarity. We usually use a kind of Euclidean distance here and the darker the spot, the more similar the patients are and the lighter the spot, the less similar they are. And so if some of them, when you correlate individuals, you will have a lot of close to zero but non-zero similarities in what, what happens if you essentially zero them out if you sparsify the matrix, you will have zeros corresponding to no edges and ones corresponding, and non-zero edges corresponding to edges in the graph. It's essentially the same thing. It's just a different representation. So this matrix captures exactly what this weighted graph captures. So in this weighted graph, each node is a patient and each edge represents how similar these patients are. Okay. And so what we do is we construct each, we construct as many of these graphs or similarity matrices similarly as there are data modalities. So here we have two and we integrate them. So the kind of the idea for this integration is random walk. So everybody's familiar with a random walk on a single graph. You start in one node, you walk around and you come back to the same node. So here it's a random walk across graphs. So it's a kind of diffusion across graphs. So you start in this node, you say, okay, I have a null path here, so it walks somewhere else, but here I have a path. And so in every step, in every kind of, and this can be captured by a standard matrix multiplication all the random ones are. And so in this kind of scenario, what happens is that you update this graph with the information from this graph and this graph with the information from this graph. So in an iterative fashion, you start refining each of the graphs to be more similar to each other. And what happens, the byproduct of that is that similarities that are very weak in one of the graphs, they go away because they're not supported by another graph and they were weak to begin with and they just kind of disappear. So you pull a lot of noise that way, but the ones that are very, very strong, they kind of permeate to other graphs. And so in the end, because in every single step, you are guaranteed that the graphs become similar to each other, you are also guaranteed, probably guaranteed to converge to a single graph which is supported by all of the data that you originally had. So the main idea behind this approach was that once we represent each of our individual data modalities with the similarities of patients, we are in the same space, in a patient similarity space. And in a patient similarity space, we can integrate anything, whether it's similarity based on a diet or similarity based on DNA methylation or similarity based on imaging or questionnaire data. And we have actually done it in combining the imaging and genetic data and some of the questionnaire data as well. So this was the idea that it doesn't really matter. It doesn't need to be mapped to genes. It doesn't need to be mapped to a common unit. You can actually just combine and you can combine any number of these data modalities using this kind of approach, okay? So I will show you the experiments. First I will show you the simulations and this is primarily for you to see how the different methods compare on the different kind of scenarios. And then I'll show you some of the results that we had from the TCGA data. So we compared methods, we compared concatenation, I cluster the patient-driven similarity and the multiple kernel learning. The reason why I didn't talk about them is because they're not used as often. This PDSD method is a very nice method, also Bayesian kind of latent factor method, but it only works for two different views. So it's not as scalable. I think they had an extension to that. And multiple kernel learning is used a lot in imaging data, but not in this kind of scenario when you want to integrate all next data. So here's one simulation. So the ground truth is here on the left in the middle. This is the ground truth. We have two clusters in this two-dimensional space and we are trying to identify to identify them from two imperfect views of this, two imperfect data modalities with the general. So here, data type one and data type two. And what happens is that we capture pretty well one of the types in each of the data sets and we mislead some of the other ones. So the information is only available for one, this is kind of the complementarity. So one of the data views contains information about one of the clusters fairly well. In the other view, it contains information about the other cluster fairly well. So this is the results. So this point is the result. And this is information about how many points from this label. So how many points were swapped between two clusters? You can see the green one is the eye cluster. The black one is the concatenation. And you can see that as the proportion of swap goes down, you actually are losing quite a bit of the accuracy of your green concatenation. And again, this is due to complete loss of strategy when you're looking at data sets. Here's another scenario, also very, very common in biology in the omics data. Ground truth again is in the middle, but then we have noise to this data. So we have gamma noise in the bottom and the difference between gamma noise in the center and Gaussian noise, which is on the top, is that it has a tail. So it's a skewed type of noise. And so you have the structure of the data captured by both of these imperfect modalities, the data type one and data type two, but the noise patterns are different. And so what happens is on the left here is we're moving this kind of this, we are scaling up Gaussian noise, keeping the gamma noise concept and here we are scaling up gamma noise. So you can see quite interestingly that concatenation, it does okay with a low level of gamma noise. Again, the tail makes a difference. But as we add more and more noise, it gets progressive, it gets much worse. Whereas here it's a lot more stable with the Gaussian noise. It's a kind of a gradual decline. The other methods, the eye cluster performs kind of a positive reaction. And that's enough, yeah, performs much better. So with the TCGA data that we had, we had five different cancers and this is somewhat older experience. So we had fewer patients than I available now range for a lot of these cancers, but two years ago it was anywhere between 92 and 250 patients. And one of the, I guess, important point for me working with clinicians and trying to integrate data is they always ask how big of a sample size do we need, how many patients do we need to be able to make the inference? And with the similarity network fusion, we actually don't need as many patients if there is some signal we'll be able to find it. Because it's not, it's again, it's in a patient space, not in a feature space. So we had three data modalities. We had mRNA mutilation, microRNA for all of these different cancers, the five cancers. So this is the case study of glioblastoma. This is actually the real data. The top is the DNA mutilation. So you have both the similarity matrix and the graph that corresponds to the matrix. And you can see that the patterns of similarity between patients is the same set of patients, but the patterns of similarity between these patients is very different in each of these different data sets. So while it's possible that some of the patients look the same or similar in all of these different data sets, it's actually definitely not the case that it's a global kind of similarity. And the question, yeah? Yes, you are right. Yeah, I don't know why I'm not. The graphs on the right look similar to each other. So the graph, the topology of the graph is based on a joint, on a fusion, so that you could visually compare. But so you shouldn't look at the distribution of the nodes. You should look at the edges, and they look quite different. So for example, there is a much stronger similarity between the small cluster and the larger cluster, as opposed to in mRNA expression, there is a much stronger similarity between much more the kind of the second and third clusters are a lot more similar than the small cluster. You see? The nodes, the embedding of the node, the representation, the visualization is based on the fused network. So that you could actually compare. It's the same, the distribution is exactly the same. So you could compare the edges that are left. So you can see that based on the DNA mutilation, there are still some of the similarities that are left from here because they were very strong. But you can also see that. So here we have the similarity type, which is capturing all the different colors that are captured in the similarity of the different patients, patient pairs within patient pairs. And you can see that majority of them are based on kind of a combination of DNA mutilation and mRNA. So they both support the similarity between those patients. Or interestingly, there are some subsets of these yellows, which are mRNA and DNA mutilation. And also there's the big pocket of green, which is the microRNA. And I think what's important is that this black is the one that's supported by all of the data sets. And we actually had to go in and check. And there are maybe a few edges. There is an edge here. It's hard to check, but if I pointed out, maybe you'll see here. There's one here. There are a couple here. But the reality is that majority are supported by two of the data types, but not by all of them. Yeah. And with this approach, are you letting us say you're messing? So you can. We have the follow up work, which we're writing up now. So it depends on a couple of issues. We looked at, I don't know, 10 different ways of how to deal with imputation because now you're imputing patients, right? You're not imputing values of a patient anymore. Like usually the standard scenario in a clinical setting where you have maybe 10% of the data missing for a patient and then you'll. So in this case, you have whole patients missing, right? And so there are different ways to deal with it and basically what we show that if you want to get the same kind of clustering as you would have gotten with all of the data, if you had all of the data sets, the best thing is to kind of impute on the similarity. So impute the similarity of the patients rather than imputing the actual values because there are no methods that impute the actual values that actually do it accurately because this is what they do, the imputation methods. Majority of say, Gina expression, it looks like, I don't know, white noise. It looks like it's all around the same small value except for a few outliers. Those outliers, you have no chance of imputing. You have no idea that these would be outliers. So you basically impute in the mean every time, no matter which method you use. And imputing the mean is not very informative for the rest of the, for these values. But yeah, so we are kind of proposing an idea of how to figure out what imputation method to use given your data using the subset and kind of assimilate in the scenario. Okay, and so what we also found was that this small cluster was the IDH1 cluster. So it is possible that the methylation data still had an effect in our clustering procedure. And this is the one that had better prognosis and was a younger cohort as was known. But what was also interesting is that steamosolomide, which is not necessarily, it's a standard of treatment, but it's not necessarily useful in, it didn't have a difference in any of the groups except for the subtype one. So in subtype one treated and non-treated patients actually were had quite different prognosis than in this larger group than in the other two. Yeah. For the IDH1 subtype, how did you, what did you prepare them? Since they're apparently young, they're probably gonna be fairly healthy. They're all gonna be treated. So what's the, how big was the group that was untreated with IDH1? I don't, I don't think, I mean, we wouldn't have had the significance for two reasons, right? One is that there's no significance with enough data and another is there's not enough significance with not enough data. So I don't remember if it was the case that we couldn't actually tell with IDH1. Yeah. You found out, first you built the networks, correct? Yeah. And you found that they had three subnetworks. And then you found out that the smaller one was the IDH1 positive one. Yeah, we just checked their mutation status. So you just took the IDH1, mRNA, and microRNA and you found out. Yeah. Which is not, it's not hard to imagine that that would happen because we had the methylation data and you saw the methylation data had a strong signal. So what you're going to have some clustering on your own without having put that in your system. Right, yeah. How did these subtypes match to the other subtypes? So the IDH1 mapped fairly well. The other one looked like one of them was mesenchymal, but it's, I don't know, the subtypes are based on the gene expression. If we just classed the gene expression, we would have gotten the subtypes. We are using three different types of data. So. That's a question. Do you know the word graph? Yeah. Survival. Yeah, you were talking about what the most of the mind is affected by nodes. Yeah. Why do you say, why do you talk about the most of the mind rather than just saying these patients look worse and worse? This is the group. This is a group based on a treated or untreated in this big cluster. It's not just their survival. It's survival when they were treated versus the, it's the group that were treated in red versus the group that were untreated in black. The treated ones did better, yeah. Oh, and so you said they did better. Yes, yes. They didn't in other groups or we didn't have enough evidence to say that they were treated. But that they did better. And this was the case. We kind of did this analysis on the five cancers that we had, the GBM and you can see on top it's just a regular PCA plot of the data. And it shows that the cluster separated fairly well. In our data below, you can see the survival and it seemed better. So the survival here was better than using each of the individual data sets independently, data modalities independently, yeah. All right, yeah? Yeah, so I don't, yeah. So I don't have this plot or do we have anything in the lab for the feature selection, NMI? So the way that we did it, I mean, once you get the clusters, you can actually do the usual thing. You can do your t-test and what we actually found, and I'm sorry I didn't have the slide, it would have been interesting to answer your question, is that the t-tests, basically what they do is they look at whether the distribution is different in cluster one and cluster two, but it doesn't correspond to the actual similarities according to all of the features. So it doesn't really capture that intrinsic structure within the cluster. And so the features that were coming out with the usual kind of analysis on over and t-testing were not very clean. The features were not very differentiating between all the clusters. But when we did something that captured more, so what we did was we had, for each of the features, we looked at how it contributed to the clustering itself. So we looked at the mutual information with the clustering, our normalized mutual information, and then the features that we got, the top 1%, really aligned with the clustering. It actually turned out that there was a microRNA, really strong microRNA signature. Some of it was seen before and some of it was me. Yeah. So Lauren will talk to you about SNF2. So the good things about this SNF2 is that you don't have to do feature pre-selection at all. You don't have to pre-select the genes that you will be working with unless the signal is very weak. So for example, if you have one feature that matters out of the 20,000, then you correlate all the 20,000. Of course, this feature is not going to matter much to the information about patients. So as long as you have the structure of the data is predictive, is associated with a disease, you can capture it without doing the pre-selection. And it's quite scalable. I think we looked at 6,000 individuals so the integration ran within 10 minutes or so, but the longest time it took to figure out the similarity, patient similarity for 6,000. It's 6,000 by 6,000, a major extent. All right, so these are, yeah. It's independent to all the cancer types from TCGA. All the cancer, why do you choose only five of them? We looked at the biggest ones then when we were doing the analysis. We looked at the biggest ones then. Biggest and no embargo. We did it in two more cancers, but they had an embargo and so we didn't pursue them. It was available to you. Yeah, yeah, right now we are, yeah, we are kind of moving on because we are method development people. Yeah, all right. So this kind of concludes the integration, method integration for data integration and I will switch to survival analysis. So some of you already know it very well. I will just talk about it briefly because it's such an important part of the evaluation of all of these integrative methods that you can't really, it's good to have the intuition behind and then you will do more hands-on work with Lauren. So survival data is characterized by the time to a single event. I talked about censoring. This is where some of the patient information can be missing. We assume that this missingness is non-informative. I'll do the mouse, sorry. So the non-informative means that it's not that the patients that are doing worse due to cancer are moving away. So we are missing these patients not at random. We assume that we are missing patients in random due to moves, due to other reasons. So for uncentered data, we assume that we have actually observed the time of the event. So this is what it kind of looks like. So for the first patient, we definitely have the information. For the second patient, the last observation, the time to the last, the study ended and the patient did not die and there was no follow up. And so we basically know that the patient survived beyond the last, the end of the study. And that's a censored, right censored information. All right. So it happens that there is a lot of censoring and majority of the TCGA data, for example. But more importantly is that there was just very little follow up.  You have to put some requests, but it's very easy to get. And that actually has a lot of much better clinical data associated with the sample. So there are two important statistics that we'll talk about mentioned. There is survival and that's just the probability of person surviving beyond time X and it has a great. This is basically saying, I know that person was alive at time X. What is the probability of this person being alive in the next instant? So delta X is going to zero, which means that it's essentially X plus a little bit. Just the next instant, what is the probability of a person being alive in the next instant given that I know that they're alive now, all right? So it's a rate. That's the difference essentially. What is the rate of values of the hazard rate? For the hazard rate, is it, it can be negative. I think it's just continuous. It's just the R, it's just continuous on the R, it takes all real values. So one of the examples of the negative hazard rates since you asked is that the risk of dying is decreasing as the time goes by and that happens definitely for infant mortality, for example, that's a, that's an example where babies when they're just born at much higher risk of dying than as time goes by. So that's a negative hazard rate. Constant hazard rate is kind of nice. It means no aging, your probability of surviving at any point is the same as it was before. It's kind of nice, but usually the kind of the aging process is the probability of you dying later is higher. It's basically the measure of slope of the hazard. The hazard? The hazard rate. Kind, it's the probability, you will see more, you will see more about it. I think it will be more intuitive, but it's the ratio of kind of an observed to what you have had expected. Yeah, it's the rate, it's the instantaneous rate in time. What's the probability now given the probability before? I think some of the further examples will be helpful to illustrate this. So a couple of my estimators go with a couple of my occurs that I've been showing you before. And these are very commonly used and it's basically the probability of surviving. So the probability is this is n i's, the number of people that are at risk of dying minus all the people that have actually died at time t. So this is the survival rate over time, over all time. That's why there is a product. So now you know that this is just essentially plotting the couple in my curve is essentially plotting the survival rate and we have already discussed that. So this is exactly what it's plotting. Now we have two survival curves. So previously we had two groups, we had an orange and a blue group. And now we need to know whether they're really significantly different or it's the eyes playing tricks on us. And so especially when they're kind of overlapping, it's really hard to tell whether there is significant difference in the survival or not. And so there is an actual test, a log-rank test which is most commonly used for this purpose. And the summary statistics for these are quite simple. These are the number of people that are at risk in each of the groups and the number of observed events in each of the groups, right? And then what you do is you assume, you basically assume that the two curves are the same. This is your null hypothesis and you work to reject that. So if you assume that the two curves are the same, then that is captured by the hyper geometric distribution. And then once you know that it's a hyper geometric distribution, you know the mean and the variance of these distribution based on the statistics, the usual analysis. So this is the mean of the hyper geometric distribution and this is the variance. And the test is just a standard normal. So you would get chi-square. Sometimes it's captured as a chi-square, but that's when you're looking at the actual numbers, the frequencies. These are the probabilities. And you can look up the p-value, how well it's, whether it's significant or not based on the p-value. All right, so this is coming back to the hazard ratio. And this is the hazard ratio for the two groups. And this is again, this is the number of expected events to the number of expected in group one versus group two. So if you have a value less than one, for example, that means that the probability, the hazard in group one is reduced compared to group two. So it's 43% of that of the risk of group two. If it's greater than one, if it's at group two, then it means that the risk, the hazard risk of dying or if not responding to treatment, the failure rate in group one is twice than the failure rate in group two. So far you're only dealing with two groups maximum. Yes, that's a good point. So hazard rate, there is an extension to a larger number of groups, but I've never seen it used. I've only seen it used for pairs. So... What is the previous test to compare if there's a difference? Do you basically just compare them all to each other to find out if there's a difference? There is, so this, for the Cox PH model, so this is what people usually use. I will talk about it now. There you can actually look at multiple markers associated, so multiple biomarkers and multiple groups. When you're looking at the hazard rate and things like that, you only look at pairs. And you can look at all pairs, but then it's hard to summarize sometimes. Yeah, so this is another very, very common way to assess and to estimate the hazard rate is the Cox proportional hazard model. It's called Cox PH. So if you have multiple variables, this is, you definitely use this when you have multiple variables that you want to assess the risk of on your survival or response to treatment. So the idea is that you have this base hazard rate. This is the risk, just the general risk in the safe population as like a prior and in a Bayesian sense. And you have an exponential increase, well, or decrease, exponential involved of every other marker increases the hazard if beta is positive, if it's exponential increasing the risk of the individual. So what happens is, so beta is this coefficients for each of the markers, they basically say it represents the log of the hazard ratio increase for one unit of change of each of the markers. Well, the same as e to the beta because of this exponential increase. It's the hazard ratio increase. Per unit of change for each of the markers. So if your marker is a gene expression and it changes and it increases, let us say, then the hazard ratio also increases, the hazard also increases. And if beta, of course, is less, then it means that the risk is decreased with this marker, right? So the hazard rate for the two markers for two subjects, then it's actually quite nice, right? You can see that the hazard rate for two subjects is kind of proportional to this difference between the values of this actual marker, right? So this is just an example for, I just said an example. If you have x equals one for the treatment when the treatment is active and zero when the treatment is placebo, then you basically have the hazard rate being 80%. It means that 20% decrease in mortality if you use treatment versus if you use a placebo. So this is kind of the intuition for the hazard rate. And finally, I want to, when we talk about survival, usually people talk about hazard rates a lot and the survival probability a lot, but they don't talk about concordant syntax. And concordant syntax, I feel, even though it's a very simple kind of statistic, it's a number of concordant pairs. So when your model predicts survival for say i and j and your survival of i, you predict it to be greater than survival of j. And in reality, it's also true. It means that you are concordant. This pair is concordant with a reality. So if you're, so basically what it means is that your model can order individuals with according to their survival information accurately. And I feel like it's a better statistic to use when you are actually trying to to tell how good your model is, right? So I want to give you an example of using and comparing different models using these two statistics. So the P value, so this is the metabolic cohort that I mentioned. This is breast cancer and they had CNV and expression data. They now have more. They definitely have microRNA data. They have a little bit of the exome. I think they have selected a few genes to sequence, actually, and they might have methylation data by now as well. And they had almost 1,000 patients in the discovery cohort and about 1,000 in the validation cohort. And so it's a very rich dataset. And as I said, it has a much better follow-up than the TCGA data. And so the PAM 50 is a clinically approved classifier. It's a 50 genes that are characterizing putting people into different clusters. So PAM 50, I just heard a talk by the guy who actually invented this signature and it took him 13 years to move it from the lab where they discovered it to the clinic. It was very depressing. And so this is PAM 50 and they assumed that there are five subtypes in breast cancer. And this is the eye cluster which was called intercluster, not nature paper. And they said that in breast cancer there are 10 clusters and they associated some of them with amplifications and others with a high different expression. And this is SNF. And so we said, we don't know how many subtypes there truly are. So we constructed the network and we partitioned it into five clusters and 10 clusters. And what you can see is on top, you have the P values for the discovery and the validation of the Cox-PH model. So you will see in your lab how you get these P values for your model. So basically what this says is that the survival in one of the groups, the curves is definitely significantly different from the curve in another group. And of course, there are biases. If you have a very small group, then the P value can vary greatly and so it's much less reliable. But by that, you can see that the difference is this kind of in P values, there is, they all look significant, all of them, right? According to the concordance index, so this is the ability of the model to order individuals by survival. The eye cluster did a lot better, but also they had more clusters. And SNF did a little bit better than eye cluster, but it was basically the same for five clusters or 10 clusters. So what it says is that our ability to order people with respect to their survival is limited when we are starting to cluster the data. So what we were asked, this was one of the reviews of our paper, we were asked how many subtypes are there really in breast cancer? Can you answer that question? And so what we said is that maybe there are no, it's not a fixed number. The more patients you'll see, you see thousands of patients, the more it'll look like it's a bit of a gradient. And so what we proposed was to not do the usual kind of what is currently done, take a new patient, put them into a subtype even though they don't quite fit and then use the survival associated with that subtype, but to take a patient, integrate them into a network and then predict the survival for that patient using the whole network. And the difference between this previous approach and the new approach, the previous approach for the clustering, it kind of says, okay, I assume that my patient is similar to all of this little group of patients that I have seen that are in the subtype. What the network does, it actually says, first of all, I have the weights of how similar and how different. So it's a lot more continuous scale, but also I know who my patient is not similar to and I can use that information. In clustering, you kind of don't use that. And so what we said is that it's a slight change in regularization for the Cox network, for the Cox PH model, but the point is when you use the network and you use the weights that we estimated of the similarity between these patients, you get a much better ability to order patients with respect to survival than the same network, but when it's kind of clustered into smaller subtypes. So it's kind of a discrete version of a variable versus a continuous version of a variable. And so basically what we are saying, and especially when we deal with neuropsychiatric disorders and things like that, when it's a clear spectrum, when it's really not obvious that there are these very, very different subtypes that maybe it's more useful to represent things as a network and try to use the whole network, the information that's encoded on the whole network. What do you mean by ordering the patient by survival? Do you mean ordering a new patient where he's gonna, he's gonna fall into the survival zone? It's, so when you build a model and you are trying to assess the quality of the model, you say, did I predict the ordering of the two patients correctly? I already know they're survival. Did I order them correctly? Did I, did my model predict survival of one being better than the survival of the other? Yeah. How do you actually compare different clustering of coordinates in this other, you're just looking at the number. Is there like a p-value to generate? Because if you even look at stage and grade and you can coordinate index for some models like 0.7, they need to do a fancy clustering with genetic information like up to 0.71 and it looks higher. But is that really either statistically significant or else there was a genetic risk there? So, concordance in this is just another statistics that comes out of the, of your cox ph model. So you can get that it's, it's associated with a p-value which is already associated with a cox ph. But if you compare one model to the other model? I know it, it goes up and you don't know whether this going up is significant. This, you evaluate the whole model. So this is yet another statistic but you already have a p-value for that model. And so you can use that p-value from your cox ph. But if you have like 0.72 versus 0.74 and you're just every cohort. I understand. And if you have different patients or different characteristics in your validation board could that be also reversed? Yeah, what I'm saying is that concordance index is not, is one of the statistics. You can't just look at the concordance index and say, this is, this is good enough. That's just another way to evaluate your performance or your philosophy. Yep. So for the data integration in my field, for example, one of them is trying to figure out the actual, what the question was about pathways and association and everything. So try not just to get the pathway as a gene but to figure out how the mutilation and the gene expression and the microRNA, how, whether there is a mechanism that is associated with a specific cluster. So it's a kind of a feature integration, measurement integration idea at the same time as the data integration. So that would be nice. And that's not available right now. There is another kind of venue where we are going with this, is trying to predict a response to different treatments for patients, right? So if we have a patient and we want to, and we have a basket trial, which is the best treatment to give to the patient? So if we have that kind of question, it's possible that for one of the drugs, at least with respect to the network approach, for one of the drugs, you need to compare according to one pathway. But for another drug, you need to compare patients according to a different pathway. So how do we kind of build that in dynamically? So this is all from me. It says, we're on coffee break and not working session. But I would be happy to take questions, more questions. Well, this is with respect to the drug response. We actually tried this and it seems that if there is strong signal in the data, we can do as well with unsupervised method as we do with supervised method. But it always scares me because I think supervised methods should do better. Yeah? I think for the brain tumors, you've had the three sort of networks. Do you build each network independently first? No, it's one network. And we can cluster that network. So in that case, we use... So if you do them separately by... Did you get a similar looking network? If you do them on their own? I will put the appropriate this. So for this particular approach, you build the network independently for each of the individual data modalities first. This is the... So you do do that first and they do look different and you would get different clustering. It's just, it's actually... Yeah, but it's actually interesting. We're doing some work with Lawrence and it seems that where it matters is actually the borderline cases. The cases where gene expression would put in one cluster and a methylation would put in another cluster. And so their integration really can be informative where because for some of the core clusters, there are some patients that are so different from other patients that you could use just gene expression or just methylation to put them into that. To identify that sometimes. So why are the... Why is the topology similar but the edges not? The topology is similar by design. It's put there because otherwise you couldn't tell of how similar or different they are. If we change the position of the nodes as well, it would be impossible to compare visually, right? Because it's a visual aid. So that only it's just a visual aid? Yes, yes. No, no. For here it doesn't. It's the topology. It's based from the fuselage. Yeah, the topology is based from the fuselage. Yeah, yeah. Yeah? And how do you do your survival analysis for the network? So it's the same. We do eigen gap or silhouette. We figure out which clusters they are and then it's the same way as you would do for any...  You don't put one patient in one cluster since you divide the time. Oh, you mean the very, very last result for the network? So we actually do not, yeah, we do not cluster at all for the network. We actually added the regularization term where it's just a smaller appendage to the Cox model. I don't have the formulas here, but you basically add a small regularization which is essentially the weights. It looks at the weights between the two different patients. And so you add, it's like a penalty for patients who are far. You will get a higher weight, higher penalty to have the same result outcome. So essentially it's a predictive model. It's a regression with a penalty for the weights between samples. It's the same network. It's this network. I mean, this is Gleoblastoma network, but it's a network. So you can look at the weights. No, in terms of a capital line. No, you can't. No, there's no way. You would just have a list of all patients with their survival. I don't know if it could be useful visually. But it's made for the regression, isn't it? Yeah, it's just a... Yeah, it's just a mathematical, yeah. Yeah, it's just a change in the regression slightly. Yeah? When you show me one of your last graphs, you showed that your network gives you on the C value of around 27 compared to the absolute value of the one that's commercialized at whatever, of 0.56. Mm-hmm. What's the chemical implication of that? Just saying that you can order the individuals better with survival. It's just that the model, if you don't actually subtype the patients, a new patient comes in and you try to predict their survival based on the existing network, you will get... Yeah, but that difference 0.56 to 0.7 Is that a bigger difference or a smaller difference? I see, so that's the same kind of question as was asked. Would it make a huge clinical difference? No, it won't make a huge clinical difference. I don't know what's a huge clinical difference. In classifying, a patient's one becomes... Yeah, yeah. In the case of the level of the part which is the level of the individual patient, the individual patient becomes un-corrected and so you get this. So that means the population of the person is really not useful. Right, but it's still only 70% characterized correctly. So for the individual patient, we don't know how likely we are to get each individual patient for, I mean, we know, 70%. So it definitely makes a difference. 72% being able to order 72 pairs correctly versus 56% of the pairs is a big difference. Yes, we are able to predict the survival, to order people with respect to their survival better. Now... But that sounds like a huge difference for both populations. It's a difference. I don't know, if there is no statistical test like we discussed, there's no statistical test associated with it. The plan is awful because it's just better than random chance in my slides. It's slightly better, right? But it's better than what was before, which was nothing. Are there further questions? More questions? Fewer questions? No? Okay. And thank you.


Young people don't necessarily need Godfathers to make it up the ladder of politics. This were the words of the PDP candidates for the Lagos State House of Assembly, Babashala Wajay. He insisted that young people most see themselves as capable leaders and take their place as chain makers now more than ever. Political parties operate with systems. They are institutionalised systems that govern these political parties. So it's not going to be an easy fit. Right, we have the bill, but it would take some time for young people to be blended into these systems. For too long we've had a situation whereby a lot of the young people shied away from politics. Now the government has encouraged us by having an enabling environment where young people should be encouraged to come into politics. But the political parties have quite a number of work to do. Look at the PDP for example, just last year we had our youth leader, a national youth leader who got elected at the age of 25. If that's so much encouragement on the part of the PDP and it's a situation whereby other political parties need to emulate. Success is gradual. Whatever would effect change cannot happen overnight. So we need to prepare for that long journey. Look at all the political actors now, I mean I wouldn't mention names on air but we can tell that those that struggled for independence didn't start at age 40, at age 50. They started in their 20s. Hello, hope you enjoyed the news. Please do subscribe to our YouTube channel and don't forget to hit the notification button so you get notified about fresh news updates.