So our next speaker is Anatole Lecouier. I hope I'm pronouncing the French. All right, thank you. He's the director of research and the head of the hybrid team at India Ren. And he has been leading a research activity on virtual reality for the past 25 years. And his main research interests are in virtual and augmented reality, haptic interaction, 3D user interfaces and brain computer interfaces. He was involved in numerous international collaborations, such as with the European guest XR or NIW projects. And he initiated and still leads the open vibe, open source software and co-founded Dementia startup company. He authored more than 200 scientific publications and has 15 patents. He served notably as a program chair of IEEE VR conference and associated editor of the IEEE TVCG journal. He obtained the India French Academy of Sciences Young Researcher Prize in 2013 and was inducted in the IEEE Virtual Reality Academy in 2022 last year. And this year, he is here with us at OIST, visiting us. Thank you very much. Thank you very much for the introduction. For the introduction. And thank you for being here. It's a bit late. It's Friday evening. I know that you are this beach calling you right now and nice area around with lots of nice restaurants. It's very nice and kind of you for staying for this very late event. Actually, I'm also very grateful for OIST, for hosting me in this TSVP program. So I've been here for a bit more than one month right now. And it's been already very fruitful in terms of exchanges, discussions. I've discussed with many people from different scientific fields, of course, closely related field, Tom and Chen. And it's a nice coincidence that we're here together. We can start collaborations. But also I could discuss with a specialist of coral fishes and octopuses. And actually, these were super interesting discussions and very fruitful also in terms of exchanges. So I really believe that this format of TSVP and OIST is very valuable. So I encourage, of course, people also to submit and come here. It's been a pleasure. I'm in the middle of this journey. And I'm pretty sure that the second half of this day is going to be even more fruitful. OK, so the idea today in this public lecture was to expose maybe what are the ongoing research topics in our community of virtual reality, showing the current trends and showing different paths that are taken in the community, somehow to illustrate what could be the future of our interactions with these numerical, digital, virtual worlds and virtual scenes. So I'm going to show different examples, different axis of research, hoping to foster maybe your imagination and foster an discussion. So I'm starting with where I'm coming from right now. I'm coming from this region of the far west of France, the Brittany region on the west part of France, the Rennes city. We are leading here a research activity on virtual reality, technology, perception, and application. We are a group of 40 to 50 people in this group. And we live in this nice city that I'm inviting you to discover, very different climates, actually, and very different food and architecture. So you can enjoy here in Rennes a more medieval European city-like architecture and food with also nice gastronomy. Of course, we are in France. Feel free to come. Another reason to come to our place is that we have this very impressive research center dedicated to virtual reality. We succeeded in the past 30 years in building one of the most, I believe, well-equipped and well-resourced center in terms of VR and XR technologies in Europe and maybe in the world. There are something like 120 researchers working on VR and XR technologies in Rennes. So it's quite a huge critical mass for working on this topic. For instance, this Immersia room, it's quite impressive. It's one of the largest cave in the world, cave system, where you can be immersed using glasses instead of VR headsets. This way, you can still continue to see your body, which is a little bit different when you use an HMD, which is cutting you completely from the reality and from your real body. The research path in our group is clearly oriented toward the design of these technologies, the design of 3D immersive and interactive technologies. But even if you are technology-oriented, we really like to work with people from cognitive science, perception, psychology, and neuroscience. As this kind of knowledge is inspiring us for designing our technology, and also we consider that these technologies can become, in return, an effective tool to study human perception, human behavior. It's a very good experimental paradigm and you can build stable, well-controlled experiments in VR. So in the end, we are reaching hybrid systems, combining all these promising technologies, mixing input and output devices like visual displays, haptic technologies. I'm gonna show some examples later on. Gaze tracking systems and even brain-computer interfaces that we started work in my team, something like 15 or 16 years ago. So today I'm going to investigate three main directions of research, trying to show you and argue that the future of VR technologies, the future of our interactions with virtual worlds is aiming, for instance, toward more and more physical engagement of your body and of your actions in the real world, and then transfer them to the virtual world, but also at the same time, more cognitive engagement of the user in this interaction. And maybe a ultimate goal or a unified scheme for interaction is moving progressively toward avatar-based 3D interactions with the virtual world, changing the paradigm of interaction, moving from the 2D mouse to this character which would enable you to interact in the future maybe with the virtual world. Okay, let's start with this first line of research. I'm talking here, for instance, about haptics. So haptic technologies, force feedback, tactile systems, actuated systems which enable to stimulate your skin, your muscles, and make you feel like you're touching, feeling real objects, although they are purely virtual artifacts. There are lots of startups, kick starters working on these projects at the moment. It's one of the big hype of the moment in the XR community. So you have examples here of exoskeleton gloves, haptic modules, many people are working on this topic. In my team, for the past 25, 30 years, we have been studying lots of different passes, lots of different technologies, ground-based haptics, wearable haptics, encounter type haptics, mid-air haptics, et cetera, I'm gonna show some examples right now. It's a very exciting field of research. There are lots of good ideas to design here. Actually, the problem is so complex. I mean, we had this discussion about the universal haptics. And is it possible, is it doable to achieve compelling haptic experience in the end? Probably it's going to never happen. So we have to consider like subpart of the problem and address the subpart of the technologies aiming at creating compelling situations and compelling experience, but maybe probably in a more focused way. Some examples here. So on the bottom right, it's quite recent work, which is very funny. It's encounter type haptics, providing haptic on demand only when you need it. So for instance here, it's a little tangible ball, tangible interface which come at the contact of your hand only when you are grasping the ball and then you can release the ball and the tangible interface goes away. So this is an encounter type haptics. There are many works and labs on this topic at the moment. This is, for instance, a combination of wearable device and passive haptics. You have a wearable system here which is pressing on your phalanx while you are touching this tangible body here. And interestingly, it's altering, it's modifying your perception of stiffness of this tangible device. So you can simulate different stiffness, different elasticity of this virtual body of this mannequin here, this tangible mannequin with these simple tricks of pressing more or less strongly at the level of the phalanx using wearable device. Yeah, another kind of engineering effort from our group here, it's to augment tablets. So it's a combination of surface haptics and ground-based haptics here. This tablet is just simply attached to a robotic arm which is moving in order to make you feel the relief, the texture, the friction, the resistance of the image here or behind the image. And last but not least, it's a very popular trend at the moment. It's mid-air haptics. So remotely, you can touch 3D, let's say holograms, using these matrix of ultra-sand emitters which are remotely simulating touch sensations at the level of your palm for instance here. Okay, and interestingly, what we like to do in our lab also is to approach some kind of low-tech approach and finding tricks, finding ways to compensate for the limitation of the technologies of the current technologies. It's one example, but it's a very important example for us who have been publishing a lot on this topic of pseudo-haptic simulating haptic sensations without any haptic actuation, without any haptic technologies behind with passive input device like just a computer mouse and make you feel the texture of this image, the relief of this image. In this case, we just play with the speed of the cursor. So we decrease the speed or increase the speed artificially of the cursor make you feel that you are falling into a hole or climbing a bump here. But just the artificial reduction or acceleration of the motion of the cursor which is perceived as a change in the height of the image and it's working extremely well. We have been doing a lot of experiments on this. So this was in 2D, but then we moved to and we shifted to other schemes and other interaction context. For instance, here we did something pretty similar to actually what you found in your, let's say hangover effect, right? Yeah, so here we call this pseudo-haptic avatar actually because we were changing the motion of your avatar and here similarly to what Sean presented we found that in this application you would feel that the dumbbell is heavier or more light depending on the deceleration or acceleration of the motion of your avatar. But this could change the way you can consider physical exercising in virtual worlds in the future and increase or decrease the fatigue of the user artificially. And these were also other examples showing how you can trick and simulate some graphical effects of elasticity here very powerful here to simulate the sensation of elasticity of an image or even on a tablet trying to simulate different kind of tactile sensations like here relief texture effects or elasticity effect friction effect at the level of the time. Okay, but from the very beginning haptics have been considered as a technology to enhance interaction with virtual objects coming from the robotic fields from tele-operation and progressively we are trying to consider completely disruptive use and usages of haptic technologies to enhance interactions with virtual worlds. So for instance, here we were trying to shift and change the paradigm and trying to see if haptic technologies could be used to simulate motion sensation and not contact with objects. So it's a completely different shift. It's a completely different paradigm to shift in the orientation of usage of these technologies. And here, for instance, in this example, we use haptic technologies to exert forces at the level of the head. It's a bit dangerous, by the way, but I tried. I was brave, I tried it. So we attached the robotic arm at the level of the head and then we translate the virtual acceleration of the vehicle. Here it's a plane, it's a flight simulator. We translate straightforwardly the acceleration into a force at the level of the head. So somehow we simulate a motion platform but at the level of the head. And this is extremely powerful to simulate eviction illusion, motion illusion and increase the sensation of flying here in this flight simulator. It's extremely impressive. But this is a completely different usage of haptic technologies. And I want to show you this one also because it's a very recent work showing how we can completely shift the usage also of a technology. In this case, still in the context of metaverse and virtual reality, our idea was to consider the use of this technology haptics as a means to support social interactions with others. In this case, what we found is that if you consider speech to touch technology, so that is we translate your speech or what I'm saying here, my speech into vibration. So it's very simple. It's just you put your finger on the loud speaker. Okay, when I speak. If I do that, I'm speaking right now and you receive my vibration, the vibration of my speech. What we notice in this paper is that if I do that and if you receive the vibration of my speech, you will gain actually 15% confidence more in what I'm saying. And conversely, when I'm speaking to you right now, I'm grabbing the microphone right now and imagine that there is a vibrator here which translate my speech into a vibration. I will feel 20% more confident in what I'm saying. Yeah, really. That's so surprising. So there are probably interpretations here. So this is what we call persuasive haptics, a new way of using haptics to foster interactions with people, increased trust and confidence in metaverse, for instance, in virtual meetings during virtual meetings. But that's a completely different way of using and considering these technologies. So now let's move on to the second axis which is completely different. It's how to make you more engaged now in the future of VR in a cognitive way. So without moving, but with your physiological body and your cognition. So maybe you notice that more and more XR systems and HMDs are integrating physiological data. By the way, with lots of ethical considerations here and potential good or bad usage here. But this is a trend in our community and these technologies to include more physiological sensing, physiological computing, and somehow modeling of the physiological state of the user and accessing the physiological data of the user. So we built like two years ago with the French Research Institute become this physiological HMD which is progressively integrating many sensors like cardiac activity, galvanic skin response, so electrodermal activity, ocular measurements, and even FNIRS infrared spectroscopy. So brain neuroimaging. And all together with this very integrated technology we've shown that we were able to extract in a very, let's say control scenario which was a flight simulator. It was possible to extract different levels of mental workload from the user, nearly in real time, like four different levels of mental workload. And this brings me naturally to the topic of brain computer interfaces which progressively are interlaced and associated and combined with virtual reality technologies. Actually we started to do that and to take this path in mixing, combining neural interfaces and virtual reality technologies together back in the beginning of the 2000s. This is the first video that we shot, 2006, 2007. We were mixing with Fabien Lotte, now an expert of the field. So in this very simple scenario inspired by Star Wars movie you are controlling the force of your brain to lift the virtual spaceship. That was super motivating by the way. And so we brought this in many conferences and made lots of demos. And in this case, we shown the compatibility of these two technologies and also the engaging actually aspects like Leah was saying earlier today that it's very engaging for the user to practice brain control and the learning of neural feedback, the learning of controlling your brain activity. Let me show, yeah, in 2005, we noticed that they were, actually we wanted to spread these technologies a bit more widely. So we noticed that there were not many open source tools on this topic. And so in 2005, we started a big research effort, actually a big engineering effort to make available an open source software for anybody who would like to start BCI research or BCI development. This is open vibe. It's an open source software which progressively established as one of the main software used in the field in BCI and real-time neuroscience in a broad sense. And this is, it's really a success. It's something that we would like to continue to support and maintain at INREA in my team to ensure that these technologies can be used by other researchers conduct and to start research on this topic. So based on open vibe, we designed different prototypes and illustration of what we can do by combining interactive 3D graphics and neural interface. This is an example of a video game prototype that we designed with Ubisoft company 10 years ago to show the potential of brain computer interface for controlling video games. So it's very basic. It's a space invader like a video game. You have to concentrate on those three different targets here and those targets are flickering at different frequency, five, seven and eight hertz. And if you monitor the brain activity in the visual cortex you can notice a peak in the electrical activity at the frequency that you are looking at. So if we find five hertz here, it means that you are looking at the left wing, flickering five hertz target. So we launched the goal left command. If we find eight hertz, means that you are looking at the cannon so we can shoot with the cannon. And you see it's very effective. It goes very fast actually. The detection is very rapid and you can control this game using this very basic idea. The same idea applied to the context of augmented reality. This was the first connection between a Microsoft HoloLens augmented reality optical see-through system and a neural interface to control a mobile robot using the same approach and doing this little pass on the ground with this same flickering targets and menu to go right, left and to move forward. But in my opinion, what is more interesting in BCI is not to control something, but it's more to monitor the brain and detect different mental states of the user and then adapt the interaction to the brain to the brain or to the mental state of the user. This is in my opinion a little bit more promising as the control with BCI is not very super reliable yet. In this case, it's an example of a proof of concept of a training simulator, which is adapted to the mental workload of the trainee. So if your workload is going too high because it's too difficult to follow this presentation, for instance, then I will be informed about it and I will try to speed down, right? For the interpreter, that would be super great. Semi-automatic warning regarding their mental workload. So in this case, we have these assistances, these guidance which are activated when the workload is too high, okay? And also, in the same line of research, more recent paper, here we've shown that it's possible to detect very rapidly in the brain when you are noticing an error in the system. So here, for instance, you are interacting in VR and something happens here which should not happen. The virtual object is frozen, which is actually an error which happened many times in VR. You have a tracking error.  So meaning that you can, for instance, launch some undo command, right? Automatic undo or you can flag the data at this moment in your experiment. So this is, in my opinion, a good pass for investigating the potential of this technology in the future. Okay, if you are more interested, we just released recently a state of the art on effective and cognitive VR, you can check. And the last pass, the last axis, I hope I'm okay on time, okay. So now let's consider a unifying principle of, let's say, avatar-based interaction. I'm talking here about this notion of avatario anthropomorphic representation in the metaverse in the virtual world. This virtual human or non-human creature, which is going to be representing you actually in the virtual world. So it's a very teasing notion. Actually, there are lots of works in the community at the moment on this topic, both on the technology, but also on the perception and psychology of this notion associated with this notion. And in our case, we're studying both aspects. We really believe it's a fascinating approach. So in this case, for instance, we wanted to check, yeah, how far can you go in this virtual embodiment of virtual body and sometimes even very dysmorphic body or different body, right? So this is what we call the six finger illusion. In this case, you put the headset, you look at your hand, you see a very realistic hand, similar to your real hand, moving accordingly to your motions, but there is something a little bit different. I guess you have noticed. There is this extra finger on the six finger, which is actually added in the model. And interestingly, what we've done here is we proposed a conditioning method to make you feel haptically the sensation of owning this finger. So to do so, we have this virtual brush here, which is brushing your finger, every finger, including the six finger.  So of course, there's a trick because when the virtual brush here is brushing the six finger, we have to do a little trick here. The real experimenter is actually brushing this finger here in a very synchronous way.  And at the same time, you see the virtual brush passing over your six finger. And very rapidly, like in two brushes, you start to feel that you have a six finger. And it's very stable, very robust across users. And very strangely, when you go back to five finger, that's the final step of the demo, we change the six finger hand to a five finger hand. And usually people feel that one finger was cut. It's a very strange feeling, showing the appropriation of this, very fast appropriation of this extra thing. So this is, in my opinion, revealing how far you can go with these illusions. But we went even one step further. This was presented by other presenters today because it was a joint work with the University of Tokyo, PhD of Rebecca, virtual co-embodyments. So this is another very fascinating situation where in this case, we show how far you can go here. We are putting two users in the same body, in the same virtual body, of course. So these two people are sharing the same avatar and what they see from a first perspective is a virtual body which is reacting to their motion, but also to the motion of the other user. And we can play with the weight of this motion, right? Sometimes you have 50-50, meaning you are sharing completely the body, but also you can have like 25 or zero percent, meaning that you are a prisoner of this body which is controlled by somebody else. And interestingly, we found that people could actually very well adapt and accept this very strange situation and even could get good synchronization of their own motion to generate some very complex here tasks. And there is actually follow-up paper just released recently by University of Tokyo showing that this can be very helpful in a training context. So if you need to train for dancing, for instance, or learning a gesture, then your trainer or your professor can take the control of your body and show you how to do which gesture to do, right, complete. And this was found actually to be quite effective. Takuji can say few words about it later. Okay, and interestingly, avatars are not restrained to a virtual reality and that's one of the last slide. It's to show that these technologies is progressively moving from the virtual stage to the real life and to our actually real surroundings. We've seen some nice projection mapping actually applications this morning. And this is the same idea of how avatarization could also happen here in this room with projection, for instance. And you could play with your body, disguise your body, change your real body in a numerical way using, for instance, augmented reality. These are two examples of recent works from our group where you can change your real hand to virtual robotic hands, but the rest of your body isn't changed, right? And it's real life around.   So this is how avatars are progressively moving toward also augmented reality and the real life. Okay, and to finish with one illustration of what kind of applications we are pushing, we are believing in, in this context, in this very, I mean, impressive context of colossal investment, economical investments of key players at the moment, investing a lot of entertainment, telework and so on. We believe in our research institute that we should promote applications with a strong societal added value in this field of metaverse and virtual reality. For instance, education, training, sports, cultural heritage, and in this case, medical application. So since three years now, four years, in our group, we have a full-time researcher who is also a medical doctor. And with her, we are designing, co-designing technologies for patients, VR and AR technologies for patients. One example here, during the COVID crisis, we designed this medical application based on avatars and virtual embodiment for COVID patients who wake up from coma in intensive care units. And this is actually the first time, if I'm correct, that VR technologies are brought in an intensive care unit. It's very complex to do that. And you see here, the person here has just to wake up from coma and few hours after waking up from comas, these people are very weak, unable to eat by themselves, unable to walk. In this case, they are proposed, they are offered an HMD and they can see themselves inside a body of an avatar, very similar to them, walking, actually walking, virtually walking for 10 minutes. Also, they are actually laying on their bed, right? They are laying on their bed, but they see themselves walking. And they do that 10 minutes per day during 10 days. And our clinical hypothesis is that using this system, these people will somehow start their reeducation earlier and they will be able to walk again more fast, faster. Ongoing clinical study, very complex clinical study, but the results are very promising. Okay, so to finish the future of this past is probably leading to native hybrid technologies, very integrated technologies mixing different kinds of sensors, technologies, both physiological computing, neuro imagery, progressively, together with visual display and haptics. And clearly there are lots of applications and we are pushing strong societal positive applications like medicine, sport training, education, I mentioned it. Let's see the future, right? Okay, I'm mentioning this project, which has just started to finish with. It's very interesting, intriguing initiative to, it's a European project with lots of European partners working on the future of metaverse social interactions. And the idea is to find techniques to promote good social behavior, positive social interactions and prevent cyber bullying online in metaverse. And there are lots of interesting techniques to do here. And we are working on haptic techniques to do that. Okay, this concludes my talk. Thank you for your attention. Be happy to answer your questions. Thank you. Thank you very much. We're almost out of time, but we have a couple of minutes for questions and feedback from the audience, comments. You can talk about octopus if you want, or coral fishes. Right there, okay. Thanks, the first question is, as I said this morning, the most difficult one. Thank you very much for this first question. Okay, sorry. I was wondering, do you see much application in education for this type of technology? Yeah, definitely. So this is clearly a very good medium for education. So it's super engaging, super motivating. You can visualize phenomena. You can visualize, you can build practical systems and tools to learn in a different way, or in a complementary way with traditional tools. So there are lots of initiative on E education based on XR technologies. Of course, there is no need for rushing into VR, right? You have to be very careful in not over killing the ultimate goal of the pedagogical process. So in this kind of project related to education, you need to make a proper analysis of the situation with pedagogical experts to see what is the potential benefits here of this immersive experience on the education and the pedagogy. But clearly there are lots of things to do here. All right, thank you very much. One more. The second question is not always easy. Okay, so this one is about the persuasive haptics, which I found very interesting. And we're thinking so much about the differences between virtual interaction and face to face interaction after the pandemic and so on. And I wrote one of your comments down when you were saying that it could increase confidence in virtual interaction. And my human reaction was, I think it might decrease my confidence because it's capable of manipulation. And when you're talking about the example you were showing is somebody's argument might be more persuasive, that I found, yeah, rather concerning. Totally, I totally agree. So it's like often with these technologies, there is the bright side and the dark side, the dark side of the force, right? The dark side of VR. There have been several papers on this topic. It's super interesting to read them and be aware about this. And indeed, with this result, I also immediately thought about potential bad usage. Imagine a politician would equip the ground here with strong vibrations. We increase your confidence in what I'm saying, right? So clearly, our political debate where only one person is providing haptics, right? We'll increase the weight of what he's saying. Some lectures finish like this, people knocking on the tables. So clearly, there are bad uses, potential bad usage. And so when we publish this paper, we had this in mind too. But so we were wondering among us, can we publish everything, right? Can we publish this kind of information which could be used in a badly way? But our motivation was to also inform and be aware about this. So indeed, now we know that this is doable and that we know that there are potentially good usage. And in guess, we're going to promote good usage of this technology, that we know that there are bad usage. So we also need to find ways to prevent the bad usage if you don't want to get bad influence, right? And this would consist, for instance, in being able to cancel a vibration or turn down a vibration, but it's not always possible. I was thinking of Kuta, I don't know if Kuta is here. But the ground of Kuta for the basketball field, we'd like to try this also. Everybody feels more confident. Yeah. All right, thank you so much. Thanks. Okay, let's thank our speaker one more time. Thank you.


How to Use Google Slides This video will show you how to create a Google Slides presentation. First, go to Google and click on the Apps icon. Make sure you're signed in to Google first. Scroll down and click on Even More from Google. Scroll down the page and click on Slides. The icon is a yellow page with a white square. Click on the yellow plus sign to start a new presentation. First, title your slideshow. Click on Untitled Presentation. Then type the name of your presentation. Next, you'll add your title to the first slide. Click on the box that says Click to Add Title. Then type your title. Underneath, it says Click to Add Subtitle. Click on the box and type your name. Next, create a new slide. Click on the plus sign in the box. That's the icon for New Slide. At the top, click to add the title of your slide. This is your main idea for this slide. In the box below, you add your content. This is where you type your supporting ideas and your details. To add another slide, go back up to the New Slide icon and click on it. You can add as many slides as you need for your assignment. To change the theme, you can scroll through the options on the right and select the theme that you like. It will change the colors and the font of your presentation. To share your presentation or submit it in Canvas, click on the blue button on the top right. Then click Get Shareable Link. You have different options for sharing your presentation. You can set it so that anyone with the link can edit your presentation or make changes, or anyone with the link can comment on your presentation, or anyone with the link can view your presentation. I'm going to select Anyone with the Link Can View. To share your link on a discussion board, go to the discussion, click Reply, and then right-click and select Paste. Then hit the space bar, and that will make your link turn blue. That means people can click on it to see your presentation. Then post your reply. To submit your slideshow for an assignment, click on the blue Submit and Assignment button. Click in the website URL box, right-click and select Paste. Then click Submit Assignment.


So, this is Carl Lackerman with the host of History is Here to Help with Scott Kikawa, who has written such a wonderful, well, he's written several books, but I just finished Kona Wins. And this is the topic of today, and we're going to focus primarily, but not exclusively, on the time period that Mr. Kikawa has chosen to write about because it is a wonderful time period, and he does a really splendid job of the history. So let me begin by just asking you to describe yourself, because you have sort of a law enforcement background, which is not the usual writer background, especially for Bamboo Ridge, I may add. Yep, that's right. I work for the federal government. I work for the Department of Homeland Security for U.S. Customs and Border Protection. I supervise an intelligence unit out at the airport, and I am a task force officer for another three-letter acronym federal agency, who I'm not going to name because I didn't run this by their press office, but they're located out in Kapolei. That's pretty clear.  You know, why did you become an author and something that you're really quite good at and, you know, an author of a particular time period? Well, thanks for saying that, Carl. This was really the result of a drunken dare. This was about 12 years ago. I was sitting in a bar in Kaimaki with a good friend of mine, Dr. Jason Chung, who is a professor at UH West O'Wabu. He teaches history and Asian pop culture. I've known Jason for years now, I think since we're both in middle school. And I was complaining to him over drinks about the lack of really good mystery fiction set in Hawaii, because we've got a ton of mysteries that are set here. But they're mostly written by people outside of Hawaii. And it really only uses this place. That I should add the people as a backdrop or standard cookie cutter plots that you could put another backdrop behind Paris, New York, wherever, and use the same story. And all you will be doing is changing the set dressing. I complained that there wasn't a book that was set in a period that I want. I know that Vicky Neubull has written some fantastic, what we call traditional mysteries, more of the vein of Agatha Christie. And she sets hers, I believe, in the 1930s, O'Wabu of the 1930s, up to the great books, and they follow that traditional pattern. What I wanted was to see something in noir, something that was hardboiled, something along the lines of the work that I really love, which is Raymond Chandler, which is Dashel Hammett. And we didn't have anything like that here. So Jason said, rather than complain about the lack of good crime fiction here, why don't you write something? And this was about 12 years ago. I hadn't written anything before them, besides reports for work and whatever I wrote in college for a grade. So I tried. And here we are. So that's kind of fast-forwarding it quite a bit, but that's how I got into it. Well, you know, on that theme, which is a great theme about setting it in Hawaii in post-World War II but before statehood, I want to go right into, I was going to ask you some other questions first, but because you mentioned this, your book mentions everything from lay to luau. When you mention regions like Papakalea, you discuss institutions like Queens Hospital. Your references to food runs the gamut of Hawaii food, and particularly with certain police officers eating things that aren't donuts in the station. And you know, my question to you is, why did you pick this? And how do you expect your local reader in Hawaii, and luckily I married my wife so I understand what Nishi Mei is. But how is someone, you know, if I were to give this book, which I promised you to my sister, how is she going to know in Berkeley what Nishi Mei is? Or do you just assume that people will look this up, or are you looking for a primary Hawaii audience? Well, you know, it was never my intention to write exclusively for a Hawaii audience. But at the same time, it was not my intention to make it more accessible for readers outside of Hawaii. That was a conscious choice, by the way. That was both me and my publisher, Bamboo Ridge Press, who decided, you know, we're not going to italicize or actually we do italicize some terms, but they are the medieval Italian terms, the Latin terms, the French terms that are in the book. We do not italicize Hawaiian words. We don't italicize Japanese words or Cantonese words or Ilocano words, because those aren't foreign languages here. The other languages are, and this was a conscious decision on our part. You'll find an editor's note at the very beginning near the prologue of the book, where it explains that we also do not use diacritical marks for the Hawaiian terms in the book, because this is not what they did in newspapers of the era. So we wanted to stay true to the era, and I did not want to make it anachronistically correct by adding diacritical marks. So that was a conscious choice. I think there's a movement afoot, too, with a lot of writers. Juno Diaz is one of the ones I think of with his Brief Life of Oscar WoW, where he uses a lot of Dominican Spanish, and he doesn't bother to explain the terms. He doesn't bother to italicize them or add a glossary. And he expects readers to find out by context. And that's kind of like the decision that I made. There's a wonderful prime fiction writer, Henry Chang, who wrote a series of detective novels set in New York City, I think in the 1980s or something like that, with Chinese American protagonists. He uses a lot of Cantonese terms, but he italicizes them. And I found it a little annoying that he puts a comma after each of those terms, and then puts the kind of the English or common definition right after them, while they'll come out white devil period, where that's where the benefit of the reader, I guess, was outside of that culture or outside of that community. And while it was probably a necessary thing, or maybe his editor insisted on it at the time, I find it distracting. So by removing all that, I saw it not to exclude folks that are outside of Hawaii or folks that might not have a context, but to give a more authentic experience to the reader. I think that's a narrative that the protagonist would naturally have, or present to somebody without explanation, without footnotes, and without definition somewhere.  You know, I read the complete, I don't think he's written anything that I haven't read, but Tony Hillerman, who, you know, focuses on New Mexico and the Navajo Nation. And I think I learned a lot about the Navajo Nation. I'm from Tony Hillerman, and I happened to be in Phoenix recently, and I was there was a guy who actually lived on the Navajo Nation, it was Navajo himself. And I said, you know, did he get it right as a holy guy, as a white guy? And the guy said, yeah, he did. And you learned a lot by reading his books. And I think that, you know, for me, a lot of these things are having lived in Hawaii and married into a local family, or quite interesting. But you know, I know them, and because of that, you know, there's a lot of adherence.   And I, well, you know, I expected, but I did not see Harry Bridges come up, you know, but I kind of expected him, because you mentioned Jack Hall. But anyway, how do you, how do you prepare for this kind of, you know, really in-depth, thorough, and meticulous mentioning of historical names? I mean, do you read all about the era, or is that just something that you grew up with, or what? Oh yeah, well, you know, ironically, I didn't really grow up with it, though my parents lived through the era as younger people, I think as teenagers. But they have a teenager's or child's perspective of the period, which is they were untouched in a way by current events, the way children or young people often are. So what they remember, and this was valuable, too, in my anecdotal research by interviewing my mother and people in her generation, to get a feel for the popular culture back then. And that was extremely important, but a lot of my research was reading a lot, and I had a lot of help, maybe not for Kono Wins, but for Red Dirt, the second book, which really looks at the HUAC's investigations here. And this was around the time of John Wayne's big Jim McClain movie, which was set here, where he plays a HUAC investigator. You know, UH West O'ahu, they're my friend Jason, he introduced me to Dr. Bill Pughett, who runs the CLEAR at UH West O'ahu, the Center for Labor Education and Research. And Bill was really generous in opening up CLEAR's collection to me. I went in there at the UH West O'ahu library, they have a closed-off room. And I got to handle primary source materials. So when I say primary source material, I'm talking about things like John Reineke's legal pad with his handwritten notes on them, ILWU minutes from their meetings, you know, Jack Hall was present at a lot of those meetings. And really, that's history in documentary form. I feel bad, I didn't take white gloves in there, I should have handled them with a lot more care. But those things were made available to me. And I've been really fortunate that organizations like the CLEAR, like the Japanese Cultural Center for Hawaii, like the Nisei Veterans Memorial Center in Waibuku, or I'm sorry, Kawaluwe, Kawaluwe and Waibuku, they're kind of on the cusp of the two places, have opened up their doors to me and have allowed me to look at their archives to peruse their oral history, the transcripts and a lot of their material. And it's hours of research, but you know, I love it. I was history major in college. And I know that many writers detest that part of writing where they have to do research. In fact, I know that many higher researchers, the more successful ones to do it for them, I would never do such a thing because it gives me pleasure to dive right into those sources. So that's what it was. And I'm amassed my own personal library of Hawaii Territorial History because I reference those works all the time.  And he goes into some reference rooms.  And it's, you know, it's, you know, he goes in towards the end of your novel. He go in mystery. He goes into a one that's, you know, air conditioned, you know, or at least has some things. And I was wondering, is that based on your own, you know, archival work at things like this? Because it kind of reminds me of our archival work back in the day. Oh, absolutely. And yeah, this is personal experience and really, you know, the irony struck me that the experience of moving from climate control to not climate control and back in has not changed all that much over the years. You know, back then there was air conditioning by 1950s, maybe about the 30s, kind of regularly here. But research is made up of those going into those spaces where documents did not necessarily receive the archival treatment. They were in warehouse-like spaces, which are hideously hot. And anybody who professionally has to look at those materials has to experience that real, that really uncomfortable climate situation. So yeah, and I've done this in my own job. So it's personal experience, but it's also doing the research and finding out that things were not much different back then.  You know, very, very little of an investigator's job is actually interviewing live people. A lot of it is what they used to call footwork. Today we do it from a computer at your desk, mostly. But back then you had to like drive to the Hall of Records and bribe, flirt, threaten people in order to get access to those materials and then spend hours with them. And that's kind of what I wanted to convey. And you do so really well. And I wanted to, and you know, do you also, out of your protagonist's mouth, that you say exactly that, that most of detective work is sort of like the kind of people would think of as boring and you don't get the people who are crying at the very end. They're generally just kind of sullen and looking down. And I thought those were great, great, great references. In addition, you make your main character a Columbia scholar.  And I thought it was also interesting that you use the divine comedy.  But you interject, you know, the divine comedy into different parts of your book. And this is a book, you know, set in Hawaii. And I just thought, how did he come up with this? So I'm going to ask you that. How did you come up with that? Well, this is a couple of things. This is both research and personal experience. I myself went to school in New York City. I didn't, I didn't go to school, Columbia. I got waitlisted there or something, but NYU picked me up. So I went to school several blocks downtown from Columbia. And I was a medieval Renaissance studies major at NYU, which happened kind of by accident, because my major was actually Islamic studies. And I figured out that a lot of the odd courses I had taken, I could cobble together a major. It was kind of multidisciplinary where it was literature and it was history. And it was art history and architecture history, all put together. Medieval mysticism is the class that we covered the Divina Comedia in. And one thing that I that struck me about, about the divine comedy is that it is not a work of devotion. Like most people think it is. If they're not familiar with it, it's satire. Dante wrote the divine comedy as a satire. And he lampoons a lot of the political figures of the day actually roast them outright in all throughout the inferno and purgatorio. Like they're all like on display with his commentary. And I thought, what could be more noir than putting references into a book on crime fiction, which references a satire from a different age? But it's also a commentary that law enforcement and the laws back then were really kind of medieval in a sense where we were authorities kind of picked into and chose what they would enforce and how they would enforce it. We're in an age before those key Supreme Court cases like Miranda versus Arizona. That's where the right reading the rights comes from. Or Gideon versus Wainwright. Those things happened in the 60s where it became very progressive and a changed law enforcement. But before that, it was it was pretty much open season. And that that's one reason I brought in the other reason I chose to make this particular character, a Columbia graduate and and and a medieval and Renaissance literature scholar is because it's somewhat historically accurate that a lot of these Nisei soldiers took advantage of the G.I. Bill and some went to some very prominent universities that it was not uncommon to see Ivy League graduates come out of this G.I. Bill program. And this was one of those things. He's an individual, this protagonist. So he did not study what his parents would have asked him to study. Business administration, for instance, or or something that would have gotten him a better paying job. He chose to go against the grain study literature, came home and found out that one of the only jobs to get if you didn't want to teach high school was to be a cop. And and this is kind of real life. Professional of choices that are that are made not just by people that era, but by people today. And and I thought this was this was unusual, but it was also historically accurate. So that was another reason for choosing. Well, you know, I mean, this is an interesting point being going back to history, because if you think about, you know, how many people of different ethnicities went into the Department of Education, it was the only job open for them. Like in the period that you were talking about, the medievalist for, you know, Jews couldn't go into a lot of professions, couldn't own land. So what were they supposed to do when they went into finance? Not that all Jews are involved in finance, but it was an open opportunity for them. That's the only thing they could do to make a living. So that's a that's a critically important point. And I did not know that many of the people who, you know, who were like in the 442nd or the 100th battalion came back and, you know, some of them went to the Ivy League. I do know one uncle-in-law who graduated from Berkeley, which is I've always considered sort of a public Ivy League. But there we go. Scott, if you don't mind, there's what I'd like to do now is I'm gonna have to turn on a light here so that I can read is that I want to read a description you gave because what's so wonderful about your book is your writing. And I want to give our viewers a sample of that. So, you know, in chapter four, you describe the Honolulu police station. And this is where your history matters comes into play. So this is the paragraph. The Honolulu police department station in downtown Honolulu, the Walter Murray Gibson building stood at the corner of Merchant and Bethel streets and was done in a Spanish art deco style so prevalent in Honolulu buildings erected in the 1920s and early 1930s. The corner entrance with this huge doors was framed in redstone quarried in Waianae and looked like the entry to some conquistadors manner. The stairs in the foyer were inlaid with hand glazed ceramic tile with the receiving desk covered with it. The roof was exposed mahogany timber from the Philippines painted with geometric designs and there was French marble everywhere in the interior. You know, you don't get many descriptions like that of in any novel these days. And so I wanted to ask you about this, but before you do, there's another one letter. By the way, I read both of these things to my wife. If you're a local guy or you spend many years in Hawaii, which is the case of this historian, you're talking about another quote as you're talking about a waitress and you're talking about a waitress in a way that goes like this. And it's a one sentence. It's one sentence. And you're describing her and you say she was acute in a Demure Japanese Makiki church bake sale way and it's hyphenated. So there are four words involved in that description. You know, how do you do this as a writer? I mean, it's just masterful. So I'm gonna stop there and let you talk. Well, thank you. Thank you so much, Carl.  I love looking at photographs, period photographs. I love looking at people's own personal photographs that they'll share them with me from the era and these images just, they come up and it would be a shame not to use them descriptively. The Walter Murray Gibson building is now a city and county. I think it's a part of the tax office these days, but it was the police station at one point. I did enter the building and tour the building on my own. The folks that worked there were extremely generous and helpful and let me wander about a bit and I did some research on where the materials came from. But it's a wonderful building and it's a shame that they had to move from that building. They moved into the Sears building on Baratanya in which they stayed there for a few decades until they moved into the present station. But a lot of these images come to me because I got to look at photographs because I got to tour these places. You know, the Alexander Baldwin building was also one of those places where they were also extremely generous and let me like wander around and take photographs. But that's part of the fun of the research and so our field trips. In your research, I was wondering how heavily do you rely on newspapers as a source? Oh, very much so. The Honolulu Record, which was the kind of the counterbalance weekly to the star bulletin and advertiser of the time. It was a weekly founded by Koji Ariyoshi. It's really prominent in Redbird, my second book. But man, this is where Ellen Park, the reporter works. The Clear, Bill Pughet has told me Clear has all of them digitized, like all the issues digitized. So I got to get in there and look at actual issues of the Honolulu Record from the period. And as you can imagine, the most fascinating things about them are not the headlines. They're the ads and they're the little side pieces. The sports page, you know, because these things give you a sense of the era and what folks consider to be important. In looking at the newspapers and things like that, were there things that you came across as an author that just really shocked you, that surprised you? For example, most people know about the Massey case, but things like that that just came up, you said, wow, I didn't know about this. Or I came across a book about an African-American cowboy who grew up in Hawaii. And that surprised me. I just didn't know that history. Well, many things. One thing that I saw on the Honolulu Record especially, where there were a lot of advertisements in the Honolulu Record, a paper for ostensibly a waku, but many, many ads for Japanese-owned florists in Hilo, which really, you know, it gave us a sense that at one point, all the other, the neighbor islands were kind of on equal economic and political footing with a waku. I think that changed forever with the World War II and the war effort, making a waku kind of center of everything. But it gave me a real sense that before a waku became economically dominant, there was a sense that the other islands also were part of that, the major power structure and schematic. So that was something I was very surprised in. You know what? When I've come across local authors, they refer, of course, in the contemporary period, they want me to say, use the word continent, which I've done. And then they don't want me to say outer islands, but neighbor islands. And then I thought that was really great. So tell us about your next novel a little bit as a way to, if you're so willing to sequence into our next talk, because, and I want to recommend to all our readers, Kona Wins, if I can get it straight in, there we go. This is, and what's nice is also the cover is so apt for what the book is talking about. It is, that's always true.  So that's really good. But tell us a little bit about Red Derpy before we go today. Okay, Red Derpy picks up maybe a couple of weeks after the events of Kona Wins, same detective protagonist and a lot of the, there are a lot of characters from Kona Wins and Red Derpy, but it's against the backdrop of the House Un-American Activities Committees, Hawaii investigations and particularly the Smith Act trials of the Hawaii Seven. So this was Jack Hall, a Koji Ariyoshi and company and brings to the forefront the Communist Party's activities here and murder together. So that's kind of what it's about. Well, thank you. I'm gonna leave you, we've run out of time here, but I'm gonna leave you with a final word about anything you'd like to say about your writing, about the books that you've written or any kind of advice you'd like to give perhaps to local writers who are thinking about doing it but maybe don't think that they've got the capacity because of their work schedule, et cetera. It's important for all to know that you work 24 hours. I mean, 24 hours, you work a full week. Yeah, a full weekend, you're in law enforcement. So that's a hefty lift. Well, I'd like to tell any writer here that if you can tell the story that only you can tell, do it. I would buy the book about a Micronesian detective or in Ilocano detective out of Waipahu in a heartbeat because that book hasn't been written yet. To my shock, my books are picked up because nobody had written them yet. I thought that somebody had done this ages ago, but the territorial period, especially that post-war period and before state, that 15-year period we're talking about, roughly speaking, was, it's part of a neglected history here in Hawaii. After the annexation, the overthrow of the monarchy, the annexation and today, all those years really get glossed over. There's a mention of Pearl Harbor being attacked, usually because in popular culture, that's the imagination of America, but a lot of this stuff gets swept under the rug and the people who live through this don't generally talk about it. This is why I thought this was rich materials and it's really noir too because it has all the trappings of noir. It's an engineer of respectability over a lot of bad behavior and that's the type of stuff that really fascinates me, but anybody who wants to exploit something in writing, in literature that hasn't been touched yet and there's a lot here, believe me, please, please do it because we need those books. And thank you, Scott Cowell. Once again, his book is Kona Wynne, so first he has described Red Dirt also, but I'm gonna wait till I finish Red Dirt before I interview again and I hope you will have time to do this, Scott. Absolutely, absolutely, it's a lot of fun. Thank you, Carl. Thank you very much. Thank you so much for watching Think Tech Hawaii. If you like what we do, please click the like and subscribe button on YouTube. You can also follow us on Facebook, Instagram, and LinkedIn. Check out our website, thinktechawaii.com. Mahalo.


Hi, and welcome back to Special Collections. So this next item has a really interesting connection to Mary Church Terrell. It's from the Wilma-Dijkman and James R. Stokely, Jr. Collection, and it's a report entitled Segregation in Washington. It was released in 1948 by the National Committee on Segregation and the Nation's Capital. And the report compiles detailed factual information about discrimination in the District of Columbia. The hope here was that by challenging segregation in the capital, it would set precedence in the rest of the country. As you can see, it has these wonderful infographics that accompany the text, and it covers several areas of discrimination and segregation, including public facilities, housing, health care, employment, and government services. So the report receives significant national attention and spurred local activists to rally around one of the report's revelations, which is found here. You can see under A, law disappears. This explains that legislation had been passed in the late 1800s, which gave black people equal rights to all public places, including restaurants and hotels, and that these lost laws had never been repealed. In response, Terrell, who at the time was in her late 80s and of course was a long time D.C. resident, was asked to chair the Coordinating Committee for the Enforcement of D.C. Anti-Discrimination Laws. The committee was there to make sure that these lost laws were brought to the public's attention and that they were enforced. She and committee supporters picketed stores and restaurants, which would not integrate, and she eventually initiated legal action against a local cafeteria. The case went to the Supreme Court, and in 1953, the court upheld the lost laws and ended segregation in all Washington, D.C. establishments.


What's happening guys, today I'm going to be giving you my college skincare routine in under three minutes.  Alright guys, so I keep my skincare routine pretty simple. As a college student, you don't have a ton of time to have an extensive skincare routine when you're going to class or getting ready for bed. So the main two things I use are a daily cleanser and an exfoliating scrub. Basically a daily cleanser is just something with a mild foaming cleanser that isn't really too harsh for your skin. The type of wash that you should get really depends on the type of skin you have, whether it's usually oily or dry. So if you haven't already, go talk to a dermatologist or go to your local pharmacy to see if they can recommend any products. This is one I got from the face shop, which is a Korean brand. This just works well because I have Korean skin obviously, so the formulas suit it a little bit better. And then with this exfoliating brush, I will usually do it once a week, maybe once or twice a week to just get rid of dead skin, excess skin cells that are just kind of growing on your face and it isn't good for new skin and healthier skin to grow. With the spin brush, you want to try and get in the pore that you don't really don't get to. So around the chin and the nose, your forehead gets a lot of bacteria up there, places where you sweat a lot, you want to just get rid of all that.  This is an essential tip for guys and girls.  No one thinks that's attractive. So these are going to be a must have in any college kids toolkit. Finally we're going to be ending with the face mask. This is essential for any type of skincare routine. The daily moisturizer that you're going to be used won't provide enough nutrients or hydration for your skin. So having some kind of alternative like a face mask is a great way. Keep your skin well treated. It's just going to help you get rid of your acne, scars, reddening. They're super affordable. You can really get them at any pharmacy. I recommend going to some Korean shop because Korean skincare routine is always bomb. And guys, like anyone that tells you that face masks are girly or not masculine. It's 2019 fellas. We got to be off our toxic masculinity game. So I highly recommend doing them probably once every few weeks or so. Maybe twice a month. Doing them with your friends. Going on a little spa day. Ain't nothing wrong with that, you know what I'm saying. Should this be the thumbnail? Finally guys, we're going to end it with toner and lotion. These are pretty simple once again from the face shop. Toner is pretty essential as well for any skincare routine. It's just kind of hydrating the skin before putting on a moisturizer. To be honest, if you only had to pick one, I would probably go with the moisturizer just because it's more versatile. Next up, we have this Persegel from Clean and Clear. This is basically Benozyl peroxide. It's very simple to use. You put it where you have any scars or pimples coming up overnight. You can just sleep with it on. Luckily, I don't have too many blemishes right now, but it has been finals week so you know that that stress has been there. Now every few weeks or so, I like to do a blackhead strip. This just removes all the blackheads that are in your clogged pores like your nose. Honestly, one of the most oily areas doing this every once in a while is really good to clear those out. Lastly, I read online that this helps. If you have any acne scars like I do on my cheeks, putting a little bit of Vaseline on them just helps them heal overnight because you don't have to worry about them. Obviously, your lips are going to be moisturizing them as much as possible. So every morning and night, I put a little bit of Vaseline on them. And yeah guys, that about wraps it up for this college skincare routine. I hope that this was helpful and that you guys were able to get something out of it. As always guys, comment down below if you enjoyed it, like for more videos and let's build.


Hi, welcome to the presentation of our paper, a side-channel attack on Masked-ins CCA Secure Saber Chem Implementation. I am Kalle from KTH, and today I have the privilege of presenting this work at chess on behalf of my co-authors. So today, we will briefly introduce Saber and how masking works. Then we will describe the presented attack and show its results, and we will finish off the presentation with a key recovery demo. Now, Saber is a key encapsulation mechanism which leverages public key cryptography to securely transmit a shared secret, such as an ephemeral symmetric key, which is then later used for bulk of the encryption. It is one of the finalists in the NIST Post-Quantum Standardization competition. It is one of the reasons why we have selected it for the evaluation. Saber belongs to a group of lattice-based crypto systems. It relies on module learning with rounding, which is a modification of learning with error. The fuzziness comes from lopping off a few bits off of each coefficient rather than sampling from an error distribution. Masking is a common countermeasure against side-channel analysis. So let's say you have a code section that's known to be leaky, or you would like to protect it. Now, with the masking countermeasure, you take your sensitive data and you split it into two shares for first-order masking, i.e. a random mask as one, and the other is the secret data XORed with this random mask. You then execute the code section on both shares, and at the end, you take the results and you XOR them back together to get the true answer back. The idea is that no point during the code execution did you manipulate the original secret data directly. Therefore, anybody that is watching on the power rails or listening to EM, they don't directly get to see what you are working on. Masking is considered ineffective but expensive computation-wise countermeasure, because we have essentially doubled the computation effort by executing the protect the code section twice for each share. So here, we see a portion of the saber key encapsulation mechanism that we are focusing in on. Over here, K is the session or ephemeral key, whereas S is the long-term secret key. Now, our presented message recovery retrieves the message from which we can derive the ephemeral key directly, but we will go one step further by combining it with the chosen ciphertext attack to derive the long-term secret key. Now, our tag point in red here is in the saber PKE decryption function, line one, of the CAM decapsulation algorithm. Our presented message recovery attack is a profiling attack, which consists of two stages, profiling and attack. During the profiling stage, since we have the public key of the device under attack, we can generate ciphertexts that contain a known message. We then send these to the device and ask it to decrypt. This is what gives us a set of power traces with known message bits. Now, normally, with the known message bits as labels, we can train a neural network to recognize what the power trace looks like when the message is a 1 and when the message is a 0. Easy peasy. But because the data has been randomly bit flipped due to the random mask, what looks like should be a bit 1 may actually encode a bit 0. And other times, 1 may actually mean a 1. We just don't know. This is the power of masking. So in previous works, during profiling, you would need to explicitly know the mask that's being used or you disable the mask altogether, setting it to a constant 0 or something that you know. This way, you know what the bit value is while it's being processed and how the power trace looks like for this corresponding bit. Now, with deep learning, on the other hand, from the attacker's point of view, we don't really care what the mask is. We just show the neural network the entire trace, such that it contains both shares, of course. And just tell it what the original unmasked bit is supposed to be. And of course, we know, since this is a chosen ciphertext, we picked it. We show it to the neural network and just tell it to figure it out. And believe it or not, it sees right through it. It figures out that one portion of the trace is related to the other and it can derive the hidden bit value that's behind it. This is without us ever having to explicitly tell it what the mask is even for this particular execution. And as I had mentioned, previous methods require you to fix or modify the mask in order to profile. This generally removes the ability to profile on the device under attack. There are usually measures in place to prevent somebody from reflashing it with a program to just read out the key to the screen with a printout function or something. Reflashing it would erase the key or otherwise render the secret key storage inaccessible to the new program. This gives our method an advantage because we can use traces and train on the exact device under attack. This largely removes device and process variations that would come from having to profile on a cloned device. In previous attacks, you would have to perform the attack stage in three steps. You would perform, first you would perform the recovery of the mask. In second, you would go and retrieve the second share, so which is the mask plus secret. And finally, the third, you uncover the secret by combining both shares. This is of course in contrast with ours, for which we just show all the shares at once and the neural network spits out what it thinks the bit is gonna be. Traditionally, in side channel analysis, we would rely on the t-test to help us hone in on the leakage points in the trace. But because this is an implementation that's protected with masking, we won't find much, if anything, that passes the interesting statistical threshold. As in previous methods, one would just fix the mask, use the t-test to find the leakage points and you would have everything, Bob's your uncle. But of course, we can't do that here. However, if you take a look at the averaged power traces, a very clean structure starts to emerge and when you start counting the peaks and comparing the loop counts to the algorithm, you quickly start to figure out where you are. On this slide, you'll see the beginning of the decapsulation algorithm. The pseudocode is on the left over here. We can see a few functions. The long one here is poly A to A and following that is pull to message. As you zoom in, you can actually see when the loop and state registers reload and start processing the 32 byte mask of pull to message. And indeed, if we zoom in further, you can see that there are 32 peaks for each share and each one represents one byte. Do keep in mind though, that each byte looks the same to our eyes here only because it's been averaged. The peaks and valleys for the individual traces are much more varied. So as I mentioned before, pull to message was previously known, but for the masking implementation, we stumbled upon a second leakage point under poly A to A, which is a custom primitive for masking developed by the authors of this saber implementation. The trace in front of you here contains the execution of 256 bits of the message. The leakage of both shares happen side by side so that for each interval between the spikes contains information on bit end of both shares. Now, from the regularity of the bits, this actually gave us an idea to cut across bits and take their union. This actually significantly reduces the trace acquisition time because from one single trace containing say poly A to A function, we would actually get 256 training intervals to show the neural network. This of course reduces the trace acquisition time proportionally. So if you say needed a million examples to train the neural network properly, this would cut it by a factor of 256 times. Now for the evaluation of our method, we deliberately sourced our boards from different suppliers to get an idea of the effect that process variation has. So D1 and D2, we source from the same supplier, whereas D3 was from a different supplier. If we take a look at the laser etchings, D1 and D2 suggests that they were manufactured in a factory in China, whereas if we take a look at D3, it was made in a factory in Philippines. Now in the table here on the very right column, you can see that the average accuracy does fall off as we get further away from the profiling device. Before I go to the next slide though, I would like to bring your attention to the fact that for Paul II message, the very last bit of every byte, so piece seven in this column, we found is the most difficult to retrieve for the neural network and this pattern actually repeats itself for every 32 bytes. These are the results for poly A to A leakage point. So this is the table for the second previously undocumented leakage point. The overall average is a bit lower at 95 versus the last slide at 97. But what's different and interesting for this leakage point is that if we look again at the first byte, only the first bit, so P0, plays hard to get. There's no major difference in the other seven bits. This actually holds for all 256 bits except for the very last one. So for this leakage point, all 256 bits, only the first and the last are a tad more difficult to retrieve. Whereas for the leakage point on the last slide, we get a repeating pattern of every eighth bit not wanting to cooperate. But it has higher overall accuracy for the unafflicted bits. So of course, as you see by now, you probably would be asking what would happen if we show both points to the neural network as they are kind of complementary. And indeed, this is the case. The combination actually increases accuracy across the board and we get our best results at an overall average about 98.6. As mentioned before, we will go one step further and combine the message recovery attack with a chosen ciphertext attack to derive the long-term secret key. The chosen ciphertexts are constructed so that we can derive information about the long-term secret key coefficients from the recovered message. The new secret key recovery approach, which we developed is based on maps from error correcting codes that can compensate for some small amount of errors in the recovered message. The full details and decoding tables are in the paper for you to take a closer look at. But now we will show a quick five-minute demo of the full process from gathering traces straight to recovering the long-term secret key. So what we have here is the chip whisper UFO platform. It consists of a modular carrier board that these blue target boards will plug into. Over here is the chip whisper light and for our purposes, it essentially acts as a cheap oscilloscope that will help us record the power fluctuations in the SDM32F4 board as it processes its data. The board also helps relate communication between the host computer and the ARM core over USB. For example, we can send a ciphertext to its buffer and then follow it up with a command to start deciphering it all while we carefully watch from the chip whisper the power fluctuations that are occurring over the shut resistor. Now we have also sourced three target boards that have the same model chip number on them. So B1 and B2, which in the paper is D1 and D2 and D3 respectively. These two we sourced from the same supplier at the same time whereas B3 over here was sourced from a different one. And if we take a look at the laser etchings on these chips, there is a closer picture of these in the paper. D3 or D3 has very different markings from the other ones and a quick googling seems to suggest that it actually came from a different manufacturer, a different factory. So we can begin the demo now. So first thing we can do is we can ask the ARM core to generate us a key pair. Now these are random and as you can see every time we run it, it will be a little bit different. And what we have done is actually we have asked the ARM microcontroller to send a copy of the secret key to our computer just so that we can follow along. Now normally we wouldn't have to do this but it just makes the demo easier. So now that we have this, we can also generate the ciphertexts, we will choose the ECC. So what this is is it has generated these 24 ciphertexts and when we do get traces, ECC and one. So what's happening in the background right now is that it's taking the ciphertexts that we have just generated, sending it to the ARM core, asking it to decrypt it and while it's decrypting the chip whisper is carefully watching the power fluctuations in the voltage rail and recording these in an umpire ray which then later on we can use to perform the attack. This process takes about a minute so we can give it. So that's actually taken exactly under a minute. Now that we have the traces which you can see in here, I'll show you here, they're just in an umpire ray. Now we can use these traces along with these here. So these four, these four here are our neural network models. They've already been trained. So what we can do is show these traces to our neural network. Please excuse the warnings, I've deliberately removed one of the libraries to prevent the computer from using GPU acceleration. This is just to show that this is a very lightweight implementation that the CPU can easily do. So what do we got here? So here are the recovered traces. So these traces here, sorry, these messages here are what the neural network thinks the traces represent. Now because we have the private key, we can actually do the true decryption of the ciphertexts and compare these against the ones that we think they are. And as you can see, there are a few errors in here. And this is why we have ECC. So as you can see, we can still do the key recovery and it should work. All right, so this is what we've essentially figured out what supposedly the key is. Now according to this, there's actually one question mark. So the ECC has identified that there is something that doesn't quite belong. Three coefficient 56, so it's approximately here. Yeah, here it is. So this question mark shows that we suspect all these other ones are correct, but this one seems a bit fishy. And as you can see here, the true key is supposed to be a zero, but of course the algorithm doesn't know this. And what we can do is all we have to do is just enumerate this and it has figured out the key. And of course the key enumeration is, it works exactly how you think it works. Because we have the public key, we can encrypt a known pattern and then using our guesstimated key, we can decrypt it and see if it matches our known pattern and then we repeat for all the possible coefficients. In this case, it says coefficient 568 is zero, which is exactly what we expect as this portion here is supposed to be a zero. And welcome back. So to summarize, we've basically seen that the neural network is able to see through the masking that during training, it figures out that the shares are related to each other and it can derive the correct bit. We then combine this with a secret key recovery based on maps from ECC, which ultimately led us to successfully recover the long-term secret key from a first-order masked Saber implementation. Our future work includes evaluating higher-order masked implementations. And we actually, we very recently just showed that first-order masking combined with the shuffling countermeasure can also be broken. A preprint can already be found in the archive with the final version being published later in November this year. Our longer-term goal is to design countermeasures against our own attack.


Discover the $300 million Comissi International Airport, before Tamal International Airport, Comissi Airport, which serves Comissi, the capital of the Ashanti region in Ghana, is the busiest municipal airport in Ghana. Comissi is roughly 3.5 kilometers from the airport, although approval was gained in 1940. The documentation for land acquisition was not finalized and paid for until 1947. Comissi Airport, on the other hand, had been finished by 1943. The Ghana government invested heavily in the runway, navigational infrastructure, and personnel resources in 1958 and 1959 to improve internal airline operations. In the late 1970s, the Comissi Airport saw another major upgrade with the installation of runway and taxiway lights, as well as the extension of the main runway to the southern end. While the lights improved night operations, the runway expansion allowed short-haul planes like the F-28 to fly. The renovation effort was finished with the construction of a new terminal and the installation of a VOR, DME, which was commissioned on December 1, 1993. Comissi International Airport was designated as an international airport in 2003, primarily for regional operations with full security, customs, and immigration employees. The freshly renovated runway with aeronautical ground-lining systems was inaugurated in December 2014. Domestic airlines were able to start operating at night as a result of this. The airport's master plan is currently being studied, additional parking aprons, runway expansion, and the construction of a new terminal building, all of which are expected to cost around $300 million, are among the project's plan for the next phase. Stay with us as we take a tour through the Comissi International Airport. Kwaku Afori Ejima, Ghana's Minister of Transport, has announced that the ongoing Comissi International Airport expansion project is on pace to be completed this year and open for operation as early as next year. The development of a new passenger terminal with a capacity of more than 1 million passengers per year is the second phase of the Comissi International Airport expansion project. The third phase of the project's scope of work, on the other hand, includes the construction of a 25,522 meters square terminal building addition, a new fire station, a new fire access road, and a new air control tower. A 9,000 square meters parking park extension, a 4,200 meters square access road extension, and two new boarding bridges are among the other projects. A 7,731 square meters apron expansion, a 202,805 meters runway strip, and an airside service road are included in the scope of construction on the airside. On the occasion of the unveiling of the Comissi International Airport expansion project, Aishma revealed that the Comissi Airport City project was well underway. He said he had authorized Vagana Civil Aviation Authority to begin feasibility studies for the project, and that the Ministry of Transportation will soon release the specifications and designs for the essential facilities as well as the cost. President Nana Akufo Addo cut the saw for the airport's second phase expansion in June 2018. The $300 million project included the extension of the runway from 1,981 meters to 2,300 meters to accommodate Bowen 737 and Bowen 800, the construction of a new two-story ultra-modern terminal, the addition of additional aprons, restaurants, shopping, and parking areas, and the construction of a ring road around the airport. The new terminal is expected to be able to accommodate 1 million passengers per year. The expansion project was part of the government's multi-mobile transportation system for the Ashanti region, which aims to boost tourism. The Ashanti regional capital of Comissi is the busiest domestic destination, with both passion air and Africa World Airlines serving it. Between Accra and Comissi, for example, passion air and Africa World Airlines offer 20 flights every day. According to industry data, 16,499 passengers flew between the two locations in 2019. Tourism in the Ashanti region Tourism in Comissi's Ashanti region accounts for a significant portion of the airport's operations. This is by far one of the country's most popular regions, recognized for its rich culture, tradition, and gold. Even today, the ancient kingdom of Assant remains a renowned tourist destination. Tourist attractions in the Ashanti region include Manhiyah Palace. This palace was the seat of power of the highest chief of the Assant kingdom, Assant Hing. It is located in Comissi, the capital of the Ashanti region. Kejisha Market This is without a doubt one of Africa's largest markets. It is estimated that there are at least 11,000 stalls and that 40,000 people work there. It is distinguished by a large number of brown roofs that can be seen from afar. There are various items and goods for sale there. Entonso Adinkra Village The printing of adinkra fabric takes place in Entonso. The prints are created with dyes and kalabash stamps. At the Entonso Visitor Center, you'll learn about the people's history, their crafts, and how to produce prints. Lake Bossamle The lake was formed when an ancient meteorite hit in the Ashanti region. A hunter is supposed to have discovered the lake after chasing an antelope into it. It's thought that the lake took in the antelope in an attempt to save it from a hunter. That is why the lake is still known as Antelope God Lake. Because of this, the Ashants consider the lake to be exceedingly sacred. The settlements that surround the lake are home to over 70,000 people. With an estimated population of 4 million people, the Ashanti region is the most populated and one of the fastest growing regions in Ghana. This is one of the main reasons why the population of Akumasi International Airport is growing by the day necessitating expansion. Thank you for tuning in. If you found this video interesting, please like, share, and subscribe for future updates.