So we're going around against the clock. I don't have enough time for everything I want to say so feel free to come after for questions and the little clock is the the red bar under there So I'll just quick show of hand also to get a bit more Excited and to stretch a little bit because I have so little time who are more interested by VR than a are more virtual reality Okay, and who is more interested by augmented reality than virtual reality Okay, so And who is in the wrong room Everybody's in the video so I'll start still with VR Simply because it's more stable. It just works better now and instead of telling you How directly the code works? I'll tell you what I believe is the point of VR in the first place So what's the point of virtual reality? So it's to do things you cannot do it's not to do things that you should do but you don't do So for example, I should go a bit more often to the gym. I don't do that I I'd like to dive and I haven't been for a while and take the time to do that So I could do that in VR But that's not the point the point is for things that you really cannot do So for example, I like to go on mars never been there That's starting to be interesting But maybe at some point I know if you're optimistic on inter-entry travel that my doubt Maybe I'll be able to do that at some point But on another galaxy, definitely not so that's starting to be interesting actually I think to be important Or to visit Hyperbolic place or planes like there That's where there is in my opinion value But still VR in itself doesn't matter VR is The time you spend in VR Can be interesting can be entertaining But it's when you remove the headset after those your session That hopefully you've learned something you had a good time You can help your friends or you can help your colleagues So not the time in the headset that's great But it's the time after once you remove the headset that I think really has value So one very concrete example that was done a few Or shown a few months ago. That's from a prison in the US where Inmates were able to use VR to discover or to train rather for The real world outside to train back to society because for example I don't know you have to step back and imagine that you've been an inmate for 10 20 30 years And then you go out and you somebody show you something like this You don't actually know what it is And then you have interviews you start to try to integrate and all those little steps that are obvious for anybody else Or not anymore You don't know how I don't know to use a washing machine to iron your shirt before an interview and all the steps that are really obvious You don't have access to so I think that's really really billion years of VR. It's but again It's after once you remove the headset that it's important not the time spent in there So what's VR? VR is basically fooling your sense. It's being able to say, hey Here is what I see in front of me and I move my head I'm in the headset and then I can see something else and the image always matches your intuition Your point of view so then you you're not like wearing a headset. You're basically somewhere else Hence the example of the holodeck there How does that actually work? So I can spend the next 20 minutes On telling you how actually the technology works and how the different sensors are working and how the data is being passed and how You can get your position in space, which is indeed how it works But that's keeping the most important part of the technology behind VR, which is the human brain so That that's a little like illustration From one of the most fascinating research I've read last week actually so it's pretty still blowing my mind now Those are beetles in australia And they are male beetles And I don't know if you can really see what they're trying to do But they're trying to reproduce with this gorgeous beer bottle Because somebody there just like through toss the bottle away But this for this kind of beetle looks like the most gorgeous female beetle because it has exactly the right color It's a little bit shiny has some dots on it So it's it's kind of a super signal that hey, this is exactly what I want to do what I this is who might need that's my My special someone so what's what it's actually illustrating is that it doesn't matter Really what you see it's Basically some interface towards that information that's actually useful to you You don't see the world as it is you see literally your perception or driven by efficiency And this efficiency is making everything that you see for your own goal It's not how the world is actually and there are lots of um, you can only see the Diagram at the bottom, but if you run some evolutionary simulation You can see that all the population that are driven to get information Realistically with perfect veracity just are driven to extinction The population that are actually succeeding is the one that are aiming for fitness So how information that you see is actually useful for you. That's exactly how your works for us So yes, you've been warned about the pizza I'm pretty passionate about the orio, but also about pizza. I love it because it tastes delicious It has such a good smell such good colors and um The problem is first I don't have one with me And the others so I can't share with everybody there But the problem is when you want to share a viewer experience It's exactly like trying to share a pizza with somebody who never had pizza So imagine a friend somebody really nice to care for him or her But somehow they never had pizza and you try to convey because you have to convince him or to go to the pizzeria because That's where it's good. And well, if you haven't tasted pizza, you just don't get it So it doesn't matter how smart educated you are if you haven't put a headset on You can come after and we'll chat. I actually have a headset there and just put it on once If you don't have time to catch me, you don't want to speak with me after They're in every city including brussel that are viewer centers. So just go once you don't have to like it You don't have to think it's going to change anything But don't assume regardless of your education We're going to complete understanding of the brain and the technology That you understand what your is if you haven't put the headset on at least once Now we're at first them, but regardless of the place, I think VR open source in VR actually is pretty important because if you think back of the holodeck I want to build a whole world around me or my friends or my colleagues If I have some kind of arbitrary limitations That's frustrating But I think when you're talking about actually building the whole reality around you I think it's more than frustrating It's actually dangerous And it can have some business implication political however you're going to call it might know the guy in the t-shirt So that's why I'm contributing to medzilla Because I think having the tools to build your holodeck and not have artificial limitations are actually pretty important So what you actually do Like I said before I contribute to a frame I'll detail what all those different pieces and tools are about I do some bull requests. I solve some I complain a bit winding on some issues I'm trying to detail as much as I can what the problem is documentation because I discussed before It is pretty important and I participated to all hands Before I went to Asia to showcase and make people actually have their first time in VR but uh, arguably maybe I like to chat too much But I would say one of my most important contribution is just being there on slack So if you go under a frame slack with a little bit of luck if you have your first time and somehow it doesn't work as expected Just ask. I'll probably be around. I'll try at least to help you Uh, some other contribution is basically doing proof of concept of our little demos Because I think those are pretty important. They look pretty innocent But so to describe a bit like what you see now, um, I There is you can you can use your with some controllers Again, if you haven't tried this like to be able to see your hands and interact and paint it is pretty amazing and uh Since I don't go to the gym that often I thought I would train and say a bit of soccer Obviously then I need my hands to grab the ball But also to have controllers on my seats to be able to kick the ball So I just went to the kitchen take some plastic wrap and wrap them on my feet wasn't the most comfortable But it actually did work. So I playing against a 3d model of myself. I scan myself and I managed to lose But you know training So that gives me a full body immersion meaning my entire body from all my limbs are there and I can actually The sense of immersion is even more present So that's a silly little demo But it hasn't been done before and it's giving me a stepping stone Let's say one way to learn out of it and I don't feel good about it visually It's not pleasing but it was new back then and I let others also Experiment with it. So it's a stepping stone for me a little learning tool But also for the community at large so make ugly demos because it's fun because it's interesting It challenges a bit and also because then you share it back with the whole community It's a whole new field. So we need to learn from each other So that's great. I made my little thing I spent a bit of time but the point after is to be able to share it So obviously that's whether the web is taking the most values I give a link you honestly can open it if you want to and we can collaborate on it Then the question is okay. That's cute, but can you actually do 3d on the web? So I took because it's a question that comes pretty often Have a bunch of examples We won't have time for all of them. So don't worry about it. The links will be at the end of the presentation so For example So yes all those Or in 3d you have some kind of reflection you have for some of them Physics base rendering you have different effects and it's all running there It's not if you're wondering, okay That's that's cool that it's on the super powerful machine the graphic card is an hd620 Which is basically the cheapest integrated chipset you can have now on a laptop and this one also So it's all in real time You can just look around So that's 3d on the web. So yeah, okay, if you look at the latest You need to any real demo not exactly the same, but I would argue that's pretty much That's pretty convincing. Let's say it's not just a cube always fear And there are again plenty other demos to explore there So I'm sorry regarding the previous talk. I didn't include directly the mdn tables because the web vr It was then really there and I didn't have time to get it myself But yes, you can still use can I use? So 3d on the web works and you are basically on the web works It doesn't work everywhere But for example this big column which name I won't mention is full of flags So it's mostly working and it's working pretty much on mobile too. So it doesn't work everywhere, but on mobile on hdc vive rift windows mix reality. It's working pretty well And then you have fully feel also as a trick even if you don't have a view or headset you can still Use it because you're on the web. You can see with just quote unquote a laptop or A desktop a tablet. So yes, you do aim in the end for your headset, but Any device will actually work And the web is not just like a lower version of net if I did show an example just before 3d on the web But it's not just a port let's say because well first of all you can have everything you can roughly from native But since also mentioned before using service worker, you can have an offline version So you're using a web page. You don't have a connection. It still works. So that's pretty good for this kind of experience And also you can do things you cannot do just in native. So if you're epileptic close your eyes now because the next slide is disco So here we're diving from one of your experiment to the next and there are just pages just links So for example, if you make a page and then you make a page and I make a page We can link to each other without asking for permission and that's without removing the headset If you do that using native then you will have to go back. Let's say to The oculus home or vive home. That's just not possible in native So that's cool. But how? Um, well you can code for it, but let's say you don't feel like it on this day Well, there's this little logo you might recognize That that has been done literally by taking your your controller and painting those strokes in space You have a one-to-one mapping So it's using a painter you have the The link also in the reference and the logo there, but you just paint the tail here just by Doing the movement in space So it means you can use you are not just to consume content but also to create content If you want after that to uh, so that's a little bit more of the interface how it's working So you just have your first controller that can be a palette of the different Brushes the different colors and then again just that we're making pain with both hands. You can be pretty fun You start dancing and everything Can be pretty serious, of course you can do serious 3d assets, but And if you have tried blender, uh, it's an amazing tool and Not exactly the same usage, but then doing this kind of complex Measures is pretty tricky. So for somebody like me who can just do that. That's a good way The inspector on the other end the fm inspector allows to just you would expect from a 3d Editor to grab an object Using your mouse or your keyboard and then change the scale its position, etc. Again without coding one line A frame itself is the framework behind it behind a painter or the inspector that allows to actually code for it So i'll do a quick example so Let's see Um, it will be mostly copy paste because i'll excuse time So i'll just go on the a frame that i website Because i don't know what i'm doing i'll go on the documentation And first link well, there is a bit of code there, but i never i don't need to get it So i just click on remix from a frame remix your own across my fingers of course because Last minute problem demo all this probably won't work, but Let's try naively So that's about 10 lines And that's it i have here my little 3d object So you're not sure you don't really believe me first time it's normal So here the box is blue So i will make it Give me a color yellow I don't know him. It's not magic or something And it's yellow. Yes so Jokes aside, um, that's an actual URL. So if you go now on bug Uh dash close that glitch that me that will work on your phone Don't go there because connection all this but if you could go you would And if if you have for example the vibe or any kind of high end headset that will work So it goes from high end to actually not vr to low end vr to high end vr all the way so that took about One two minutes basically to have literally nothing nothing installed to create content and also nothing installed to consume content Okay, I recommend this book Okay, so you saw like four One cube one cylinder one sphere you're not really impressed So it starts from really really simple to going really all the way down So if you're a graphic programmer, then you can go all the way down to shaders because It's nice to have those basic visuals But if you want to have your own either special effects or deformation of 3d objects, you can use that too So there are a lot of really cool website to learn how to do that and then to integrate it back So why also I insist on this because once you've done once you Know that it's shaders all the way down. It means it's executed on the gpu Using web gl and it means It's pretty close to native. I would argue 90 80 percent performance wise. So again Yes, it's on the web, but it doesn't mean it's like a lower version of native If you don't want to come to write your own component to change the behavior of your object in space Then you can whoop. You can use directly again without copy pasting The repository with tons of different components. It goes from very simple one like I don't know a mountain to motion capture. So if you have an object in space Yes, you can draw it but then after that you can animate it So it means instead of like coding the line You would just take the object move it around Repair as play and then it's like a little rabbit jumping for example And then you have physics also so you can actually just again straight from the browser Have your rabbit. Yeah, you don't want to throw the rabbit away that let's the ball of basketball Then you can make it bounce So a little summary of the tools a frame is the framework So if you want to code in tlsl in custom element the kind of pseudo html as I showed before Javascript any import whatever number you want you can use that The inspector is to put them in space. The repository is for all the community third-party components A painter is to paint draw In vr and then because we're still at at the beginning whatever you also want to do Well, it's a whatever you want. You'll share so I'll keep those qa nas for the ends just one qna That's there is is ar better than vr Yes, no, it depends. It's not the same thing. Basically. So the second and last part is About ar specifically augmented reality. So let's imagine here instead of having this nice bottle of water had actually a delicious Trappist beer I won't give any brand but it's not actually there, but I wish it was there So that's basically or when you have the illusion where you're not like with a headset directly Secluded or blocked in this virtual world I would say the biggest limitation for a native ar That people don't download app. So if you're facebook if you're whatsapp if you're you know snapchat, that's cool You're okay, but if you're not in the top 10 and you spend hours and dozens of days or to to make your ar app Nobody's going to actually download it. We still download it now because it there is some kind of novelty factor But bit by bit it's wearing down and I think even if there wasn't this novelty factor If you spend more time installing an app than using it There is somehow a kind of problem. So since most ar applications are just a few minutes long or little bits of information what I would like to imagine is they were just like a Finger food basically you just have a little bite But if you spend more time actually preparing and then sharing it there is clearly a distribution problem Obviously once again the web to the rescue So that started a while back meaning about Seven years ago or 10 years ago a george attack. They were Blur Macintyre, which is now at Mozilla for the isaw ar project Started a browser to do ar Where does it work on which hardware? I would argue everywhere ish in the sense that as soon as you have a camera and you can do ar Not amazing you are but you can already superimpose Whatever 3d or 2d object in front of reality The more hardware you have Well, the more interesting it becomes but also the trick you it is because then you are going to have to go from General browser To more custom that you'll have to actually either build yourself at compile and send So the more hardware and the more advanced the usage the trick you it will be So if you just want to superimpose on a camera, whatever commodity hardware we will do The most is the easiest way to do it now If you have An iphone or any kind of modern ios device will be to get the xor viewer So i'll do a little demo with this I'll I'll show first how it works I'll So that was in my kitchen yesterday morning was kind of Clean And then you see the grid on the floor and all those little yellow dots So the yellow dots are a point of interest basically where you have Sufficient amount of contrast and then it's unique enough. Let's say so that when you move the phone It's able to localize itself by inverting Okay, the points are getting further or closer away that i'm getting closer further away from the previous location And yeah, I used my hand so it was pretty stable to not lose the position So yeah, that's that's how it works finding those little yellow dots and then moving around to see if they move from the last frame basically um, and then once you have that when you have your position related to Points in space you don't have to show them first of all it was just to explain you how it works And then you can put objects in space And then you can put some emulators and start to to play around with this and it doesn't have to move To show a little bit the degree of precision then This is in my salon that in the kitchen this time I just put the first or actually all my little anchors that have their position in in space and um a meter that had From wherever and then it's about two meters and then you see the measure More or less two meters If you're already familiar with 3gs, which is basically the default choice if you want to do 3d on the web or No, let me say it another way the most popular way to do 3d on the web Then all those utilitarian function like distance tools you hide the first point the second point and you just get the value To get the distance it's out of the box. You don't even have to do all this kind of difficult mathematics yourself There are those some limitations It's not magic. So for example now if you use or a kit or a core Which is what each of you is using it doesn't it only know flat surfaces just the plane So if you want to make an object, let's say a window if you want to make it move You basically have to position it on the floor and then bring it So I did like a little menu on the side and then you are both still to Have your object vertically moving And yeah, a little you see the little Box there in the back It's because it's just a 2d camera. So it has no notion It's not a depth sensor So it doesn't have a notion that this object is behind let's say this shell for this other object. So It works but with with some limitations So that was two days ago if you want to put a time for a AR you don't have to buy a $3,000 or your HoloLens you can take the top of your Tupperware and then start to Simulate how or what the different actions will be It's not great But actually if you want to convey to a friend or a colleague how it works pretty efficient because you can start to say Hey, I'll measure this space and then I'll move it around Because that's basically the display you'll have with your phone if you do it Demo time second demo time Okay, we'll go super fast Let's see if it works You can see my phone. Yes Okay, so I start the XR viewer Oh, no choose everything already. Don't look a bit of suspense You can still see So I'm looking for the little yellow points. I showed you before can I show you If I see so I don't see I see some that's good. Okay, so this is a bit. I have my grid Then I can put my objects there And if I turn around They're anchored in space So how does it work is again? I import a frame to be able to position my object in space and then using the If an XR library then I can use actually The camera of the phone as a bathroom camera and then to localize Myself in space and I can still use all the syntax those custom elements in a frame. I'm familiar with Okay, that was this. Uh, yeah Again, why why it matters is because I think a or is a pretty powerful medium But it's a new medium If we are already trapped within some kind of proprietary ecosystem then we can actually explore and That's not the kind of future I want so I want to be able to go wherever I want with it What's actually yet to come so for VR? Obviously we want higher pixel density If you have tried VR two or three years ago Try again because if you try the Vive Pro or something other see the pixel density is pretty good So you can still if you focus see the pixel But it doesn't but you nearly don't see them anymore if you don't pay attention For tracking it's a better position as you saw was it was a little bit Maybe it's my phone was stressed by the presentation but was not perfectly aligned So that's also with a depth center We have in one more autonomous car that's getting to go way cheaper and they're way more popular And finally better unification with web XR. So A little extra on this so last part which actually last three seconds Is to say just that web XR is actually web AR web VR and web MR and web whatever Or any kind of reality is now under web XR specification specification Might sound a little bit abstract, but if you're interested in the field, it's a pretty open discussion It includes all the different browser vendors all the different part interested So I invite you to join the specification to see how it works and also to share your needs on it Last absolute last slide is um, don't trust your perception It doesn't matter if you do a or of your something else as long as you build useful interfaces That's what matters And that's it slice over there. You can just search and all the reference out there with the example Thank you