We've talked about what it's like to test for a belt rank and what to expect and how to prepare, but what happens if you fail? So I was recently talking to a very close friend about their concerns for an upcoming black belt test and that conversation combined with several recent conversations with many of you maybe want to address this topic today. Not only were some of these discussions about upcoming tests, but I had a couple of private conversations with viewers who were in doubt of the rank they already had and they weren't quite sure if they deserved it. Talking about belt ranking in the martial arts is like navigating through choppy waters. There is no set global standard and it's almost always subjective and personal. Because of this I can understand feeling uncertain and in a way I think that can be productive. It shows a desire to step up and do your best and represent your art, school or rank to the extent of your ability. The expression that you are your own worst critic often holds true, especially in the martial arts. We talked in previous episodes about what to expect in the black belt test, but I think the topic of failing the test and not just the black belt test, but any colored rank is a little bit of its own challenge. First and foremost, it feels horrible. There's no reason to sugarcoat it, but not passing the test sucks. But if it happens, then there are pretty much two ways you can respond to it, positively or negatively. You can be positive and use this as an opportunity to grow and improve or you can get mad and divert down a road of passing the blame or taking it as a personal attack. I know of a student at a school who was testing for their brown belt and they had felt that they earned it, but the instructor felt different. The student did not know their full material and what they did know, they were not performing to the expected level, so they were denied the rank and told to keep working on it. Well, that student chose to quit the school and attempted to smear a campaign to discredit the instructor in the school. Not exactly a great display of character, which we'll come back to in a second. But not passing the test doesn't have to be a huge deal or be taken as a personal attack. I've been there and just about everyone I've trained with has as well. In my early days of Kempo, we had a simple stripe test every month and you simply showed up to those days and tested with the material that you had. If you knew your curriculum and you could perform it, you got a stripe or belt if you're at that point in the curriculum. But if you didn't, then you didn't get a stripe and you got a chance to try again the following month. Now, there were a couple of times that I didn't get a stripe. I just wasn't ready. And that's part of it. And I really want to make this distinction. There is a big difference between not feeling ready and not actually being ready. And deep down, I think that most people can tell that difference, not feeling ready as in having doubts or nerves or wondering if they know the material well enough or could I be doing next was the better or is the instructor going to be happy with my performance, etc. All of those feelings are perfectly normal. Most people aren't comfortable with the spotlight and it's completely natural for anxiety to come into play. But here's the secret. Most of the time. And of course, I can't speak for every school, but most of the time your instructors aren't looking for a perfection. If they are asking you to test to begin with, then that usually means that they feel you are ready. So part of the test is already passed. They've seen you work your material.  It's more about seeing how you perform under pressure. The test is more about your character, your focus, your attitude, your determination and your problem solving. Well, we would hold tests for the kids classes. I wasn't worrying about the kids doing the techniques perfectly. No, I was more focused on what they did when something didn't go as planned. If they're okay, perhaps didn't respond the way that they were supposed to or if they made a mistake in the form. Did they freeze and lock up or get mad or give up? Or did they make the decision on the fly to adjust and keep going? A student that can alter their technique on the fly based on the sudden given change shows more skill to me than the student who can make a technique textbook perfect. Several years ago, I was sitting on the panel for a junior black belt test, which just meant that our students were graduating from the kids curriculum and beginning to work on the full adult curriculum. But it was a big deal to the kids. We had this one girl who breathed through the test and she was able to perform the self defense on her partners and her forms look good. And she did very well during the sparring session. The snag actually came at the end ceremonial part. We would have the kids break a board as the final part of the test. It wasn't hard to do. It was just a single one inch pine board and it was more of something satisfying for them to finish with. This girl got hung up on that. She hadn't broken boards before and she was unexpectedly hesitant, worried about being unable to do it or hurting her hand. She knew how to punch correctly, but she got inside of her own head and she would try but not put any follow through into it. And she held back and of course the board wouldn't break, which only added to her anxiety. To make the spotlight hotter, everyone, including her family was there watching her. She needed this in order to pass. We encouraged her. We talked her through it, but after a couple of attempts of not breaking it, her hand really was starting to hurt. So she switched hands after about five minutes of everyone holding their breath.  And I'll tell you hands down, despite everything she had performed during the previous five hours, that five minutes was her real test. We knew she was ready to pass, but seeing how she handled herself in that moment of high pressure and anxiety only confirmed it. So your instructors aren't just looking at your technique. They want to see your focus, your effort and how you handle the challenge or what you do to improvise in the moment. So there is a difference between feeling ready, having doubts and such, but it's different when you really aren't ready. If you haven't covered all the material or if you don't understand it enough to make changes or if you're just trying to cram in preparation in order to force the test, you know it and you know it feels different. When I was testing for my secondary black belt, I had spent 11 years up to that point prepping. School changes, instructor changes kept delaying it. But when it was time for me and another student to test, we were having black belt review sessions with my instructor a week before the test. Well, a third student who was a brown belt and felt he was ready to test just started showing up to these reviews. And it was a little bit awkward because we could clearly see he wasn't ready. He didn't know half of his form and he was freezing and blanking out on most of his techniques. My instructor indulged him for the first two review sessions. But at the third, after freezing up halfway again through the Cata, he stopped and said, you know what, sir, I'm not ready to do this. My instructor nodded and said, I'm really glad you said something because at the end of today, I was going to tell you not to come back tomorrow. So you know deep down if you know the material or not. But if you do tests and you don't pass, it's OK. It's natural to feel frustration and disappointment, but this is an opportunity to improve. The first thing to determine is why? Did you not know your material? Were you too apprehensive? Did you have a bad attitude? And if you truly don't know, then ask the instructor what you can improve on and focus for the next time. And that's the beauty of it. As long as you can remain constructive about yourself, there's a next time. You know, it's not like trying to pass the bar exam where you have limited attempts or if you don't pass, you're never going to. You get to practice and try again. And to be honest, while it's not as common, some instructors really will fail the students for the wrong or unfair reasons.  So he was purposely denying him rank, despite the fact that his assistant was the best martial artist at that school. So there are situations where it's not your fault if you fail, but you are accountable for your own training. So if you truly believe that this is the experience you're having, then this is an opportunity for you to make a positive change. This is a chance for you to decide if this is the path you want to take or try another school. Failing the test grade can be a learning moment if you allow it to be. A belt is just a piece of cloth. You put the meaning in it, not the other way around. Thank you for watching. I would love to hear about your testing experiences, both good and bad, and what you learned from them. Also, check back in again next week because we're going to flip to the other side of the coin and talk about being an instructor who needs to fail the student.


All right. Well, welcome everybody to the Bookmap ProTrader webinar. Today we have TraderAid. We actually had a ProTrader webinar.  And now we're having Markets and Mayhem with TraderAid. They both work together or have this service together with TraderAid. I'll go through the bio here of Markets and Mayhem. He's experienced Trader and investor cutting his teeth in the markets starting in 2005, learning to trade and then invest after doing some of his first trades during the dot-com boom, which sparked his passion. Mayhem has experienced analyzing flows, geopolitics, macro, systematic trading and technicals. I have many links here for him. The TraderAid.com website, macrovisor.com, his YouTube channel here, and then also special offers from Bookmap, from TraderAid. Let's go through the disclosures and I'm going to turn it right over to Mayhem. General disclosure, all Bookmap limited materials, information and presentations are for educational purposes only and should not be considered specific investment advice nor recommendations. Risk disclosure, trading futures, equities and digital currencies involve substantial risk of loss and is not suitable for all investors. Past performance is not necessarily indicative of future results. Let me get his screen here and we are good to go. Okay, take it away, Mayhem. All right. Well, thanks everyone for coming in to check this out. I'm going to do first just a couple PowerPoint slides to talk about some of the convergences I look for and why I find Bookmap so valuable as a part of my day trading and even swing trading process. I think that one of the really interesting things about Bookmap is for us retail traders looking at depth of market and really looking at where order placement was, we could do it through the DOM and that was fine. But the way the heat map works, I just find it extraordinarily helpful, Bruce. I mean, you guys have made an amazing product here. Let's kick this off. First things first, the theory behind resting liquidity being a signal. I like to look at just like my partner, the market as an auction process. Every day, we come in and it's basically, we've got three different auctions. We've got the Asian auction, the European auction, and the US auction or the North American auction. Over night, we get different levels to pay attention to, but we also see that the way things trade is really like an auction in the sense that if you have someone out there, the really big order and it's not a very liquid market in particular like we're seeing now. That order commands the attention of the market even more. It's like someone at an auction who's very vocal saying, hey, I've got X amount of contracts at this price. I tend to see resting orders of over 200 in size being meaningful. And that is to say, in a day where the market is trading during our regular trading hours, it's not necessarily as impactful during extended trading hours, but during regular trading hours, if I see an offer and we're moving higher and it's 200 contracts or larger, that gets my attention. If it's three, four, five hundred contracts, I'm really paying very close attention to it because as we trend towards it, it tends to act a bit like a magnet. And that effect is important because for me, if I'm trying to get in and out of a trade, I do want to make sure I'm setting reasonable targets based on where the market's likely to go. So I'll actually set my order, if we're talking about this theoretical offer that we're kind of running towards and we're sort of doing a little of that right now in the market, then I'm going to set my order about a point below because there's two scenarios that tend to happen when you get to these key levels. You either get into it and through it or you get rejected just below. And when you get rejected just below, it's usually about a point or so that that tends to happen. You kind of get close.  So for me to have a higher probability of getting filled, I don't need to realize every single point if I'm able to get more trades in. So I tend to put my offer in just a point below or my bid just a point above where I'm seeing that large area of resting liquidity that I'm targeting as my exit price. And it's just a way of trying to use the information that's available through Bookmap to optimize my entries and my exits and also just get a better sense as to what other participants in the market are doing. I know it's a little counterintuitive. We probably, you know, folks here are probably more familiar with this, but I know I'm talking to YouTube as well. But for a lot of the people that I've talked to, they find it a little counterintuitive. Wait, why would a large offer kind of be bullish for price? Isn't that telling the market that there's someone up there that's kind of going to sit on price? Well, I'd say for a single stock, that might be more true, particularly after hours. But when you start to look at something as big and as liquid as the S&P, it really does come back to looking more like an auction, the way it trades, where you have a bunch of liquidity sitting there. It's often tempting for that auction process to bring the price there to release that liquidity into the market, particularly during a less liquid market. The market wants that liquidity. So when we watch those unusually large limit orders, in this example here, we've got one that was below us and it was eventually filled. And you can see how big it is, not only because of the size in the cumulative order book column, which is second furthest to the right, that's 672 by 3990. But you can also see it in the heat map with that dark red bar. It really stands out. And this is one of the things that I like about the heat map in book map is you really get a good idea as to what's on the book. And those large orders are visually going to grab your attention because when you're trading, you don't have a lot of time to look all over the place. You really need actionable quick data. And that's what I like about this in the sense that I can just look and know exactly not only where liquidity is resting at this moment, but where it was recently and where it may have moved from there. So on this chart, we can see we were at 4002. You can see there was a number of large red bubbles leading into this. And we were trending lower as we were getting to this point. And you can see that that order at 3990 stands out. It's the most aggressive order on the book. And if we zoomed out even by 50, 100 more points, it still would have stood out. This is one of those kind of slam dunk trades where you're getting right into that with the trend. And then you see that large resting bid. And you can say, okay, well, you know, I'll get in there with a bid at 3991 to cover my short. The other thing that adds to my conviction in this trade, what makes it important? Look above at the rightmost column. You'll see around 4015, you've got 4833, around 401250, you've got 228. Those are large areas of aggressive buy delta. So that means that by the time we've gotten down to 40225, there is a lot of folks that are on the wrong side of this trade, presumably at least a chunk of those buy orders were buy to open. And so if you're now 1015 points below where you bought to open, you're not in a happy place. Your stocks are starting to get triggered, or at least you're, you know, if you're a day trader, you're looking at managing risk by getting out. You don't want to be that far out.  So that was another thing that I was looking at saying, okay, like what else would give me some conviction that we're heading in that direction. So that's an example of sort of microcosm of how I use book map in a vacuum. But I want to zoom out a little bit because I find that looking at other areas to find convergence can help to give us a little more conviction in our trades. I also think it's important to be aware of the broader environment, the conditions that we're trading in book map gives us a day to day view of the liquidity that's in the market. And there's a couple of plugins that one can add to make that view even more helpful. But you also want to zoom out and kind of get a sense as to where you are versus prior levels of liquidity because it will allow you to better gauge that sort of realized volatility that you might experience in terms of intraday price swings, right? And we are in a pretty illiquid time in ES. It's gotten a little better and we'll talk about that in a second. But if you look at this chart going back, you know, basically three years, you can see that we have had periods of much better liquidity than we're in right now. And so what does that tell us? It just tells us that price swings could be a little bigger. So for me, it may cause me to want to be a little more conservative with position sizing and a little more likely to scale in and out because of that greater degree of price variance. It also means we may need to use somewhat larger stops because less liquidity is correlated to larger amounts of realized volatility. So when we zoom in, and this is a tool I recommend everyone check out, it's a CME liquidity tool, right? You can use this to show the book depth for whatever period of time you want. I think it goes back about two and a half years. But you know, it's useful to tell you kind of where you are relative to where you've been. And you can see recently, S&P liquidity was very constrained. We're starting to become more healthy. We're starting to get closer to where our averages are, but we're not quite there yet. So we're still in this somewhat liquidity constrained environment. And you know, if you go to CME's website, you can sign up for quick strike. It's completely free. They've got a lot of cool tools and they plug in well to what we're doing with book map because we can kind of zoom out, see the depth of the order book over a period of time and get a sense as to where we are and let us plan our trades and our position sizing and how we manage volatility. And this is why because just as I was saying, liquidity is strongly negatively correlated with volatility in the sense that an abundance of liquidity usually means lower realized and implied volatility. And that makes sense because realized is what you've seen and implied is when people like dealers are looking at pricing options, they're saying, what's the future price variance we can expect? That's going to help to provide some feedback on implied volatility. Now, I know it's a little different now. I've got all these zero DTEs. It's a little bit of all compression. But at the end of the day, this is a phenomenon that especially for realized volatility remains a constant. The less liquidity, the greater that price variance tends to happen. It expands tails in both direction. That is to say, if either side really takes control of the tape, they can move the market meaningfully. And I also like to look at options positioning in a couple of different ways. So this chart is the naive model of total gamut exposure and naive because we're looking at just the CBOE options chain. It's about 10,000 options on the SPX contract. And those options are assumed to be bought to open on puts and calls. Now, we know that they're not always bought to open, but we also don't have enough data in terms of open interest being transparent to say bought to open or bought to sell. So we're assuming that they're bought to open, which is largely correct, but there's some variance. Nevertheless, the key levels that this elucidates are important for us to watch as traders because where there's really heavy options positioning in net puts or net calls, those tend to be levels where the market interacts with. And so we've seen that already when we hit 3,900 on SPX. We've seen some reflexive buying. When we get below some of these key levels, we tend to see kind of the floor start to drop out. More intensive selling happen just like when we break above. It tends to release some pressure. But typically when we get close to that level, it can act a little bit like an area of support if you're above it or resistance if you're below it. So mapping these out and watching for convergences in book map is really important. Now, I know most of the folks out there watching this know this, but I'm going to say it anyway. With ES and SPX, there is a variance, right? So right now that variance is going to be about 29 points between the two. So when you're looking at those SPX levels, you do need to translate it into ES. And since we have a contract that's further away, we've rolled over to June, that means that variance is going to be bigger. And then as we approach that contract, it shrinks and it shrinks. So you kind of want to watch that delta. Nevertheless, these are key areas to watch. So on this chart, for example, I'd be very interested in that 3,800 level because I think that would be an area of pretty key support. And it also is if you look at the technicals, which showed you yet another convergence. So if I were trading and we were much further down in the market and we were approaching that level, and I saw a very large resting bid down there, I'd say there's no reason for me to get more aggressive than 3,800. I'll be happy to get out if I can get 3,801, assuming price is trending in that direction. And there's again that large resting bid down there. And that's where that convergence between larger options positioning and seeing that resting liquidity in book map can be very helpful. And the reason I mention it is I've seen this happen consistently. It's not every time, but often is the case when you have very large areas of options open interest, this gam exposure, you also see orders in book map that kind of correlate. So look for that. And this is the type of data that you can get online, but we also offer a trade rate on our website. It's updated every 20 minutes. Next one is looking at options, open interest, and option volume for these zero DTEs. I know they've been the talk of the town, but the big takeaway here is 70% of all notional value traded every day is in the options market. And that's the most it's ever been. And of that, 50% of all options trading, whether it's index, ETF, or single stocks is zero DTE. And that comes up to a notional value exchanging hands of about a trillion dollars a day, half of it in indexes, half of it in ETFs and single stocks. That's a lot. It's the most it's ever been. There's all these new daily expirations are relatively new that CME introduced last year. And so that does create more of this sort of very short term leverage time sensitive speculative flow in these options markets, which means that not only is it important to zoom out and look at the bigger picture like we did in the last slide of where positioning is, but it's also important to zoom in and look at where some of these levels are because again, you're going to often see convergences between what we see in these zero DTE flows and where some of these big levels of resting liquidity are in book map. So I do the same thing. I look for that convergence and I try to play it as I see them in book map in these options levels, whether it's zero DTE or longer term, and that often ends up being another edge. Part of the edge in trading is also psychological, having the conviction to see your trade through, right? We go into a trade, we have a thesis, we say, okay, these are the levels, this is where I'm going to execute. And then the market chops around and maybe we lose some of that conviction. Well, having some of these other areas that at least allow us to add to why we're in the trade so we can check back on them and see if they're still true can be helpful also to seeing that trade through to its end. However it ends, whether we get stopped out or we reach that level. And I think volume profile is also important. We talked a little bit about the session volume profile. That's the volume profile that I take from the 6 p.m. start and that's Eastern of futures trading through the current session to 5 p.m. That's my SVP. So I'm looking at SVP, but I'm also looking at this larger volume profile and on the chart above is a volume profile over a 252 trading day period. So that's one trading year. And that interests me a lot too, because again, we're looking for convergence, we're looking for coalescence, and we can often see it in areas where people have preferred to transact in the past. There's some degree of reflexivity to want to transact there again. And so looking at volume profile in the big picture and seeing similar levels playing out in book map, I find that to be helpful in my trading and kind of setting my risk and reward as well. So that's everything I've got on the PowerPoint presentation. I want to now move over to book map. So just give me a second to switch screens and Bruce, I imagine you'll probably have to do something on your end as well. I don't think so. I think I'm just broadcasting your screen. Okay, got it. Give me one sec here. Yep, I see. Excellent. All right. So now we've got book map running live. There's one part that people out there cannot see. And that is the market pulse indicators. I do really like those. Bruce sent me an email a couple weeks ago saying, hey, check this out. And I have been using those ever since with the audio alerts, but I tweak it a little bit. I use thresholds of 90% so that that way it's kind of telling me when there's really noteworthy pressure going on in the market. But other than that, I mean, these plugins that the team that book map makes, I mean, these are some incredible plugins. I have also got the stops and icebergs plugin set up. You can see that on the sub chart. You can also see that on the main chart. You've got these stops below and you've got some of these icebergs above. I also really am pretty excited about the plugins that you guys created that just show these tags on noteworthy levels of resting liquidity. And as I mentioned, the presentation, I consider that 200 and above. So that's how I set the plugin and I have it showing the five most noteworthy levels on the chart. And overall, I have a pretty basic configuration, but I do do some customizations. You can see my heat map might look a little bit different than yours. I try to make the really larger levels stand out a little more because I just want to be able to very quickly look at book map, glance at it and have a sense as to what should I be paying attention to? What's important? Because, you know, I'm looking at several different charts. I've got four timeframes I look at in my in my day trading chart. And then I am also looking at book map in a very more sort of near term sense. You can see I'm only going back about a half hour on this chart. And I'm watching the trade in resting liquidity, which you can see both in this chunk of the chart as well as in the cumulative order book. But I'm also watching some of these sub charts here because I do find convergences on this interesting as well. Like when we see and this these this white line and this lighter blue line, this is the price change and absolute delta from the market pulse plug in. I find those to be really helpful. But I also like seeing convergences with the stops, with the icebergs, with the liquidity difference. Because when you see them all three moving in the same direction, it can kind of give you a sense that momentum is going to move in that direction as well. And sometimes it gives you a little bit of an early indicator when that's going to happen. So I really do think that looking at this from the perspective of what do larger market participants think? And they could be playing both sides of the trade. You could have folks that are up here on their offers and down here on their bid just playing the range as well. But for us as a small fish, it behooves us to just kind of consider that the best we can do is not swim in front of the sharks, but swim in their wake. We've got a lot of larger folks out there. There's no reason to try to be a hero in every trade. So I'm very content when I'm day trading to pick up small amounts of points for my more frequent trades. There's no reason to be a hero here. So if this market, for example, was to start to trend a bit higher, I would be looking at some of these larger orders up above, particularly this $39.75 at $229 on the offer. I think that's a pretty interesting area. And we're starting to see some signs of stability here. Perhaps if we're trending higher, that would be an exit target that I would take. I would want to see us break above this area here where there was a lot of aggressive buy delta because right now buyers are just sort of break even. They're starting to push above that level. But if we make a meaningful push above that level, that tells me that these folks are going to be a little more comfortable staying long. And that could give us a little more room to the upside as well. I also like having the cumulative delta indicator, a volume delta indicator on here. I don't have it on the sub chart there, but I do have it here because it doesn't move enough on the sub chart. It just tends to be kind of a flat line. But when you're looking at it, it gives you just a little bit of a sense as to through this session, what were people doing? And in net net, they've been buying, right? You see a cumulative volume delta of over 7,900 contracts to the buy side here, which just tells you most participants are more on the buying side than the selling side. Price, of course, tells that story as well with the S&P up just over a third of a percent. But this is why I'd be looking at this trade now and saying, you know what? I'd be more comfortable looking at taking this on, stopping out just a little bit below 60, maybe two points below and looking for 75 as an exit. And it doesn't mean the trade's going to automatically play out, but it means the odds are in your favor when you've got that large order and when we've got cumulative delta on the buy side growing. And we're starting to trend more in that direction. So that's one way that I like to look at it. I also like to look at the liquidity differential. It's sort of similar to the delta absolute, but basically when you see that more positive, and I'd like to see it a little more positive than it is now, that also tends to tell you that buyers are starting to take greater control of the order flow in today. So that's an example trade setup. We can see that we're starting to move a little bit more in that direction here, but it is a choppy trading day. I mean, look at all the stuff we've had over the weekend, the macro overlay being one of maximum uncertainty continuing. And so that probably portends with the low levels of liquidity to a choppier trading environment. And we can certainly see that in just the price variance in some of these five minute candles, if you're looking at a five minute chart. So that's the basics, nuts, and bolts of how I'm using Bookmap to trade. I want to kind of open up things to questions and answers, if people have some questions, or if Bruce, if you wanted me to elaborate on any areas that I'm talking about. Yeah. No, thank you, Mayhem. I don't see any questions at the moment. And that was a lot of information really quickly. No, that was just excellent. And the analysis top top down approach was just spot on. Really, really great, great stuff here. And then also what you're using in Bookmap to show all of this really interesting configuration. I mean, from some common stuff, but you're looking at all of this data together, like you said, in kind of a cohesive package here to give to that directional move here. And makes complete sense. I'm wondering about maybe how you manage some of the risk, and how you kind of determine some of the risk reward ratios. Sure. Yeah, like so in this trade, for example, and we see that we're starting to head to that 75 level, we've gotten up about, you know, seven points since I put on that theoretical trade. The biggest way that I'd manage risk on a day like today is if buyers get offside of that offside, so that aggressive buy delta at 3960, I don't want to be in the trade because they're going to become motivated sellers. They've bought aggressively at that level. That also aligns up pretty well with the daily point of control, right? They pretty much created the daily point of control there. And so if we get below there, then sellers have the upper hand and I would want to be out. So I'd probably stop out two points below 3960. So I don't get head faked out, but so I also have an opportunity to get out of that trade as I put it on. And as the market starts to push higher, I would set a little more conservative stop because now we're starting to get very close to my exit. So I'd probably move my stop up by about five, six points to maybe 3963 to 3964. And we're looking to get out at 3974, right? Because the idea wouldn't be that we're looking for that full fill where the idea would be that we're looking to just get right below there and see what happens, but get out. We don't need to necessarily be too aggressive there. So this would be just a scalp. It would be based on the fact that we're trending higher, that we have a positive cumulative volume delta, that we're seeing this get closer and closer to a pretty key area of options exposure around SPX 3950, but also that we're just starting to show some signs of relative positivity. The market tried to break a couple of times this morning during its open and the sellers failed to take control there. And now we're seeing buyers show a little bit more aggression. So I'm more comfortable just from a scalping standpoint to be very clear, to be long until we get to either my stop out or that 3974 level. And I would, as we move higher progressively, manage my risk moving my stop up a little more if this was a bigger trade. So if this was, I was looking for, you know, 20 more points, I'd continue to move that stop up as we navigate through the trade, because I also want to protect my profits. And if I don't capture the full extent of every move every time, that's fine. I'm just looking to try to get the bulk of the move consistently. And that's another reason I try to get out a little earlier, because I don't necessarily need to hit the level on the dot. I like to be just near it, about a point away. I found based on backtesting and also just live trading that I'm more likely to get my fills doing that than trying to hit at the exact level. Okay, so this 3960 and because of the delta there in the SVP column is kind of a key level. Also, I mean, like you mentioned, you have all these other indicators, all kind of aligned here for a beautiful move and CVD is positive. So how do you determine how to protect your, you know, put that protective stop in, like you said, as moving it up? And because it's always tricky to kind of figure out, all right, is it based on some sort of ranges or is there something else you're looking at in the data? I mean, one thing that I like to look at is the convergence between realized and implied volatility. So I do like to take the two numbers. I like to add them together. And then you take the sum of that. And in this case, divide it by about 32. And that would tell me what the market is expecting volatility to be for an intraday move. And when we see those higher levels, when volatility is higher and both realized and implied terms, then I'm going to have to be a little wider with my stop. And that's just how it is because the market's going to be a bit more choppy. Similarly, when we see liquidity drying up as it is, I have to be just a little bit wider with my stop, but I'm still going to move my stop up when the trade is trending in the direction of my favor. On a day like today, I'm probably going to keep my stop about four or five points below current price as we move higher. And the reason that I'm doing that is, you know, I know the market can whip saw me out of a trade, but at the same time, I do want to try to protect some of my profits. There's always going to be more trading opportunities. And so my goal isn't to make a home run. It's to just continually make successful trades and repeat that as consistently as possible. Now, if we have a more liquid day, volatility is lower, price discovery is cleaner, it's a clear trend day, then I'm going to keep my stops a bit tighter because in that type of a scenario, I feel like it's more likely that I'll be right stopping out with less risk than on a day like today, where it's going to be choppy for all variety of reasons, not the least of which the, you know, the level that the VIX is at, it's still elevated at 29. Realized volatility, I want to say it's a bit lower, right? But it's still like 17 or 18 on SPX.  The other way that I manage risk is that on days like today, where there is likelihood for higher volatility, I'm going to take on smaller positions. And that allows me to make sure that I'm not drawing my portfolio down too much on stops. My goal on any trade is never to lose more than 1% of my total portfolio value, such that I have enough ammo or capital to keep trading. And as long as you're managing your risk properly, not taking large losses and sizing your positions appropriately, you can trade in any volatility regime you're comfortable trading in. Okay. So, and then would you be looking for like full in, full out on a day like today at least? On a day like today, if I was looking at a bigger trade than the example, I would want to scale in and scale out because I think, and you raise a very good point, that when volatility is higher and when liquidity is lower, there's going to be greater potential for price variance, which for me as a trader, it behooves me to just make sure I don't feel like I'm that much smarter than the market, especially when it's nervous and more likely to misbehave. So, I would likely take a position in thirds or halves on a day like today versus if it was a more liquid day, I might go all in or go in halves instead. And then scaling out on this type of a position because we're looking just to scalp a small move, I would take everything out at 39.74, which we are approaching. Yeah, interesting. I mean, so, and it's the kind of bigger picture that you're looking at that kind of determines how you're going to manage the trade. Is that correct? It's part of it, right? So, yeah, I like to look at how like I'm so, you know, I didn't talk about this sort of technical process that I look at as well, but I do like to look at price action. I do like to look at key levels, you know, just outside of volume profile. I do have VWAP set up on my intraday chart. I use a two standard deviation on VWAP to kind of see where some of these moves might be getting a little bit exhausted. And so I would say I look at sort of macro to micro in terms of how we approach this type of trading. And some might say, well, that's just too much work. But I think knowing the environment that you're in helps to set the tone. It doesn't mean we come in with any bias. So to be clear, just because we've got all this negative, nasty news out there, doesn't mean we just come in automatically bearish and look to take any short we can. It means that we come to appreciate that there's greater risk from a variety of different factors. So I do like to look at that top down view, Bruce. I like to look at the options. I like to look at volatility. I like to look at the volume profile. But then I do like to zoom in. And I like to look a little bit more closely at what's going on on the five minute chart, the 30 minute chart, the four hour chart, because that helps me to set the tone and get a little bit more of a grasp as to where the market's been. And as a result of that, where it may be more likely to go. And so it is an involved process. But I really am very data hungry as a person and people that follow me on Twitter probably have a great deal of appreciation for that. And so I like to kind of build mental models. And I've found that over time, it improves the consistency of my trading. But it also, as I was alluding to earlier, it helps with conviction. Because one of the things that I hear from a lot of folks that I talk to about trying to help their trading is they don't always have the conviction to see their through their trades through as the meme, you know, paper handing it. It's sort of like people lose that conviction during the trade and then, you know, they get out and then it does what they thought it was going to do. And I feel like having these different touchstones, these different points where I can say, is it valid because of X? Is it valid because of Y? If I can have all those areas to check against, then I'm more likely to stay in the trade when it's relevant, when it checks out with the thesis, and then I'm also more likely to be able to get out when it doesn't because I see things are turning in a different direction. Yeah, that that that was something I noted. That was a really interesting comment that it may or may not, you don't know if it's adding to a higher probability trade, you think it does, but it adds to your mental conviction. And yeah, I haven't heard that before that is either well, either helps me or I know I have an edge or I don't, instead to hear that, well, it helps me like psychologically. Yeah, and look, I think that the more signal we have that we can focus on, if we find that it helps us develop our consistency and cut through some of the noise then that's very valuable. And I do believe that it helps us develop an edge to have conviction where it's properly rooted, right? Because we can have conviction in a bad trade and hurt ourselves, or we can have data points that at least give us some greater clarity as to where things may go. Maybe we can model probabilities based off these things as we get the feel for them over time, as we journal our trades and see what our inputs were and how they validated the trade or did not. But it's also about the psychology of trading and part of that is being disciplined. And so the other thing that this helps me to do is know when to get in a trade. Because what's the biggest temptation we have as traders that gets us in trouble? Taking on trades just for the sake of taking on trades. And that's not something that anyone should do because often is the case, if we're just taking on a trade because we want the excitement, the exhilaration of being in the market, we're going to get ourselves hurt.  Because being in a trade all the time is mentally exhausting. And it's unnecessary. There are key areas for day traders where you can operate and you could have your whole day done by 11 a.m., maybe with one or two trades. That's the beauty of trading. But having to have the feel or the need to constantly be in something, I can tell you from my own experience, as I was cutting my teeth as a trader, it's tempting, it's addictive, it's bad.  But if instead you have a system, an approach that not only gives you conviction when you're in the trade, if it aligns with what your model says, but also tells you when not to get a trade, because you don't see various checkboxes being checked off, that is a really valuable tool. And that's the other reason that I like having multiple data points. Yeah, yeah, no, really, really great, great points here. There you go. So you just got filled at 74. And so I'm kind of curious though, okay, so this was really a picture perfect. It aligned with everything you were talking about. You saw the opportunity, you would have been in the trade, and you would have just gotten out. And this is a choppy day, so this is what you were looking to do. Now what are you looking for? Well, so at this point, I'm going to see what the market wants to do, because we're kind of testing the highs of the day. I think if we can break out meaningfully from here and take out some of that above resting liquidity, particularly at 75, we've got some room to move higher. But if we get rejected here and fall below the daily point of control at 65, I think we've got some room to move lower. And on the book map chart showing daily point of control at 60, so I'm a little variance between motive wave and book map there. But nevertheless, what I'd be looking for is either a breakout to ride some more of that momentum, or a breakdown to look at maybe seeing this thing shift and go the other way. But for now, I'm content to sit on the sidelines and watch and see what happens. Because again, I'm a little fish, I'm going to see a big sharks, and I don't want to be eaten by them. I just want to swim behind them. So I'm going to let them do the heavy lifting and tell me what's next. Yeah, yeah, I like the analogy. It's great. A few questions in here. Let's see about your volume dot settings, what they might be. Let's see which volume settings are the volume dots. If you just right click on the volume dot there on your chart, and then go to settings. Gotcha. Should be pretty standard. It looks like we cannot see, we only see the book map window. That's a failure of discord. So what I can do is I can post a screenshot of this in the room. Or you could also tell us, I guess. So it's 3D bubbles, volume delta by minus cell, size is right in the middle, transparency is probably about two-thirds up, and then clustering is smart right in the middle. Minimal displayed volume two, minimal trade size two. Oh, okay. So you do use those filters. Just very, very little, just to get rid of some of the noise. Yes. Interesting. Okay. And then if you have a question about that, let's see who was it here. Balian, just email me or hit me in discord there and I'll, I'll, I can make a screenshot and show you as well. Let's see another question. Yeah. You rifled through all of this really, really nicely. It was a lot. If you could maybe go through the lower left, lower right hand corner there and the different things that you're looking at here and then how they help you with your trading. Sure. So we're talking about the horizontal bars here? Yeah. I mean, I know that it all applies to the left as well, but yeah, the question is about understanding what it is you're looking at here. Sure. So I'm looking at the absolute delta and the reason that I have that here, this is from the bookmap market pulse indicator, which again, if you guys aren't using that, check it out. It's pretty darn handy, but this is just telling us the delta difference between what we're seeing in sellers and buyers. And so for me, I like to look for, you know, for moving up. I want to see that absolute delta continue to move higher. I like to see buyer aggression. I like to see some degree of them crossing the spread. And when that delta absolute is higher, it tends to show that there's a higher potential for that to happen, that that up move may continue. So right now we see the opposite, right?  I know you can't see it on my screen because market pulse doesn't come through to the discord stream, but you can also see it in those bars in market pulse. So that absolute delta horizontal bar is just a very quick at a glance indicator to show me who's taking control of the tape in this very moment. And I like to look at levels that are, you know, greater variance in 100 on either side to get a sense of some degree of what's going on. Liquidity differential is kind of similar. This is one of the plugins that you guys offer at book map. I think there's both a free and a paid version of it. I have the paid version of it. And I do map it out just on this chart here. I don't have this on the sub chart, as you can see. I just don't, it's like cumulative volume delta. I just don't see it move enough that it's worth having a line because it ends up just kind of being a more than flat horizontal line. But when I see large moves, large areas where we're positive or negative and it converges with other indicators, that just gives me a little bit more conviction about where the aggression is, if it's buyers or sellers. Icebergs. And this is a plugin, the Icebergs and Stops plugin that you all use, that you introduced, I think, what was it, like early to mid last year. And it kind of took the place of the absorption and sweeps indicator. And I find a lot more signal here in the Icebergs and Stops. So I really like this plugin. And what I've done, I have edited my settings. So I'm going to, I'm just going to share this with you all because I think it's valuable to do a little filtering. So I do set alerts, but I don't have my vocal alerts on here. I have it on the stream that's constantly running. So I'm going to talk a little bit more about how I filter these settings. So I go into the Stops and Icebergs on chart and I'll share a screenshot of this in the special events room as well. That's also where I put the screenshot of my volume bubble settings. So just so everyone knows, you can grab that there. But this is the settings that I use for the Icebergs. And so I'm using a standard deviation interval of 20 minutes and a standard deviation multiplier of four. And I find that to be helpful because I don't want to see the smaller ones. They just, they, to me, I, again, I'm looking at my chart very quickly and I need to see visual indicators that are of meaningful importance to me in that moment, which means I just want the least amount of what I might consider to be less important information as possible. So I do set that standard deviation multiplier to be higher because I'm looking for the Icebergs that stand out versus the past 20 minutes of order flow. I find that to be a bit more helpful when I'm looking at the chart quickly at a glance to get a sense as to, is this important? Should this, is this going to matter? Or is this something that I can just gloss over? So that way more of what I see on the chart is going to be things that I consider to be potentially important. I do similar with the stop settings and I'll share a screenshot of this with folks as well. And it's a interval of 20 minutes and a multiplier of four. And you might ask me, well, why do I use an interval of 20 minutes? And the reason is that if I use a longer interval, particularly like an hour, it tends to be very noisy in the morning because you've got all that pre-market data of lighter volume. And so for the first, you know, half hour hour of the trading day, I'm getting a lot of variance, right? A lot of Icebergs or stops that aren't as important. I find that 20 minute period to be helpful. Also, as we come out of the lunchtime volume wall, it tends to be a little more helpful, making sure that it more quickly recalibrates. And then use that higher standard deviation because I want whatever it is I'm seeing on the screen to stand out. And so moving down the line here, we've also got cumulative volume Delta. I, as I mentioned earlier, do not display that on the chart. But what I'm really looking for is which side is in control? Or do we have a lot of people buying this market? Are they absorbing these sellers? You know, and we can see that with the Icebergs, if that's happening as well. But we can also see, you know, kind of where the participation is. And today, so far, it's been on the buy side. We can see ES is now up about a half a percent in cumulative volume Delta. Last time we talked about it was just shy of 8,000. Now it's about 10,479. So that's how I look at the lower left quadrant. And then on the subchart, on the lower middle to lower left, I also have some of these indicators that I don't necessarily have on the lower right. One of them that stands out is this white line. And that's the market pulse price change indicator. And I just like to kind of see all this stuff together. Because the convergence of data to me, that's one of the reasons that I see a little bit more conviction in what I'm trading. So like right now, we can see things are kind of like leveling out, weakening a bit here. Sellers are starting to get a little bit more aggressive on this tape. And we can see price following. So I'd be watching very closely here. And we can see now this is continuing, that momentum is going down even further. I would like to see what happens if we hit 60 and break below. I think we'll probably see a lot of stops triggered on the way lower. And I think that that could accelerate some of that downside. If we do break below 60, then that would get me more inclined to consider taking on a short term scalp to the downside. Right? So right now we just kind of see this chop. I'm not very interested in the chop. I like to see some degree of directionality or some degree of clarity as to where we might go next, at least with a higher degree of probability. And right now we're just kind of chopping sideways. So that's what the indicators help me to do at a glance. And then I also have on the chart, I've got these great liquidity indicators that the team at Bookmap put out recently. These are really helpful because you get to see how much is above, how much is below. You kind of get a better sense of the delta at a glance that there's 2,100, 2,200 contracts on offer above greater than that, or I'm sorry, on bid below greater than that above. So that's also really helpful. That and you can see it where it is now and where it was in the past. You can see how that positioning is changing as time is going on. And that's just telling you right now that the delta has shifted, right? As prices moved a bit higher, there are actually more orders on top. There are more offers willing to start to get out of their positions at these higher levels. Okay, excellent. That describes it in detail. Let's see if there's any more questions in here. Troy is asking, I'm not quite sure what he means in here. Do the tools in Bookmap give you GEX type of info or do you use another tool? Okay, so he's asking about gamma exposure and gamma exposure is not something that's in Bookmap right now. There was something similar to that. You guys used to have the spot gamma hero indicator, which would show the implied change of exposure based on moves and SPX options. And that was really neat while you all had that on there. I hope it does come back. But no, I do use different tools for gamma exposure. One of them is one that we have available at Traderade.com. That's the longer term gamma exposure model. And we have three different charts for that that are rendered every 20 minutes during regular trading hours. And then I also use my broker. So I have interactive brokers and they have a decent open interest option volume model that and that's what I'm using intraday. I'm not actually using gamma exposure as much intraday. I find it to be much more helpful over longer time horizon. So I'm watching open interest in volume intraday. And then that gamma exposure chart that I showed you, I'm looking at that more over a longer term period of time. So again, with that chart, we're aggregating about 10,000 SPX options on the CBOE option chain. And then that's that could go out all the way to at least 2025 in terms of the exposure. Okay, excellent. Let's see. Nirav has another question. You can see there's very little equity in the Dow. Does the Dow move because of the ES? Yeah, I guess correlations and different stock indexes the question, if something that you look at or follow? Oh, I mean, for sure, like, for example, and this is this is going off the beaten path just a little bit. But I think it helps to get right to the core of the question, you know, walking through different indices, both in terms of US indices, but also even international indices is helpful. If we're looking at these US indices, one thing that we saw recently, right, was the relative strength of the NASDAQ. And the narrative started to develop that, hey, there's like a lot of strength in tech, it's being seen as a safe haven that this is the place to go when, you know, when banks are having trouble. But the real story was a little bit different. And this comes back to talking about options and talking about positioning. But there was a lot of short positioning and also a lot of put skew in the Qs, right, in the QQQ ETF, in its components, in a lot of these arc stocks, growth stocks, you know, speculative tech, etc. And so when you have that much short positioning or hedging, it does tend to create these passive flows that bit up these indices. So the NASDAQ showed relative strength, but it wasn't because it was strong. It was because there was just a lot of people kind of piled into one side of the boat, very short. And so when everyone's getting to that position, it's more likely that you actually, you know, start to move a bit higher or at least stabilize, right? If everyone's prepared for a crash, does the crash happen? Usually it doesn't. So I do look at relative strength, but I also look at some of the nuances as to why it's happening. The Dow, for example, had very good relative strength from like October through December. It was the strongest index on a lot of days where other components were down, the Dow was resilient. So one of the things that I will do in a choppier market for swing trades is I will put on something that's a little more Delta neutral. So even though I had a bearish bias at times, I would be putting on the Dow as my long, and I'd be putting on the index with the relative weakness as my short, and that would vary between the NASDAQ and the S&P. And that could be a way to swing trade during those choppier times and kind of capture a little bit on both sides, rebalancing one's book regularly. So I do pay attention to relative strength and relative weakness and not just at the index level, but also at the sector, industry, single stock, commodity, currency level. I think relative strength and weakness is a really important area. Like today, for example, you've got a lot of relative strength in the Russell and you can explain it in the sense that the Russell's weighted 18% banks and banks have a little bit of relief coming to them. So the Russell's getting an outsized bid versus the rest of the market. You can also see the NASDAQ has relative weakness. Now that we're post-OPEX and those constructive Vanna and Charm flows that were bidding up the NASDAQ in addition to short covering are behind us for a couple weeks, it's likely the NASDAQ will be the under performer for a bit. So I do like to look at these things. I also would like to try to drill down and see why they're happening and see if there's any kind of edge to be discerned. Wow, this is great stuff, Mayhem. Thank you. Really a very, very informative webinar here. I see no more questions if there's any last minute questions in here, but there's a fountain of information here and this is all recorded. So I would just recommend coming back and watching this again. And would love to have you again, Mayhem. So yeah, this is really, really great stuff here. This approach is just top-down approaches, just excellent. I don't see any more questions here at the moment. So let's see. Mayhem, I put your contact information, your website, your YouTube, your macroadvisor.com link, and also special offers from Bookmap all into the chat there. So if anyone wants to reach out to Mayhem, you have the links. And let me just, I'll give you the last word, Mayhem, and conclude, and we'll call it a day here. Sure, sounds good, my friend. Well, Bruce, really appreciate you having me here. It was a lot of fun doing this presentation. I hope folks found it helpful. And I just want to also just take a moment to mention that for anyone that's interested in more of what we do at TraderAid, we do have a two-week free trial. So for our base plan, you can go to our website, you can sign up and there's no obligation to buy. If you don't like what we do, you can cancel during the two weeks and there's no charge. And if you keep on, it's only $20 a month for our base plan. We also have our own Discord plan for about $50 a month. And so, you know, we're always happy to take people on that want to learn more about how these markets work, how they trade, about how we approach them with this level of nuance and with this sort of multifaceted approach to both day trading, but also swing trading and even investing. And that's kind of our goal, is to help people find their edge, both in their systems and also in the psychology of trading by breaking down the complexity of macro fundamental and technical analysis in a way that is approachable to anyone. Fantastic. Thank you very much, Mayhem. If anyone, if you like this video, please click the like button. It's just excellent education here. And yeah, we'll do it again soon, Mayhem. Sounds good, my friend. Thanks again for having me wishing everyone a great trading week ahead.


So, my name is Geoffrey, thanks for inviting us at the CSVConf, which is a very great conference and we are very glad to be here. So today we will present a first presentation around the theme, solving some of the mysteries of open data. But first of all, we will talk about ourselves and where we come from. So, we are members, Anthony Pavel and I, of the department, which is named Etalab, which is a mission under the French, the authority of the French prime minister. And there is many teams inside this department, like an artificial intelligence laboratory, but also a team which is called data.groove.fr, which is the name of the French open data platform. And the French open data platform is addressed to every French administration that needs to do this data in open data. And as of today, we have more than 36,000 data sets and more than 200,000 resources. And by these different resources, we have many CSV files. One of the specificities of the French open data platform is that anybody can deposit data on the platform. So the administration, of course, but also every citizen that needs to share data, it's possible. So, as you can imagine, the data that is published inside the open data platform could be structured, which is very much appreciated. The administration, which are publishing structured data, have often a big IT department, which refer to a specific data format or data standard. But we also have published many data that is not structured. Why we have that? Because we don't want to prevent data to be published. If we have data, even if it's not structured, we can allow the possibility to publish it. But as a result, we have many data quality issues. So I will talk about these data quality issues for the presentation. And how can we explore the unstructured data? So how can we explore unstructured data? This is important for different users on open data platform, which want to know what is inside a specific file, a specific resource. And there is many tools in the literature that is existing to retrieve simple data types, like if a column is an integer, a date, a string. For instance, we have tested recently a Panda profiling and there is a session tomorrow, which will talk a little bit about our experiment around these tools. And this is a great tool to find simple data types. But we also would like to inform users about complex data types with a business meaning for the different free users and for further reduces. What is a complex data type? A complex data type could be information related to a concrete thing. So for instance, the identifier of a company of a society, it's complex data types. And we would like to retrieve and to be able to access to this data and to be sure that a specific document is talking about information relating to a specific company. There is many complex data type, like information regarding a locality, like latitude, longitude, or for instance, zip code or region name, region code, department code, et cetera, et cetera, which is related to French localities, for instance. And more generally, we would like to be able to retrieve some common codes used in administration in French administration. For instance, we would like to be able to retrieve identifier of French health care establishment, which we is used to be able to analyze data around COVID-19, for instance. And so many, there is also a different kind of tools that is existing. And that is the beginning of our thought and the development of a specific tool that we called CSV Detective. So we will talk about this tool next and how can we use it and how does it work and how can we evaluate it. So for that, I will let Anthony speak and take the next slide. Thank you, Geoffrey. Hi, everyone. So yes, I will talk to you a bit more about what is CSV Detective and how it actually works. So first, CSV Detective is a Python package made by Etalab. Next. And what does it do exactly? First step, it manages to get some classical information that we are used to have, like parsing information, encoding headers, separators, and so on, that are specific to the CSV file. And second, what it does, it is what is interesting for us here, is that for each column, it will detect a kind of likelihood score for each complex data type that CSV Detective can detect. So for instance, if we have a given column in a given CSV file, we will have some things like we have a 70% likelihood that this column is a country name, for instance. And on the right, you can see some example of the types that CSV Detective can detect. So we have very common types that we could have in other countries like latitude, longitude, JSON format, et cetera, et cetera. But we also have very specific French format that must respect a very specific format. Like here, we have Syran and Syred that are the French companies identifiers. So we have very specific rules to be able to detect this kind of complex types. And in the end, all this is returned in a JSON-like format. Next slide. So I've been talking about likelihood score, but in fact, it's not just one, but three different scores that we have. Because basically, we try to leverage every information we have in the file to be able to identify what type, what complex type is in each column. So the first one is the field score. So it leverages what is in the content of the column. So I won't detail because I will do it on the next slide. The second one is what we call the label score, which is based on the header. Because we know that usually when the data is quite well done, the data type can be more or less detected, or we can have some clues in the header, so in the column title. So here, for instance, we have a specific list of column title examples. And if there is a perfect match with the list that we have, we give a score of 100%, so one. And if the header of the column only contains one of the words in the list that we have, but is not an exact match, we only give a 50% score. And the last score is a machine learning score. So we designed an algorithm, a machine learning model, thanks to annotated data to be able to detect automatically what complex type is in CSV files columns. But at the moment, we mostly rely on the first two ones because we need to still work in progress, so we need to improve it to actually use it afterwards. Next, and just one word about the score. Sometimes we also combine them to get better results in the end. So now just an example, a very concrete example of how a CSV detective can work on the field score. So it's a score based on the content of the column, so the actual values that are in the column. So for instance, here we have a column that is called commune inse, so we try to see how we can match the complex data types that it's called, it's called commune inse, which is a kind of official zip code inference for cities. So here you can see that it analyzes the first rows of the column. And for each element of the column, it will try to match with some specific rules. So for instance, in this case, we have first steps that is checking, thanks to regex, that the content corresponds to a given format. But we also have, after a second step, that matches the element with a comprehensive list of all possible zip codes in France, because not all numbers that matches with the regex can be actual zip codes. So that we have the most perfect match here, the most specific rule to detect the code commune inse. So in this example, for example, on the left, you can see that three of them, they don't respect the specific formats, the specific rules that we set. So we have only eight elements that respect the actual format, eight over 11. So the final score will be 73% in this case. And in real life, of course, we analyze more than 11 rows. So this is how it works. But the question that comes after, of course, is does it actually work? And what we do to actually evaluate how it works, next slide, yeah, thanks. Is that we compare what we have? So we apply CSV detective on the CSV files and CSV columns that we have on data.gov.fr. We compare the results, the predictions, from a CSV detective with manually annotated data that we annotated ourselves by human beings. Then thanks to it, we calculate some performance and data we show you afterwards to identify flows. And thanks to this course, we can correct the detection method, the rules that we use to try to improve CSV detective. And we do it again to check if we had an actual improvement of the Python package. So we actually used two kind of methods. The first one is a numerical method, which is very close to machine learning method to evaluate classification models. We use precision and recall. So precision answers the question, when I predict a given complex type, what is the likelihood that my prediction is actually correct? So it evaluates prediction quality and the recall. It actually evaluates. It answers the question, what is the percentage of actual columns that were annotated on a given type that were correctly detected by a CSV detective? And it evaluates the prediction comprehensiveness. In this case, we don't choose accuracy because it's not really relevant here because the main reason is that we have unbalanced data in our case. And you can see on the right that we have mostly good results, except for specific complex types like address, department code, city name, and so on. Just to give you some examples. We have five minutes. OK, and next, the second method we use is the confusion matrix. So it allows us to be able to detect what complex types, CSV detective, confuse with other types. So for example, we have here the region code that is often confused with the department code. We have troubles to differentiate latitudes and longitude. JSON types are often not really well detected, et cetera, et cetera. So now you know how it works. And I let Pavel talk to talk about the future of CSV detective. Yes, so thank you very much, Antonin, your point. So as you heard already, this is an ongoing work. We have some plans to try to improve it in the short term and in the medium term. We have these improvements designed in a three-axis fashion. The first axis would be metallurgy improvement. Of course, we would like to improve the model, the system, with how can we get more information from our columns, from our CSV files in order to improve the performance? How can we mix the different scores that we use in order to show to the final user or to ourselves why a decision is taken and how can we weight different scores into a best optimal score? We would like, of course, going forward with machine learning, but till now, we still have to annotate more data in order to make it more robust. According to new features, we would like to, one, we would like to detect multiplex columns, that is columns that contain different types of data. We'd like to generalize to more file types going forward, going farther than CSV files to Excel files, for example, or proprietary files. And regarding the open data ecosystem, we would like to, mainly, we would like to allow for people to create their own rules and employ their own rules to generalize the use of CSV detective. Right now, we work with French data, because we are a total of, and we are working with French government data. But of course, these two could be used for several use cases, several other open data platforms. Next slide. And so finally, to sum it up very quickly, you have to keep something in your head before going to sleep. We created a tool that takes a simple CSV and gives you a sub to what type of data is within the CSV. We believe it is an important task to further downstream data cleaning tasks. We use rules, and we use the heaviness of these columns to determine, right now, to determine the type of data that we are treating. And it's not easy. We have some challenges. We have a lot of rules, and this is kind of getting non-maintainable, so we have to find a solution for this, how to manage all these rules, how to address this problem. And of course, data is dirty data. Of course, this is the lesson of our system, to treat dirty data that is lying to us that it's not having what it says it has. So these are our main challenges. Next slide, Joque. So thank you very much. This is all for our part. You have any questions, don't hesitate. This is our source code. It's open, of course, and our mails. You want to ask a question for the room. Thank you again. We are happy to be here, and we can answer your questions for Joque. Fantastic. Thank you so much, Pavel, Anthony, and Joffrey. We have one question in the Ask a Question section. So the question reads, can you give an example of how you will leverage CSV detective for data cleaning pipelines? Yes. So we can use a CSV detective to be able to analyze automatically every resources that is published inside our French Open Data Platform. And with this, we can inform people and users to know on the data set sheet what is contained inside the CSV file. So that is a pipeline that we can imagine. When someone publish data, a CSV file, automatically it triggers a CSV detective analysis. And the output file design format will be able to inform the users with a specific interface about what there is inside the data set sheet.


The best amongst us are three types of taxes. Income tax is one, and I trust that my dear Ebon has fulfilled his obligation in that respect. And somebody pointed out that he's a wealthy man, you know, and that we may not all know it, but some of us know that he's a very wealthy man. The second tax is a social tax, philanthropy. And in his case he has already demonstrated that he has fulfilled that obligation, especially with the Yemio-Kumbi Anglican schools. Clearly he has paid that social tax. The third is the civic tax. And this civic tax is the one that I think he has paid with the book The Road Never Forgets. The civic tax is an obligation that those amongst us who have reached a certain level of success, who have achieved their aims on several of the objectives in life, all the rest of us, to tell their story and from their stories we'll learn. And I think that this book The Road Never Forgets fulfills that obligation very clearly. I think that we must also, whenever I look at a book, I think that one of the things that one wants to look at is what exactly it is that the author seeks to achieve. And I think that by and large, as for anyone who has read this book or who will, you will notice that all that Dr. Kumbi wants to achieve in this book is to tell a story. Not just of himself but of our country. And I must confess that in this book, not only does he discharge that obligation, he has also shown that he is one who is capable of telling a story without embellishment. And anyone who has read the book, and I've had a good opportunity to read it although I haven't read it all, I've covered quite some ground in it, will agree that not only does the road never forget, not only is it true that the road never forgets, but you will also remember that the elephant that walked that road has a phenomenal memory. The elephant, as you know, forgets nothing. Its brain, we are told, is five kilograms in weight. So the elephant in this room, if you'll pardon the part, Dr. Kumbi surely forgets little. He speaks of such a wide spectrum of issues from his childhood and youth through to events that happened just last year with the same mind-boggling freshness of memory. I think that Dr. Kumbi's story is at once a life story of a truly remarkable individual and at the same time the story of a country. And who better to tell the story of Nigeria and the magical possibilities of our ethnic blending than one born in Kano of a European father and an equal mother and whose first language was Hauser. The subtext of this fascinating life story is the account of a man and his country both struggling to define themselves. From his idyllic childhood in sub-Hungary, and you need to read the stories of his childhood in sub-Hungary, Kano, he witnessed the first ethnic riots, the 1953 Kano riots. How does a young boy with his own ethnic mix even begin to understand the strong parochial hatred that developed overnight and led to the killing of those of other tribes, many of whom had lived together once as siblings? The young nation lost its innocence just as a six-year-old Yamio Kumbi lost his. But he would become the brilliant university teacher, newspaper executive, debonair, connoisseur of wines, collector of fine arts, equally at home with modern and traditional settings. By the way, on the matter of fine wines, I must not forget to tell you to read the hilarious account of his initiations into wine drinking. By none other than his illustrious teacher and friend, Professor Wanesho Nkama. And I think that the story really makes for interesting reading. He would also overcome his initial hesitations and take the titles of Balogun or the Pararemo and Omo Loku and Dibola of effect. In this contemporary history of Nigeria, it turns out by some quirk of circumstance that the author is present at several critical events that occurred in our country. He had a ringside seat during the wet year period in the old western region. By virtue of the fact that Ibadon Voice House High School was located behind the chief of Parfemiah Olowa's home in Ibadon. His first open day at King's College was the day of the first coup in Nigeria and he was right there when Adikule Adikuleju was fatally shot at UI. So in telling this compelling story, we are led through the nationalistic idealism of our pre-colonial days, the excitement of civil rule and its tragic dememore. Then military rule, a curial diarchy, other iterations of civil rule and all manner of contemporary events. But he engages every subject honestly, openly and frankly. Somehow it almost seems that by his open, vulnerable style he designs and commands empathy and admiration. And perhaps there is counsel there for us as a nation. Perhaps we need to talk more to ourselves and not art ourselves. We need frank discussions on the issues that divide us. And we need openness about our fears and prejudices. Perhaps that way we may gain each other's confidence. I think that Dr Obumbi's powerful storytelling is made more so by his uniquely unashamed style. Maybe age helps. It might help in telling one's story. So you can tell that he's not anxious to justify his actions or make himself the hero of every experience. And you can tell that he's just open and frank about everything. He dedicates this book to his wife, Aunty Shadeh, in the following unforgettable words and I must read it to you. Dedicated deservedly to my much-loved wife, for her unbridled love, has steadfastness, tolerance, forbearance and unwavering commitment for the past 53 years, even in spite of myself. And of course, I need to read the book to find out what a gem she has been and how her forbearance has made even the story tellable. It won't now that you are 75, there are interesting biblical admissions that I will direct your attention to. When you are called in and given the task of birthing a new nation. Maybe there is a message there for you too. Perhaps your exceptions have only just begun. Everyone has said that you are not just a man of charisma but you are a force of nature. An elemental force over yourself. Perhaps you can make a few things happen now that you are 75 and we all look forward to that. I thank you very much for your care and wise counsel and your guidance at all times.  Happy birthday as your days, social your strength, social your wisdom and social your favour with your might. God bless you.


Okay, so this is going to be the second part of our two-part videos on solutions and dilutions. And so in part one, we kind of talked about solutions and concentrations and dilutions and their definitions and their importance and spent the majority of that video talking about dilutions. And so this one we're going to be concentrating on solutions and kind of the nomenclature or the terminology related to solutions and how we make up solutions. So as we said last time, the kind of notion that kind of ties solutions and dilutions and all these things together are concentration. And for this discussion, we're going to kind of use a mathematical formula and we're going to say the amount of solute over the volume of solution, right? And we're talking about again volume of solution, not the volume of the solvent. I remember the volume of the solution is going to be the solute plus the solvent. And so this solution is going to be kind of the total volume of the solution. So let's look at some of the different terminologies to say with a different kind of solution. And we said percent solution, right? And this kind of information I'm actually working off to kind of preamble to the lab that you're doing on solution. So the first thing is percent and when we think percent, we're thinking per hundred. So if we had 10 would be 10% of a hundred or if we had say 30 people in the classroom and 15 people went on a field trip, we could say that 50% or 15 out of 30, 50% went on the field trip, 50% stayed home. But it's based on 100, we'll see how we do that. And we're going to talk about a couple ways of one with volume to volume. And we say that that's V to V. And so these would be solutions where your solute would be in liquid form typically. So you'd be adding amount of liquid to an amount of liquid. And so in the case gave in the lab would be 5% volume to volume. So if we say put 100 in the denominator, so we think 100 mils, right? And so 5% is 5100, so we would have 5 mils of solute to 100 mils of arrogant solution. Remember not solvent, because in the case of the volume, the 100 mils is a total. So we would have 5 mils of the solute and 95 mils. So if we wanted to make 5% acidic acid, we would have 5 mils of acidic acid and bring it to volume. Remember that bring to volume to 100 mils. So it's 5 out of 100. Now if you were wanting to make a liter, right, you would have to have 50 mils of the 500. Remember it's going to be a proportion. So if you take it to 100, if you base it on 100 and then do your proportion for whatever volume solution you're wanting to make, then that will work for you. Now the other would be weight to volume, right, or WV, right? And that would tend to be when your solute would be a solid and then again your solution would be water, ethanol, what your solvent is. So the example I gave was 7% weight to volume, right? So in this case now the percentage, we're going to say 7 grams of solute for 100 mils of solution. And so our rationale for this is if you recall, we take the mass of water per gram per mil. So this 100 mils is 100 grams, but we're still calling it 100 mils. So it's 7 grams per 100, 7%. And then again if you want to make a liter, you'll be proportionally 10 fold more, so you'd have to have 70 grams per liter. So think of the percent that's based on this 100 mils of total volume of solution. Okay, so B, our second way of talking about concentration of solutions would be molar solutions. And of course we're talking about concentration in terms of molarity. So we remember we had this molarity is moles per liter. So in this case if we had a 3.5 molar solution, we would say it would be 3.5 moles per liter, one liter of solution. So in this case if we were making a 3.5 molar solution, we would dissolve 3.5 moles of solute and bring to volume at one liter. So that's our molar solution. And the third is what I just call direct notation. It's when you basically just have an amount or some volume. So in a situation like this it may say that you want a concentration, let me, I can write a little bit in that concentration, 20 milligrams per mil. So if you were making one mil you would just weigh out 20 milligrams and dissolve it, bring it to the volume of a mil.  So if I wanted to make 100 mils of solution at a concentration of 20 milligrams per mil, I'd have to say 20 milligrams per mil times 100 mils. So I would need 2,000 milligrams, right, or that's equivalent of gram, right, 2,000 milligrams per mil of 100 mils. So if you have 2,000 by 100 and that's 20 milligrams per mil. So it gives you your recipe basically in terms of concentration, like the one previous said, if you wanted 3.5 molar solution to definition 3.5 moles per liter, if you're making more or less of that then you have to adjust for that. So your recipe is given in the concentration 3.5 moles per liter, right, percentages, right, taken to 100, and then what I just called the kind of direct notation is it'll tell you what weight you have per volume. So our lab handout has a couple of examples.