What's up everybody, JCF with Jasmine's casebricks.com just sold out 2019-20 Panini Optic Sella one-pack break number 36 random teams These are the last four spots that are hiding and impeccable here in this break. So Winch spots an impeccable So again, this will be a one-pack break of Optic Sella. We randomize customer names and teams open up the pack Distribute the hits then at the end of the break. We will randomize all 30 customer names that bought in and top name at number four or top four, sorry Come in and win a spot in impeccable cheer random teams, which I believe is a $240 spot Paying only a fraction of the price potentially win a spot. So four out of the 30 customer names will win a spot in the break So good luck. Let's do the break first roll it six to two eight times It's for the packs. This is for the teams and names of the break one two three four five six seven and eight Quinn down to James seven done of the pelicans very times With the net Steve you have the thunder Ryan with the Celtics and sons Our son Celtics Zach with the Clippers James with the Knicks Zach with the Spurs and with the Grizzlies Derek with the Lakers last module Steven with the magic follow the T-Wills James with the Blazers Ryan with the Bulls Jack with the Rockets Chris with the 76ers Ryan with the Raptors James the Nuggets Jack with the wars after the cows Quinn with the Pacers act with the Jazz and Dallas Mavericks Mike with the heat James of the pistons Ryan with the Hawks Zach with the Hornets Kevin with the Kings Aaron with the Bucks Chris With the Wizards and James with the pelicans So yeah, no one really ever trades in these pack breaks. So Let's just close up the trade window We'll start the break. I'm quick off the cello pack. Let's switch scenes one or two three times customer names top four Get a spot in the break three times one Chris and Aaron After three times top four. Yep top four names Three times Graduates guys you guys are now on the on the break coming up next is impeccable. We should guess


As viewers of this program will know Labour Party bosses allied to Keir Starmer have been working on overdrive to suspend party members who dare to debate whether or not Keir Starmer was right to remove the whip from Jeremy Corbyn. On Thursday the latest victim of this purge was a prominent Jewish activist Naomi Wimborn-Adresi. Wimborn-Adresi is vice chair of the local party in Chinkford and Woodford Green and was suspended after allowing a motion in solidarity with Jeremy Corbyn to be heard. I invited Naomi onto the show but apparently if you've been suspended from the Labour Party you also get a bit of a gagging order so you're not supposed to discuss the case and which seems a little bit one-sided considering that you've got people within the party briefing the press and in many cases you get front bench MPs sort of speaking up and talking about these things but in any case as an introduction to who Naomi Wimborn-Adresi is and we're going to show you a clip from a recent interview she did with our friends at Double Down News it's been viewed about a million times now on Twitter so it's really kicking off that the Labour Party have suspended Naomi. Let's take a look. Not a proper Jew, the wrong sort of Jew, self-hating Jew. I was called that for the first time when I was 19 years old at university where I made a speech in defense of a pro-Palestinian motion and it was in the Jewish telegraph and they front-paged it this self-hating Jew she must hate herself when she looks in the mirror I was 19 years old. I've had people phone me up and say we're going to put you in a wheelchair we know where you are we're outside your door probably the worst incident was when I was with my sister at a meeting about anti-Semitism with all Jews on the panel and people were shouting at us Kapos! Kapos! You're called traitor Jews! Kapos! Kapos was a Jewish inmate of a concentration camp who collaborated with the authorities we're talking people who collaborated in annihilation of their own people so it's a pretty bad thing to be called and it's Jews calling other Jews not nice. As a Jew on the left who is intensely anti-racist and intensely aware of what anti-Semitism is and how dangerous it is to be called an anti-Semite oneself is about as low as it gets it's a bit like being accused of pedophilia or something I cannot really think of anything worse and it undermines the fight against real anti-Semitism this is one of the most frightening things for me people have been weaponizing accusations of anti-Semitism for political ends the fact that that is going on seriously undermines and endangers our chances of dealing with genuine anti-Semitism which is a real threat in our society. One of the most ludicrous allegations against Jeremy Corbyn was that he exhibited anti-Semitism in chairing a meeting in 2010 in Port Carlos House where the main speaker was a Holocaust survivor from the Netherlands called Hio Mayor. I was at that meeting and what Hio did was to put on a screen comparisons between the treatment of Palestinians in the occupied territories and the treatment of Jews in areas occupied by the Nazis and there were uncanny and very unnerving similarities between the way these two communities were treated by the occupying powers in each case. I saw in Auschwitz that if a dominant group wants to dehumanize others so as the Nazis wanted to dehumanize me these dominant group must first be dehumanized in a way themselves by diminishing their empathy due to propaganda and indoctrination in order to be able to be as true as some were but the same holds nowadays for Israel. The most shocking thing to me is the portrayal of that meeting as somehow despicable because we saw a Holocaust survivor comparing his experiences with what he could see happening to Palestinians. What was horrifying about that meeting was that there were a bunch of really intolerant bigoted aggressive bullying pro-Israel campaigners in that room who shouted Hio down. It went on for a long time and lots of us in the audience was sort of saying to Jeremy can you please call the authorities to get these people out they are harassing and intimidating an 80-plus year old Holocaust survivor it was intimidating it really was to be there I remember it vividly. That was a section of a video that's about 10 minutes long I do recommend going to watch the whole thing double down news obviously good friends of ours make loads of brilliant content so Pfizer Shaheen was the candidate to be MP in Chingford and Woodford Green so that's the constituency and when Naomi is vice chair so Pfizer tweeted Naomi lives local to me and was kind enough to offer her car to us during the election during lockdown one when I was organizing deliveries for those shielding I gave her one of our most needy callers because I knew she'd be kind and patient she doesn't deserve this also Mehdi Hassan obviously very prominent British journalist now working in the United States and so he quote tweeted the double down news tweet which bore the news of her suspension and wrote whatever your views on Labour or Corbyn you should listen to this eloquent woman speak and hear what she's had to put up with um finally we've got a tweet from John Mcdonnell um who's probably now you know the most senior um Labour left back Bencher who tweets I know Naomi Wimbourne-Adresi she's a decent sincere socialist not everybody may agree with everything Naomi says we all have the right to speak and the right to disagree but disagreement shouldn't result in suspension I'd be a witness for her at any party disciplinary hearing um that seems quite significant especially that that final one because that's a sitting MP and a sitting MP who has sort of you know attempted to have a strategy which is quite conciliatory towards Keir Starmer so it seems significant that he has spoken out and about a suspension of an individual member which is something which is very much frowned upon by the leadership so I think he's putting his his neck out a little bit there which I mean hopefully means some progress will be made but it's very difficult um to say I'm going to go to Aaron in one moment first of all um if you're enjoying the show if you're enjoying um the viral media in general please do and remember to subscribe to the channel hit that subscribe button hit that notifications button because we will be talking every week about all the big stories that are going on in this country Aaron I want your thoughts on this do you think that now um the party in there I mean we can call this a purge now basically can't we in their huge drive to suspend as Angela Rainer said thousands of thousands of members now they're um you know suspending quite prominent Jewish activists for being implicated supposedly in anti-Semitism I mean I I presume that's what we're supposed to infer from from the suspension do you think this is going to be something which creates more more pushback than we've seen up to now yeah I think it'll get worse I don't think they'll I don't think they'll make the right decisions I think they'll carry on I think they'll dig their heels in I think they'll keep on digging the hole and I think they're I think they're polling will continue to hear it there's a poll out this evening which has labored down to uh the lead between Boris Johnson and Keir Starmer in terms of who would you like to see as Prime Minister is that it's highest since August now partly that's because of course of the fantastic news and the vaccine most people think right we're out of the worst of this we'll have a modicum of reality come back in say March we've got furlough until then I'm really happy the government's behaved in the way that it has I think that's clearly one variable but another one is they're looking at what's going on in labor you've got I think more than 60 clps now saying they want Corbyn to have the whip restored the party in no way feels or looks like it's talking out to society at large that's because it's not by the way Keir Starmer has absolutely no policies which partly explains this determination to fight a permanent war with much the Labour Party membership because he has to do something right and I think their polling will continue to deteriorate I think it will and I think they're going to be in real trouble if they carry on with this for another month or two but what else what else can they do now they've got no alternative and I said this on the day with the day that Jeremy Corbyn was suspended I emailed Paul Mason actually I'll say this I won't say what he said because that's it's a private communication but I said this is the day that Keir Starmer absolutely secured the next general election for the Tory party this is the this is the single best day for the Conservative Party in the British establishment in a very long time in a very long time you've just had Marcus Rashford highlight children going without school meals getting the government to U-turn you're making real progress on progressive politics in the context of in the context of Covid which actually Labour have really struggled with and this is what you do I mean the man's an idiot and the people instructing him are idiots and there's absolutely no evidence that they're going to change course from this I'm afraid you know like you say just a few days ago Angela Rainer saying will suspend thousands of people if I will suspend thousands of people first of all by the way that comment recuses her from any process because she's clearly not independent right I mean we're just dealing with unserious people and this is a deeply serious matter and I think people probably quite rightly look at them and say you're not really capable of going the country certainly not better than the Tories that's really that's a really sad thing to say now clearly many people said that with Jeremy Corbyn too at least with Jeremy Corbyn you have a structural explanation the left doesn't have lots of bureaucrats civil servants it's not been tested in a position of power for decades that was all the case by the way but with Keir Starmer you've got the centrist media batting for him he's getting a light you know he's basically being let off the hook most of the time by the BBC he's getting nothing like what Jeremy Corbyn had his policy agenda isn't particularly radical and yet he's decided to kind of self detonate his own prospects for entering Den Downing Street it's inexplicable really and I think frankly it has to be attributed to the fact he's advised by people whose primary concern is not winning the next general election but destroying the left and I think ultimately that's going to destroy Keir Starmer and it is difficult to see where this goes I mean I've asked people who I thought might know what what the plan is and I still I still can't really work out what the leadership are expecting to do with all of these suspensions of chairs and vice chairs because I think upwards of 70 70 constituencies have now passed motions in solidarity with Jeremy Corbyn there will be more more more of those more than those which wanted to but decided not to because they didn't want to break the rules and didn't want to get themselves suspended we spoke to Corby Drew on on this programme we've had to make that very difficult decision herself so there's clearly an enormous amount of anger at the grassroots of the party which isn't going to go anywhere and I mean it does seem like the Labour Party or the Labour Party bosses are even going to have to step back or they will be suspending thousands of thousands of people just as Angela Reina said which I mean seems like a pretty risky strategy to take if you're seriously interested in winning power and it will I mean you can already see sort of the amount of pushback there has been about this suspension that people do think this just looks ridiculous it's not really credible to be suspending this many people especially Jewish people for you know supposed approximation to anti-Semitism because they voted to reinstate the whip to someone who hasn't even been suspended from the party someone who's been readmitted to the Labour Party they're now voting they should get the whip back and now you're having a mass basically mass expulsions all over the country completely incoherent completely authoritarian and it has to end


Ok, so let's try this one. It says the pH of a 0.25 molar HF solution is 2.036. What are the values of Ka and pKa for hydrofluoric acid? So in order to do these Ka, pKa questions, it's asking you what is the kA? So in order to figure that out, you have to figure out, well what is the equation of HF or hydrofluoric acid reacting with water? So let's write that out first. So HF AgWis plus H2O liquid is an equilibrium with F minus Equial plus AgWis. So since we know that and we know how to figure out Ka, we should be able to put the two together. So what would be the expression for Ka? So recall it's the products, the reactants, right? So in this case the products are going to be a concentration of F minus times the concentration of H3O plus divided by the concentration of the reactants. Now remember with the reactants we only put the things that are either AgWis or gaseous in these equilibrium expressions so we're going to leave out water. So HF concentration of HF. So you might be tempted to take this concentration here and plug it into this value. But unfortunately you can't do that because this actually is the initial concentration of HF. So what you're going to have to do is set up what we call an ice table. So ice initial change equilibrium. And from this we can get the value of Ka. So the initial concentration of HF is presented to us in the problem at 0.250 molar. H2O we don't worry about. F minus the problem didn't us to put any in there. So it's 0 molar. H0 plus 0 molar. But once we added our HF it did react with water so something happened to it. It decreased by some amount. So that amount we're just going to say is X and the negative shows that it decreased. So since we have a one ratio of HF to F minus this F minus increased as much as this HF decreased. So we're going to put a positive X there. And of course the same thing happened to H3O plus so positive X there. So our equilibrium concentration which is what we're going to put into this expression for Ka is going to be for HF 0.250 molar minus X and F is going to be X and H3O plus is going to be X. So let's just go ahead and put these equilibrium values in for Ka. So F said it's X. H3O plus is also X. And HF is 0.250. There's no units in Ka so we'll just not put any minus X. So the problem also gives us this information though. PA H. So what do we know about the pH? pH is the negative log of the concentration of hydronium mine. So what are we looking for? Well one of the things we're looking for is the concentration of hydronium mine and it happens to equal X. So it'd be really nice to figure out well what is that concentration? So we rearrange this. H3O plus equals 10 to the negative pH which equals 10 to the negative 2.036. So we're going to have to plug that into our calculator. We're going to get 9.20 times 10 to the negative 3 molar. So notice that equals H3O plus and H3O plus equals X. So we can plug that value in for all of those things. So let's do that. So X times X is X squared. So I'm just going to write 9.20 times 10 to the negative 3rd squared divided by 0.250 minus 9.20 times 10 to the negative. So when we do that we get the KA and it's going to be 3.52 times 10 to the negative 4. No units. So that's the KA for hydrofluoric acid. And remember in chemistry P that's just another name for the function that's the negative log function. So if we're looking for something that's PKA that's going to be the negative log of the KA. So the negative log of that number that we just figured out, 2.52 times 10 to the negative 4, 3.454 when I do that. So remember your significant figure rules when you're going to and from logs. So we went from 4 so we went down to 3 and so we went from 3 here up to 4. So you've got to remember that rule. Go back to chapter 1 if you don't remember. So are there any questions on this one? Pretty long drawn out process but you've got to do it every time. So these ice tables are really the key for doing all of these types of problems. Let's kill them.


Cool. So, how's it going? My name is Kevin. Today I'm going to talk about Gorilla user research tactics to get mainstream adoption for your DEP. So the original version of this presentation actually focused a bit more in the beginning on some of the user research I've worked on globally at Facebook and Quartz and some lessons to be derived from that for blockchain and payments. But after doing some user research of my own, a lot of people say that the second half of the presentation, just the actual tips and tactics were the most useful part. So this presentation is going to focus entirely on a bunch of things that you could do for your DEP starting tomorrow to help validate the idea for your DEP and the concept for your DEP and all the way down to launch. So a little bit about me. First, I've touched user research and data from a few different perspectives. I cut my teeth spending summers at Google as a product data analyst running a lot of Python data jobs and analyzing user data for the Geocommerce team. I spent a summer at Microsoft managing user research for Cortana. Then spent a few years at Facebook working on growth product, product marketing and helping drive user research initiatives both on the product and perception and sentiment side, but also across a number of different continents. And currently, I'm a product manager at Quartz. We're focusing on memberships and subscriptions and doing a lot of scrappy, scrappy startup research.  Instead of a dictionary definition, I think I'll just give you my own colloquial definition, which is a bunch of ways that you could interact with users, potential or current users that help you understand how they do things. And so these ways or research methods, you could kind of cut in a variety of different ways. You could think of the methods in terms of what do they track? How do people think or how do people actually behave? You could do it by the phase of the development cycle that you're in and which tactics map best to that. You could also do it by the context in which the study is actually taking place. Don't worry, you don't have to memorize these slides. Another main split is qualitative versus quantitative. And for those of you who didn't know, a lot of user research is considered quantitative. For example, for surveys, especially when you do them at a really large scale, you need to calculate the margin of error and make sure you have statistical significance in your findings and results. So what is gorilla user research then? It's basically just a term I made up. And what it is is it's trying to do user research for your DAP in 2018. It's scrapping and clawing to get any sort of validation for your DAP that probably, if it has launched on main net, probably doesn't have a ton of users while dealing with few resources and the dozens of other barriers that you face as a blockchain founder in 2018. So this is just a quick thing I drew where this is the preferences of a real kind of person with an actual problem. To the right is the solution that they're using now. They like it. Slightly to the left is your blockchain based solution. The farther to the right it is, the more they want the solution. So you've heard the saying that you need to be 10x better than your competitor in order to get over switching costs in order for the person to actually switch over. I've always thought 10x was kind of a lot, but let's charitably say 2x. So you're already starting off at a huge disadvantage.  Then you introduce the other things that are happening. People are skeptical of crypto and blockchain because of the market crash. People may not even know that you could build apps on blockchains, all the standard exchange and metamask barriers, all the UX and copy confusion that has been very well documented and talked about, I'm sure, covered very well by a lot of presentations here.  And if you're an enterprise product, you have to convince at least 10 different stakeholders within that company that this is real and valuable and secure, which is going to be very, very hard. And so you're basically off the map now. That's kind of your starting point as someone who's building dApps today that are competing with actual centralized solutions. And even developers and those who invest in them don't use dApps. So this is from a great medium article I read. I thought it was pretty funny because it seemed pretty accurate that even developers who build them and the investors who invest in them, they just don't even want to use them because it's so annoying and hard to do and they have lots of other busy things to do in their life. That's what we're dealing with. Yeah, so great. So some initial questions you may have thus far. So isn't user research only a thing that big companies and fancy design consulting companies can afford? No, I mean, obviously it helps to have money, as you could see, I've been on both sides of it. So I've seen firsthand. But the problems are kind of different. For a small company, you're just trying to validate your idea at the beginning, you're just trying to find any time to do user research, whereas at big companies, you're more kind of launching new product lines, kind of protecting existing products against competitors, etc. How many of you guys work for a company that's above that maybe has more than one full time user researcher by any chance? Cool. I'm guessing most of you people are consensus or perhaps Coinbase or status, which is no, which is good. It's like, I think we should all aspire to do that to be honest. But I also know that a lot of you guys are really small and just trying to hack and get something out the door. So these tactics hopefully should be pretty helpful. All right, well, we're too small, we're short on funds, we can't hire a researcher. Well, so you don't you may not actually need to hire a full time researcher. So in terms of finding your researchers, so one Ethereum token means you don't have as many resources for means you have more resources. So when you're pretty small, five people or less, it's gonna have to be you. And that's okay, because a lot of the tactics that you'll actually be doing like interviews, surveys, usability tests, which are just, you know, kind of walking people through your DAP and seeing how they respond and giving them direction. Those are fairly accessible to pick up with some study of the methodology. Also, a lot of some of the best people in the world at user research actually started from a founder point of view. So you're set up pretty well. When you get to maybe like 10, 15, 20, 25 people, probably want your designer or PM, you hopefully have a designer to spend part of their time doing that it maps pretty well to their skill set. And if you're if you're really in a crunch, I think two other skill sets that could map well to user research are one, maybe like a marketer that's really interested in marketing research and really cares about the user, or perhaps someone on the business side that used to be a consultant that cares a lot. Usually the kind of research a lot and deliver actionable insights within a time constraint kind of method helps consultants transition over. If you have a few more people, you might be ready to make your first full time hire. So obviously it would be nice to get someone with both the academic background, usually some grad degree and one of the experimental social sciences, and also the practical background having some experience at a tech company. But that's pretty hard to find. My opinion on two kind of requirements for a full time research hire that you're making if you're on a bit of a budget are one, make sure they have some sort of UX portfolio, you know, similar to designers, a lot of aspiring UX researchers often put together a collection of articles or they walk through the ideation process, they walk through user interviews they did, they document, you know, their thought process and that's helpful just because you could actually evaluate their aptitude. And also because it's just proof of commitment as opposed to just some theoretical thing that like, hey, I'm like a product manager and I might want to do research and I'll convince you in the interview. And then also some professional work experience, I think would help just because you need this person to execute for you now or your DAP might be done. And often people who have been in a professional work setting are just more familiar with the types of constraints that they have to work under. It's not a hard rule, but those are my personal opinions. And then finally, if you have the money, for example, if you have ICO funds and hopefully they haven't been siphoned off through a smart contract by anonymous CEO, you I think it'd be good to poach an experienced user researcher from a tech company or design consultancy, especially if you're doing a lot of upfront idea validation and generative research. Because in terms of evaluating concepts from scratch, it's really hard to beat a lot of actual practical experience. All right, so okay, we could find someone, but it's expensive still. I don't have money for all of these things that you need for research. Well, you really don't need much. So this is just a quick example of some of the tools. And pretty much all of these are free. A lot of these are even just Google sweet products that you could use for free. We at Quartz use a good chunk of these. And don't you don't have to like memorize these. I'll find some way to share slides after. But I think the idea is that there's really nothing stopping you from right after this talk, setting up your own user research stack. It's just screen sharing, video conferencing, survey tools, actually scheduling is the most is one of the most important ones here. If you share your Google Calendar link, the other person can kind of ask ask you for a meeting or propose a time and scheduling actually is a big barrier. But there should really be nothing stopping you in terms of actual tools from doing any user research. And this is just an example. Like when I sometimes when I do mobile remote usability tests, I just plug in my I asked them to plug their phone into their Mac if they have a Mac, two clicks, and they're mirroring their phone instantaneously using QuickTime on their laptop. So they're just screen sharing. All right. Great. So all that's great. But I'm also just I'm just a developer. I'm just a founder. I don't really know much about what to actually do. Do I just talk to people? Well, that's what we have the rest of this presentation for a bunch of things that you could do at each stage of the journey. And I might optimize a bit more just I might go a little fast just to make sure I cover everything. But at the end, I'll make sure to provide my contact information and we could kind of talk through anything. I'm happy to answer any questions. So first, you just want to start small, not big. I want to make the distinction between protocols, which I think is good to think super, super into the future top down, how is this going to survive in 50 years governance? That's great.  Pretty much every giant tech company started with a super small slice of a pie. Airbnb literally was just air mattresses at just conferences, then went to just air mattresses, then went to, you know, renting people's apartments. Now they're doing luxury travel and experiences and concerts. Same with Uber started with just luxury limo cars, then all types of cars, then autonomous vehicles. And the reason why that is is because when you win a small slice, you get a unique vantage point into the entire kind of pie of that industry as one of the winners to see the other opportunities in that pie that no one else can. You've learned the best practices. You've learned the industry better than everyone else. You have a well oiled team with great operations. Every one of your people in their field is an expert in their particular duty. So you're just set up really well to dominate more and more of that pie. And that's kind of the mentality that I think would be beneficial. And just a quick example. So this entrepreneur I know, I don't know him very well, honestly. He actually was never really a crypto guy. I think he, he's in his mid 20s and it sold the e-commerce startup to e-bates for a modest before hand. But it's a super simple experience where you just download a Chrome extension. And if I want to buy something at one of these retailers, and there's a lot of retailers covered, a little pop-up comes up. I click it. Great. It's activated. I go through my normal checkout flow. And then two days later, I just have Bitcoin in my wallet. And there they have custodianship of the wallet. And I believe you could withdraw after a certain amount to either a bank account or you're like a like a Bitcoin wallet. But I don't know. I mean, it's this is I think a good example of starting small. And for what it's worth, even doesn't matter too much. They have a lot of strong investors on their side, a good amount of funding and they seem to have good adoption. So I feel like, you know, there's really nothing separating any of you from being able to just really tackle very real problems. Yeah, you want to do lots and lots of interviews upfront. Depth is more important than breadth, I think. And you don't have to quite go so far. But I did want to highlight a cool example that I saw of a stablecoin company, Selo, who went all the way to Kenya to do user research on the ground to understand how Kenyans use Mpeza, which is mobile money that they could send really easily over your phone to other phones. It's extremely, extremely widespread and popular in Kenya. And for example, I thought interesting insight was Mpeza kind of spread adoption wise, not by people looking it up and, you know, kind of trying to get it or download it or whatnot. But through other people in the village that people knew, teaching them physically and showing them how to use Mpeza is a very like local growth that way. So yeah, just sometimes you really need to just talk to people to understand the nuances that really define the ways that people think and act about certain products. And the tough part of this stage, especially for dApps, is that at this point, you probably have the least resources. Like even if you're funded, this is probably a pre-funding point. But research is the most important stage at this point, just because of the large amount of time it takes to create a set of secure and well tested smart contracts. So it's kind of a lot of pressure. But at the same time, a lot of the tools that you're going to use are relatively straightforward for you to pick up. And as long as you focus and try, I think that will be a big improvement in and of itself. So when we talk about design and prototyping, I actually went to a pretty great workshop yesterday by these designers named Samarin Hanny who walked through a few great prototyping strategies. But you basically want to use interactive prototypes or kind of a web mobile MVP, no blockchain at all, just use a centralized server with some dummy data, just to get something in front of people that resembles what they would actually be using. So if people didn't like your idea in the interviews, you could show this to them. And this should be a fairly representative sense of this is a real problem that they're having or not. And you want to get as many users as possible on it. So briefly walking through an example of what exactly usability test is for those of you who don't know. So at Quartz, we launched this product, which was a story series with 180 degree video called Machines with Brains. And we decided to be pretty experimental in terms of launching it. You know, you kind of scrolled down in your article amongst different cards to read your article and swiped left and right to get to other stories. We thought it was intuitive, but we also had a big time crunch. And we heard some bad anecdotes upon launch. And so we conducted some quick usability tests. We found that the large blank spaces at the end of cards made people think that the story had ended. And so they just left. We also found that scrolling card to card because they were different heights was not very intuitive and people felt like their scroll was getting hijacked. And we also found that people were accidentally swiping horizontally when they might meant to be swiping vertically, probably because they're swiping at a bit of a diagonal angle. And so we quickly kind of enacted fixes to these solutions. So usability fixes, these types of things can really help you in terms of your product. You get a lot of great information upfront. You want to design for the least blockchain savvy and technical version of your user possible. And so I actually wrote an article about this a while before. The use case, we did a hackathon. The problem was build a farm to table local supply chain DAP built it on hyper ledger. And they mentioned that one of the users was this old 70 year old farmer that doesn't know how to use email. So we kind of designed with that in mind, made it super simple. So this applies to really everyone. Like if you're building prediction markets, you probably want non blockchain experts to use it at some point. So you should probably try to optimize and design a bit more for like a regular kind of gambler. Even if you're building developer products, you probably want developers who don't know that much about blockchain now to kind of onboard onto blockchain and use your product. So you want to make it as block blockchain jargon free as possible, at least in some of the main areas, just so it's really easy for them to onboard. Since actually a lot of develop, there's a lot of really skeptical developers for blockchain and crypto out there. And even crypto products, honestly, there's a lot of people who trade crypto and own crypto don't really know how it works.  And yeah, so you, you got to, you got to test your copy, both product copy and marketing copy for product copy. Product copy is always not as clear as we think. And don't use lorem ipsum use real copy in the context of the product for marketing copy. Even for like developer products. So, you know, these are some really complex developer products with some really, really simple marketing messaging. Stripe, Watson, Twilio. I know we're all proud of the technology we built and want to show it. And you also want to impress other engineers and investors, but especially on your main homepage, you know, permissionless decentralized credit market algorithmic efficient money markets. It's just kind of not that necessary. You're just not optimizing for as many people as you could be. Even financial products, you know, fidelity, it's not like they're a fast moving startup. Credit karma, wealth front, you notice that they're focusing on value propositions like what the end result of what this product will do for you, how you will benefit as opposed to here are all the small technical things that we have. And you know, for marketing to global audiences, I'll just kind of let this slide speak for itself. But please just, you know, even just through some through the crypto network or just talk to a few people. Translations can go really wrong. So yeah, just talk to people. And I would highly recommend that you don't move past this phase unless you have users in the bank. And what I mean by that is having a bunch of users that are kind of you interview them or you do testing with them. They're so into the idea they immediately see the value this would bring to them. They're bugging you every week asking you when your products going to launch. They're talking about other people kind of in their field that meet their profile. They really, really want it. And you kind of have to be honest with yourself here. But once you get into the smart contract development phase, you start to get to some, you know, really heavy upfront costs. So you really want all of the work or most of the validation work to be in these first two steps. And then when you get to the test net phase, you know, test net's mainly just to test out your smart contract functionality. By this point, your idea and your actual product experience should have been vetted in the previous steps. You will want to make sure you just explain in a simple way what a test net is to all users, even though it has a word test in it, it's not that obvious exactly how the components work. For example, on MetaMask, on your test that it still shows a dollar value of the ether that you have in your test wallet, which is kind of confusing because when you're looking at a wallet, you usually and you see money, it was like, I was at like money that I have. Just make sure that you explain what it is. I would recommend that you have basic event tracking, like the funnel, major actions, user sessions, Google Analytics is free. You could just use that. There's a ton of documentation. And if you really care about user privacy, just don't associate sessions with any particular user identifiers. I just I'm not sure how you could realize if you've hit success or realize how close you are to success without tracking basic metrics. And one idea I have is to and that we've, you know, I've seen a lot is to use support messaging products on your DAP. We're actually in the middle of installing one at Quartz right now. You know, I'm sure most of you have seen this. This is intercom. You see a little chat window.  You could immediately start chatting with customer service or you could read a few different resources. I think this is a great way of just setting kind of a set it and forget it automated way to catch people in who go to your DAP and get some feedback from them. Because you really remember this is gorilla user research. You need to use every tactic imaginable at your fingertips to try to get any, any feedback at all. When you get to the mainnet launch, another example of an automated feedback tool that you could use are in-app surveys. So in-app surveys actually intercom has a plug-in for in-app surveys. There's some other vendors like SurveyMonkey, Instabug, et cetera. Just a quick sample that you could do, you know, hey, this is really important. How'd you find out about this DAP? Why are you interested in trying it? Provide some free form feedback options and then collect their contact information for follow-ups. Just tell them that we won't associate it with your wallet, like your product data, but you need the ability to follow up with these people to really understand some of their use cases or pain points or problems. This is probably like the most relevant set of users you could get information on. So you really need their contact information. Obviously, you could go really extreme. So it's well documented that Facebook would send in-apps, would show in-app surveys or web surveys asking people if they cared, if they thought that Facebook cared about its users. It is a bit of a blunt force technique, but I have to say, I, you know, while I was there, I looked at a lot of that data and it mapped pretty well to how people felt about Facebook. So it was valuable. Be desperate for feedback. Aggressively scour the web social for anyone who has used your products. Similar themes. Don't be too proud to pivot. At this point, if you realize that your idea isn't something that people want, you've already learned a lot about how dApps work, how blockchain works. Be honest with yourself. Don't do the, you know, everything else is great, but the throughput. So I'll just wait two years for sharding or it's just metamask. That's a problem. I'll just wait a few months for delegated transactions for more people to download while it connects. You should probably be solving a problem that, in spite of everything that's happening right now, some people at least want, really, really want to use it. So if it doesn't meet that bar, I would just really, really stop. So that's that. Here's some of my contact information. Any questions? I'm seriously happy to answer them. There's also just a lot of talented people at this conference that could answer some of these questions better than me. And yeah, I could send slides to anyone or I could find a way to post them. OK, thanks everyone for Kevin.