We're going to be talking about awarding behavior and altering businesses. And it's because of the first part that I get to be able to talk about the second part, which is very cool stuff. I'm going to start off with a video, which is the first time I've ever tried to do this in a slide. So it may or may not work. We'll see. There are many ways to earn credit in the DMA Friends program. Activity codes are available in various places around the museum. At programs, in galleries, and special hidden codes may occasionally be distributed by DMA staff. These codes may be entered at any DMA Friends kiosk, or you can text the codes if you have linked your mobile phone to your DMA Friends account. It is a fun way to track your visit at the DMA while earning credit. The museum has also created funtals of activities called badges that are rewarded to friends who really plug in and make the DMA a vibrant place to be. Badges can give you new ideas about ways to use the museum that you've never thought of before. Badges are earned when you participate in activities listed in the badge descriptions. You can earn the Insomnia badge when you visit five DMA late nights in one year, or the Grand Tour badge by visiting four specific galleries in the DMA. We will periodically add new badges to the DMA Friends program. So check back when you're in the museum. Earning badges and credit unlock special rewards like free tickets to special exhibitions, lectures, behind-the-scenes tours, discounts on shopping and dining, and access to exclusive experiences at the museum. You can use that credit and you can spend the night at the DMA or tour the museum's art store. You use credit to claim rewards, but you will always keep your badges. When you redeem rewards at the DMA, a voucher will be printed at the kiosk where you signed in. Each reward is unique, and each voucher will have printed instructions that explain how to claim rewards. On your next visit to the DMA, stop by the kiosks to become the nearest DMA friend. Start wearing credit, and we'll deliver rewards. That was a pretty cool technology stack. I think we can all agree. And I'm going to start my presentation with a bit of courtesy. We're going to not talk about WordPress for the first several minutes here, so bear with me. We're going to get around to WordPress in a bit. They had a lot going on, right? DMA is Dallas Museum of Art. They're based in Dallas, Texas, and they are a very large facility. They bring in live exhibitions. They bring in traveling artists. They have lots of things for people to see and do. And until recently, they were funded entirely by people paying to go and see these things. And they started this program called DMA Friends. And what they did after introducing this is they eliminated the paid admittance to the museum. Not completely. You can still give them money. They'll take your money. But you can now go and visit the Dallas Museum of Art completely for free, because you're giving them a lot more information than you would get if they were just giving them your money, like your name and your phone number and your email address and your zip code.  And the way this DMA Friends program works is they have these iPad kiosks stationed throughout the museum. They have some when you first get there, so if you've never registered before, you can register. And also so you can check in before you go and experience the museum. And throughout this, if you didn't catch it from the video, you earn digital badges by exploring museums. By doing things you had already set out to do in its first place. And now you get rewarded for doing those. So if you show up to several late night events in a row, like they said, you get the Insomnia badge. And you get badges just for showing up on a regular basis. You get points every time you check in. And then you can turn those points into real world things like free coffee, free parking. If you collect enough, you get a free private tour of the museum, you and some friends from one of the curators, which is really awesome that they can just give that out. And it also allows you to access their events, which used to only be available to their paying, they're called DMA Partners. Things like $100 a year. I'm guessing a lot of you have art museums or civic things like this where you can pay them for an annual membership and that grants you access to the things they do throughout the year. That's what the DMA Partner program was. By becoming a DMA friend, you know how to access to those things as well that used to only be available to you at the $100 tier. And so one of the major benefits of this is they increased visitor participation. They pulled down a lot of paywalls and they got more people in the door experiencing what they do, which is exactly what they want to have, right? Curiously, they also started getting more money. Funny how that works, right? You get more people in the door. You start getting more money, even when you start charging people as much up front. And all of this revolved around the idea of giving people these digital badges and points completely made up fake things. Someone took some time to make some pictures and put it on screen and now people are showing up to participate in the museum because they get some flickering pixels. That's crazy. And let's talk about the technology stack from it. I mentioned they have iPads all throughout the museum, right? Some cool things that they did is they would automatically award you badges or points if you checked in at certain spots or at certain times of the day. So if you show up to one of their evening events and check in, the only thing you could possibly be doing is going to that evening event. So they automatically register you for it, which is just very clever. First of all, it minimizes the amount of things that you have to punch in on a screen, which is very important. There's lots of people who are trying to come through this very frustrating experience, right? I'm sure you've all used a device where you have to touch and it's not very pleasant, especially when you have people lining up behind you. So they did some clever things there. They also set it up so that you can interact via SMS you saw in the video. You could send a text to a phone number and it would be the same as registering or punching in a code at the iPad keyhouse. The neat thing about that is that the SMS only worked via certain hours of the day. So if you try and collect all these codes and then text them from home and text them every single day, it's not going to work. It only works when you're there during these certain hours, during these certain days of the week. And then they've got printers at certain kiosks where you can take the points that you are and turn them into rewards and they print out a receipt for you. So you can take it to the coffee shop and get coffee, take it to the gift shop and get discounts on there, their knickknacks and books and things. You can get your parking reimbursed. You can get event tickets, right? And so they've got all kinds of elaborate things wrapped in this. It's fairly sophisticated. So this is where I want you to be thinking when we're talking about giving people achievements. They fundamentally altered how their business works because they realized if we give people way of fake badges, they're going to show up and start giving us money so they can keep going with business. They get to give presentations at certain Smithsonian Conferences, national level museum, to talk about how they were revolutionizing how not only their museum work, but all the other museums in their collective. And aside here, if you don't know this, most museums, like most libraries, exist as part of a collective because you can do a lot more things as a group than you can do individually. Like the fact that you have lots of amazing speakers here, not me, but everybody else, because all of you are here and said, I want to come to this event if you bring in speakers. Powering numbers. And so the DMA raised money. They paid for the development of this platform. And then they got other museums in the area to join on board. And so everybody benefited. And so when they went into the second round, a couple of other museums kicked in to fund that piece. And so, again, Rising Tide raised all the vote to everybody wins because they're all working together. And they built this really cool, slick thing. I could talk quite a bit more about this, but the important thing to remember is you're signing in on an iPad, you're getting badges, you're getting points, you turn the points into real-world things. It doesn't cost you anything. And then, yes, they made more money. Another similar program is the YMVP program. This is put on by a small gym in New York named the YMCA. Some of you may have heard of them. And things that's all around the country, of course. But specifically in New York, they were piloting this MVP program, which stands for mild to vigorous physical activity. I think, I forget what the acronym is. But the idea was to encourage all of the students coming in through their programs to actually participate and do things. They have a lot of kids in their city who are looking for things to do, who have memberships in the Y. And they wanted to kind of guide them through a more directed approach to physical activity. And the way they did this prior to this experience that they have here, the pseudo iOS app was pencil and paper. So they have coaches with a clipboard, and the piece of paper represents each student.  I spent 15 minutes lifting weights. This, and then they would get rewarded on physical legacy leaderboard like that. And with this, you can see here, they have a timeline that's showing you what everybody is doing when they complete an activity, when they earned a badge, when they checked in. Things like that. And it encouraged them to participate and create their own workouts. So in a couple slides from now, we'll see a little bit about how this one works.   So you can check in and say, well, I did this, and then I did this, and this. These activities are basically to your shopping list. And then at the end, you can say, you want to save this as a playlist. I'm going to come back to do this again next Wednesday.   And then you get badges, I want to call them meta badges, when you create a workout and when someone else completes one of your workouts, which is pretty cool. So you're getting badges even for other people doing activity. And like I said, you're getting badges for these activities that you're doing. And then have a leaderboard for points ranking, because who doesn't want to be at the top of the leaderboard, right? The best way to get a bunch of high school kids to participate and actually care is to say, you can be on this giant screen when you walk in and the number one spot has been the most important. They had to rethink that one a bit because in the first iteration, and I know all the insiders, I helped build these. In the first iteration, they didn't want us to spend a whole lot of time limiting how many hours someone could, or how many minutes someone could get a lot to attack. So you can come in and say, like, I did an hour on this, I did two hours on that. So a kid could check in and say that he did four hours of activity and leave and just maintained being first on the leaderboard forever. That lasted about a week. And they pulled it down and we put in so that you have to check in, the clock starts, and then you check out, and then you can reassign all of those minutes to match up with what you actually did. And you can never actually use more minutes than you were there. And then they also took the leaderboard away from being on the home screen and buried it back in your stats. So you'll only see it after you finish logging your activity. And it turns out that was all they needed to curb people from gaining the same winning. And then, so what they realized is the main point is to get this timeline to put this at the forefront. They see here's what everyone else is doing and what you should do as well. And they did some really cool stuff with their kiosks. They were just like iPad sitting on a desk. They actually made, like they bought a store kiosk and they put decals all around it.  So it's a really cool experience. And just like DMA friends, as we've been saying, they utilized iPad kiosks. The cool thing about both of these that I forgot to mention is the way that you would sign into these, because it's very cumbersome to type in an email and a password, right? Both of these places had printed out ID cards. And so we utilized cameras so you could sign in and then hold up your ID card. It would scan the barcode and sign you in and then you're good to go. Here's a bit of a look at how it worked. So once you sign in, this is the screen that you see so you can pick one of these pre-made pick playlists. And if you're already actively working at one, some of them span multiple different sessions. You can do progress. And so you can basically say, I'm going to do these things today. And then you go out and do those things and then you come back and you can say, you know, I spent this much time on each of these things or I also did this, but I didn't do that.  So you can see how much time you spent today and how it breaks down across the different kinds of activity, cardio, et cetera. And then you can see the badges that you've earned today and the challenges that you completed today. And then you can see it for the week into the month. I think of the three views that you can get. And the funny thing about this is there are sometimes badges that you didn't know existed. They're hidden badges. One day of basketball for logging total over the course of your account, 24 hours worth of playing basketball. And then you can see all the badges that you've earned and the ones that you haven't, at least the ones that they publicize that exist. And then on the community tab, we did own a screenshot form where they had the leaderboard and the other activities stream actually logged in. So really cool stuff. And then a third one that I want to give you here for our case studies. I really don't have a screenshot for it. This is one that did have the staying power that the company thought it would. So this is a somewhat sad case study. But I'm including it both because it was a really cool project and also to show you that it's not always going to succeed, right? You might think it's awesome idea and you get rolling on it and then it falls flat. So it happens. Two out of three of these worked and they were awesome. This one was awesome while it lasted. This was called Scout and it was for Pierce County Libraries. And what they basically wanted to build was a summer reading program on steroids. So get all the kids in the area participating in the library in the summer months when they would otherwise be taking naps and watching TV. And with this they had book reviews and scavenger hunts and interactive photo submissions. And what they were secretly doing was teaching kids how to use the library and how to engage their brains even in a self-directed sense during the summer. So the scavenger hunts throughout the library, they were telling you like go find this fiction book. Where would you look? How do you learn how the Dewey Destiny systems or a more apropos version would be how do you find these things via Google, right? And so they have digital scavenger hunts as well. So there would be links placed on other sites, partners of theirs. So when you found that they could click the link, it would bring you back to their site and you would earn achievement for having done that action. The really cool part of this one, in my mind, was the ISBN lookup integration. So they might have a rather amorphic achievement like read a fictional book about dogs and you would punch in a book that you read, either it be a title or the ISBN and it would look up one of the ISBN services. What the book was, try and find some keywords that match what they wanted and if it was a fictional book about dogs, you would earn that achievement. Which is just very cool, I think. And then the part that made this really work is that they integrated it with buddy press. Oh, I just boiled a bit of surprise. So as you were completing these activities, it was showing up in an activity stream, just like on YMCA. So people could see what you're doing, but unlike YMCA, you could also participate. So you could see this. Someone submitted a photo of a diorama that they'd made for a book that they read and then comment on it. You could see that they just earned the midnight reader badge for the sixth time in a row. You could congratulate them on it. And then you, as you're doing things, you'd get notifications every time you've heard something in near real time when you unlocked it, even as you're moving through different parts of their website, which is just darn cool. Unfortunately, they only had enough funding to run this for a single summer, and then they had to pull it down to them and have enough momentum to keep staff running it, which is a bummer. But I'm glad that they got to do it at least for one summer and demonstrate that it was a viable exercise. So what do these sites have in common, other than me making them and knowing how cool they are? They're all actually powered by WordPress. So everything that I showed you here was WordPress through and through the whole way. Even the iOS apps, the app part of the iOS app was simply a wrapper that removed the browser controls. And in the case of the YMCA and the DNA, we tapped into the camera just so that we could read the barcode to a lot of people there. So we had an iOS team make that part, and all the barcode scanner did was, it would recognize it using an open source library called, I think, Z... for scanning barcodes. And it would hit an endpoint on our server, and it passed on the data, and we authenticated them and logged them in based on them actually being in a physical location so we don't need their password because we know we can do reasonably assured that they're good polls. And I would not recommend doing that in like a production environment where you don't have control over, okay, they're literally at this physical location. Anyway, the rest of it is all WordPress. And the achievement piece was all run by BadgeOS, which was a plugin that I got to work on quite a bit. This is really cool stuff. If you are looking to do achievements in any capacity on your website, there are lots of solutions. I'm not going to tell you that this is the one that you want to use, but I would recommend that you check out BadgeOS. I would recommend that you check out achievements and just search for awarding Badge to be awarded. So find three or four. But two that people use most often are probably going to be BadgeOS or achievements. And what's nice about these is that it's extremely simple for you to set up achievements on your site. BadgeOS, I can speak about from experience because I helped write it, and I know there are lots of extensions that exist for it. I also want to preface these examples were from two or three years ago. I've been sitting on this talk for a while, letting it marinate. All of the examples are still relevant, but if you go and look at things and see, oh, this is two years old, I promise the code is okay. I wouldn't say that if I'm looking at it, right? I would be like, oh gosh, I wrote that. But generally, it's okay, even though it's a couple years old, it all still works the way it was designed. And the screenshots look pretty terrible on the projector, but what you'll see is this is a fairly familiar WordPress UI. On the left here, we've got the BadgeOS menu that it adds. We can see a bunch of different achievement types that exist. And it's just the WordPress posts interface. You can click and make a new one, you can edit one. There's one set of meta fields where you can specify details about the Badge. How many times can it be earned? Must the steps be completed sequentially, or can they be completed in any order? Or is it earned maybe not by completing steps, but by submitting a photo, or by filling out a nomination? Is it admin-awarded only? So it's an achievement that can only be given by you, the site owner. Things like that. And then this bottom part here, which is just trainwreck pixels, is the UI for creating steps. So you add a step and you specify what the step is, like they must comment on any post one time. And then another one is they have to earn all achievements of the type level. So I've got an achievement type called levels, like level one, level two, level three. All of those, then you completed the step. And so maybe this is an achievement called trophies. So we give you a trophy for earning all levels. The nice thing about BadgeOS that other achievement platforms don't have is you get to define the standards. So you're not necessarily giving people badges. You might be giving them badges, but you might be giving them levels, or trophies, or quests that you would complete. So you get to define all the verbiage that gets shown and even for these steps, you can't really tell if you screenshot, but it will pre-populate what the label may be for the step, like comment on any post one time, but then you can change it completely, like comment on at least one post. It's freeform, you type it whatever you want that step to be. And you can set an image up for what the achievement should look like when they earn it. And this pairs up with a service called Craigly, which is pretty slick. Just a second. And they have a Badge builder. So right inside WordPress, you can click and design a badge. You can pick from, I think, six different shapes with six different border styles with an unlimited number of icons because it connects to the noun project, which has like thousands of different icons for describing every different kind of noun. And you set all the colors and you save it out. Boom, you've got a badge for whatever it is that you want. So even if you're not a designer, you can use badges for every achievement that you want to award. And the publisher goes on the front end and to down people who start getting achievements, there are add-ons to tie into things like buddy press, so when they join a group or when they get a friend or they can get badges for that group for showing up and participating. And the way it works, this is for you developers in the room, it's all just hooks. So there are a couple of filters that you can use for redefining what kinds of steps exist in the drop-down menu here as you're being able to select what people do. And then what it's listening for in the actual rules engine is for a hook to fire. So like the very first example here, comment on any post. We're listening for the save comment hook to fire in WordPress. And when it fires, we look to see are there any achievements, any steps that should be awarded and then it walks through. Now that we've earned this, has the user unlocked any achievements? No? Okay. Or yes? Okay. We give them this achievement. Now that they've earned this achievement, do we give them anything else beyond that? Maybe they just got level three, that means they get a trophy. And it just works through all that. And all it is at its core is hooks. You modify one filter to say I want to listen to this and you add a hook at the other end and BadgeOS will just listen on both ends and automatically monitor things. That's very neat. The example for the digital scavenger hunt that the library system used, we just had a custom URL endpoint, query string. So if you click a link that has that query string in it, it brings you back. Optionally, we can check the refer to make sure that you're coming from the page that we know the link to be on and if the refer matches the query string in the present. We just triggered the whatever hook that would then reward the step. And it's very, very, very simple on the other side. If you're a developer, you want to extend it to track other things. I was just wondering if there's a public API for the BadgeOS stuff? No. There are no awesome, not like a REST API because it was made a couple years ago. Credly, the part that it integrates with, that is a fully featured API, the Badg builder piece comes from the API. The other neat thing about Credly is that it allows people to take the badges from your site off of your site and promote them on Twitter and Facebook and stuff without you doing anything. And their idea, Mozilla also has an open badge platform system similar to this. So you get badges and achievements across a number of sites but have one backpack so to speak where all of your badges exist. Which is pretty cool. And so you get that out of the box with BadgOS and that means that your badges don't necessarily exist in a silo. But no, regrettably there is no API for it yet but it's extensible enough that someone enterprise name not good right now. So, now that you know that all of these very cool sites were made using WordPress and BadgOS what can you do with this information? How can you take this to award achievements and change businesses, right? Can you come up with an idea that is as fundamentally destructive as doing away with payment system for a museum and still make money? Well, maybe. So the very first thing that you do with this is increase visitor participation. That's why I worked for the DMA. They netted more revenue by charging less money because they had more people coming in more people participating and therefore more people investing in other things than just paying at the door, right? They're investing in the cafe they're investing in the events that they now have access to that they didn't have before and thinking smaller like if you just want to put this up on your own site let's say you run a blog you've got a nice contingency of readers you want to get them participating more maybe you start giving them badges every time they leave a comment so on the first comment they get a congratulations for coming out of the woodwork badge they leave their 10 comments you give them congratulations for sticking around a badge they leave their 100 comments you say easy buddy maybe you should start a blog badge right? So you're awarding them for participating and you're encouraging desired behavior right? You want more comments on your posts you start telling people leave a comment and you could build a rewarding training platform right? If your website, if your blog is about instructing people how to do something let's say that you're running a blog with recipes and you're teaching people like here's what I make and here's how I made it and all of a sudden you start adding your payment is free but you want to walk them through the basics your parent is concerned about a child leaving away for college and they have zero cooking skills whatsoever so you point them at this blog because this blog walks them through how to do all these things and this blog also gives out achievements every time someone says I made this recipe they click a button, they get a badge or maybe you're running WordPress training for your clients right? You've got people who have done this stuff, you've given them WP-101 you've got the WP-101 plugin running in their dashboard so you write a little add-on plugin that listens for things happening in the WP-101 plugin and every time they watch a new video you get a badge for it so there's lots of different ways that you can reward them within a training platform right? You could improve local commerce, this was an idea that I didn't get to build now I'm sad about but Chamber of Commerce and somewhere wanted to increase people going in the doors of all the businesses that participate in that Chamber of Commerce certain towns do this thing I know in my little co-dump town there was a midnight something there was a midnight movement like that where if you go to all the stores like beyond closing hours each of them has a special discount and you can if you go to more than one you get another 20% off like it's a compounding thing so it's a curve you can show it more and more the idea of putting this in the badging is now you're getting to punch in a code for each place that they enter and at the end they get a massive discount if you have something I'll leave the specifics up to you I'm just giving out free ideas here and then of course you can create a more engaging social site so you've got a site, the client says I want to make my own Facebook you go first we're going to add a couple more zeros to this invoice preferably on the left side of the decimal and then we'll start talking about your idea of making the next Facebook but for what you want right now maybe all you need is just the messaging piece of Buddy Press and maybe the way to encourage people to participate and message each other on your site you're giving them badges for how many people they choose to communicate with maybe you give them badges every time they join the group maybe you give them badges every time someone likes something to encourage good behavior people being generally kind to another on your site that's a good thing to reward and you'll tend to pull back more rewarding users because of that one of the cool things about BadgeOS that it does with the free Buddy Press add-on is every time you get an achievement it shows up in your activity you being the person participating and also for as I just described certain Buddy Press behavior that you might want to encourage them to do I didn't mention this here on my slide but you could also turn this on for a different LMS learning measures there are two really popular ones called Learn Dash and Sensei Sensei by Luthi BadgeOS add-ons that exist for those I think one of them is paid and one of them is free I don't remember which one Learn Dash is paid so I think Sensei is probably free because Learn Dash is free platform and Sensei has a paid platform which is how they worked out that decision but anyway these add-ons already exist if you wanted to take one and make it for say Lifter LMS which is an upcoming star we're doing a lot of really cool stuff BadgeOS is very easily adapted into that as well and so now you've got this training platform where you're giving people access to courses and quizzes and when they complete a quiz now they can get a badge from BadgeOS so you can build a very rewarding training platform I can talk for hours about this I'm going to pause now I've already given you a shotgun blast of information does anybody have any questions say you have a membership site with an LMS in there and you wanted to instead of selling different levels you have one level but you would unlock another membership level with badges there are ways to do that that you can see in BadgeOS after they complete some of the LMS modules now they have the ability to get this out of the ocean and access other LMSs so the question to repeat both for the camera and the picture that I understood it correctly is to say suppose you're running a membership site that only has a single level of membership is there a way for your members to unlock an additional tier by earning achievements right? or you can have a membership with multiple levels usually you have to pay if you're a member of level 1 then you can pay level 2 but what if you don't want to pay if you want them to participate so I haven't participated in any any project that has done that but it is definitely feasible I worked on one a while back where they wanted to take points that a person was using from BadgeOS and turn it into store credit so a similar thing could be done here so you're using the points as sort of a refund on the thing it can only be bought by points might be one way to do it there are also a lot of helper functions if you're a helper have one working on the project where you can say do they have this achievement and so if they have this achievement then they can do whatever the next thing is there's nothing out of the box but it can probably be done so the SMS side of things for the DMA I believe was Twilio and so we just wrote a simple PHP connector that would send data to Twilio and listen to data coming back from Twilio and then we would use that to trigger I think just simply do action so we get it all folks so we trigger do action with the response that Twilio sends back the phone number and we use the phone number paired with the user account to know this should go and so on and so on so the Twilio connector piece was a single file I think it was like 60 area lines total 20 here to send data out 20 to get data back and then a couple of lines for the do action add action to bring back the images Is there an add on to encourage social sharing I don't remember I know that was something that we talked about I unfortunately haven't been active in the project for the last two years and I think you got made, so I don't think one exists currently the way that we talked about making it was there is one that exists but is completely proprietary for one particular company they paid for a service that would go out in mine all the social feeds looking for hashtags and specific things and then when they would assess that the sentiment was pleasant they were saying like these guys suck they would then see if they could match their name the username that was saved in the profile and then award them something so I don't think one exists currently I have a question I don't want to stop the staffing issue so the question is what happened with the staffing issue at the library I'm not sure of the specifics they've gotten a specific grant to run this program and then by the end of the summer which is how long it was supposed to last to get a renewal to keep it going I'm not sure I don't think they brought on more people but I think that they needed more support from their current staff more hours and things like that and they wanted to build more things and they could forward as soon as they could I think so I think their specific issue is that they had the people who were running it had basically a second job now they're managing the library and managing a website and they could do one or the other and not move yeah so in terms of actual management it's not intense right it just takes time what do we want something to do well that's going to look like this like a scavenger hunt for example they have to figure out where they're going to send them they're going to have to hang up codes for the person to find and punch in and spend a week just thinking through the curriculum there's 40 hours that the library hadn't budgeted that's a good question how do you identify rewards that people will respond to how did I that's an easy one I didn't have to do any of that I just got to implement it at the end I can tell you though it's very challenging to come up with the rewards that they actually care about I think there are lots of articles written about gamifying systems to encourage things and a lot of them make a lot of really good points one thing that I did while I was researching this is I just trolled Steam which is a platform that Valve created which is a brilliant money maker on their part and a really great way to distribute lots of games but one thing that was really handy to me in this case is they would show the kinds of achievements that come along with these games you can see there's a certain pattern all of them had X number of kills or find X number of hidden areas so they were encouraging exploration and they were encouraging participation exploration for finding hidden areas participation for the number of kills or for style kills or for using a certain thing or behaving in a certain way I think the first frame of reference to start from is what do I want people to do on my site how do I want them to use my service what would I want that to look like because the end goal let's go back to my teaching example the person is running a recipe blog who turns it into instructions for people doing for college the end goal there is if they follow these recipes they'll know how to boil water they'll know how to cook an egg how to cook spaghetti all these things so at the end they could conceivably not only make food but find groceries and so how do I know that they do that at the end while I award them achievement for making this recipe I award them achievement for saying that they completed this skill and so your goal first is to encourage them to do the things that you want trying to get a mouse through a maze you're putting cheese at the right spot for them to make the right turns the right frame of reference is what is the cheese so yes I'm going to achieve them but what am I going to name the achievement how easy is it going to be to get this first achievement because you want it to look kind of like a lot of rhythmic skill they signed it in the first hour they got like 15 achievements they're feeling pumped the next day they get another 5 the next day they get another 2 a couple days later they get another 2 and then it takes longer and longer to get more and more and then continue to to give them positive reinforcement as they go I don't know specifically what it looks like but most of the time it's going to fall either into encouraging exploration and encouraging participation just one more just one more alright but it's a good one no pressure I'm curious about the planning process for the achievements themselves and how how that happened like if you're involved with that like how did you plan all the achievements first or build stuff and then do it or how did that go out that is a great one to end on so the question is what is involved in the achievement process and how did it happen to be planning the achievements first or build things and then build achievements off of those and what sort of thoughts went into that the achievements came first so we designed software to solve problems that they already had in the case of the YNCA how do we get these kids engaged how do we get them to participate in these specific things in fact the specific goal for the YNVP was to get people to do the things called the presidential challenge so 30 minutes of mile to vigorous activity per day up to I think 4 days a week so it's a very low bar especially for youths they built everything else out to support that goal so how can we get kids exercising for 30 minutes a day well it means we need to get at least 4 different 15 minute activities or 2 different 15 minute activities 3 different 10 minute activities you know and one thing to pair well together and so they worked through that it was definitely messy in some cases we found like after we started implementing things like oh this achievement conflicts with this one because the way Badge West works is when you do a certain activity it's good for everything so in this case the YNCA had very custom activities where it's not coming unopposed it's log 30 minutes of playing basketball so we had to do a few different things to track okay they've just logged 30 minutes of basketball and it counts towards all 3 of these bags we do want them to earn the 24 hours of basketball even though we're also counting with 30 minutes to whatever challenge they're working on but we don't want them to get that same 30 minutes logged and tracked 4 times we need to say okay this activity of 30 minutes is done we'll never count it again even when we re-calculate Badge and with DMA they saw through like what things do we want them to go through what do we want them to participate in so everybody figured out what their achievements were and the flow of the users first and then we built the software around it and two things collided well we don't actually want them this one activity to count both of these things to count towards either one of these things we need to set up an exclusion so it can only go to one so there's some challenges but usually the achievements came first and then the solution to award them came second if you have any more questions I'll be around I'll need to be in happiness bar and please feel free to stop me anytime today thank you very much