Welcome, and thank you for joining us for today's TechSoup for Libraries webinar, Measuring Program Outcomes, a Toolkit for Small Libraries. My name is Crystal, and I'll be your host. Today we're joined by two guests who will talk about how small libraries can leverage easy-to-use resources from the Public Library Association to measure outcomes and use outcome data for advocacy and to take action. But before we begin, I have just a few announcements to share. Today we'll be using the ReadyTalk platform for our meeting, and please use the chat in the lower left corner to send questions and comments to the presenters. We will be tracking your questions throughout the webinar, and we'll answer them at the designated Q&A section at the end of each presentation. All of your chat comments will only come to the presenters, but if you have comments or ideas to share, we'll forward them back out to the entire group. You don't need to raise your hand to ask a question, simply type it into the chat box. Should you get disconnected during the webinar, you can reconnect using the same link in your confirmation email. You should be hearing the conference audio through your computer speakers, but if your audio connection is unclear, you can dial in using the phone number in your confirmation email or that we've shared in the chat. If you're having technical issues, please send us a chat message and we'll try to assist you. This webinar is being recorded and will be archived on the TechSoup website. If you're called away from the webinar or if you have connection issues, you can watch a full recording of this webinar later. You'll receive an archive email within 24 hours that will include a link to the recording, the PowerPoint slides, and any additional links or resources shared during the session. If you're tweeting this webinar, please use the hashtag TS4LIDS. We have someone from TechSoup live tweeting this event, so please join the conversation there. TechSoup Global is dedicated to serving the world's nonprofit organizations and libraries. TechSoup was founded in 1987 with a global network of partners. We connect libraries and nonprofits to technology, resources, and support so that you can operate at your full potential and more effectively deliver programs and services to better achieve your mission. TechSoup has helped to distribute over 14 million software and hardware donations to date through our product donation program. We offer a wide range of software, hardware, and services, including software like Microsoft Office and refurbished computers. For more information about TechSoup product donations or services, please visit TechSoup.org. Again, thanks for joining us for today's TechSoup for Libraries webinar, Measuring Program Outcomes, a toolkit for small libraries. We have two guests joining us today. Samantha Lopez joins from the Public Library Association in Chicago where she is a project coordinator for Project Outcome, which we'll learn more about in just a few minutes. Robin Treslow joins us from Prince Frederick, Maryland, where she coordinates adult programming and manages public relations at the Calvert Library. My name is Crystal Schimpf, and I'll be your host for today's webinar. Assisting us with chat and Twitter, we have Ginny Mies and Susan Hope Bard from the TechSoup team. We also have Emily Plamon joining us in chat from PLA and from Project Outcome to respond to questions as they arise. We'll be on Twitter using the atTechSoup for Libs handle, so you can also reach us there. Now we will have time for questions throughout the webinar today, so please send us those questions as they arise. And we'll address as many as we are able to. Some of those responses may come in chat from Emily, and some of those will come during our designated Q&A sections on the record during the webinar. If we aren't able to answer your question during the webinar, we will follow up later on with an email to give you a response. Again, this webinar is being recorded in all of the slides, resources, and materials will be included in the archive, which you will receive within about 48 hours after the event. We'll start off today by hearing from Samantha who will share information from Project Outcome, a free set of tools and resources for public libraries. She'll start by talking about why measuring outcomes and not just outputs is important for libraries. Then she'll share the Project Outcome toolkit and resources, as well as ideas for how you can use outcome measurement data in your library. Then, Robin will share her experience measuring outcomes at the Calvert Library across four programs, and how they overcame challenges along the way. We're focusing on smaller libraries today, but if you've joined us from a large library, you should still be able to apply these concepts and utilize the toolkit. The toolkit is only available to public libraries in the U.S. and Canada currently, but if you've joined us from a nonprofit, you're welcome to stay on the line and adapt any of these ideas for your own setting. We'll have time for questions after each speaker, and as I said, Emily will also be responding to questions in chat throughout, so please send in your questions as they arise. Now before we get into our content, just out of curiosity, we'd like to know if this webinar is your first time learning about Project Outcome. So if this is your first experience, you can just select Yes, and then click Submit. If it's not, then select No, and click Submit, and you'll see the responses as they come in. And I'll give you a few moments just to put in your response and send it to us. At this point I can see as the responses are coming in that we're seeing a strong majority that this is your first time learning about Project Outcome. And if that's the case, then we're happy to be able to introduce you to this resource today. Now if you're already familiar with it, then we hope that today's webinar will give you some additional ideas for how to implement outcome measurement in your library. I can see that the responses have slowed down a bit here, so I'm going to go ahead and close the poll so you can see everyone's responses. And we can see that just over 70% say that this is their first time learning about Project Outcome. So you are in good company today if that's the case for you. And welcome and thanks for joining us. All right, so now I'm going to hand things over to Samantha so she can tell us more about Project Outcome and the importance of outcome measurement. Sam? Thanks Crystal. Hello everyone. As Crystal mentioned, I am the Project Coordinator for Project Outcomes. And I'm glad to be here today to be talking about why libraries should measure outcomes in the Project Outcome Toolkit. So first, let's address the question, why measure outcomes? We know times have changed and as a result, so have libraries. There's been an increased need for services and programs. The library's role has transformed into a community hub addressing a variety of community needs. But traditional measures only capture outputs. They don't capture the library's newly expanded community role. We know libraries offer a variety of important services from digital to early literacy programs and so much more. We also know how valuable patrons find these services. But numbers like these are no longer enough. How do we capture the library's impact on the community? In other words, what are these numbers actually need? For the purpose of clarification, I want to take a minute to explain how Project Outcome defines the word outcome. An outcome is a specific benefit that results from a library program or service designed to help patrons. Outcomes are not outputs. In this table, you see some examples of outcomes versus outputs. Some outcomes include a job seeker is more confident in their job search after meeting one-on-one with library staff. An elderly patron is able to create an email account after attending a class at the library. And after attending a library story time, the caregiver feels they are better able to support their child's literacy, needs, and growth. Now that we're more clear on what we mean by outcomes, we'd like to know how many of you are currently measuring outcomes in your library. Please select one of the responses, then click Submit. Once you submit your response, you will see a summary of all the responses. If you have any ideas you'd like to share, please put them in the chat. We'll try to share out as many of your chat responses as we can. I'll give a few seconds here to get everyone's responses in. Now let's see our results. Okay, so a vast majority of you say you're not measuring outcomes. About 30% are using other methods. Some of you are actually using Project Outcome, which is great. Whether you are not measuring outcomes or already measuring outcomes and looking for new ways to do so, Project Outcome can help. Project Outcome is an online toolkit that is free for all U.S. and Canadian public libraries to measure outcomes of their programs and services. Project Outcome is managed by the Public Library Association and one of many ways for libraries to measure outcomes. But the benefit of using Project Outcome to do so is that it's free, easy to use, and takes the work out of creating your own questions or needing to be a data analysis expert. It does the work for you. The surveys themselves were developed by a specialized task force comprised of a diverse group of public and state library leaders, consultants, data researchers, and analysts. The task force pilot tested the surveys in 2014 and they were finalized and launched with the Project Outcome website and tools at ALA Annual in June 2015. You do not need to be a PLA member to participate in Project Outcome. And while it was designed for public library staff, state library, and non-library users can also register for free to learn more about outcome measurement. The Project Outcome toolkit includes access to the field tested surveys measuring outcomes in seven library service areas. The Survey Portal tool, which helps library schedule surveys, track and store data, and access ready-made reports. The Visually Interactive Data Dashboard tool, which helps libraries analyze and understand their results. And all of the resources and training we have created to help libraries throughout the outcome measurement process. We have heard from our small library users especially that the combination of the ready-to-go surveys and easy-to-use tools really help library staff save time and energy in planning their data collection. Leaving more time for decision-making and advocacy once the results are in. These icons represent the seven survey topics available within Project Outcome. The task force intentionally designed a set of questions that were short that captured the most essential patron outcomes the library would want to know. We have heard from our users how helpful it is to have an off-the-shelf set of questions that they don't have to create on their own. And that patrons find the short, simple surveys easy to complete and are willing to take the time to do so. You do not have to measure across all seven topics. You also do not need a certain amount of responses to start measuring your impact. We suggest starting small with one survey, seeing the results, and planning for larger programs from there. The surveys are six questions long and they are designed to be administered directly after a program or service has been delivered. The first four questions measure a particular type of outcome, knowledge, confidence, anticipated change in behavior, and increased awareness of library resources. As you can see in this picture, the surveys have a five-point Likert scale for the first four questions, allowing patrons to select from strongly disagree with the option of not applicable. The last two questions are open-ended and designed to allow for additional feedback from participants not captured in the first four questions. We have heard from our current users that the open-ended comments are key to making programmatic changes. This is where programming staff learn what their patrons like most, what needs improvement, and what additional programs they'd like the library to provide. The questions cannot be changed or edited, but libraries can add a question or two if they like. This was intentionally done by the Task Force because the questions have a research component that allows for the questions to be valid and provide consistent aggregation of data. The surveys come in both paper and digital format and are currently available in English and Spanish. I'll also add that the Task Force is currently working on the next set of outcome measures, which will give libraries even more ways to capture patron outcomes. These new surveys will be launched this June at ALA annual in Orlando and will be available for all users following the launch. So this is the Project Outcome website. This is where you will access all of your surveys, tools, and resources to help you throughout the outcome measurement process. Again, registration and access is all free. Now I will walk you through the Project Outcomes tools, which are available on the Surveys and Resources page of the website. The Survey Portal is where you go to schedule and access all of your surveys, customize your surveys' program information, including program name and date, enter all of your survey responses, track program attendance and survey response rates, and review your auto-generated reports and data. Again, we recommend starting small with a program you feel confident about getting patron feedback from. You do not need a high number of responses, but it's always best to aim for a high response rate no matter the size of the program. This screen shows what you will see inside the Survey Portal, where all of your survey scheduling and data collection takes place. Here is where you will go to schedule your surveys, see all of your currently running surveys, get your digital survey links, enter paper responses, and access all of your reports and data sets. On a recent presentation with Iowa Libraries, our co-presenter was a small library who reported finding the survey scheduling process very easy and especially liked being able to copy and paste the digital surveys on iPads for patrons to complete as they left the program. No extra work was needed by her or her program staff. This screen gives you an example of what scheduling a survey will look like. You are walked through the process step by step from choosing which survey you want to run, to naming your survey, and selecting your fielding dates. Project Outcome provides users with auto-generated reports they can use in presentations to their staff, board, or city council. The summary report includes community talking points and statistics about the survey topics, aggregate summary results of your outcome scores, and program detail information like program name, attendance count, and session dates. Our Iowa Library presenter also found the auto-generated reports extremely helpful, especially that it eliminated any additional data analysis work on her end. In your library data set report, you can see all of your survey responses including the open-ended comments. All responses are also tied to branch location and program name and date. You can really compare and contrast results within a single survey. You'll return to the Project Outcome website to access the data dashboard tool, which is where you will view, interact with, and analyze your survey results. Once survey responses are entered into the survey portal, your results will automatically populate in the data dashboard. The four data dashboards help libraries learn more about their results. They provide high-level summary scores and quick comparisons of national and statewide averages. They help you visually explore your data and see relationships and correlations between survey topic and outcome sites, which can help drive decision-making and identify gaps in service or impacts. Your service outputs are also captured in your dashboard, since outputs and outcomes work together to help libraries better tell their impact story. You see a lot of data points here, but if your library only wants to run a few surveys or only survey two of the seven topics, that's fine. You will only see the data relevant to your library's collection needs. Here's a closer view of the Detail Dashboard page filtered down by Survey Topics. Here we can see the library, state, and national averages in the center of the road, with the scores going left to right from strongly disagree to strongly agree. These results are color-coded with weaker, lighter-colored scores to the left and stronger, darker-colored scores to the right. Here's where you also have an additional view of your open-ended comments. The data dashboards are designed to help you clearly and quickly see your impact without needing to shift through rows of Excel data. If you prefer to work in Excel, then the Survey Portal reports provide that for you, too. You've tried to cover every way a library would want to interact with and learn more about their data. I know that was a very quick overview of the tools, but you can learn more about how to use the tools on the Project Outcome website, which hosts a variety of helpful resources. You can find all of the Project Outcome resources under the Websites, Surveys, and Resources page. You can find resources by clicking hashtag categories on the left-hand side of the screen, which will point you to resources specific to that topic. There's also a search box to help you filter through the resources. Here are more examples of the types of resources available to help you throughout the outcome measurement process. From getting started to how to talk to patrons about surveys to influencing your programming. Project Outcome also hosts three monthly webinars that expand on these resource topics. All of the archived webinar recordings can also be found on the Website. Since launching last June, Project Outcome has seen a lot of participation and a variety of programs and services have been measured. Over 11,000 patron surveys are currently aggregated within the Project Outcome system. The Education and Lifelong Learning Survey is our most common survey schedule, which libraries use to measure popular programs like teen-steam programs, and adult skills such as knitting, book clubs, and ESL classes. The more libraries participate, the more outcome data will be aggregated, and the fields will move toward outcome measurement as common practice. Listed here are some examples that we have heard from libraries already implementing the surveys and the programmatic decisions they have been able to make as a result. One library used the surveys to measure the effectiveness of their Science Kit service for one month. The library put the Education and Lifelong Learning Paper Survey. In each Science Kit, they loaned out. They received about 30 responses, which was a 17% return rate. What they learned is that most parents and kids were unaware of the additional Science Programming the library provided. One response actually said, the library should provide kids programs, so kids will want to come to the library more often. This unawareness shocked the library and resulted in the library inserting their program brochure so all Science Kit users could learn more about the library's hundreds of kids programs and when they were offered. 90% of the brochures did not come back to the kit. This was a small, quick, and inexpensive change for the library to make. Most libraries are getting questions about why the library still matters. Many Project Outcome Libraries have been able to use the positive results to reinforce their value in the community when presenting to their board. They have been able to use the summary reports and data dashboard views to give a clear and concise message about their patron impact. One Project Outcome Library said they were able to change the conversation with their board and internally with staff from numbers being down to what are we accomplishing and what is happening in the lives of our patrons. This was all thanks to conducting a few Project Outcome surveys and finding out what their patrons really needed. Now I will take any questions you may have. Crystal? All right, Samantha, thank you for sharing such a comprehensive overview. I know there is so much with the Project Outcome Toolkit and resources and what's being done there. But I am glad you were able to share such a broad overview of it with everybody. We have been getting some questions in the chat and I know we have been sending off some individual responses but I would like to address some of them now just to clarify for everybody. Now I know you said earlier how we are able to access the Toolkit and the resources but just in case anybody missed that can you tell us again how can people gain access to all of these resources you have just shared? So to get access to the tools and resources you simply register on the Project Outcome website. So you will go, you will hit sign up, enter your email, get a confirmation, click the confirmation email and then answer a few questions about where you are from and what library you work for and that will direct you and link you to your library's account. We allow for multiple registrations for libraries. So you can have multiple people in your library all registering on their own all links to the same account. So within the survey portal you see all of everyone's data from your library and the same with the data dashboard. So everything lives behind the registration wall of the Project Outcome website but signing up is quick and easy and again it's free. Great. And just that last sentence to reiterate how much does this service cost this set of resources? Free, free, free. Great. And who is able to? Excellent. That's what I was just going to ask. So this is currently available to public libraries in the United States and also in Canada. Do I have that right? Correct. Great. So those are the important things we want to make sure everybody knows before they walk away today so thanks for clarifying that. We also had a question come in earlier just about the languages that the surveys are available and are they available only in English or is Spanish available as well? We currently have the surveys available in English and Spanish and we know some libraries are requesting other languages. We haven't really grasped what the strongest need is for certain translations so we're still gathering feedback from our users so we will be adding other translations in the future. All right. Now one person has asked a question about the staff time involved and of course we're looking at small libraries today and staff time is always a concern there. So do you have any indicator on how much staff time is involved in entering data from what you've been hearing from the small libraries using it? Is this something that a small library would be able to approach on a smaller scale? Yes. Project Outcome was specifically designed for libraries of all sizes, small, medium, large. So we know that small libraries have limited time, limited staff time and capacity. So the great thing about the survey portal is it kind of forces you to plan and think ahead. So if you go in, schedule your survey, decide in advance which programs you're going to measure, print out your survey or get your digital link. You'll have it ready to go. If you use the digital surveys, there's no data entry on your end. It automatically populates in your reports. It automatically populates in your dashboards. If you are collecting paper surveys, we give you an extra week after your survey fielding date is closed to enter all of the data manually. And to enter the data, it's super easy. The screen looks like the digital survey. So the staff would have the paper surveys go in to enter the paper surveys, and it looks like they're just completing the online survey themselves. So there's no Excel work. There's nothing. There's no additional confusion. It just looks like you're completing the survey online. You click submit, and that will also populate all of your reports and all of your dashboards. Excellent. So the goal being an easy to use tool for libraries of all sizes, including smaller libraries with less staff available to work on it. Sounds great. Now you mentioned that the surveys could be entered from paper, and someone has asked a question, are the surveys printable? Clearly you've just answered that in your last response, but could you tell us a little bit about both the ways that people can access the surveys for printing them out and also for access on a computer or on a mobile device? So once you go into the survey portal and schedule your survey, you'll choose which survey topic you're going to measure. You're going to answer a few more questions about your dates and which programs you intend to measure. And then you'll be able to click a checkbox and link that will give you a PDF download of the paper survey. So the surveys do not live on the Project Outcome site, and that's done on purpose so that libraries know ahead of time that they can't just print out the survey, hand it out, go back in, and enter data for that day. They have to plan at least the day in advance through the survey portal. When you schedule a survey, you automatically get access to a digital link. And they're really easy to use. We heard from small libraries that they were able to just put the URL in on an iPad and have patrons complete them while leaving the program or the library. And that all lives within your survey portal dashboard, the screen that I showed earlier. And you just copy and paste a URL. So whether you're putting it on a desktop computer after a digital learning course, or if you're putting it on an iPad or an iPhone, however you want to use the digital survey, it's super easy. You just copy and paste. Excellent. Well I think we have time for one more question, and then we're going to hear from Robin who's going to actually tell us what it's been like in a smaller sized library to be using project outcome surveys. So we'll hear about Robin's experience. But I also just wanted to share a comment from Peggy saying that they especially want to apply this, or interested in applying this to writing grant applications and final reports for grants. And so when you think about using the outcome results, I think that's another great example of how this outcome measurement data so Peggy thanks for sharing that. And then the last question I'm going to ask right now, and then we will have time for more questions and answers at the end of the session so please continue to send them in, is a question about survey fatigue, and this comes from Creed. Of course we know that our patrons in our libraries are bombarded by many surveys in all different directions, and that can cause what is sometimes referred to as survey fatigue. So Creed's question is how does one ask the relevant questions without overwhelming? And Samantha I thought you might be able to tell us a little bit about the questions in the project outcome surveys and how those were designed to perhaps be more manageable for library patrons. So could you respond to that? Yes. So we all know about survey fatigue. We'll probably be surveyed after this webinar. And the task force knew that too. So going in they knew they wanted the surveys to be short and simple and easy for patrons to complete. So that's why they limited themselves to four major patron outcomes. So knowledge, confidence, application, and awareness. We know that libraries want to collect everything as long as you're surveying someone. You want to ask them 100 questions about how they learned about the program, where they're coming from, their demographic information. But that really limits your response rate. And what we're trying to get here is a high response rate. So you can add an additional question but you can't collect it within our tools. So if you're going to add an additional question it needs to be outside the project outcome toolkit because we specifically designed our surveys to be aggregated so that you could talk about data over a long period of time. All right. So that gives us a little bit of a window into project outcome tools and resources. And Samantha, thank you for sharing that presentation with us and also for answering some questions. We will have more time for questions at the end. But right now we want to move on and hear from Robin. So Samantha, thank you again. Thank you. And we'll have you come back on at the end for some more questions if we have time. Now I did want to share an opportunity that project outcome is gearing up for. If you are attending the ALA annual conference in Orlando in late June there will be a free project outcome enrollment workshop that you will be able to – in that workshop you would be able to learn more about how to use project outcome in your library and learn at a deeper level. Now this workshop is free but you do have to apply for it and space is limited. So I know we're going to share that link for you in the chat. In fact we already have. The deadline to apply is May 22nd and space is limited. So if that is something you're interested in doing you'll want to check out that link and we'll include that in the archive as well. But a great additional opportunity for free training on this project. Now let's hear from Robin who is going to tell us about how they did things at her library in using some of the project outcome surveys to measure outcomes. Robin. Thanks for including me. So I'm just giving a little bit of my bio here so those of you who work in small libraries can see many hats. Adult programming, marketing, publicity, IT, great partnerships, basically whatever my director asked me to do. Jack of all trades which I suspect many of you experience as well. And then I've always heard you should always include a baby or a puppy in your slideshow so there's my baby. And to know a little bit about Calvert Library because I guess the definition of small library can vary. This is us where for locations plus mobile services department we serve a population of 90,000. Our circulation is a bit over a million per year for a whole system. We own about 350,000 items and in a typical day we have at our main library we have about six to seven staff on the floor at once and about two to three staff on the floor at each branch. So that's sort of what we look like and what I think of as small. And then our county bio. We are an agricultural community. We used to grow tobacco, a long time history, and that was followed by rapid growth where a lot of folks moved in. We're within commuting distance of Baltimore, D.C., Annapolis. Some folks go south to Northern Virginia, et cetera. So we have a really a mix of farmers and city folk in our community. It's about 62% of our population actually commute out of the county for work. And I've heard that what you do for fun defines you. So that kind of tells you what our community is like. We love farmers markets. So just an overview of what I'm going to talk about today and that is that there are four different surveys that we've done through project outcomes. And I'll talk a little bit about our methods of implementation for each of those surveys, what we learned about those methods, and then what we learned overall from our survey results. And within that conversation you'll hear about obstacles we had to overcome and so forth. But overall it's doable. So the first survey we did came about because we had signed it for project outcomes. Several of us attended the pre-conference last June. We were super excited to be involved. And then summer happened and summer reading. And we kind of forgot about project outcome in the rush of summer. And then when the dust settled and the kids were headed back to school we thought we should do a survey. So of course we had our summer readers register for summer reading and we had about 2,000 emails from that, email addresses. And so we emailed a link from project outcome to a survey. And we didn't get very many responses. We also sent a reminder email saying please respond. We still ended up with only a total of 61 responding which is only a 3% return. And you heard Samantha say the goal is to get a good return rate. So we kind of learned that that was not the best way to go about administering the project outcomes survey. And what we're going to do differently this year is when people register for summer reading we'll tell them that we're going to do a survey thinking that they'll form this idea of oh, there's going to be a survey and I'll be prepared to do it. And we'll probably send it earlier. Some people complete summer reading within four weeks. And if we're sending it out at the end of August they've forgotten about it by then. So we're going to send it earlier and maybe do some weekly reminders. So that was sort of the implementation piece that we learned about. But 61 results wasn't none. We got really a lot of good information from the 61 people. There was repeated feedback about our software that we were using for summer reading, that it was clunky, that reading log wasn't really fun, not motivating. And we heard that enough that we thought well gee, we need to improve that. So this year we're trying a new software that really gamifies the program. It gives badges and basically we think it's going to be a lot more fun to use. And of course we'll do a survey and see if our customers agree. But it was important for us to hear that from our customers and project outcome was a great way to do that. So the second program that we did a survey for, we learned from our last lesson. This is a self-defense workshop for grown-ups and we had people register again for that. So we had email addresses. We emailed those 15 people and we got seven responses. We emailed them the day after the event. Seven responses was almost 50%. So we thought that was an improvement. The third event that we wanted to survey was a clean up your record. And that was how to get your state arrest record expunged. And we didn't think collecting emails or registration was going to go over as well with this crowd. So we thought we better do a paper survey. And we did consider, well gee, if we have a QR code they could go to a link on their smartphone or whatever. But we kind of were afraid to make too many assumptions about this audience and thought the paper survey was safer. So that's what we did. We did paper surveys. We had 46 attendees. 32 paper surveys were returned. You can see our results there. I know someone asked about how much staff time does it take to enter. We're fortunate that we have a lot of volunteers at the library. We have an older community, an aging community. So it's easy enough to ask folks to enter it for us. Honestly, I don't think it took her, I swear it only took her half an hour to enter it. But it probably wouldn't have gotten done within our week if we hadn't asked for a volunteer and she did it. And it was a great outcome. And I should say I don't pull up any of the reports we've gotten for this before, but the reports are really awesome. So what we learned specifically about this event was that there was obviously a need for this workshop. The turnout was great. The people who responded on the paper surveys were so positive. They loved the presenter who happened to be our prosecutor for the county. They said she gave great information. They understood what to do afterwards. It was highly informative. So it was wonderful for us to be able to tell this professional volunteer. They loved it. It was wonderful. Thank you so much. And to have that specific feedback for her. And then I loved the response that someone gave that was there as hope, which really made it feel very worthwhile. And then we also heard that we should do something similar for folks who have federal arrests. So we are going to do that. So it was, like I say, a good result. We learned a lot. Our fourth program came when we were invited to help with this webinar today. And I thought, oh gee, we haven't done a survey in a little while. Maybe I better check it out to see if there's anything that has changed. So we had a program on April 12th. It's called Connect with Your Children Using Minecraft for Parents. And so for that survey, I knew that Samantha said you have to plan ahead. But about 30 minutes before the program, I went on to a project outcome and said, gee, I want to set up a survey. Discovered that you can't actually schedule one for the same day. But I got around it. We overcame this opposite goal by saying, okay, well, the program is really tomorrow. And now I can print a paper survey right now. So I had surveys available to hand to the participants just my dates off by one day in the system. I would encourage you all to plan ahead, better than I do.  So there are ways around it. So, and then of course I entered the results the next day. And, you know, we got those results. So overall, what we've learned, you know, I think, I feel like we've scored pretty well. And I look forward to, you know, comparing us just sort of to national averages. But areas that we felt we could improve on were the impact on confidence. That people didn't say that, yes, we had a huge change in our confidence levels. So why is that? You know, was it because people already felt confident in this area? Or maybe they needed more hand-holding? So we really want to follow up on that and figure out, you know, what can we do to increase confidence? And then the other piece of, you know, marketing person, this impact on awareness, we seem to not have helped people be aware of other things that the library were offering. And I thought, gee, we should do better at cross-marketing because people that come to a library program are probably going to come to another one if we tell them about it. So that was good information to have. You know, our awareness could be improved. How we've used the data, I've mentioned some of those. We have a real formal plan about how we're going to use it. We're really excited to see what it looks like nationally when we compare our library to other libraries and impact. But overall, we're just excited to be part of a national data collection and just to tell you it's really not that hard even for a small library. Well, Robin, thank you for sharing some of your experiences. And I think it's great to see how you've put this into action in a few different ways. And the question I want to start out with is, do you have any advice for small libraries that are looking at this? Where should they get started? If you were them starting again now, what would you recommend starting with? Well, there are some great videos on the site that you can watch that give you some overviews of how to do this. And we've watched some of them. I admit I have not explored all the resources on the page yet, but it's rich in resources. So I would say find something to watch and get a good feel for it and go for it. Great. And actually to that point I know we've seen a few responses from people who have just in the webinar time today gone on to try and register and a few issues came up. So I just wanted to address those in case you've had them as well. And for those of you who are very eager to get started, I'm glad to hear it. First of all, you do need to get your account approved and that can take up to 24 hours and you'll get a confirmation email. So if you first go in and it's waiting to be approved, know that to watch in your email for that specifically. And the other issue we heard about is somebody who's gone in to try to start one of the resources that had kind of an interactive video content. And if you have a lower bandwidth internet connection, it may be because you've got the webinar going at the same time. There wasn't enough bandwidth there. So if you've experienced that or if you experience it, know that some of the resources are videos and so they take a bit more and maybe to try them at a different time. We certainly recommend waiting until the webinar is over just so that you get a chance to really look at those. And like Robin said, just dive in and give them a try. Robin, I did have another question for you. I wanted to go back to that question of survey fatigue and just see if you have experienced any of that in your library, do patrons seem willing to fill out your surveys or are they expressing any fatigue? And if so, how do you work around that? Okay, so interestingly the paper surveys have been, we've had the best return for those, but you've seen the surveys and they are really quite short. It does not take long at all to answer them. So far really no one has objected. If you look at our return on the summer reading, that wasn't great. But I do think that's because we asked so late if we really needed to have done it earlier in the whole process. So I don't know. I think that it's a pretty easy survey, so I would say no. All right. Well, Samantha, I'm going to have you come back on because we've had a few questions about the administration of surveys themselves and where you might use them. And we had one person ask a question about using the survey tool to measure collection development was the question that they asked specifically. But I think the bigger question here is what types of programs and services can the surveys be used for? Is there a way you could give us kind of a brief answer for that? So what I will say about collection services, the project outcome surveys are specifically designed to select patron outcomes after attending a program for service. And by service I think the science kit example is a good idea of how to measure patron outcomes from a service. So they're not designed for collection. The task force had to really look at what were the easiest outcomes that they could collect, which services should they cover, and they had to narrow it down. And they chose their seven core service areas. But we recommend taking the project outcome questions. And if you want to write your own surveys that measure things like collection, then by all means do so. We're all about promoting alpha measurement in general. It does not have to be restricted to our seven surveys topics or using our surveys. But the surveys are designed for really those programs right after attending a program, the immediate perceived benefits that a patron reports. All right. Another question, Samantha, about the surveys in general is that the surveys you've talked about come at the end of a program, seems, but Kathy says many grants like a pre-survey and a post-survey, and does Project outcome have any type of pre-survey or other survey types besides the ones you've told us about today? So Project outcome does not have a pre-survey. We do recommend libraries to measure the same programs multiple times to try to see if they can compare and contrast differences, but that's not a pre- and post-survey. So we are currently working with the task force to develop the next set of measures, which are not pre-surveys, but follow-up surveys. And those will be launched at the ALA annual pre-conference that we talked about earlier. And those aim to capture patron reported changes after a period of time has passed. So those surveys will aim to answer questions like, okay, you attended a job, a job search program, did you search for a job in the way that you were taught, did you receive an interview or a job offer since then? Those types of questions. If you want pre-surveys, Project outcome is working with the task force and an outside consultant to develop guidelines on how to write your own outcome measures, which will include tips for pre- and post-surveys and skills testing. So those are coming later in 2016. I don't have a definite date for you. The follow-up surveys will definitely be launched at the end of June. But the guideline measures for writing your own and for pre- and post-testing, I'll say fall 2016. All right, great. Another question we got, and I think that part of this may have been answered in the fact that this survey is about programs and not just day-to-day attendance.  So how can a library with a very small population or perhaps small program attendance utilize project outcome surveys? And I think that there's also an underlying question here, which is, is there a number that's too small? Is there a minimum number of surveys to utilize this program in these resources? There's not a minimum number of surveys or a minimum number of attendees for program that you should measure if you are a small library and have small programs and few attendees, then that's fine. That doesn't mean you can't measure the impact you had on those three attendees of your program. Plus, you might have the highest response rate. So we recommend measuring programs not based on the number or popularity, but really what's important for your library's goals to align with your community needs. So if it's a program that you really want to emphasize, you're having an impact on the community and it's a small program, we recommend you survey that program, no matter how many attendees there are. Great. Samantha, I have one more question for you, and then Robin, I'll have one more question for you. We've had so many great questions come in. So some of these we will follow up with later via email. I know Emily's also been answering some directly for you in the chat, but we've got time for just these two more questions before we do a few more announcements and wrap up for the day. Samantha, the question I have for you is really around the idea that when people submit a paper survey and they happen to know the person who's presenting, maybe even if it's an online survey, but you know the person presenting, that people may not always be as honest and that the outcome rating, in this case, they say that the ratings increase substantially when the survey taker thinks that the presenter can trace the source of the survey and so we might not get as accurate of a result. So does Project Outcome have any recommendations for encouraging more honest and accurate responses from survey takers? We've heard this from several libraries. We all know that people who are already attending library programs typically will respond that they love the library, they love their librarians.  We recommend starting off the survey administration process by saying this is not a reflection of me, this is to help the library. All feedback is welcome. Please be open and honest. Your surveys are also anonymous, so I would emphasize the anonymity of the surveys as much as possible. The responses are not tied to any individuals, so they can be as open and honest as possible. We also recommend maybe you leave the room or there's a drop box. Whatever makes the patron feel more comfortable filling out the survey and being honest about it. All right, Samantha, thank you for that. Robin, we have time for one more question for you. And this is maybe from the programming side of it and thinking about how do you use the results to adjust programming when you're dealing with perhaps other people on your team? Do you have any recommendations on that, having looked at the results so far and considered some changes for the future? How do you coordinate that with others working in your library? Yeah, for us it's really about ownership. We ask that is the people that are doing the program take charge of the survey, whether it's that they have actually, we usually will set it up for them or I will usually set it up for them. But I let them know what the different options are and which one seems to be the best fit and that we're going to do it. And then they administer it. They're the ones that look at the data first. All that is sort of, I think it's that ownership piece. Once they have that in hand then they sort of want to do the tweaking themselves. I'm not sure if that answers the question, but that's how I heard it. And that was a great, just from your perspective I think that's what I wanted to provide there was what your experience had been in working with programming staff in your library. So thank you very much. Thanks again, Samantha and Robin for sharing what you know. I'll invite everybody to stay on the line for just a few more minutes as we wrap up here. I know we had a lot of information today and just a reminder that that will come out in the archive email. All of the resources and links that we talked about today will be shared in the archive email and you should receive that by the end of the week. We also have some other webinars coming up that you might be interested in next week on May 2. We have a webinar with some updates on what's new at TechSoup. So whether you are new to TechSoup or have been using TechSoup for years it's a great way to learn the latest product donations and offerings. And then on May 18th we have another library-specific webinar on how to teach older adults digital literacy skills. And this is focused on public libraries and features both a free resource and some good practices for library programming. And you can register for these webinars and view archives of past events at TechSoup.org. We'll have a survey in just a minute. We will ask how you felt about today's webinar and give you a chance to provide us some feedback. So please stay on the line if you can. But before we sign up I just wanted to ask, do you have a story to share? TechSoup for Libraries is always looking for great examples of how libraries are utilizing technology to feature in our webinars and in our blog posts. So TechSoup for Libraries addresses the specific technology needs public libraries and we have a monthly newsletter also where we do that. So if you've got a story to share you can do that at TechSoupforLibraries.org. You can also sign up for our newsletter there to read about stories from other libraries and hear about upcoming webinars. So visit us online there. Please do stay on the line for just a moment longer to take that brief survey about today's webinar. Thanks again to our guests for sharing their expertise today. And I think it was really great to hear about project outcome and the resources and toolkits that are available there. Thanks to ReadyTalk for being our webinar sponsor. And thank you to all of you for joining us today. Have a great afternoon.


Hey guys, it's Nate, AKA the Foot Accountant, and welcome back to the channel. It is no secret that right now on the FIFA 23 market, prices are very, very high. But will we ever have a market crash? Will it come soon? Will it be a while from now? That's what I want to talk about a bit today, because we actually started to see yesterday on Friday with the Future Stars Team 2 release. Some cards started to drop off just a little bit. And I'm talking a little bit like pretty minute amounts, like this Golden Bop is 840, 835,000 coins right now. He's down like 20,000 to 30,000 coins. That's not a crash, that's just a slight drop. But is this a sign of more things to come, or is the market gonna continue in its very high priced ways over the next couple of weeks? And this is just a little bit of a blip on the radar, if you will. We're gonna discuss that a bit today with some other events that are going on. Today on Saturday, we'll also talk about, for the content today, what to expect. We had a crazy flashback leak yesterday. That might be our SBC today, and honestly it would be crazy if EA did that. So we'll take a look at that, and of course talk everything related to Future Stars Team Number 2, SBC's objectives, cards and packs, and the like. So if you're excited for the video today, hit the thumbs up, subscribe if you're new. Let's talk market boys, because it is no secret. Like we said, the market is up a lot, and as expected, Team 2 cards from Future Stars started off in price very high yesterday. Enzo, Musiala were both 2 million coins are now down a little bit now. I expect a lot of these guys to drop further today as they most often do on Saturdays. Now of course, there will be some fluctuations, right? I actually bought a Musiala at the 1.7 flat range, hoping that he can rebound back up and get rare to about 1.9 before he drops off further into today on Saturday, stuff like that, right? You'll have some rises on cards today, maybe in Ketia, maybe Fagioli goes up a little bit, but a lot of these cards will end up being lower in price tomorrow than they are today. So just be careful holding on to them, especially Kavara Dona, he got his price range update, extinct at 800K, went up to about a million coins, and is now down to 830. I expect one more rebound on him, and then his price probably, like imagine how Mudrik and how Alvarez's cards did last week, right? They kind of dropped off a decent amount during the day on Saturday, since these guys have already started to drop off and might not be as much today, but just be careful if you're trying these guys out in a week and leave, whatever it may be, don't hold on them forever, they'll probably continue to drop off into today. But for the rest of the market, yesterday was a pretty mediocre day, right? And as we take a look at some prices like this gold Mbappe, he's actually down, and this is not a good representation of the entire market because other cards are still crazy high in price and not down at all, but some cards are following this trend where you see prices actually being their highest yesterday on Friday before content, and then some of them have just been slowly falling since yesterday's release of Future Stars Team 2. Mbappe is 830, 840 right now. Now, is this the sign of the market like starting to drop and drop a lot? I really don't think so. I really just think this is a start of maybe the end of the ultra, like the peak, like the ultra high prices that we saw, those were not gonna last forever on all of these cards. And I think that's what you saw yesterday and the cards that are dropping off right now on the market are slightly dropping for a number of reasons, right? First reason yesterday, this Alfonso Davies was 360 and he was invested in a lot. People were really hoping that he would rise for when Musiala came into packs. Now, Musiala is very expensive, a 300K left back, linking up a 1.7 link when card, probably a little over invested there. So this card dropped off and same thing happened with Kim Min Jae with the Kavara Dona being extinct. This is a card that people invested thinking they could link to that new card and maybe it would rise because he'd be out and people would have to link him in some way, but this guy was 100,000 coins, went all the way down to 80K, picked two up there and he's now back up to almost 90,000 coins, but panic selling was one reason why cards dropped yesterday like the Davies and the Kim Min Jae. And then again, we see this every single week, this happens, right? There are new cards that come onto the game that replace older cards, right? And Kettia and the Kettilara, two strikers yesterday in the two to 300K range, but especially in Kettia, if you're running a print team, you maybe were using Harry Kane, right? Look at his price. Since 6pm yesterday, a content drop, he has been dropping off in price because people are switching to a different striker. They're changing up their team, they're using Kettia or they're using that new striker, the Kettilara, whatever it may be. Some cards are down because of that as well. And then if you take a look at the rest of the market, I mean, there's some other cards in here that are like, Nate, why is Kula Bali down? He's 565 right now. He was actually lower than this. He was 550, 540, but look at his graph, right? He was almost 600K, went down to 546. Like why are some of these cards down? And I mean, even Saka as well, right? Saka was 300K, he is down, Valverde is down a little bit. It's not just team of your honorable mentions either. If you look through some of the other promo cards, Royce is down a bit, Fred is down a little bit. I mean, even Zlatan, I saw a name on it. Was it like 26 or 27? Yeah, 27, he's down a little bit. I mean, what are the other reasons for why the market has dropped off just a little bit in the past day? Is there really like panic upcoming for, is there something that we need to be worried about? Is it that icon pack? I don't really think it's that. I think it maybe just be a combination of a couple other things. Of course, the anticipation of that big 89 plus prime or world cup icon pack could be making some people sell a few cards to their teams. That could be part of it. And we had the 87 plus hero player pick yesterday. But really what we have to consider with all this is too, I mean, we've had a lot of hype on FIFA with team of the year, even before that with winter wild cards. And then it felt like during this future stars promo, it's kind of just started to drop off like the hype in terms of the SBCs and the content. Yes, the great cool cards are dropped during future stars, not the most meta per se, but there's still really cool cards that we can buy and try out and different players getting a promo card that don't normally get that. But with new other video games coming out and just maybe the content on FIFA lacking a little bit, prices could just be falling off because there's a lack of demand or lack of hype to play FIFA. I mean, that is something that we really have to consider. And I think that could be a part of the aspect of why you're seeing some prices drop on this game at the moment. And that's why I think we're not really like seeing the beginnings of a market crash today. What I really think we are starting to see is just the beginning of or the end of the crazy high prices where prices got way too high for what they really should have been. But it was just because of the way content was, right? Content wasn't that amazing. It really wasn't that interactive. The team of the year prices were so crazy high that a lot of people went and bought other cards and then pushed other cards way up further on the market because of that. So if the market's gonna start slowly dropping from here on out on some cards, right? I still think team of the years are really safe. I still think a lot of cards, even that Neymar are really safe cards unless EA does something crazy or like our Neymar Road to the Final comes out specifically for Neymar. I feel like the market's still in a really safe spot. And what I'm trying to tell you today is not to panic sell by any means because I feel like the market's in a safe spot. But I'm just trying to say, if you value your coins so much that you want to sell your card at the peak price possible, I think we are ending that, how much is Neymar's in for? 900K? Goodness, me, that's crazy high. Stuff like that, right? That card was like $600,000 in coins when team of the year was around here. And now he's 915K, like that's pretty wild. So if you're trying to sell your cards and get the best possible profit that you can get, then maybe this is the time you think about offloading a couple cards from your team and just knowing that they will probably not be this expensive again. But if you're like, I bought Neymar for 650K, I don't care if he drops to 750 in the next two months because I'm gonna use him in my team, that's great as well. So it's up to you, it's kind of a personal decision. I'm not expecting a really big market crash anytime soon because there's no real catalyst yet. The only thing that can make the market really drop off a lot, the way that I see it right now is people just deciding that they want to sell. Because when people start to decide that they want to sell undercuts and panic and just honestly panic for no sense happens too many times on this game when it shouldn't. And that can absolutely impact the market. So that's the only other thing that without any big SBCs or leaks or a promo's upcoming that we're like scared about, you know what I'm saying? Like there's none of that right now which makes me feel really confident still about this market. But you know, if people decide they want to sell that's gonna make the market drop off a little bit because people will start to panic.   We are in a high point, we've been saying it all week but I just don't think it's gonna go from like level 10 crazy high prices to level two big time market crash in like a week. It's gonna take time because there's nothing, no big catalyst we've been saying, right? To make that happen. So that's kind of what I'm thinking with the market right now. Be careful today, there's a lot of anticipation for some market crashes. You saw me look here at the Yaya Torre World Cup. There is some anticipation of price drops on some of these cards. World Cup heroes like the Lucio, like the Yaya Torre, like your top tier most meta cars, maybe some team of the years a little bit but just your pro level cards. You know, I think about this Mbappe, like the team of tournament Mbappe is one of those that pros are using. Six mil, goodness me, there's only two of them on the market but stuff like that could drop a little bit today because there is pro event qualifiers going on. So just be careful if you have any of those cards. Like I have a Prime Yashin right now which is something that I probably have to be careful with even though I'm trying to flip it for profit at the moment.  I don't think it's going to be anywhere near as bad as it was during team of the year though because of course that time there was like oh my goodness team of the year is coming, prices are going to drop, sell, sell, sell. So just watch that and be careful with that today but that's kind of how I'm feeling about the market. I wouldn't really be scared right now. I would just say notice the drops but don't be super duper scared by any means with what's going on in the market. So let's talk about content today on Saturday though. What's up next for this game? Well, first of all, we got to take a look at this leak because this shocked everybody yesterday and I don't think anybody was expecting this. Phil Jones has added to come as a flashback SBC soon. Now add this to the list of SBCs that we have leaked. I believe we still have that. Future stars Taram, Holidgang, center midfielder from league one, the French center midfielder and we also have a moments Yovetich that is still leaked but last year on this very day, this is a trip down memory lane. Last year on this very day, we had the flashback Neymar released. Yes, it may seem like a really long time ago and this seems like a big downgrade over a flashback Neymar but that was this day last year and it actually caused the market to crash a ton last year on this day. So just if you remember that or not but this is a crazy SBC idea. Like again, foot share for leaking this is like EA has to be kidding, right? We don't even know if this is serious or not. Phil Jones's regular silver card has like 28 stamina and 37 pace. So they're gonna have to give him a huge boost but this is just an interesting one and it might be a fun card, might be a meme who knows but we'll watch out for this SBC maybe being today but also those other leaks that I mentioned I would expect to see some sort of player SBC today on Saturday, right? The Friday, the Saturday player SBCs are kind of almost a given so I'd expect to see that. I would also expect to see a brand new token challenge. We've got future stars challenge and I gotta get that one done before it expires but we had a challenge yesterday, challenge number five. I would expect to see another one of those today but other than that, it might be a pretty quiet day. I'm not expecting too much else other than that. Maybe one of our last objectives. I mean, the Academy objectives seem to be on kind of a schedule. So we had Jacob Ramsey yesterday which is a lot of games in a friendly mode if you wanna go and do that. I don't think we got Anthony Gordon till Monday of last week. So maybe the Neurotavars that we have, the other Academy leak that we have right now that might not drop to Monday we'll have to see but I think it's gonna be a pretty quiet day today on this game in terms of the content. Now speaking of quiet days, I know one thing that a lot of people are looking at and looking forward to is investing in fodder because we have that 89 plus pack on the horizon and a lot of people are thinking about that. So where are we at in the fodder department? Well, yesterday with the refresh of the 87 plus player pick fodder actually went up a little bit not crazy amounts, but your 84s are now at $5,000 in coins after they were about 4.7K yesterday. Yeah, 4.7K, 4.8, they kinda spiked around content to 5.7 and now they're back down. Honestly guys, I still think this is a decent time to buy in on fodder because we have this big SBC upcoming and we have a lot of SBCs still in the game, more player SBCs upcoming like the Phil Jones that we just talked about and we saw leaked. Like I know that fodder prices are up. They are very high overall. When you look at 84s being 5K, that's up a lot. 85s, 13, that's up. 86 is being 18K on the grand scheme of things. They're usually like 12 to 13, right? And we've had some really high fodder prices in the past couple of months. This is just a normal time of the year for fodder to be very high. I think it's not a bad gamble or a bad risk to go in on some of these cards. Now the prices are just a little bit up from where we really wanted them to be, but if you try to get some on bids, I think I would focus in the 86 to 88 range because with the 89 plus icon, that's what we're kind of investing for, right? And there's a lot of people investing for it as well. So maybe you don't go like all in on fodder. Maybe you do if you really wanna risk it, but I mean, there's gonna be a lot of investing for this icon pack. I mean, we saw people buying cards even on Thursday. Remember when the pack code was dropped? We saw these 87s go from like 22K to like 25,000 coins and a big spike and now they were back down. So yeah, try to get some of these guys on bid. I mean, I know the prices are up a little bit, but I guess that 87 plus yesterday with the refresh and just the combination of not many people opening packs, I was expecting fodder to drop down a little bit more tonight or Friday night into Saturday as I thought it normally does and it usually does, but I did it this time. And I think that 87 plus is to blame and the quiet day of content in general to blame. So fodder prices are still up a bit, but I think they will end up going higher. So I think fodder is investable. I'm gonna be careful myself and probably not invest too much, but that is something that is there that we have to kind of keep an eye on for today on this game. Now, like I mentioned, I have the Ashen. Let's talk through some trades, right? With some of these future star cards because I do believe a couple of them will go up today just because people wanna try them out. And one of those cards is Eddie and Katya. Ooh, he's actually going up already. I picked up in Katya's for 235 to 237 and it looks like he's about 250K. I remember that when the Harry Kane card came out and the team that your honorable mentions his card kind of exploded like the day after he was released. And I think what it is is just people wanna go out and try a brand new card, especially if it's a Prem Stryker, especially if it's an English Prem Stryker, there's just a lot of demand there. As people wanna easily plug and play that into their teams. So I think that and Katya card is gonna rise up very nicely today. As I mentioned as well, I've been trading a lot with this Jury and Timber card and there's a lot of hype with this Timber because of his brother's SBC that was released earlier. He's like 320 at the moment. So he was 340, still a very rare card. I'm probably gonna sell him as he is pretty rare. I mentioned a Musiala as well. I picked up a Musiala at 1.7, hoping that he can get really rare and go back up to about 1.8. Still getting listed at the moment. So we'll keep a close eye on that but that's kind of where I'm at with him. I think these cards will have a couple fluctuations into today but then drop off a little bit. And just talking about this team in general, just kind of an overview of yesterday's content. I mean, this team too, right? The whole question was team two, greater than team one now with the cards in the game. Team two, it looks good but does it look insane? Not necessarily, like it just kind of feels mid. Kind of like the whole Future Stars promo has felt. And you know, yeah, that's just kind of how it feels to me. I don't know about you guys but that's how it feels to me. The SBC yesterday was the Decaturera and this is a really interesting one. The player pick here was what surprised us all. I know it's a big decision. This is one of the tougher decisions we've had for like a dual threat player pick, whatever it's called, dual potential. Decaturera left wing with five star skills but less stats overall. Or the striker, four star with the five star weak foot. Man, five star skills in this card would be so much fun but I think I would end up doing the striker with the five star weak foot just for the bigger and better stats and the fact that it could be lengthy on a marksman. So I watched the Inception review and Inception did the striker version. He thought it was a really good card. So, you know, 300K for this guy. I feel like if he was on the market, this would be a round. What his price would actually be.  I feel like this is pretty accurate for what his card would be on the market. He's got AC Milan links, which are pretty good links, especially in this year's FIFA. That's not an undervalued SBC at all. I think it's a WSBC GG's to EA for that one. And then the Jacob Ramsey card that we had yesterday, it's just a lot of games. Again, these Academy objectives, they really make you work for it. They really do. And part of the reason I have an issue with this as well is, yeah, you can get this Jacob Ramsey here for playing all these games, but you can almost get the exact same card, just a little bit worse by going on the market and buying Joe Willick for, you know, what is he, like 30 or 40,000 coins. They're not exactly the same card, but they're both Hulet Gang with all 80 stats. And they're similar enough to me to be like, okay, I would just rather go buy the card at the market if I was trying to, you know, buy somebody of this type of player. So that's why I'm not a huge fan of that.  You know, you can go ahead and get him in that way. But, you know, honestly, yesterday just kind of felt mid once again. And I think that's maybe why you started to see the market drop off just a little bit. Again, as well as I feel like some people are seeing this content and like, man, I'm not about it. I think this content is just so mid that maybe I'm not playing FIFA as much anymore. And we mentioned as well that the Hogwarts game is, you know, it's not quite on the same level as like Fortnite in 2018, but it almost feels in the same way. Like when has there been as big of a game, maybe besides like Warzone during COVID that like pulled people away from FIFA at the same time that FIFA was really going on. It was really, really kind of hot. So, you know, I think that and just the combination of the content being a little bit lackluster, we're, you know, inevitably going to see some market drop offs, but that's why I want to have that conversation today and talk about stuff because, again, all comes down to your mindset. If you don't mind not selling at the absolute top with the highest price as possible, then keep holding. But if you do and you want to sell, then I think now is kind of like the end of those peak prices for a lot of cards in this market. So I know there's a lot of different cards in a lot of different places, but in general yesterday, the one thing that I saw in common was a lot of cards that were very, very high just stayed at the same price or maybe dropped off just a little bit. And that's how I felt like yesterday on this game way. I did have a couple of nice flips yesterday. I bought a Zidane for 1.22. This is the messy I bought on Thursday. Wow, I never even noticed. I got a lazy bid on that one, 1-6-3-5. Bought that for 1-5-flat. Arajo, I lost about 10K on on a flip because I just wanted to get some coins out to buy other stuff. Timber, this is the big one, right? I bought this at 3.46, sold at 4.99. And some other small flips in here. And then this is what I have on the transfer list at the moment, the informs. And then I need to relist my Yashin. I'm gonna list at 7.40. Try to collect some profits there. And then hopefully we see a few rises into today on some of these future star cards where I can cash out, take some coins, and it makes some more profits. So it's gonna be an interesting day today. We'll see how with quiet content, potentially the market moves. And if there is panic, but I'm not expecting a ton because again, what's there to panic for right now? Not a lot. So if you enjoyed the video today, smash a thumbs up on it, comment down below if you have any questions and subscribe if you're new. It has been Nathan Foot Account and I will catch you guys later. Peace out.


Hello everyone, I'm Keith Schreen and I'd like to speak today about creating an inclusive digital community. I am the author of Corporations Compassion Culture, Leading Your Business in Diversity, Equity and Inclusion, published by Wiley in March of 2021. Also, I am the host of Refinitiv Sustainability Perspectives where we talk to institutional investors, C-suite leaders, and others in the sustainability ESG and D&I space about how to move our sustainable communities forward. And I am the director of risk and environmental, social and governance partnerships at Refinitiv. So what I know well is partnering, is collaborating to move toward a goal. What I also know well is risk. The damage that risk can do to our businesses, the damage it can do to our marketplaces, and also how can we take risk and build opportunities from them. In today's digital environment, in our remote workplaces where we have days filled with Microsoft Teams meetings and Zoom coffee breaks, there is an overwhelming need for social capital that's primarily gained from one-on-one interaction between colleagues, between manager and employee. Now when we don't get these interactions right, when these interactions don't lead to productivity, there's an inherent risk there to our business, to our profitability, and even to our relationships. An actual digital remote community, which is what we're living in now, it requires deliberate effort toward exemplary treatment of colleagues, of those in our communities. That's what I'm going to speak about today. I'd like to first share with you the ideal, the aspirational goal of what an inclusive digital community can look like. From there, we'll explore the benefits of an inclusive digital community. And finally, we'll commit to a simple four-step plan to build an inclusive digital community. Those steps, we're going to start right now. The first one is committing to introspection and core principles. Now, I first want to talk about the notion of community ship. What does it mean to have a community even before we get to the introspection piece? There was a 2009 Harvard article, Harvard Business Review article, and it talked about the term community ship, and it defined it as the space between leadership and collective citizenship. And at its center, it talks about the need for leadership to not be egocentric, to not focus on a top-down framework. Instead, it's leadership that includes reaching out to employees, not reaching down to them. Leaders welcome. They invite. They engage. What happens when communities feel disengaged versus when they feel engaged? Let's get to the engaged first. According to a Gallup report called What Is Employee Engagement and How Do You Improve It? Engaged employees and teams experience a 17% increase in productivity. And for those of you in sales, this will resonate. Engaged employees in sales experience a 20% increase in sales. So when we talk about productivity levels from engagement with employers, with employees, with our entire business community, business rationale behind this is clear, not to mention the social aspect of it. But this isn't just true in the employee level. And I don't know if you, how many of you have heard of the role model effect, but essentially, it says that when we see someone who looks like us, or is really like us in some way, that it makes us feel validated and that it empowers us to ascend in business careers or in political careers or whatever industry you're interested in. And I can talk from experience there. When I was a young child, I would be so enamored with watching Oprah. 4 o'clock p.m. Eastern Standard Time, 3 Central Time Monday through Friday. And I loved her work. I loved her mission, the people that she brought on. It just seemed fascinating. But what was also fascinating is that Oprah looked so much like me. She was black, like me. She was a woman, like me. And she also lived in a state where I was born. She lived for a time in Tennessee, just like me. And because of that, I felt that I really could achieve some of the things that she achieved in the areas of writing and in the areas of journalism. That's just one example of the role model effect. I've experienced this myself and for many of you have. So if we look at that aspirational goals, particularly those of us who are in our careers and people who might be a bit more junior, looking to senior management, looking to executive teams to understand what they can do, how they can progress. Let's take a laser focused view into that and let's talk about the benefits of that sort of engagement. We find that at the senior levels where we have the impact of the role model effect where junior employees can look at those senior level employees. We see that there is a disconnect. We see that in an environment where senior level employees are that there is unfortunately a lack of a lot of diversity in those senior levels in those business communities. As a matter of fact, a 2019 McKinsey study found that executive teams that were in the top quartile in terms of the numbers of diversity around culture and ethnicity and race, they outperformed those companies that were in the bottom quartile by 36% more profitability. Those teams saw 36% more profitability just based on who they had in their leadership in their community. Now let's look at the role that equity plays in your community in a community building. According to a lean in survey women in the United States make about 18% less than men, but for women of color, women like me, the disparity is even greater.  Asian women make about 90 cents for every dollar the white man makes. Black women make 62 cents about for every dollar a white man makes. Native American women 57 cents.  Now we talk about engagement and employees really showing up enthusiastic about what they do and how that can translate into engagement and sales and productivity. But when we have such a large number of our communities, essentially all women in our communities who are experiencing such a lack of parity. To this extent, this greatly damages our efforts toward community building. It's also a risk to our communities. As I mentioned before, I am a risk professional and one of the key risks that firms and businesses and units and departments communities. The biggest risk they experience is reputational risk. Investors are those individuals who are buying stock into our companies, as well as institutional investors those huge pension funds and, and mutual funds who are buying large amounts of stock into our companies. They are a reputational risk. And if they see those types of behaviors around pay parity around lack of inclusion and lack of engagement and diversity at the senior levels. Sometimes they consider not investing in companies. That's a risk. Also, for those of us who are interested in having the best and brightest in our it departments in our CTO offices. Those prospective employees see those behaviors lack of pay parity lack of inclusion, and they may choose to not become part of our talent pool. That is a risk to our communities. And finally, very importantly, our customers who hear about perhaps lack of engagement from employees hear about pay disparities lack of pay parity. And those customers who choose to disengage because their values are not aligned with the values of a company that considers to continues to condone these unfair practices, those customers can disengage. We're hearing a lot about those customer groups and the values that we're seeing now of millennials of Gen Z of some Gen X. And as these people these demographics continue to grow continue to purchase continue to invest with a value with their values heart placed with that sort of inclusion. That presents a risk to our business when we have demographics of people who have different values than our business that have particularly as it relates to inclusion and diversity and equity businesses must get this right. And the way they can get this right is through their communities. So now we're going to talk about introspection I hope I've clarified goals around what a digital community can be the aspirational goal. As well as the business case for why there are benefits for an inclusive community. And now we want to talk about introspection. First we have to do the introspective work that's the first step to get to those inclusive communities. Leaders have responsibility to serve and support their employees and to do so effectively will acquire some introspective work. And this means examining our own biases are motives are agendas why do we do what we do why do we behave in the way that we behave. Now this step is often overlooked. In paper of what I call the more practical questions we ask ourselves and that could be how can I enhance this product. What type of integration do I need for this new product. How can I build out this API. Those are questions that many tech leaders CTO officers IT officers ask themselves and whereas they are important questions. We also need to analyze our actions in the same way that we analyze our products as leaders were often asked to analyze and think about how other people can improve how processes can improve. This step asked us to ask ourselves how can we improve. Successful leadership requires this analysis of our behaviors and it's important to take a judicious approach whether we're talking about looking at our products or whether we're talking about looking at ourselves. Regular introspection helps us align our actions with our personal truths and helps to reinforce confidence in our abilities to innovate and to make decisions and to execute ideas. We're able to do that because we're clear on what our agenda is and we can align that to the company's agenda. In 2017 Boston Consulting Group article explained that critical thinking lead CEOs and addressing immediate challenges, but reflective thinking introspective thinking that helps leaders clarify the big picture. And isn't that what we really want to focus on as leaders, as the ones who are building our communities, the big picture of where our communities can be the aspirations of where they can go. Regardless of the size of your community. And of course, in this context I'm talking about communities as in our teams, our business units our departments regardless of the size. We're still leaders and we still have to act like leaders and think like leaders. Doing this introspective work allows us to think about fairness and equality and how we treat those in our communities. Whether we're supervising two people are the managing director of 200 people, we have to understand what we're doing well where we are really showing up for that equality and treatment and equitable treatment. And where we're challenged where we need help. Now how can we do this, we can do this one way to do this is by asking our colleagues, asking our leaders are executives even asking our direct approach, direct reports, how are we showing up. For example, we can ask, send a survey of examples of when we made other members of the community feel valuable. When we were willing to share our roles share our power in terms of our roles as leaders. When did we show up and treat something equitably are make a decision that showed that we were focused on fairness. Now conversely, we can also ask our colleagues and direct reports and leaders, where are we challenged, where have we made decisions that just didn't seem fair. When did we treat members of our communities in a way that was not equitable or in the way that maybe led them to believe that they weren't valuable. This introspective work. No, it's not easy hearing feedback that shows that there may have been times we weren't entirely fair. Of course that's not easy to hear. But this is the work that we have to do to create our inclusive communities introspection. That's number one, the first step. The second step is collaborating on our goals. That's the second step in reaching an inclusive community. After introspection, we have to focus on achieving our goals to really build a community. And the first step here is to constantly review what you want to achieve. For example, what are your goals is your goal to build a community that ensures that pay parity is there for everyone who does the same job. Or is your goal to retain an increased number of people of color in your business community. Or is your goal to start a mentorship or a sponsorship program. And I just want to pause there for one moment because I know in some cases, some of us are confused or just don't quite understand the difference between mentorship and sponsorship. And in order to have a successful community, it's really important to know the differences in the nuances. So with mentorship, mentors provide their mentees with guidance and day to day advice about reaching goals or reaching ambitions. There's someone that you can talk to that you can confide in. They're considered an advisor. Sponsors on the other hand, now they take a more active role in advancing the professional careers of those that they sponsor. So the sponsors and the sponsors who they support, the sponsors are generally senior level people, perhaps at the same firm as the sponsor. And they use their networks and their professional connections to advance the sponsor through helping them get access to high visibility roles to big projects, as well as helping them secure promotions and secure new jobs. So just wanted to give that difference between sponsors and mentors, but let's get back to our point about goals. So clarifying the goals and really understanding what the success look like to you. How will you know when your objective has been achieved. One way to do this is to bring in your colleagues bring in other senior leaders. Share your goals with them. Get their feedback on the goals. Remember, we're talking about inclusivity and the way to be inclusive is to ensure that you get others feedback so get their feedback on the goals. And you know what, being open to tweaking those goals based on the feedback of others. That is a sure sign of inclusivity, and it's definitely a way to really get those goals accomplished. It takes a community success is not a solo sport and that's why it's important to have an inclusive one an inclusive community that is. Our third step in building an inclusive community is moving with deliberate action I like to say swift action to in here, I want to talk about the re learning process. And the deliberate action that comes with re learning specifically re learning and replacing divisive behaviors. Now there are some biases and conduct that some of us have seen in the workplace that we want to root out that we need to root out to have an inclusive environment. In the past, some of us maybe have even participated in behavior that did not belong in the workplace. Now this behavior might include using inappropriate language when speaking about colleagues are speaking to colleagues. There are unfair performance assessments that don't reflect an employee's work, but rather reflect their physical appearance, for instance. It can also be knowingly paying an employee less money than someone else, even though they do the exact same job. These behaviors are divisive. These behaviors promote exclusion and communities. These behaviors are big risks to the sustainability of our businesses and our profitability. And this step with deliberate action, we've got to commit to removing this behavior from our communities from our culture. This is where we can commit to holding people accountable. When they persist in behaviors or conduct or language that doesn't promote inclusive community. This is where we commit to deliberate action. So holding folks accountable means really to outline what is acceptable behavior based on your introspective work based on your collaborative work with colleagues, direct reports and employees coming to an understanding of what inclusive behavior looks like. And also understanding what it doesn't look like. Sharing that across the community and forcing it and really ensuring that people who do not have the same level of focus on these inclusive behaviors and people who continue and persist in those exclusive and divisive behaviors holding them accountable. That's what moving with deliberate action means. One additional point here, if you are unsure about what actions or behaviors are inappropriate. What actions or behaviors are divisive or exclusive. What actions and behaviors don't belong in your community. Did you have any doubt about that. Look to from the perspective of the person who is the recipient of the behavior of the language of the divisiveness look from their perspective. Let that be your guide. Determining whether the person who's received this behavior considers it inappropriate. Let that be your guide as to what behavior belongs in community. And getting the feedback of people in your community who may not have the high representation level is crucial. Let that guide you. And our last key factor in building an inclusive digital community is measuring progress. We've all heard the saying what doesn't get measured doesn't get done right or doesn't get managed. For instance, measuring your progress and horse correcting if you miss the mark. This is the only way to ensure that we're building inclusive communities, inclusive communities that can grow and that can really prosper and become profitable even more profitable. The tools can be as simple as a survey we're on the scale of one to five employees can answer questions like, has your firm improved on offensive gendered language are, do you see subtle discriminatory behaviors toward people of color are, do you see instances where the second guest more than men. Another option is to give your community members, your employees at your organization, the opportunity to answer these questions in a long form file. This really allows them to give examples of what the issue was of when they experienced the issue and how it made them feel who want to be inclusive, we need to understand the importance of the person who experienced this. How did it make them feel, including those sorts of things on the survey whether it be a short one to five ranking or whether it be a long form, we really need to understand where we stand there. Now measurement can also take the form of outlining the percentage of say women senior leaders that you want to have in your organization over the next 12 months, 18 months, five years, doing that as well for people of color. We can also talk to firms who have accomplished these goals. There are loads of firms who speak about how they were able to accomplish a certain number of women in the executive roles are numbers of people of color in the executive roles, really getting insight from the folks who've accomplished it and letting them support you in building the goals and really understanding what success looks like and understanding how they measure the goals is another way to get to this inclusive digital community. So there are vendors who can support this type of measurements, they're been these types of measurements, there are vendors who create environmental, social and governance ratings of companies. They also build out diversity, equity and inclusion ratings. So these vendors can really help you understand where your firm is now. And obviously that can help you build on to a plan for where you need to be. And also you can look at competitors in your space and see where they are. See where other firms outside of your industry are. Give an understanding of what makes a good firm in terms of their social engagement in terms of their environmental engagement and even in terms of how they govern getting that type of insight that type of data from vendors can help you tremendously understanding where you are now, setting a goal for where you want to be, and then taking the steps talking to people externally talking to people who've already accomplished this goal, letting them help you and support you in getting to your ultimate goal. Now, these are steps that you can do today right now as soon as you in this webinar in fact understanding where your community is now and understanding what's needed to progress the goal. It's that simple understanding those things help you get to your inclusive digital community. Now, we know that measuring evaluating and evolving is the way that we enhance our products, our services, our tech deliverables. Why aren't we letting those tools that measure and evaluate and evolve also help us and support us in reaching our goals toward an inclusive community. The way that we do it and the way that we accomplish it in terms of our business should be the way that we accomplish it in terms of building our communities. As I mentioned, I am a risk and environmental, social and governance partnership professional building and maintaining maintaining is really important. Inclusive communities that are now digital communities is what helps me drive my business forward understanding risks and how I can create opportunities from those risks. It's what helps me grow my business. The four steps to get to the inclusive digital community are doing the introspective work, collaborating on gold, moving with deliberate action and measuring progress. These four steps represent how we can successfully build and grow our inclusive digital communities. I welcome you, your comments, your responses, as well as your questions and overall outreach on social media. Please feel free to reach out to me on LinkedIn, Twitter or Instagram. Thank you for joining me. I'm Kisa Schreen.