In this set of slides, we will talk about network address translators. We have seen that firewalls introduce a single checking point in a network where security policies can be enforced. This logically divides an address space in an internal trusted network and an external untrusted network. There is another method that makes use of the idea of internal and external network and it is typically implemented on the network access router, network address translators. Network address translator, or NAT, is a way to map an address from a certain subnetwork to another address. It was initially introduced for handling situations like customer changing their ISP without having to change their internal network configuration. Nowadays, it is typically used to map address in a private network to a single address on the open internet. For example, if your network is implementing NAT, all the hosts in your home network will be reachable from an open internet using a single IP address, namely the one that your ISP has assigned to your router. The main goal of NAT nowadays is solving or at least lowering the depletion of the public IPv4 address space. Therefore, it is important to understand that NAT is not a security mechanism per se. However, and this is the reason we treat NAT in this course, it indirectly provides a security layer by isolating the hosts in the internal network from the external network. We will see more in the security implication of NAT later in this lecture. A NAT works by accessing and manipulating both NAT work and transport level packet information. Therefore, source and destination IP addresses and ports. Let's see how this is done. Let's assume we have a private NAT work with a router implementing NAT. The addresses in the private NAT work are in the NAT block 10. The router is reachable to the internal NAT work with the IP address <IP_ADDRESS> and the open internet with the public address say x.y.z.w. The overall idea is that all datagrams leaving the private NAT work have the same source IP address, although they will have different source ports. To implement this translation, a NAT router needs to take care of three operations. First, to replace the source IP address and source port of each outgoing datagrams with its public IP address and a new source port. Second, to keep track of this association in an internal translation table. And third, to replace for each incoming datagram its public IP address and destination port with the IP address and port that has previously stored. Besides remapping IPs and ports, NATs also need to decide if an outgoing or incoming connection is allowed. Even though the overall mechanism of IP and port remapping remains the same, NAT implements several type of restrictions. We therefore have full code NAT, restricted code NAT, port restricted code NAT and symmetric NAT. Let's have a look at each one of them. Full code NAT is also known as a static NAT or one-to-one NAT. If a connection from a private IP and port is open towards the open internet, NAT creates a mapping between the internal IP port and the public IP port. Every subsequent packets from the same private IP port will be forwarded to the open internet as the public IP port pair. Let's now consider what happens if a connection with a destination the public IP port is requested. Full code NAT allows every connection with destination the public IP port pair from any source port in the internet to be forwarded to the private IP port. This could mean reply traffic from the just open connection or any other incoming traffic. Full code NAT is the most permissive form of restriction and it essentially is a form of port forwarding. A restricted code NAT or address-restricted code NAT works in a very similar way to the code restricted NAT. But these mechanisms place additional requirements on which external IPs can contact the private network. Same as full code NAT once a connection from the private network is allowed, a mapping for those public and private IP port pairs is created. Traffic from an open internet host received traffic from a host in the private network is always allowed. Note that in this case only the source IP address matter while the port number is not considered. If traffic for the private network reaches the NAT from an IP that was never contacted from an host in the internal network this traffic is dropped. If the NAT also restricts traffic to previously contacting IP port pair then we talk about a port restricted code NAT. Therefore traffic from a previously contacted IP port pair is allowed but traffic from that same IP but from a different port is blocked and so it's traffic from a different IP. It is important to notice that in this case the mapping between the private network IP port and external NAT IP port will remain the same for each time that the internal IP port will be used to contact any destination on the open internet. Assume therefore that this mapping has been creating and therefore this incoming traffic is allowed as we have seen before. In the same private network IP port is used to contact another host in the open internet then also this traffic will be allowed using the same mapping. If we want to specifically take into consideration which destination in the open internet host in the private network is talking to this case is covered by a symmetric NAT. In a symmetric NAT we have again that the main driver for creating a mapping in the translation table of the NAT router is a connection initiated by the IP host in the private network. And again incoming traffic is allowed only if the initiator of the exchange was a host in the private network. We are not showing incoming traffic here. However the destination host on port will be instrumental in creating a mapping for the NAT translation table. For example if a second connection is generated to a different IP and or port this will be stored in a different mapping. The major difference between port restricted cone and symmetric NAT is therefore in the mapping creation. We should also add that nowadays it is not that easy anymore to classify NAT in one of the above classes. And vendors can also implement variation of the above. I believe that the most important aspect to remember in case of NAT is the mapping between the internal and external NAT work and that they will reuse refuse incoming connection if a mapping is not yet present. And from a security perspective also that they will accept incoming traffic if a mapping is present. It is now time to discuss the security implication of NAT. Although designed with a different goal in mind NAT can however provide a sort of security bonus for a network. This is the case for example where NAT accepts incoming traffic only if an internal NAT host is contacting a certain external host while any other traffic will be dropped. However we should be careful here this is not a security feature. Blocking unwanted incoming connection is due to the fact that there is no mapping for the involved host in the NAT table and it is not due to an intentional security policy. Therefore although NAT might as a side effect aid in hiding the internal NAT work it does not implement access control and therefore it does not replace a firewall. Also once a mapping is in the NAT translation table traffic is allowed into the network. The underlying assumption is that this traffic is okay because an internal host has first initiate an exchange but this might not be the case. This in practice creates a hole in your perimeter. It is important to stress that a NAT is not a firewall although incidentally both create a checkpoint for the traffic entering and leaving the internal network. Their main functionality is different. While a firewall will inspect the packets to implement the access control NAT will only map internal and external IPs and ports. We can therefore say that the goal of NAT and firewalls are inherently different. NAT devices are also often criticized because they do not respect the protocol stack layer separation. NAT is implemented in routers which are network level devices. However NAT manipulates both network layer and transport level information in a packet. NAT might also interfere with the functioning of several applications especially the one relying on random ports. Thinking about forensic a NAT can also interfere with finding the region of malicious traffic. Once a NAT work is behind a NAT traceability of security incidents becomes a problem. Although one might rely on logging of NAT mapping in practice this is not done meaning that it is quite difficult to identify the host originating malicious traffic. Last for this list NAT may reduce the port entropy in the traffic visible to the open internet. This happens for example for NAT implementation that uses only a range of ephemeral ports for example ports higher than 50,000. Reduced entropy in source ports becomes a problem for protocols that uses port randomization for improving security. For example we have seen that a DNS resolver must use an unpredictable source port and an unpredictable query ID as a mean for protecting against cache poisoning attacks. If NAT remaps queries to a smaller range of protocols the protocol becomes more susceptible to cache poisoning attacks. The picture you see in the slides shows how in practice we are confronted with this issue. The figure is based on data collected at one of the authoritative name server in Surfnet and it is a scatterplot of the query ID on the x-axis and the source port on the y-axis. If those two parameters will be full random we should see only a noisy uniformly distributed set of data points. However there is among other anomalies a distinctively denser zone in the higher range of the source port for which NAT is one of the most likely causes by remapping outgoing queries to a port range roughly between 50,000 and 65,000.


A lot of non-hubing characters from children's media have their gender left ambiguous intentionally, presumably so that as many kids as possible can relate to the character they're viewing. However, the reason behind Gudetama's unknown gender actually makes perfect sense. Gudetama has no gender at all, because it's literally an unfertilized egg and therefore can't have one. As far as pronouns go though, Gudetama is typically referred to as it, However, it should be noted that for some reason the Hello Kitty YouTube channel refers to it as him. He him. He him. He him. Someone's getting fired.


But how do people experience you as a leader? And how do they experience themselves when they're with you? I am convinced that right now in this world there's two types of people. There are the people that constantly and consistently see the problems. That you've been in any situation, any constantly complain, they constantly look at the bat, they constantly focus on what's not right. But then there's the person that constantly and consistently sees the opportunities. Call them an optimist at heart. They choose to see what's good about a situation. And that's what great leaders do. In my research and everything that we've done for the last four years in the undercover millennial program, we have found that nobody wants to follow a pessimist. People that are really loyal to people, those people genuinely have a sense of optimism about them. They create hope. They create an environment where people go, you know what, I experienced my best selves because of you.


Hello and welcome to E-Liv 2019, the International Congress for Automotive Electronics, being held here at the World Conference Centre in Bonn. Now, Audi AG are known as one of the most innovative car makers when it comes to exterior lighting concepts. They make some seriously cool stuff. Here on the ST stand we have a brand new digital OLED technology demonstrator, the result of a long-standing collaboration between Audi AG, OLED Works and, of course, ST Microelectronics. As you can see, there are some pretty amazing and dynamic lighting patterns and signatures. And thanks to the groundbreaking technology all three parties are bringing to this project, this is just the start. So, let's begin by having a chat with Audi. Dr. Michael Krupper here is head of rear combination light development or head of tail lighting if you prefer Audi, so just the man to talk to. Michael, why are you as a car maker so excited about this new lighting technology? Well, quite simple. This is the most perfect light source you can take in a taillight. So coming from every individual segment which you can turn on and you can turn off like you see here, you get the best perfect contrast range you can imagine.  This is coming to the second point, how to illuminate and display light structure in the car. You want to have a surface light source and this is what you get with the OLED. In the end, if you would do the same thing with an LED, you would have a point light source and you have to do something weird to spread the light inside and you're losing a lot of photons. This is bringing me to the third point of discussion is the optical efficiency. We want to turn the electrons into photons in the most efficient way and this is what's happening in the OLED. You don't lose electrons in the car, you transfer them into photons and you create gorgeous looking light. Yeah, I love the technology. What about me? What about me, the driver? Well, quite simple. It's amazing. So if you have something like this in your car, all your neighbors will get jealous. If you look on the car when you're driving out, you might have a different signature of your tail light like your son or your wife, so you can individualize, you can personalize the light. By simple means like using an app, using the HMI in the car, you can play around with the car. But there's another point. In the end, what we can do with that is to use information from the car to communicate with the outside world. This is what we named car to excommunication. So the car is getting a signal like you're approaching a traffic jam and it automatically starts to indicate like a warning triangle or whatever. You don't realize this inside, but the person following you keeps distance and there's everything safe for you inside the car. Absolutely amazing. Michael, great stuff. I said this was teamwork. Let's go and find OLED works. Fourth Gang Gogh and his managing director at OLED works. Fourth Gang, most of us know OLED technology because of our TV sets, smartphones. What's it bringing to the automotive world? Automotive can use very well our unique technologies. We are known from the general lighting market where we have our panels installed in quite some installations due to their high brightness, high performance. So we are there the market leader. And automotive is with their high standards very interested to apply also our technologies in their real light functions. With our panel shown here with a deep red color point which is very thin so the layers are just couple of 100 microns thick. We can have including the segmentation additional functionality to the taillights which is really compelling and helps then also the automotive customers to attract more customers and all light scenery are possible. And what have been like working with ST? Working with ST was very very beneficial for us because we have a driver expert that helps us to develop and produce an automotive complying driver for usage with our panels. And the OLED panel plus the driver is a system which can be easily integrated also in other applications.  I've been joined by Nicolae Liberace who has been at the heart and soul of this project for ST. So Nicolae where does your technology fit into this amazing jigsaw? So Hi Chris, you know, fleshy lights have fantastic, really hemorrhaging, okay? But without I would say a brain, a reliable brain because we are on automotive applications there is absolutely nothing. Where is the brain in this context? The brain is this one, this small stuff here, the L99, LDLH32. This one drives end control, the multipixel OLED array from OLEDworks. And this I believe will fulfill the dream of lighting designer for continuous animation and faster animation. This is why, again, this driver has been equipped with an high speed communication interface, the so-called STF lab. Now it must be amazing working with Audi and OLEDworks. Tell me a bit about that collaboration and also the potential for all of you. This was really fantastic. I have to say two partners, two fantastic partners on Audi as well as OLEDworks. And there is a potential for everyone, for all of three. We as ST, we are in this field, we are marketed here in this field. We are there since ever, since the beginning, since the incandescent or halogen bulbs that you cannot absolutely compare with this stuff, of course. And we say we... Prehistoric, I think. Yeah, it's historic, absolutely. And we really believe that all the technology for the intrinsic capability that this technology has, like the Cat2X communication, the animation, let's say the safety, the enhanced safety, again, automotive. This is a fantastic opportunity. There is very great potential for all of us. And this we trust in this stuff. I can't help thinking that I got my first car 30 years ago and this kind of technology was like science fiction stuff and now it's reality. Thanks to this one all. Nicola, thank you so much. It was my pleasure.


All right Hey, welcome to our two o'clock session two o'clock central time session for big talk from small libraries 2018 I am Krista Porter your your host here from the Drasca Library Commission Next up we have small data can still be smart data how outcomes can help your library And with us is first up Samantha Lopez. Hello, Samantha. Hello. She is a program officer at PLA Public Library Association up in Chicago and along with her is Pam Bonnie. Hi Pam. Hi And she is library director at Winslow Public Library in Winslow, Maine way over on the east coast for us and Together they're gonna talk about a la or PLA is project outcome This is a such a program that we've heard about I've heard about before elsewhere I'm gonna share it with you all today. So I'll just hand it over to you to take it away All right. Thank you so much Krista And thank you everyone for joining For today's presentation on how outcomes can help small libraries Krista already did some introductions, but I'll say it again. My name is Samantha Lopez I'm with the Public Library Association And I'm so happy to be joined by Pam today who's going to talk about her library's experience using project outcome Here's just a quick look at what we'll be covering today I'll go over the importance of measuring outcomes and why you want why we want you to do it What project outcome is and the benefits to libraries and how libraries are using their outcome data? And as I said Pam will also share her library's experience using project outcomes So first I want to take a few moments to explain what we mean by outcomes and why we are helping libraries measure them So for years libraries have gauged success through their patron stories and the core metric has been how often they came back for more But as you know times have changed and so have libraries Intuition anecdotes and attendance counts are no longer enough To demonstrate the value in the community libraries, especially small libraries need more data and evidence There are many data pieces that help demonstrate your library's value You may already be conducting some needs assessments in your community and answering the question What is our community need? You may be doing some patron satisfaction surveys in your library to answer? What should we do better? And you're most likely collecting outputs like attendance and door counts to answer the question. How much did we do? Collecting outcomes is a little bit different. It helps you answer the key question. What good did we do and At PLA we define an outcome as a specific benefit that a patron receives from a library program or service Outcomes can be quantitative or they could be qualitative They can be those stories that you hear and they're often expressed as changes that individuals perceive in themselves And again, they answer that key question. What good did we do? So an outcome is a way to determine the extent to which a program achieved its intended results by Measuring outcomes you're learning what changes effects or impacts your programs are having in key areas such as knowledge Skills attitudes opinions behaviors actions or even status So you're learning did the program positively impact the lives of the patrons? Did it make a difference and how are the lives of the patrons better off as a result? During this presentation I ask that you think about a problem your library needs to solve or is currently trying to solve and how Measuring outcomes can help here are a few examples that we've heard in the past when I've asked this question Libraries want to know if patrons are finding value in their programs if they're actually helping people achieve their goals if they're actually helping people get jobs for example and if there's a way to better show funders that they're being successful and When I do present this in person This is about the time where I see some hesitant faces in the audience But since we're virtual today, I'll just assume that they're there, especially since I'm talking to a small library audiences You may be thinking yes, that's great I would love to measure outcomes and collect all kinds of data for my library But I just don't have the time I'm way too busy and I know small libraries in particular are strapped for time staff capacity and resources Well, the good news is that PLA's got your back with project outcome A majority of the work is already done for you to make measuring outcomes as easy and simple and painless as possible So now I'm going to go into Highlighting what's actually included in the online toolkit and what the benefits of using project outcome are Project outcome if you don't know is a free I'll repeat free online toolkit designed to help public libraries understand and share the impact of their programs and services By providing simple surveys and an easy to use process for measuring and analyzing outcomes Project outcome also provides libraries with the resources and training support needed to apply their results and confidently advocate for their libraries future We currently have over a hundred thousand patron surveys collected into our system So far from hundreds of public libraries across the US and Canada and to put that into perspective We officially launch launched the project outcome website in June of 2015 So we already have over a hundred thousand patron surveys from hundreds of libraries Which is really exciting our goals with project outcome are To make measuring outcomes business as usual for all public libraries It's also to supply libraries with standardized outcome measures that any library no matter the size or capacity can use and learn from and Also provide a user-friendly tool that anyone can use at any capacity the project outcome toolkit gives libraries free access to quick and simple surveys and easy to use survey tool to collect and enter all of your survey data custom data reports and interactive data dashboards for analyzing the results and All of the resources and training you need to help you throughout the outcome measurement process and What we've heard from library users is that the combination of the ready-to-go surveys and the easy to use tools really help library staff Save time and energy in their planning so that it leaves more time for decision-making and advocacy once the outcome results are in And again, it is free free free I try to repeat that as much as possible because I'll still get that question at the end But really how much does it cost no I promise you it's free and everything I'm going to show you today is available to you on the project outcome website at no cost Project outcome surveys are designed to capture four key patron outcomes We focus on capturing an increase in knowledge and increase in confidence Patrons intent to change a behavior or an actual behavior change and their increased awareness in library resources We also help you collect some of that qualitative data We ask two open-ended questions and all of the standardized surveys that are similar to What did the patron like most about the program and what can the library do to improve? And it's these open-ended questions that have been invaluable to libraries Here's where we hear that they gain the most insight into how to help their patrons And they gather that qualitative evidence to demonstrate their value in the community So they're sharing out that qualitative data There are seven survey topic areas to help libraries measure a broad range of programs and services So we have surveys for early childhood literacy digital learning Education and lifelong learning civic and community engagement job skills economic development and summer rating There are several survey types that libraries can also use to measure their outcomes We have immediate surveys that measure patron-reported learning. We also have follow-up surveys that measure patron-reported behavior change And we have outcome measurement guidelines that help you design your own outcomes and data gathering methods to capture longer-term benefits And with project outcome, there's no specific pathway you need to follow. It's really a pick-and-choose type tool You can use all three any combination or just one It's really up to you and your needs and the learning outcomes of the program that you want to capture The immediate surveys that we provide are designed to capture that patron-reported learning and the immediate impact to the program These surveys are the easiest for libraries to use because you just hand them out at the end of a program or series and then you Automatically have their results. So these are the most popular surveys that we see a majority of our data That's collected in the system do come from the immediate surveys because they are so easy for libraries to implement And in this example, this is our digital learning survey example You see that patrons are asked if they feel more knowledgeable about using digital resources If they feel more confident when using digital resources If they intend to apply what they just learned and if they're more aware of resources and services provided by the library And of course those two open-ended questions The follow-up surveys that we provide are designed to capture patron-reported behavior change Change once a patron actually leaves the library These require the library to follow up with the patrons. So they're more time consuming. Like I said They're less less used in the system because they do take time to follow up And you will have a lower response rate since you're kind of narrowing the pool of responses But they will provide some hardier data for you if you do decide to use follow-up surveys Because instead of asking patrons how they feel follow-up surveys ask whether or not they actually applied what they learned So in this example, this is our early childhood literacy survey our follow-up survey For example, it's asking caregivers if they spend more time doing what they learned with their children as As a result of the library program So think of how powerful that data piece could be if you did collect even a handful of surveys that said Yes, I have been spending more time with my child ever since attending the story time. That could be a really powerful message The outcome measurement guidelines that I touched on they live as a resource on the website And they help libraries that want to expand beyond the standardized surveys that we provide So they help you think about if you want to maybe write your own outcomes If you want to think about measuring data over time how you would go about doing that If you want to do something other than surveys if you want to do say a focus group or an interview And it also helps you think through strategies of working with partners And how either you could measure outcomes and share them with a partner or if how you could measure outcomes together with a partner So thinking back to the program that I just kind of listened in on before this one thinking about how you could work together with those Fitness partners and who would collect outcomes and think about how you would maybe Provide the advocacy for your partnership using your outcome results Everything for project outcome can be found on the website like I said the url is project outcome.org really easy to remember As I said registration is free and it only takes a few simple steps to begin Once you are logged in this is what your home page will look like as you can see You have quick and easy access to all of the tools and resources We have our survey management tool our data dashboards. We have all of our training resources We have a peer discussion board and our news and events page I'm going to quickly walk through these tools, but there is more information for you once you are logged on There's a ton of tutorial videos and FAQs to help you learn how to actually use project outcome So this is the survey management tool. It's where you will create and access all of your surveys It's also where you'll customize your program information You can track attendance and response rates Enter paper survey responses download your raw data and view all of your past surveys And we have filters so you can easily manage and sort through all of your surveys and data Here's a snapshot of how you create a new survey You'll walk through five easy steps to create your standardized survey And then you'll customize it with your specific needs and hopefully what you see in the screen In this screenshot shows how user friendly and really simple the tool is The survey tool also allows you to add your own logo So whether you have a library logo or a program logo you want to put If it's something like summer reading that has its own logo. You can put that on the survey You'll include some specific program information like the name and date You could add any intro or thank you messages to your survey And you can also add up to three additional questions of your own So if you already have something that you're required to collect in your library You could simply add it to the project outcome standardized surveys And once you're done, it's really easy. You'll have a pdf ready and available to you You'll also have an online url that is specific to that survey so you could collect Surveys online if you plan to do that And surveys are all available in English and Spanish as well Once the survey is created, you'll be able to enter your paper responses Or view the online responses that have already come in You'll be able to track your attendance and response rates and download an excel sheet of all of your raw data So that's one of the nice things about project outcome is that you don't have to wait for your results to be in You could access them immediately once they're entered into the system You can download and see your raw data The data dashboard is where you'll go to view and interact with your results It's also where you can get your summary reports And here's a snapshot of the report builder tool and different dashboard views for analyzing your results We have this report builder tool it acts similarly to the survey creation tool So it'll walk you through a few steps to choose your report criteria For example, you can run a report by system or single branch You can also choose to roll up all your data by survey topic Or you could narrow it down by a specific program name or even a single survey Once you do select your criteria A report is automatically generated for you. It's already designed and ready to go Here's an example of what it looks like the reports provide snapshot percentages of your outcome scores And comparison averages at the state and national levels As well as program detail information About which programs are included in the report what your attendance was response rate for the survey We also have some community talking points So these are really great communication tools for libraries because they're ready to go like I said And they can easily be shared internally with staff or externally with your library board or community stakeholders And once you have data in the system everything is automatic including your data dashboards So here's some snapshots of what the different dashboards look like And I'll briefly go over them But trust me it's more fun to kind of go in there start a survey enter data and then go in and play with the dashboards yourselves Screenshots really don't do it The overview dashboard provides aggregate scores in each survey topic and outcome type So whether you're interested in just increased knowledge or if you really want to be focusing on Your summer reading results. You can look at your overview dashboard You'll also see state and national comparisons and you'll also see the total number of surveys The matrix dashboard allows you to interact with your results So you can filter soar and scroll over them to see where your strengths and weaknesses are in each of those categories We also have a detail dashboard which shows your results by each survey question. So you can analyze them at a deeper level You can also access your open-ended responses in the dashboard and add them to your reports So if there's that qualitative data that you really want Included in your report, let's say, you know, two really good quotes about From caregivers about how they're spending more time with their kids You can add that and you can view that here in the dashboards as well There's also a library info dashboard. So you can incorporate some of those library outputs with your outcome data And we also have a map dashboard that lets you see how each branch that's participating is doing And if you click a certain library Population size the map will automatically show demographic data. So you could talk about your community impact in those areas And like I said, we have a ton of resources on the website to help you There's no official training Needed to get started with project outcome We have everything from getting started to best practices for data collection to taking action using your results We have a news and event page that will help you Stay up to date with our latest trainings and any announcements that we have We also hold regular webinars to help libraries continue moving forward with their outcome measurement We also have a peer discussion board where you can connect with other project outcome users and you can ask questions and share experiences And that was a very very short overview of project outcome And the online toolkit, but like I said, you can go on there and there's more in-depth tutorials or you could view past webinars There's definitely more training on there If you want to learn more But hopefully I've highlighted some of the benefits of using project outcome, especially for busy small libraries This is not a tool for rigorous data collection And random sampling in your library What you're doing is you're targeting your users and finding out what they're gaining And what else they need from the library to help support them in their learning This allows you to get snapshot data And the short simple surveys help you get more responses from patrons So as I said before the open-ended questions of the surveys are a gold mine for libraries This is where they're gaining the most insight into their community's wants and their needs Plus we've done all the heavy lifting for you. We have the standardized surveys easy data entry and ready to go visualizations and the reports And the key benefit of using project outcome for your evaluation is that you're using standardized outcome measures across time branches And a variety of programs. So while your programs and audiences may be unique Such as, you know, who's attending a story time and the learning outcomes of that versus who's attending an excel 101 class By standardizing the outcomes you're able to talk about your impact across the board Which then allows your results to be aggregated in our system with state and national datasets For your comparison's sake, but also so we can talk about library impact at a national level So now, um, I'm going to hand things off to Pam who will talk about her library's experience using project outcome Great. Thanks, Samantha. All right, Pam. I'm going to give you presenter control now Correct. Am I presenting from this screen that I see or do I need to go to the slide? I'm going to be switching it over to you right now. Hold on just a sec You shouldn't see a little pop-up letting you share your screen And Krista, I'll be taking it back once Pam is done. Okay First timer for this I'm tempted to title my part of this presentation project outcome for dummies We're just To gather outcome data about our programs and have just scratched the surface of the resources available on the website We've done a few basic surveys, but we're wowed by the great information. We've gotten from getting these using these resources Oops, here we go Oh, I'm sorry. I'm lost in space Oh dear. I was afraid of this There we go. Thank you A newbie at a lot of things here. Okay. So this is our library. I want to tell you a little bit about it We're a small public library in Maine, but Nationally, but in Maine were considered a medium-sized public library really with a town of just under 8 000 people We have a staff of two full-time professional librarians and one full-time and two part-time paraprofessionals We're open six days a week for a total of 46 hours We're a municipal department and and with an advisory board of trustees And we have the distinction of being the only library in Maine that is a former happy wheels roller rink And actually it works great. It's a big wide open floor plan very accessible. We really like it I've been the director for the past five and a half years I must admit that I was intimidated by the thought of joining project outcome I had heard about it for several years But I felt it was just going to be too difficult for a small busy library with a small staff to tackle I was afraid it would be too much work that only libraries with large staffs could handle the work involved And I feared it would be a commitment a big commitment of time and that by joining We'd be agreeing to survey every program we did I was also afraid our patrons would be reluctant to participate and would tire of being surveyed But the main state library hosted a day-long program on project outcome last spring And after attending it our youth services library and I decided to give it a try Summer reading was coming up It would be so great to get some real feedback about the program that we've been doing for so many years And to be able to show the impact the program has on participants Like all libraries we've been using statistics to tell our library's story for years But mere numbers don't begin to tell enough We need to show our stakeholders the impact our programs have on the community I was motivated to investigate participating because we need patron feedback to improve programming in general And we're not getting much of it And we need to make a strategic plan and need compelling information to help create it We also need to show the impact of what we do to the stakeholders the public the town council the trustees To ensure continued adequate funding and to get support for a needed increase To be used to create more services and provide the staff a living wage Well, it turns out my fears about participating in project outcome were unfounded the project outcome surveys are so easy to use They're already created for you and can be customized if necessary We've been fine with using the surveys as they exist So you spend zero time creating a survey you just have to choose a ready-made one from the categories offered and off you go We can choose how many programs you want to survey. There's no commitment to survey all or even a certain number of them It's entirely voluntary And as yet we've had no patron complaints about doing the surveys project outcome gathers and analyzes the survey results for you, which is an amazing time saver They create beautiful reports from the survey results at the push of a button. This is our report on summer reading You get graphs the national comparisons of results and a narrative that explains the survey and the outcomes of the program being surveyed Something to be used with our stakeholders for sure They do all the number crunching and the written explanations So in august after summer reading 2017 came to an end We decided to dive in and do an online follow-up survey of the children's caregivers slash parents And the adult summer reading program participants We went to the project outcome website and created new surveys for each group and chose the type of survey Summer reading is a category. So it was an easy choice The surveys are ready to use. We were able to add a logo and introduction to personalize them We thought emailing the survey to participants would be easy since we had gathered email addresses when they registered A link to the online survey you create is provided and can be just pasted into an email However, this is the one spot. We found a lot of work was necessary Typing each of the hundred email addresses in to create an email group was time consuming Maybe next time we'll recruit a really good volunteer We didn't get a high rate of response, which is a little disappointing 25 out of 100 for the children's program and six out of 40 for the adult program But the responses were really interesting and next year. We're going to promote the surveys before the end of the program All the responses are collated by the software and the reports are a thing of beauty Here's an example of an excerpt from our summer reading program This beautiful essay about the effects of our summer reading program is just something I can't wait to share with the town council at the budget meeting this year I'll read just a little bit to you wherever public libraries are working possibility lives People who work in public libraries know that library surface services open new opportunities for anyone who enters And then it goes on to talk about The effect we have and the patron benefits are in high demand patrons most commonly suggest improvement for the live For the library or new more and frequent classes and programs Then it goes on to say that the percentage of parents or caregivers surveyed Who either agreed or strongly agreed? They benefited It gives you the great percentages 83 percent report the child maintained or increased reading skills 68 percent report the child reads more often and so on and all we did was Typing the surveys send it out and project outcome gathered all the responses and created this beautiful report They also create collect the responses to the open-ended or qualitative questions in a spreadsheet for you Which is a great time saver as you can see Here's an example I pulled them out of the spreadsheet and put them in a slide But what you like most about the program or service and right here they are From our small survey of adult participants very easy to look at and analyze on your own This past december I decided to survey another long-standing program our adult book discussion group I decided this would be a good group to try out an immediate paper survey with Since it would be a small number of surveys completed and would be easy to enter into the project outcome software by hand Attendance at our book group usually ranges from six to twelve And I wanted to get some feedback about this successful program I chose the lifelong learning category of surveys Easy because it included book groups as an example of programs to use the survey with I handed out the survey at the end of the meeting of one of the book groups And I had a collection box for the surveys right there in the room And again, I customized our survey with a logo on a brief introduction I was really pleasantly surprised at how easy it was to hand enter the survey responses into the website And I was again thrilled with the coalition of responses and the beautiful report instantly created And I've decided it would be pretty easy to delegate typing this Of the responses in with the next time I do one of these to another staff member or a trusted volunteer So in conclusion, I like to encourage you to register on the project outcome site and give it a try We're just getting started. We have much more to learn and there's so many resources on the site still to explore But already as newbies we feel it's extremely worthwhile We'll definitely survey summer reading again this summer And we'll consider handing out paper surveys at the program finale as well as emailing them to participants In order to see if that will increase the response rate by giving the participants a choice I also want to survey more programs in the near future. We plan on doing a survey of our weekly Weekly story time program this spring One of the great things about the project outcome reports is that they connect our survey results to a national database of library outcomes So they give a lot of weight to our local survey outcomes By contributing our surveys to this national database We're also able to work with libraries across the country to support and justify The importance of public libraries to the culture of our nation and to the fabric of democracy I'll hand it back over to you net folks now Okay Uh, so men thumb. I'm gonna make you a presenter again. Correct. All right. Great. Thank you You should see that to be able to share your screen again And are we seeing the correct screen? Um, it says wins the public libraries experience Okay. Yep. All right. Thank you. Pam. It's so great to hear Your perspective and to hear that getting started perspective and also what we hear from so many libraries Which is just start small try it out. See what happens So now i'm going to try to quickly touch on what we've heard from participants and how libraries are using their outcome data This is a snapshot of our registered us libraries by size Not surprisingly, we see a lower number of smaller libraries registered I think this speaks um to what pam touched on about small libraries fearing the time and the work commitment with measuring outcomes But we do have a pretty good variety of registered users thus far We have over 116,000 patron survey responses collected in our system overall across a broad geographic range, which you can see here on the map And what we've learned from Some external evaluations of our project is that participating in project outcome does help increase library Use of outcome data, especially among smaller libraries We've seen an increase in use of outcome data and regular use of outcome data among participating libraries And as you can see here out of 275 small libraries, there was a 10 percent increase in regular outcome data use after joining project outcome How libraries use their data differs as well. We Find that smaller libraries are especially using their data to inform or measure progress on their strategic plans And what you might find most interesting is that libraries are reporting increased benefits to the library Including having a bigger impact and reaching more people And over a third of libraries reported either getting more funding or non monetary resources by using their outcome data 45 percent What we've heard over and over is what is that getting started is the hardest part something that pam touched on We know you have so many other priorities and responsibilities that this might get pushed aside You might want to do it, but you might just feel you don't have the time But what this figure shows is that once libraries get started once you survey just one program And actually use the results 97 of libraries plan to continue to measure outcomes They see the benefits and they want to continue those benefits And as we've seen small libraries are slow to adopt project outcome But here are some ways that libraries have overcome that getting started barrier You can adapt the surveys into other tools that you might already be using Or you can also pick and choose when you want or need to survey You don't have to do everything all at once start small with one program Actively promoting the surveys to the patrons also helps increase your response rate and create more useful feedback than just we love the library Talk to your patrons about why you're asking them these questions and how their feedback will help improve the library Building staff capacity and buy-in is another common thing we hear you need to get other staff on board and make sure they understand You're not evaluating them as instructors or practitioners You're assessing program and service impact to see if there's ways it can be improved and magnified So now i'm going to walk through another case study we have from a small library in west virginia burnsville public library Bpl has used project outcome to better understand the impact of its programs develop new partnerships design new programs based on community input and increase funding Project outcome surveys showed that caregivers of young participants in bpl's summer reading program wanted tutoring and extra help for their children Equipped with this information and evidence of program impact the library worked with the local school district to have two teachers Offered tutoring at the library the following summer A library staff person whose two children participated in the program Shared that the children work on reading math. They get on the computer It's really benefiting them and some of the kids are here because they need extra help And some of them are here just to try to beat the summer slide and it's working very well Bpl also started a new after-school program because surveys showed an appetite for additional programming for children On the surveys children shared that they wanted to learn more about science and technology So one of the after-school classes that bpl added will include science hands-on science technology engineering arts and mathematics activities Here's a quote from uh bpl board member The reason we do it is we are trying to find out the interests of the community So we could serve the community better any library can use it. I love that quote because any library can use it Um digital learning surveys also showed that basic digital literacy skills Classes helped adults feel more confident using technology and become more active email users So they were changing that behavior Bpl shared the results in a grant application and as a result they received funding from the west virginia library commission To upgrade and expand their computer lab. So they could continue to help those lifelong learners in the community Evidence shows that project outcome helps libraries with programming decisions advocacy funding requests and grant work and building partnerships Since libraries see their results immediately, they're able to analyze their data and make quick and effective improvements to their programs and services This is the most common way libraries are using their project outcome data to improve or add programming In this example example Tulsa city county library used project outcome surveys To make an improvement to their story time So they measured story time across several branches, but only one branch had Designated playtime and toys for after story time and what they found Was that the open-ended comments really highlighted the post story time Toys and activities almost as much as the story time itself so the The library was able to use that data and share it with their friends groups So they got funding for the toys for the other branches. So they could provide the same post story time activities Libraries have also reported being able to use their results in a variety of funding requests Like I just showed including grant applications easier lsta reporting Helping pass referendum and requesting money from their friends groups For example, the cleveland heights university heights public library used project outcome to apply for a dollar general grant for their early readers program And by using project outcome and the summer reading caregiver survey as their evaluation method The library was able to set quantitative targets in their grant application They ended up being awarded the three thousand dollar grant and their early readers results exceeded their initial grant goals They got 85 percent of survey respondents Reported their child maintained or increased their reading skills Many project outcome libraries have also been able to use the positive results to reinforce their value in the community They've been able to use the summary reports and the data dashboards to give a clear and concise message about their patron impact So they're increasing that transparency and changing the way they talk to patrons They talk to staff and externally with their library boards and community stakeholders For example, the atlanta-fulton public library shared their summer reading survey results with their friends group their board And to the businesses that donated summer reading prizes and the businesses What they did was share photos of the kids thanking the businesses and they included some of the quotes from the surveys And the businesses just ate this up. They ended up sharing them through social media And because of this the library anticipates doubling their local business prize donations next summer One parent survey comment also made it into the library foundation newsletter newsletter, which goes out to all of the library's donors Collecting outcome data also helps start partnership conversations. It can create new and strengthen existing partnerships For example, workforce development and small business creation and growth is a high priority for pima county, arizona In the library's quarterly updates to the county as well as their annual report. They included some of their project outcome survey results And when the career center for pima county Asked for more money instead the county administrator suggested that they partner with the library Because from those results, they already knew that the library was doing great work in this area So what resulted was a new collaborative effort between the career center and the library to provide youth with work experience As well as college and career readiness and programming And this year round program addresses all aspects of teen development from academic goals to social and personal interests And combined with the career center's efforts to provide employability skills training It helps create pathways to college career and entrepreneurship for this youth group And you can find more examples like I just showed under our from the field resources on the project outcome website Which include case studies or speaker wall of fame Which includes all of the presentations that people have done alongside us We have over 60 people who have presented with us over the past three years And all of our on-demand webinars as well So now I'd like to circle back on my earlier question What's a problem you need to solve and how could measuring outcomes help? Hopefully seeing a little how the toolkit works and hearing from Pam's experience and some other library examples has helped you Think through how project outcome could help you collect the data you need in order to help improve your impact On those problems you're trying to solve or the community needs you're trying to address I'm going to wrap things up with a few announcements and then we can open it up for questions So we've recently released our second annual report and final project outcome or project evaluation results And you can find these under our about us page on project outcome.org. I suggest you check them out If any of you are attending PLA conference in march in philadelphia, we have two programs featuring libraries using project outcome So, uh, please join us for those if you're able to Uh, we also offer a full day in-person workshop training for state or regional groups who are interested in training up to 60 Librarians in using project outcome So if you're part of a larger group or just know someone, please share that information Um, we're happy to work with them to provide an uh regional training I recommend checking out our tutorial videos and case studies if you're just getting started And to learn more about um, how to use the tools and more about how other libraries are using project outcomes And of course sign up for free at project outcome.org Review our resources that I talked about Get started go in create a survey run it run it through a program and just view your results see what happens Um, also encourage you to engage and ask questions on our peer discussion board Okay, christa, I think I'm through do we have questions? Yeah, okay. Um, great. Thank you very much. Samantha and Pam. Um Yes, we do have some questions. Uh, let's see. Um There's one first question came in up, um earlier in the session and I can't I'm not I don't remember honestly I probably exactly if you'd mentioned this um, so let's know if um, can we link the surveys that you Provide to our social media pages to share them out there and um, so everything Like Pam said every survey will automatically generate A unique url for that survey So if you're confident that if you can share it out on a page and be really specific if you attended this Storytime at this time Um, and people will complete it then you can share that url. Yes, sure. All right um all right then um The question about uh for it was for when um, pan when you were talking about your surveys Um about the return rate of them What the percentage of the uh return rate of your surveys? Um, was it very low? Um compared to other other um Ways of reaching out to your to your community. Um, this person says so in direct mail You're lucky to have a three percent return rate. How does how do you feel that compares to what you got from? The surveys and what you use through project outcome. Is it higher or lower? Well, that's interesting. I've never heard that statistic before. Um Well, I look we sent out about a hundred surveys for the children's program and got 25 back. So that's 25 percent. That's awesome Six out of 40. Oh my mental math isn't good, but that's I don't know 20 so I guess it's not bad um We were a little disappointed with the with the summer reading one But we also think because it was just kind of a okay. Let's do it decision kind of last minute We didn't promote it all summer long and I think next summer we'll definitely do that and talk it up and I think we'll do better Just needs more a little bit more promotion So did you think it was an accurate representation of who attended this time or? Ah, that's a really good question. It's hard. I know these are hard to The the the immediate survey we did with the with the book group, of course was was 100 of the people attending and So of course it was very accurate, but uh with the larger group. That's hard to say It is yeah until you like look at them and then really evaluate what you What they say it's hard. It is there is a difficult question I also wonder uh, if because we only did online surveys with email that some of our patrons Low-income people don't have an internet connection at home. Don't do email. It might not have gotten to them So we realize after the fact that we'll definitely give the paper surveys as an option to people too Different different varying ways of getting that getting it reaching out to them. Yes Yeah, we do know overall that the paper surveys definitely yield your highest response rate So it really just depends on your capacity or your audience You know the the online surveys are good if you're doing some Uh digital literacy classes and people are already at their computers You could already have it up on the web browser and say hey, this is here. Just click complete But it is while the paper surveys do take the time to enter the results into the system You will get more responses if you use the paper surveys. Sure. Sure. Okay All right, anybody have any other questions type them into the questions section in your go-to webinar interface We do have one comment from one of our librarians here and up in Valentine here in Nebraska Project outcome seems like such a valuable tool. I was thinking I could use some of the reports from my annual reporting to the city and county They always like to see outcomes and visual assessments visual stuff. Yes. That's always awesome That would be great. Please do that Um, we tried to like I said in the presentation make everything as user friendly and simple to use as possible So if you do have to enter a couple paper surveys, you know, the benefit is that everything's automatic You get those results. Um, you can analyze them really quickly share them really quickly We know those reports are really useful to small libraries in particular because you know If you don't have the time to create data visualizations, I mean, I don't even know how to create data visualizations Something that can do it for me from the numbers Absolutely and someone else says totally agree regarding any report. Yes. Um, the more, uh, Interesting just interesting you looking you can make them the more people are going to actually read them potentially and um And you know what you actually have said in the in the dense text potentially Yeah, and you know the more you can share the more you can say about your programs and services other than We reached a hundred people You know just more data more data. You're building that story. Yeah Great. All right. Well, it doesn't look like anybody else unless something somebody's typing a really long long question Um, it looks like we are good for this session today Thank you very much. Samantha and Pam for talking to us about um project outcome today


Good morning, everybody. We're in Warrens, Wisconsin. Just delivered our load of lumber and we're headed over to Oatonna, Minnesota to pick up some glass that we got to take to British Columbia, Canada on the West Coast. That's a nice little town. Wisconsin's actually got quite a bit of awesome little small towns. Last month in December when I delivered that load up into Northeastern, Wisconsin. I went through so many little towns. Tons and tons of them all very well maintained, well kept. Nice places to see. You know, it's it's rare, I guess, that people would visit there because there's not really a lot of reason to go out there unless you live there or if you're delivering freight to the area. That's one good thing about this job is I get to see a lot of little towns and stuff that I I don't want to say are forgotten, but are sort of missed by a lot of people because they're off the main routes. Pumps are frozen here. I was lucky enough to be able to bob tail here to pilot flying J to get fuel while they load my trailer. The pumps are pumping really slow, too. I don't think they're used to this cold weather here. It's about minus 25, I think. It's supposed to go down to about minus 30. That's in Celsius, but it's around about the same. Both Celsius and Fahrenheit meet at minus 40. I'm really hoping that by the time I'm done fueling that this guy will have left. Looks like he's been here for quite a while already. Everybody else that's been waiting with it parked in front of the pumps and went inside. They've all left already a long time ago. He's still sitting here. I don't know what it's taking him so long. Probably takes a little while to take a shower sometimes, I guess. Yeah, the reason I bob tailed here while they loaded the trailer there. I just dropped the trailer there. They're actually not going to start loading me for a couple of hours yet. But I asked them if I could just drop the trailer and go out here and fuel because I was below a quarter tank and with temperatures being this cold, I don't want my tanks to be empty of fuel. You have to keep them full of fuel and I also had to put some anti-gel in there as well so that I don't end up with gelled fuel because I don't know if I'll be able to leave there tonight yet. If I'm only getting, if they're only going to start on me in a couple of hours, then they got to load it. Then I got to tie it down. Then I got to tarp it. I might not even get out of there at all. I may have to stay there the night and leave in the morning. So I dropped the trailer and I bob-tailed out to the nearest Flying Jay and get my fuel now just to make sure. You know, I don't mess around Mother Nature. I've said this before. I don't mess around with that. Yep, it's cold. The good thing about where I'm loading though is I get to tarp it indoors in a heated building. Oh man, I couldn't imagine tarping in this weather. I mean, I could imagine it because I have to do it sometimes. This guy still hasn't moved. Wonder if he's going to move? I guess we'll just wait. You can see how dirty my windshield is. He turned his lights on now so I know he's sitting in his driver's seat. He just doesn't want to go. I don't know if you can see those two vehicles just off to the right. Now, pardon me, just off to the left. I don't even know my directions. Round to this side. Apparently I can park my whole unit truck and trailer in the garage here. So I don't have to unhook. The other building where I have to go, where I go to usually, there I have to unhook my trailer because I can't fit everything inside the building and of course we want to close the doors because it's minus 30 outside. Nobody wants to freeze inside and I want to tarp my load in a nice warm environment. So here, apparently it's a little bigger. I'm curious. I've never been to this side. I see. Where'd he go? Where'd he go? Oh, there he is. He just turned his lights off. Oh, is it going to be in that building? Oh, fancy. That one's straight ahead of us there. Where'd he go? Where do you want me to go, bud? I see you're just parked here. I have no idea where I'm going. This is awesome, actually. There's just one door here. Just mine.  So what this means, since I'm the only one here and there's no other doors or bays where other drivers are loading their freight, that means no other drivers opening and closing overhead doors to get in and out. On the other side, there's what, ten doors all the way across and whenever our drivers finish, they open up the overhead door and they have to go out, right? Or they back a trailer in and every time that happens, all the cold air rushes in and all the hot air rushes out and you're always freezing while you're tarping, right? Here I'm guaranteed to have a nice warm bay all by myself to tie down and tarp this load. I wonder if I can request to always be loaded here. I feel so special. Well, this is probably the slowest it's ever been at this place. It's always a little slow. Let's say it's about six to eight hours to get loaded here. But today it's been seven hours since I checked in here and they haven't even started. They did get me inside, which I appreciate. It's nice that they haven't even started loading me in. I believe we give them four hours free here and after four hours we start charging them for a detention pay. That's what they call it. I don't know exactly how that works. Usually they get me loaded within the four hours at least or close to it and then I just have to tie it down and tarp it which takes an extra two hours. It's now midnight. In another three hours, my logbook will be reset. That's how long we've been here and I can start a new day. I stayed awake this whole time because I keep thinking that they're going to start. Now they're finally on my trailer. They're finally putting the first piece on just now. Seven hours later. I should have slept. I should have just gone to bed. But instead I was messing around on Facebook posting memes. It was worth it. It was pretty funny. But still, what am I going to do now? It's going to be very difficult to make it to my appointment. If I go to bed right now and sleep for the next three hours while they load me because it's going to take them at least two to three hours for them just to load me then I have to tie it down, then I have to tarp it. I'm not going to have enough energy to start my day. I'm going to have to go to bed and then sleep to like one in the afternoon tomorrow just so that I have a good rest. It's going to be very difficult to get to Burge, Colombia for Monday morning at 7am. Even though I do gain two hours going west and I go two time zones over there which means I gain two hours I was just hoping to have a little bit more of a relaxed drive but I might not even be able to make it on time for my appointment and I might have to call them and be like, yeah well it took them literally half a day to load me so I'm going to be a little late. Nothing I can do about it right? Maybe instead of unloading me at 7am they can unload me at noon or one o'clock in the afternoon. Lost satellite reception. Well you don't say. That just happened now. What happened? What are you talking to me now? I'm not grumpy yet, but I'm sort of getting to the point where I'm getting a little bit irritated but there's nothing I can do about it so I probably shouldn't dwell on those feelings. It's just how she goes. I'm a truck driver. This is life.  We'll make it work. We'll make it work. Just before I filmed these clips for you I went out there again and at the seven hour mark I went out there and I asked around a little bit. I don't want to irritate these guys. I don't want to give them any excuse to do a slack job on my load or not to do their best. I don't want them not to like me but I just wanted to know. I'm like, hey did they forget about me? I've never had to wait this long. Is everything okay? Apparently it's been really busy today. Short staff, you know all the usual responses and excuses and I just said, well you know what I don't blame you for that. It's fine. I just want to remind you that I'm here and that I've been here for seven hours. What else can I do? Right? I don't want to get mad. That doesn't help anything. I'm not mad. I'm just disappointed. The time is 3 a.m. Got here at 5 o'clock yesterday so that would be 10 hours. I took them to load me. I've already got the straps in the front ones here. I just finished putting them over the back. I started to. I've got a few more on yet. They just finally banded up this last bundle and they're finally done. 10 hours later. So I've got to tarp the thing yet and go from here. So you know what's funny? According to my logbook I can start my day now. 12 hours later now when I picked up my paperwork on the way out it was almost exactly 11 and a half hours since I got here. That is a new record. Let the record stage. I was at the chipper for 11 and a half hours. If I wanted to right now because I was off duty when I got here I dropped the trailer or I parked the truck and trailer in the garage there since then it's been over 10 hours and I don't have to do anything. Technically I could go but I'm not going to. Not going to. Technically I was on duty when I was strapping and tarping there. And there we go folks. This is what 11 and a half hours looks like. It was actually pretty quick to tarp it and tie it down because it's all pretty much the same size, same height. I think it turned out pretty well. I'm happy with it. So guys don't forget to subscribe. I'll be back tomorrow. We're going to start our three day journey to the west coast. We've got to deliver this to British Columbia Canada.


Another rough one for Severino. What did you think the issue was tonight? You know, again, more trouble there in the first inning where, you know, that first inning just not as crisp as, you know, really with any of the pitches. I thought the Mets did a good job with his slider of being able to lay off it some pitches that sometimes are chases. And then they put some good swings on sliders as well. But, you know, this, you know, the last couple outings where I feel like I've seen that sign where he's getting that life back on both his fastball and his slider, I didn't see that life as much today, even though we saw some late good velocity numbers, just getting that crispness back where, you know, from the side, you really notice that slider, that the shape on that slider, you know, where that fastball kind of has that ride, that pop at the end, didn't seem like it really had that tonight necessarily, you know, perhaps maybe a little bit overthrown the slider so he doesn't get the bite on it that he wants. And then, you know, they made him pay with a couple of mistakes. Because of the facts that you just mentioned, is there even more cause for concern when it comes to him and his numbers over the past couple of? Well, I mean, we got to help and find and get to the bottom of it. You know, physically, I think he's sound, but we got to, you know, we got to get this righted and that's on all of this because he's so important and obviously, he's so dynamic when he's right. You say physically you think he's sound. Have you checked with him and asked, does everything feel okay? Is the arm? Oh yeah, we check all the time, we keep checking with him and, you know, monitor him between starts and everything and yeah, I think he's okay. And we've seen enough flashes that he looks like savvy, but just, you know, a little bit of the flatness that other teams have taken advantage of with some slug. Mark? Erin, when you watch their reactions, like you mentioned with the slider, even the fastball, like some pretty easy takes, I mean, do you start talking about maybe giving this guy extra time between starts or skipping a turn just to sort of get back on track, regardless of how he's feeling physically? Right.   It's just, you know, right now just too many mistakes. Yeah, just piggybacking on that. And when a guy doesn't have that life or the crispness, and I would seem to suggest a little bit of fatigue, if not anything physical. So, as you weigh pushing through that versus maybe backing off, how do you, do you watch them?  But I don't think this is a situation where we're planning on skipping anything right now. Is there a way, like just generally with pitching that you think generally works better to push through something like this? Is it, can you guys usually able to pitch through it once you hit this?  So I feel like we've done a fair share of that this year and we'll have to continue to kind of work through ways and get to the bottom of and get him righted because again, he's so important to us. Oh, Billy and Kenny. Yeah, can you just describe what's Sabafia's condition and... Just his knee, you know, his knees always, you know, the biggest concern with CeCe and, you know, when he kind of had to grind through that last start as well as he did pitch with it, but he kind of came to us and it was like, you know, it was barking pretty well. So we decided, you know, best by DL and him now maybe only means he misses one start and we kind of maintain that and, you know, the swelling wasn't very bad, which is a good sign. So we do believe it's probably just one turn through and hopefully something that benefits him down the stretch. Kenny. Aaron, who will take CeCe's turn on Friday? We'll talk about that some more. I would say it'll likely be CeCe and he'll probably be inserted in the middle of the week. Anyone else up against the wall? Just as far as the next three days, you don't have anybody announced as starters. Do you know who you're gonna be throwing against the race? We'll get that, we'll try and get that announced by tonight. I just wanna make sure a couple of things and that we're lined up how we think it's going. Okay, thank you.


The next reaction is neutralization. Remember that we know that when acids and bases meet each other, they neutralize each other's properties. But how? Let's take the example of hydrochloric acid reacting with sodium hydroxide. What happens? Well, the products are a salt and water. So where does the water come from? It's formed by the hydrogen ion from the acid bonding with the hydroxide ion from the base. This is why acids and bases neutralize each other. And once that has happened, what's left? Well, the anion from the acid, the chloride, and the cation from the base are left. And it's these that form the salt. And in this case, it is actually table salt, sodium chloride. Let's try another example. Phosphoric acid reacting with magnesium hydroxide. Okay, so the products are water again. The protons from the acid will react with the hydroxide ions to give water. I'm not worrying about balancing the equation yet, just what the products are. Okay, if we assume all the hydrogens and hydroxides are used up, what's left? The anion from the acid is phosphate, and the cation from the base is magnesium. So the salt product is magnesium phosphate. And now we can balance it.