I should say that Julian was supposed to be here if you have read the program in advance. On short notice he unfortunately couldn't make it here, so I just made up a talk that I always wanted to give, but never found the right occasion for it. So this is something I wanted to talk about for a long time, but the talk itself is completely improvised. I just hacked together some slides yesterday in the hotel. Yeah, so that's essentially it. Julian wanted to talk about new stuff in the Prometheus world. We will still have a very compressed version of that in the maintainer session on Thursday, 230. It's called Prometheus intro and deep dive. There will be an intro and then there will be deep dive with the news. It's very compressed, but Julian also told me he will record his talk anyway and publish it on his blog or somewhere. So just follow him on Twitter or something and you will enjoy the talk. Anyway, okay, cool. So my topic, alerting an anomaly detection. Best friends forever. Short answer, no. And talk done, right? I guess we have 20 more minutes. I should have a more nuanced view on the topic. Let's go back to 2015. What happened in 2015? You should be fans, right? This was when Prometheus got publicly announced. Remember, Prometheus was always in an open source report on GitHub ever since November 2012, meaning we are kind of approaching a 10-year anniversary, which is pretty incredible. But 2015 was the year when we made a bit of noise and Prometheus became very popular quite quickly, which we didn't really expect. We expected people asking us questions, weird questions about those weird things we're doing, but there was one question we didn't really expect and this was kind of one of the most frequently asked questions. Can you do anomaly detection? Because back then in 2015, the hotness was anomaly detection and whenever somebody claimed to create a next-gen monitoring and alerting system, obviously this must have to do with anomaly detection, right?  We were kind of surprised and I'll explain why. One thing is, seven years later, anomaly detection is still the hotness. I have to read this that way. So, marketing language. Imagine, for example, a food delivery app that has lots of usage at lunch and dimmer times, but is pretty quiet in the early hours of the morning. The same threshold doesn't work well for both scenarios and could lead to missing incidents and all noisy alerts. What if you could learn from our metrics in the past and create alerts that adapt to our data and context over time? It wouldn't be that great. So, I'm carefully navigating the competitive landscape here. I don't want to put blame on any of the competitors of my employer, which is Grafana Labs, as you might have seen on the first slide. So, I took our own marketing language. So, my honest answer is then you would almost certainly miss incidents and get noisy alerts. That's the sad truth. Why is that the case? First of all, outages are not necessarily looking like anomalies. Especially nowadays, you might have a high availability service, three-nines, four-nines. If you just have fractions of a percent of an error, you are already out of your SLO. But patterns, I mean, it looks normal.  Yeah. So, you will miss outages if you rely on anomaly detection for alerts. The other way around, it's even more obvious an anomaly is not necessarily an outage. On the contrary, most anomalies are not outages. There is my favorite example, the World Cup Final. Here in Spain, if I say World Cup Final, you know what I mean, right? In most countries of the world, you know what I mean. There are a few countries where World Cup Final means something else. I mean this year, right? This sports, which personally, I don't really like, but most people like it. So, the World Cup Final happens and most of the world is watching that. And you might be the engineer on call and you also want to watch it. But since your alerting is based on anomaly detection, every World Cup Final, every four years again, you get paged during the World Cup Final because your traffic drops, like 70% of your traffic drops away. Everyone is watching the World Cup Final. You want to watch the World Cup Final? No, you have to act the page and realize this traffic drop is actually fine. People are just not using my service. It's not an outage. So, really bad. You will never watch the World Cup Final. There's even a little anecdote internally at Google. I don't know if it's true, but it's so nice that I like to tell it because where's Google from? It's a country called the United States of America. They don't watch the World Cup Final, right? And so, their engineers, at least initially, when they were like more Eurocentric, they didn't know there was a World Cup Final. They just saw 70% traffic drop. What? Something must be wrong for sure, right? So, even if humans do the anomaly detection and they are supposed to be smarter than your machine learning, they will still have false positive and panic because the traffic has dropped. Yeah. So, another thing is that anomalies are just anomalies. They don't judge your anomaly, right? So, if you are a crappy startup, you are not making any profits, your product is unpopular. Suddenly, your product becomes popular, traffic goes up, you should be happy, but it's an anomaly, right? So, you get paged because you have success or you were just like duct-taping your site together. You're most of the time down and suddenly you're up because you did proper work.  It's an anomaly. You've never been up for like longer patches of time. Anomaly, anomaly, anomaly, but no, right? It's not really an outage. Okay. So, coming back to Prometheus in 2015, we kind of knew that anomaly detection is problematic for alerting, but we really didn't have it on our radar. We had something else on our radar, which is this philosophical alert philosophical discussion in symptom-based alerts versus cause-based alerts. That was the hotness for us in our little Prometheus bubble.  Traditionally, you would monitor packet loss on the network. I don't know, servers that go down, disks that fail, right? This is traditional monitoring. And this is what we call cause-based alerting in distributed complex systems. First of all, you have so many notes that this will happen all the time. Luckily, your systems are designed to tolerate that, which in turn means if you alert based on causes, you will get very noisy alerts and you'll get woken up in the middle of the night because of something your system can cope with. So, what you should do is symptom-based alerting. So, you should alert on conditions that actually mean that your users have a big experience. If you have an SLA signed or you have set LCLOs, you actually know what your service should do. So, you can alert directly on that, which is called SLO-based alerting. That's another new hotness. Our discipline has the habit of writing the hype.  So, people have like overblown expectations there. But, in principle, it's a very good approach to do like symptom-based alerting, SLO-based alerting. So, if you get paged, it should be a real issue which has to be dealt with now. This is why you got woken up. So, we were fighting kind of this battle, symptom-based alerting versus cause-based alerting. And now anomaly detection comes into the game. Where's that even here? Anomalies could be symptoms in rare cases. We will talk about this a bit later. Anomalies could be causes or correlated to causes, but most anomalies are neither. There are neither symptoms nor causes. And why should you base your alerting on them? Like this was for us, this was so off the radar that we didn't even think about that. And the rest of the world, they ask us how we do anomaly detection in Prometheus. Now, there's hope. There is, you could argue, there are cases where you can use anomaly detection for alerting. Strictly speaking, that's the case if anomalies are the symptoms. So, there are very rare symptoms where anomalies are a symptom of a failure. There are systems where you just want them to run very normally all the time. It's just hard to come up with really good examples. I always think like of medical stuff, like if my heart rate is too low or too high, that's an anomaly and it shouldn't always happen, whatever. Like there are definitely technical systems where that's true. They are just very rare. Like perhaps one or two in this room have a system where this is really the case. However, the more, like the worst signal noise ratio you're willing to accept because the stakes are so high, the more anomaly detection is something that might make sense. So, stakes are really high if you run an airplane or nuclear power plant, right? You could kind of argue you should have an error budget and in reality you have. Like nuclear power plants blow up, planes fall from the sky, but you shouldn't really tell your passengers or the users of your electricity. Yeah, there's a kind of 0.1 percent chance this will blow up or fall from the sky. You kind of try to keep this really, really low. So, in those cases, you also want to know if something is going to happen before it happens. And it's so expensive if it happens that you are willing to accept noisy alerts. And then, of course, if anything is weird in the airplane you want to know, if anything is weird in your power plant you want to know, even if 90 percent of those alerts are false positives, you don't want to operate your whatever, search engine in that way, right? Because nobody dies if your search engine throws a few errors. I also think about like fraud detection of something where anomaly detection might be cool because with like intrusion, fraud, you have an attacker that deliberately tries to not trigger your alert, right? So, you kind of, yeah, you have an intelligent antagonist and then you might say anything that is not normal that looks weird should ring a bell. And maybe that's a good thing, but I also remember, I was a couple of years ago, whenever I traveled to another country, first transaction with my credit card, it got blocked because normally, right, I never traveled to France and suddenly I do. And the whole point of a credit card is I can travel to another country, put in my credit card without cash and get money and the bank thought that's an anomaly and it should block my credit card. So, even there, you have to use it responsibly. Okay, there's another thing and this is way more relevant for most of us, which is we should actually think of alerts in a wider way than just pages. And for Prometheus people, which you probably all are, you are familiar with that because what we call an alerting rule in Prometheus isn't necessarily a rule that creates a page. We have all kind of alerts, right? But the lingo is really different and everyone uses different terminology. And then there's the SRE book, the famous Google Blue SRE book, which has a terminology established which I find a bit weird, but they use alerts synonymous with pages. And I call this SoundCloud lingo because that's where Prometheus was first used. And this is what I personally tried to establish, like let's not call pages alerts because that's the general term, let's call it pages, right? And then you can, in Prometheus you can attach labels, free form. So, we use the severity label, you can use something else, you can use a different terminology. Prometheus is really inclusive here and open-minded, but it comes at the price that terminology might change. So, severity critical, this is something that you act on immediately. It should only ever be based on symptoms and it goes to your page. Now, another alert and I like the word from the SRE book which is tickets. So, I also tried to establish it at SoundCloud, but most people call it an email alert because they send it to email although it should be an issue tracker. So, this is, it should still be actionable, right? So, anomalies are kind of still bad for this because there are so much noise. It should be a symptom. It could also be a cause because most causes have to be dealt with eventually. They should just not wake you up because you, oops, sorry, here. You should act on it eventually, but you can do it during work time. If you have packet loss in your network, you should not ignore that. It will eventually create something or some real outage or it's definitely something bad, but nobody has to be woken up. The network people who are dealing with that, they can get an alert during their work hours. So, that's what you should do here. It could even be based on causes. And then, this is less known, what I like. I call it information alerts. SRE book calls it logs, which is a bit weird. Maybe logs are usually of that nature, but it doesn't have to be logs. It could be a Prometheus alert which goes nowhere. So, what is this good for? Or it goes to a dashboard. I like those alerts, informational alerts because they make sense if you have a real outage and you want to find the cause. Contrary to common belief, a monitoring and alerting system is not only there to tell you if something is broken. It also helps you to find out what is broken. And those alerts help you because they tell you if something is weird, which smells like anomalies, right? So, this is many alerts actually that you might have in your system and they are even paging or creating a ticket. They might be better information alerts like the developer of a piece of software thought. If this value goes up above this threshold, that's kind of weird. But it's not really breaking anything. But if you see that something else is going wrong, you should know, right? So, information alerts. And I think anomaly detection has a great place here. And this is actually what I think this whole like machine learning blah, blah, blah, blah, blah, blah, buzzwords, where this actually makes sense and is a billion dollar market because that's really what you do if you're troubleshooting, right? You want to see what's wrong. You get a page because you have a real outage. It's not anomaly based. It's based on real measurement against your SLOs. But what do you do usually? I mean, we all have this intuition. What has changed? 10 minutes ago an outage started. Was the new software version pushed? Did the traffic spike? Did something in the network go wrong? And it would be so nice if you could like Star Trek style ask the computer, please list all the things that have changed in the last 10 minutes or perhaps in the hour running up to it. And that's what we humans do by what we call staring at dashboards, right? This is an anti pattern. You just look through all your dashboards and you might find something would be so cool if machines could do this for us. And that's what machine learning can actually do. And this is also, it inverts the requirement for signal noise ratio.   And one of them is right. That's awesome, right? I only have to test 10 theories and I will find the real cause of the outage. Great, right? So I think this is where we really have value. Okay, let's come back to 2015. Everyone is asking us, can you do anomaly detection? We slowly understood what people actually want. We tried to explain why you shouldn't use it for alerting. But we also told them, listen, promql is super powerful. Of course, you can do anomaly detection. All the building blocks are there. Brian, you can see 2015, he wrote this blog post on the Prometheus blog. It's still there explaining how you can do anomaly detection with Prometheus. So finally, we could claim we can do anomaly detection and it might even make sense. This is like the example query in the blog post and you can see there are the building block. We can do an average. We can compare to the standard deviation of latencies. This is between instances. So that's a reasonable thing, right? You load balancer should load balance stuff reasonably. And if a single instance is more than two standard deviations away in its latency from the others, probably something is wrong. It might not be a problem that you should page on. But if you get paged based on your nice SLO based symptom based alerts and you see, oh, yeah, one instance is much slower than the others. Great, right? Perhaps noisy neighbor. I don't know. Broken note. This is helpful then, right? In the blog post, this query is refined a lot to make it less noisy and all of that. You can look it up. There's also a lightning talk on this during this Prometheus day later today about anomaly detection where you probably see all those tricks, I assume. So you can do this, but all of this is rule based, right? What the people back then were all looking for buzzword machine learning, right? So I want to close this with Cartesian coordinates, quadrants, that's always cool, right? So this is anomaly detection, the method you use, which could be more on the machine learning part or more on the rule based part and the purpose which could be alerting or what I call troubleshooting, right? And Prometheus is here, right? It's in this quadrant. Prometheus is always rule based and it's for troubleshooting. It's what we want, right? You could use it for alerting, of course. There are Prometheus rules for anomaly detection, but we kind of philosophically don't want this. There are, again, this is already exceptions. There are ways where this might make sense. For example, I would never just alert on a traffic drop because World Cup final, right? But you could be pretty sure that there are limits where you say, if my traffic drops 99%, that's weird even during the World Cup final. You could make up rules where you're reasonably confident that something is wrong, but then you could also say it's not even an anomaly, it's something where you just know this must be wrong. It's kind of more symptom. But anyway, this is careful. Alerting with machine learning just don't, right? Dangerous territory. It's hardly ever useful exceptions, power plants, fraud detection maybe, right? But this is an interesting area here. You want machine learning and this is essentially Star Trek computer style, right? Where Captain Picard still has to ask the computer the right questions, but the computer will do all the hard work of analyzing and correlating and everything. This is just nothing you can do in Prometheus. And my prophecy is that Prometheus will never have those machine learning parts, not just because we want to be focused on what Prometheus does well, but also because your machine learning should look at all signals. And Prometheus is looking at metrics, but you have so many other signals in your modern monitoring systems that you should put them all into your machine learning systems. So what machine learning systems do? They query Prometheus, they can retrieve the data, there's a query API, right? And then they can process this and do this. And then maybe it will help your troubleshooting. I think there we will see the real progress, the real money and the real convenience coming from. But not here, right? Okay. I think that's it. We have a few minutes for questions. Thank you. So one just put their mask back on, but the person, yes, thank you. Questions? We've got five minutes to turn. And are there any projects currently doing that automated troubleshooting that you talk about there that we could use? Can you hear me? No, you can hear me. I don't know of any in particular, but I talk to the people. I'm not following so much the marketing side of this, but I talk to the engineers who are doing machine learning, including the machine learning experts in my own company, because I'm always keen on, please don't tell people that they get automatic alerting. They have never to think about thresholds again, because this is just wrong, right? And they all tell me, yes, we understand. We have already tried that. It's super noisy. But, and then they talk about exactly this, right? They want to make this whole operational troubleshooting part. They want to support you. And I think they can. I'm just not sure if somebody has something that is already in the market that actually works, but I know that the people are working on it. So if it's not already in the market soon, it will be there. And I guess multiple vendors will offer that. And I hope it will be good. More questions. Also knows. Could you put your mask on? Thank you. I don't want to be obnoxious or anything, but again, it is highly unfair if everyone does a thing and then a few think they're special. They're not.  I wear them. Done. Any more questions? The life, the people watching this virtually, they can also ask questions in the chat. Oh, yeah. Question. So what are we supposed to do for alerting? The graph implies that we should only do troubleshooting, not alerting. Yeah, you should do alerting, of course, but not based on a normally detection, right? So the usual, like the marketing story about is that, which you could see from the example from Grafana, but everyone is telling you that if you just have thresholds, static thresholds, it won't work. This is a bit unfair because modern monitoring systems, they also teach you to not just use a static threshold, they tell you do something smarter, look at your SLOs. And even then you say you get like an error rate in your SLO, which is already a bit smarter because it's like relative to traffic, but even that isn't really what you do.  There's like SRE workbook, the second SRE work, chapter five, I think, and there's, I myself did something back at SoundCloud, there's a blog post, then did the same thing at Grafana Labs and it's in podcasts and all over like, this is what we call SLO-based alerting. It's like real science, like rocket science in a way, but it's very elaborate and it has its problem. There are also a lot of talks these days why SLOs aren't like the silver bullet for everything. Nobody ever said that, but it helps so much and there was a reason, like, sorry, shame this blog, Grafana has a new podcast, it's called Big Ten. There's an SLO episode where they interviewed me and Matthias Leuvel, right, who is perhaps in the room, I don't know. So, Matthias also has a lightning talk on Prometh today, I think, about this as a low base alerting, so watch this, watch all the day, all the talks today, of course, but this is so kind of ingenious because it really alerts you in a non-noisey fashion and Tom Wilkie, which is like my boss's boss at Grafana, he said this so nicely, like how they had very noisy pages initially and then I came along and said, we have established procedures, do this and it was like, it was day and night, right? Of course, there are shortcomings and it's not the perfect solution, but it's so much better than what you had initially and if you ever get into this direction, you also realize, why did I even ask for like automatic alert thresholds, push the button and never worry again, like you should know your system better, right? That's where your alerting should come from, from your knowledge of the system, what your users expect and not from some magic, it will automatically tell me if something is wrong. No, it won't, it will tell you something is abnormal, but that's what you want to know. I'm wondering, you said that we're supposed to avoid noisy systems, noisy alerting, but sometimes it depends on context, like you said with this example from Google. I'm wondering if you have any advice how to avoid noisy alerting in the same time, keep the context of alerting and keep alerting that are important, which depends on time or any other things that are outside of the system. Yeah, I mean, it's really like, there's no silver bullet, you cannot stop thinking, you have to what you call context, right? You have to think about your system. I think most of those like online serving system, most of us run, probably read chapter 5 in the SRE book, go through the blog posts and podcasts, this is probably what you want, right? Don't do it, don't apply it without thinking, because if you run a nuclear power plant, you don't want to have a 0.1% blow-up rate per month or something, right? Obviously, but if you run just a normal service, that might be just fine. It really depends what you're doing, and then you have to pick the right method, and it's like, can't give you the one, three, whatever rules for that to find out what it is, it's in one's decision, of course. But most of the time, don't do anomaly detection for your paging. That's the rule that's most often true with very few exceptions. We've got five more minutes. Any more questions? What question didn't the audience ask, which you would like to have seen asked? Oh, I think that they were good questions. We can also... Anything more from online? Okay. Okay, then let's... Thank you very much. Five minutes, relax. Thank you too.


Hello and how are you all doing today? My name is Priyanka and I shall be helping you with the following question. It says if the function fx satisfies limit x approaches to 1, fx minus 2 divided by x square minus 1 is equal to pi. Evaluate limit x approaches to 1 of the function. Now before proceeding on with the solution, we should be well versed that limit of a function when x approaches to a is equal to f of a. Right, this is the key idea for the question. Now, let us proceed on with the solution. We know that as x approaches to 1, the function is f of x minus 2 divided by x square minus 1 approaches to pi. But we also know that x square minus 1 when approached to 0 only if as x approaches to 1. Therefore, the function that is fx minus 2 divided by x square minus 1 is equal to 0 divided by 0 for x approaches to 1. And if fx minus 2 approaches to 0, then we have limit x approaches to a f of x minus 2 equal to 0. That further concludes that limit x approaches to a value of fx is equal to 2. Right, so 2 is the required answer of the section. That is, we have found out the value of, hope you enjoyed, have a nice day.


In this video we provide the solution to question number eight for the practice final exam for math 1050 We have to find the slope of the line that passes to the points negative one one and three zero So we're going to jump straight to the slope formula here and Equals rise over run we take the difference of the y-coordinate So zero minus one divided by the difference of the x-coordinates three minus a negative one here and the numerator We have a negative one in the denominator We have a three plus one so we end up with negative one fourth the correct answer within b-choice f


suspense and the producer of radio's outstanding theater of thrills the master of mystery and adventure William M. Robson you can't say we haven't been warned from cradle to the grave we are piously advised that the love of money is the root of all evil we are urged to be moderate in all things and we are reminded of the futility of greed by aphorism and fable but it doesn't do much good for there seems to be a little larceny lurking in the best of us and one place where it's sure to show is at the roulette table around which the action of our story revolves tonight listen listen then as John Lund stars in winter lose all which begins in exactly one minute another visit with Joe and Daphne foresight Joe yeah Daphne look at this story about savings bonds in the paper yeah what about it do you think that's the best way to tell people about savings bonds why not look see it says here that savings bonds are a guaranteed investment right now they pay off at the rate of four bucks at maturity for every three bucks invested you're not convinced why not no salesmanship no salesmanship what more do you need to know why right now more than 8 million Americans are buying saving bonds regularly through the payroll savings plan so so what that's what I say so what now look Daphne if millions of Americans are convinced that saving bonds are their best investment not only financially but for the future of their country what the heck is bothering you well I think they could sell a lot more with salesmanship you know slogans and jingles let listen if you're spending more and saving less try a savings bond oh boy or maybe savings bond pay good like an investment should Daphne you get a lot to like in the savings bond interest earnings guaranteed wow well did I say you yeah but I forgot what it was you were selling savings bond I'll take a hundred and now winner lose all starring John Lund a tale well calculated to keep you in suspense Las Vegas the sucker city the land of the money cow in my pocket I had a permit to milk it a system to beat the wheel but first I had to convince one of the farmers tending the cow that I wasn't gonna take too much after about a week of nosing around I decided on the place I was gonna hustle the owner was a guy named Carlin Walter Carlin and he wasn't doing as well as he wanted to but then who is come in Mr. Colin that's right who are you my name is Bob Richards I've got a proposition for you goodbye mr. Richards now listen to me for one I said goodbye mr. Richards but I want to give you something for nothing nobody ever gave anybody something for nothing I will guaranteed all right you got one minute make your pitch when it was the last time you had a spread in the New York Times ah come on son quit playing this is a small place compared to the joints out in the strip and you're not only small but your business is way off isn't it mr. Colin I said I'd give you a minute to make a pitch not to discuss my business as part of my pitch I can put this place on the front page of every newspaper in the country keep talking you have 30 seconds okay I've got a system for a letter oh come on oh I know everybody's got some kind of a system but I got one that will win and the only trouble is when the house finds somebody's got a winning system the tables closed after a while or the bedding is limited now here's my pitch you let me win $200,000 200,000 let me finish you let me win $200,000 it'll take about a month to 40 days all I want for my share is 50 grand in cash and you've got yourself a million dollars worth of publicity you expect to walk in here take 200 grand out then return 150 when you're finished I wouldn't even trust myself to do that I didn't expect to take the 200 grand out now that's too tempting huh the house can keep my winnings for me until such time as I decide to quit which in this case will be 200,000 I don't know remember those two college kids and what they did for that joint in Reno and they only went for a couple of weeks and a few grand you're sure your system works what do you care the works you're in if it doesn't I lose my own dough all right on one condition name it stretch it out to two months and you got a deal I can really use that kind of publicity okay when you want to start tonight fine oh just one more thing Richards yeah be a smart boy don't try anything that might get you into trouble well the only thing that could possibly get me in trouble is your 200 grand and how could I possibly get my hands on it see you later mr.  Richards you've got a real hot street going a real hot street oh that's it for now stony back tomorrow mr. Richards why not this first week is only the beginning double-zero green baby I guess I'm just lucky stony just like you have the figures for the week mr. Colin you want detail or a quick run down just a quick run down okay this is for the third week of operation since the kid came in with his sister mm-hmm he's into the house for about eighty three thousand dollars and it in that same period our gambling gains have doubled the bar is five hundred percent over and see right here the morning business is almost triple what it was four weeks ago mm-hmm oh there's another magazine crew coming in to do a layout this evening to take care of them give them everything they want and don't let them spend a dime it's cheap enough for publicity we're getting that you Bobby yeah hi how'd you do tonight oh not bad nine grand how much is that all together about a hundred and seventy thousand oh then another week or so and it's over any it's over as of tomorrow night what do you mean I'm taking it all of it tomorrow night what about your deal with Colin deals of her suckers I know how I can get away with all of it but you've got to help Bobby I'm scared nothing to be scared of now if you want to help me say so now if not you'd better pack sure I'll help but I'm scared all right I want you to buy a good used car tomorrow why we've got a car stop arguing and listen to me sure Bobby okay now you leave here at 9 30 tomorrow evening drive north on route 95 mm-hmm a five miles out of town you turn around and park heading toward town when I leave I'll drive to the same spot then I transfer to your car and we head right back through town to LA and then we're on our way to South America baby free and clear you couldn't really call it a gamble it was a cinch bet and the power of the press cinched it I tip Wally Campbell of National News Service to be at the joint that night with a photographer and I was all set to make my play all right you're going to bet this one mr. Richards huh oh oh yeah 20 on black 10 even and 10 on the first 12 thank you all bets down oh hi a walley be with you in a minute oh by the way I want to introduce you to mr. Colin he owns this place mr. Colin this is Wally Campbell of the National News Service you do hello mr. Colin hey black even well I guess that doesn't taking a break Richards no mr. Colin no I quit I figure the house owes me exactly let's see with what I have here two three three fifty exactly 179,550 dollars but I want the crook be to have 550 so that leaves a round figure of $179,000 well look I want it in cash and I want it now Wally you can start taking pictures anytime now all right Hank come on over here and set up stony the table is closed yes sir what are you trying to pull Richards I'm not trying to pull anything I just want my money that's all are you lousy double-pressing chiseler I'll take Wally over here with you yeah what do you want mr. Colin wants to make a statement huh go ahead mr. Colin make a statement well I really don't have much to say except this proves that your wheels are completely honest isn't that right mr. Colin yes that's right and mr. Richards here approved it yeah my money mr. Colin where's my money in cash stony yes I get a hundred and seventy nine thousand dollars from the cashier yes sir look the two of you stand in front of the wheel by that pile of chips no a little you're right Bob here that's it that's fine sure you know what you're doing Richards I knew when I came here I won't quit looking you know that sure but you won't find me no look pick up a handful of chips mr. Colin give it to Bob I'll find you I wouldn't bet on it I would in fact I'm betting a hundred and seventy nine thousand dollars on it we continue with the second act of suspense the evolution of a medal in 1847 during the war with Mexico Congress established a citation award for conspicuous service by members of the United States Army this was the certificate of merit strictly for army enlisted men in 1891 almost a half century later non-commissioned officers became eligible to receive the certificate no medal went with this award until 1905 when a coin-shaped metal in bronze bearing a Roman eagle was approved and adopted the suspension ribbon was vertically striped in red white and blue in July 1918 Congress abolish the certificate of merit replacing it with the distinguished service medal and the distinguished service cross the medal is awarded for exceptionally meritorious service to the government while the cross is reserved to honor extraordinary heroism in connection with operations against an armed enemy before the certificate of merit was discontinued in 1918 1211 enlisted men had received the award given in recognition of gallantry in action or exceptionally meritorious service during time of peace the certificate of merit retains an important place among America's historic medals and now starring John Lund act 2 of winner lose all it was easy almost too easy I found myself with a hundred and seventy nine thousand dollars done up in a nice drake canvas bag like they use in the bank now all I had to do was meet Annie change cars and I had it made any any's a nice kid a fifty thousand dollar type kid not a hundred and seventy nine thousand dollar type but for now I needed her for now maybe later I wouldn't that's you Bobby yeah it's me I began to get worried I'm here now get going is everything okay I said let's get going all right I'm getting into the backseat I'm gonna stay down on the floor drive easy and legal and as soon as we're on the other side of town let me know till then don't say anything and don't look back just drive north of town about five miles out I guess he got into another car there then where'd he go name it you can have it tonnipa to Reno Barstow L.A. Bredudale Central to Mexico what do we do now find him nobody suckers me nobody call the boys and Reno Carson City Frisco LA tell them I want Bob Richards tell them I want him bad and alive Bobby Bobby hey Bobby boy where are you Bobby hello hello this is the apex travel service we're calling mr. Richards to confirm his reservation for one on the 855 trans Polar Flight 358 Paris pardon me mr. Richards his reservation for tonight oh for two no for one I said for who oh mr. Richards what room did you want to 14 well this is room 212 you got the wrong room yeah I'm sorry Bobby boy Bobby boy what a rat you are what are you doing here I told you to stay in your own room yeah but I got worried about what about you I can take care of myself now hello yes yes yes right thank you who is that the airport reservations desk confirming our reservations for tomorrow's flight to South America tomorrow yeah yeah 9 a.m. now go back to your room and I'll see you on the plane tomorrow I'll wait till the last minute before I board just playing a safe you know Bobby where's the money in a brand new suitcase stashed in one of those 24-hour lockers at the airport you know mr. trick do you I can't afford to honey I'll be a good girl run along I'll see you on the plane tomorrow morning so long Bobby so long Annie see you tomorrow yes Bobby tomorrow operator I want to make a person to person call to mr. Walter Carlin in Las Vegas yes that's right and please hurry what did you have to be such a rat Bobby in a moment we continue with the third act of suspense we have together ample capacity in freedom to defend freedom this is NATO the North Atlantic Treaty Organization in addition to the obvious military organizations and commands of NATO civilian council committees under the international staff and secretariat are constantly at work coordinating political affairs information services economic matters production logistics scientific affairs civil emergency planning and financial problems concerned with the maintenance of this vast and vigorous alliance the United States of America is a part of NATO you should be aware of and alert to the objectives and programs of the North Atlantic Treaty Organization and now starring John Lund act three of winner lose all three there pardon me but is this customs gate 21 yeah are you taking the trans-polar yeah business combination so yeah it's a nice suitcase you have there thanks I'll bet you it holds a lot of money what's that might even hold a hundred and seventy nine thousand dollars why are you right now you're lucky I want to stretch it get on that plane and you're dead what do you want me to do now that's your business just don't get on that plane you want me to go back to Vegas don't you well now sir that's up to you and if I don't that's up to you too let me in quick what's the matter Bobby you look pale they found me who found you Carlin I don't know how but he found me where they find your Bobby at the airport yeah they found me what did you say they found you at the airport didn't they Bobby getting on the Paris plane just as I told him to why you was very glad to know where to find you five thousand dollars glad I'll break your neck no no you won't Bobby Mr. Carlin sent me a bodyguard to he's in the next room of course he isn't as clever as you but what good is clever do something clever it now Bobby better give Mr. Carlin his money or bang you're dead you got a bus that goes to Mexico not direct you change the San Diego for Santa Cedro and you get a bus Santa Cedro Tijuana fine how soon as they leave about an hour eleven fifty five p.m. okay give me it bang you're dead get on that bus and you're dead leave me alone like I said don't stretch you luck taxi taxi where do you want to go mister take me take me to Las Vegas that's more than 300 miles cost your bundle I don't care what it costs it's not my money well here it is Carlin I spent about a thousand no Bobby boy I don't want it this way why not this way well then then then how go downstairs to one of the roulette wheels and start playing what with your money that's right but don't bet more than fifty dollars at one time you've got a system lose with it lose the whole hundred and seventy eight grand but but that'll take months that's right Bobby boy months but think of the publicity I get suspense in which mr. John Lund starred in William M. Robeson's production of winner lose all by Ross Murray supporting mr. Lund in winner lose all were Rita Lynn Lou Merrill Eddie Marr Jack Crucian and Sam Pierce listen listen again next week when we return with another tale well calculated to keep you in suspense this is the United States armed forces radio and television service