Hi everyone, Joe for jaspyscasebreaks.com coming at you with a Prism basketball sell-o-pack random team break number 226 Giving away 10 spots in that one box immaculate basketball break First the break itself big thanks to this group for making it happen All the teams are in right there. Let's roll it. Let's randomize names and teams three and a four seven times for names and teams one two three four five six and seven in final time Of course different dice roll for the giveaway apart after the break seven times to the teams one two three four five six and Seven final time. All right. There's the first half of the list right here and The second half of the list right over there and let's print and rip So this is the second to last fellow though if you're watching live the last filler. I think only has two spots left and this person by and That is now full So that break will be coming up a little bit later Update the schedule really quick. I think we just have one more quick little break in between All right food. So if you click the link if you're watching live, you can click the link in the You can click the link that's Pin in the chat and I'll take it to the schedule and that'll give you an idea of when we're gonna get Everything going here. All right. Let's see. We've gotten here re-checking in saying blue jays win Three to nothing and Jordan Romano breaking the blue jays saves consecutive saves record 26 Had them on my fantasy team last year. It's pretty solid. All right. So let's see what we got break wise Deandre hunter green pass called siacum and an emergent silver Anthony Edward. That's not bad Dusty with the Timberwolves Red, white and blue, Lugans dork, Dwayne Wade and Jaden McDaniels As well. All right, not bad. Let's flip back here. Oh, there's a schedule. Let's flip back to the list Let's gather everybody's names From one down to 30 and everyone in between so once again top ten after Six five and one six times. Good luck everybody one two three four five and six All right, so from 11 through 30 sad times, but thank you for giving this a shot Especially that 11 spot right there Alan. Thank you. Thanks for giving this a go All right top 10 though. Happy times for Darren Dusty Kevin Nick Nick Dusty Dusty Dusty Dusty and Kevin again. There you go top 10 Thanks for watching. Thanks for breaking with us. We'll see you a little bit later tonight for the other filler And then the one box macula basketball break. Bye. Bye


You did? Did you really? What made you go vegan? I didn't expect The one of the police officers to be vegan. You can take one of these actually.   This is a meat dairy and egg industries in the UK Trying to show people where the cruelty in there. Oh Hey, wait, don't leave don't leave. Have you this is about do you eat these products chicken? Do we eggs? You don't need beef or chicken or eggs or dairy eggs. Yeah. Yeah, so all these all the egg laying hens are all slaughtered They're all slaughtered.  It's hidden in there, isn't it? You don't realize? Yeah, yeah You know, you kind of forget sometimes when you buy it.  Backyard slaughter.  Yeah, I'm not sure if you're eating animals or animal products Vegetarian Go vegan. Do you know about veganism? Have you heard about veganism? I do, I've tried. Do you know why people are vegan not vegetarian? Like do you know why there's a diff- like what the difference is? Because the dairy industry is also cruel Yeah, yeah, basically, yeah, they all get slaughtered too all the dairy cows go to the beef industry Do they?  As soon as they hatch They're still alive, I do it while they're alive They're fully conscious Oh my The females go and get their I didn't know how they did it, I know I thought they'd get rid of them but I didn't know how they did it So sometimes they gas them or they put them in a bag and suffocate them Oh, right, so they do it in different ways, yeah Yeah, just the horrific That is disgusting Doing it like that Yeah, different ways, I mean, gas chambers are still, they suffer for about a minute And then they die and then You know, it's just horrible This is a free range egg laying facility This is free wing? Yeah Honestly? Yeah, no, I promise you They're free range, free range barns There's still crap out there Free range barns, they can have like Sometimes 10,000 in there So you're not, and it's no different than is it buying free range?  It is so innumerable It is horrible There is no actually main way to Shoot someone in the head and cut their head off, like I can't believe that they can do it In such an opposite way Yeah And the people out here, they're paying for it They're eating it, they're consuming it They're not aware of this, you know Well, we just waved about the price of it and out there Yeah But you know, you're never going to get There's a lot of people who just don't class fish as Animals Yeah I know, it sounds silly, but Most people think fish don't feel pain, they don't suffer They don't matter So, what does it, how do they kill most of the fish then? So, they might use these big trawling nets Drag them up out of the ocean or they Just suffocate Yeah, they suffocate to death They're just stabbing them to death Trina, they might stab on the boat Other fish, they'll just dump on the boat And this is another thing, all these people That eat fish and then they'll go Spend three days trying to save it Yeah You know They'll save the dolphins, but they'll Consume all these fish, like these big trawling nets They drag up all the species of fish indiscriminately So, they care about dolphins And there's all these by-catch in these nets Yeah, is this what they've caught then? No, this is just someone being nice to a fish I just added that in there to To show that fish Yeah, they can be, they just They don't want to be harmed, you know Yeah So I don't know, people do say How far do you take it and like, you know Like, well Yeah, how far? For life Vegetables are alive, yeah You do sort of get these things I get that all the time, but like They don't have a brain and they're not They don't get scared They're not conscious beings They're not having subjective experience They're alive, but It doesn't matter if they're alive It matters if they're conscious I think most people accept that we don't need to eat meat But They Choose to eat meat I think most of them know that we don't need meat Yeah, now, by now By now There's still some that They don't, oh I need the protein and I need this and I need that But by now it's pretty much accepted You don't need to Initially when you've got kids Some people Think that it's cool to not give the kids meat But you know, I used to think well You feed your kids what you want to feed your kids What about what the kids want?  If you showed the kids where it come from Do you reckon they'd want to eat it? I know They love animals Most kids like animals But like I said I won't go all out saying to somebody Why do you give your kids meat? You know what I mean? You don't I would I would say why are you feeding your child A tortured animal When you know that they're against animal cruelty Without them knowing I think now that's cruel The parents are choosing What to give to the child And like if the child would Shutter at this And you're still feeding them pieces of pigs Knowing that if they Seen a pig get killed That they'd be terrified So what Is it stands for change?


Good afternoon. Good evening. This is Guillermo Salvatier. I'm your host for today's show on Perspectives on Energy. I'm director of international services for HSI, the Health and Safety Institute on industrial skills. And today we're going to be talking about DER, Distributive Energy Resource Integration, otherwise known as DERs. So I'll be using that acronym quite a bit. And we'll see how the industry is going to manage this integration, what we've done so far and where we're headed and what we're looking at in the future. Definitely a lot of variables in here and a lot of things to discuss. We're going to be talking about a few different items in here. I've got a few bullet points that I've given myself to cover. Number one, what is it? We're discussing defining what DERs are, what DER integration is, and we'll cover a little bit of that. After that, we'll talk about how much penetration we've had so far and what that looks like up to now and how much more of a widespread penetration we expect in the next two, five, 10 years. The next topic we'll talk about is the modeling and planning studies. Like any engineering job, you're going to represent it with challenges as far as how this particular new resource will impact your day-to-day operations. So planning long-term is a challenge and modeling as well, but also day-to-day is going to present itself with some certain challenges when it comes to figuring out how to plan and operate your system. The other issue we're going to have, of course, is understanding how this will benefit the utilities, how it will benefit the consumers, how it will benefit the industry. That's the other topic, and then in the very end, we'll talk about the potential of specifically consumers when it comes to peer-to-peer energy marketing, possibility of being able to sell power and buy power between yourself and your neighbors or yourself and this whole pool of DER energy producers at the residential level for the most part those are car consumers. Okay, so let's dive right in. So what is a DER, a distributed energy resource? So that could be anything like a solar array on your roof. It could be a regular old reciprocating engine generator that you have on your house that runs on diesel or gasoline or natural gas as an example of that. You can have a battery banks that are already installed like a Tesla Powerwall, for example, at a residential level, or that could also be, for example, a heat pump system as well. So those have been around for a while, but those are now becoming popular again with how they can reduce the amount of power that's expended. They can store some energy, or more importantly, they can actually release some energy back into the system. The other thing, of course, which is becoming really, really interesting is the advent of electric vehicles and how that can be tied to the grid by the form of distributed energy resource management, such as the availability of them at some point serving as energy storage. So the likelihood of people installing batteries on a house is not as high as the likelihood of people buying EVs, electric vehicles, and then charging it at home during peak or off-peak hours. So given that type of likelihood, now we're looking at the possibility of the distributed energy resources now being encompassed into the idea of not just solar panels on your roof, but also your electric car on your driveway or your garage. So that's definitely going to be something that will be considered a DER at the residential level, so an example of that. So one of the things that is the terminology is we all became consumers of electricity, right? But once you become a, but you also produce electricity, you produce more than you're consuming.  Once you get to that point where you have a net positive generation of power where you're actually feeding power onto the grid, now you're becoming a prosumer, which is both a producer and a consumer. Of course, that all depends on what time of the day you're looking at, right? So that's basically what it is in a nutshell. Integration in this regard is once these resources get numerous enough to the point that they reach a certain critical mass that they become a concern or an opportunity or something that really impacts utility, that's when integration becomes important, right? Now we're already looking at the problems and the opportunities that are presented by rooftop solar. For the most part, there's a famous term known as the duck curve, which is basically midday peak demand has been reduced because of the output of all these like rooftop solar panels. Naturally, that reduces the amount of power being consumed. So then you have, for example, the low curve is not going to be as high as it was forecasted. So at around 10 a.m., the low just dips and it comes back up again right before sunset. So ultimately, the low curve takes the shape of a duck, which hence why it's called the duck curve. So that in itself, each here as more and more solar panels are installed, that the back of that duck curve gets lower and lower on that graph. So eventually, you will get into a problem of getting into a valley issue in the middle of the day. Most utilities have a valley issue at night, usually when everybody's gone to sleep, there's not that much demand for power. They've had to cycle generating units to be able to get rid of that excess power because they don't need it. And they're just basically running the base load units that are usually like in most cases, nuclear or hydro or something that is rather inexpensive, but rather large and difficult to cycle off and on. And a lot of places that are those are the large nuclear plants. So they comprise the base units in parts of the different parts of the country. That's also the large coal units. So usually cycling those or even re-dispatching those becomes cumbersome. So as we replace most of our coal fleet with natural gas, that those units are still rather large and difficult to maneuver, even while burning natural gas. So part of that base load gets affected by during the day now, when you actually get to the point where some of these valleys are actually lower than in the day that they were at night. And we're seeing some of that happen already in places like California, places like New York and places like even in the Pacific Northwest, where they have a lot of solar facilities and even in Texas, where they had the same issue with plenty of solar facilities that was creating a valley problem in the middle of the day for them. So where are we when it comes to penetration? We're talking about that, how the load curve has been offset dramatically by the penetration of rooftop solar. And somewhere about 20 or 30% at this time, right? We're looking at like another 5-10% increase year over year, when it comes to the rooftop solar installations. Along with that, we're going to see quite a bit of batteries also installed, whether it's electric vehicles, which would be the main driver, or it could be static power wall type of setup. So you have your garage, right? So there the limiting factor, of course, will be cost and will be availability given the fact that we don't have an infinite supply of lithium batteries or so there will be other type of technology that we're going to see being deployed. But for the most part, when it comes to vehicles, you're seeing that in its office becoming a limiting factor. Now, there are certain incentives, given the fact that some utilities, of course, are getting to the point where they are looking at maybe giving incentives away when it comes to having you install EV chargers at the residential level. Like certain companies here in Florida, for example, are giving you the incentive of covering the entire cost of the hardware, the labor, the permitting of installing a level two charger at your house, and also giving you unlimited optic charging for your EV off for about $36 a month with a 10-year commitment. I can personally tell you charging my vehicle, my EV runs me about $120 a month, and we use it a lot. So that's definitely quite the savings there, and it'd be really worthwhile. So with that kind of incentive, I can definitely see people inching that much closer towards making that decision and getting an EV trade. So the other challenge here is the next thing topic that we were discussing is the whole modeling and planning study issues. So when it comes to modeling this type of resource in the past so far, all they've done with it is really treat it as negative load. So as a distribution circuit usually is readily fed, as they go out from the stations to the feeders to the laterals and the different circuits, power flows in one direction from the source to the load. In this case, now we're looking at what's happening is that for the most part, some of these rooftop solars, all they've done is really offset the amount of load being served because the customer is basically supplying their own load with their solar resources as more and more of this grows. Eventually, you're going to see, of course, depending on the amount of real estate they have on their roof when it comes to their panels, or they install more efficient panels, you may get to the point where certain times of the year, they're not running air conditioning, for example, or there's not a lot of load in the house, they may get to the point where they may be at the point where their power is flowing back up the feeder, back up to the station, and back up through a transformer and into the transmission system. This is, of course, a concern for the electric utility planners, especially the transmission planners. Modeling is one issue. How do you model, rather than taking a net number, are you going to model this now a different way once you have, for example, a battery stored on there or a generator or some type of generating resource, whether it's a fuel cell or an EV or something as dispatchable at that point. So that's going to be one of the interesting challenges. There's quite a few algorithms right now. There's a lot of studies going on in place to figure out how this is going to be done. Ultimately, there are definite advantages to getting ahead of this, specifically for the utilities. If they got ahead of this, and we'll cover this later on in the segment, but they can definitely use this for their advantage if they are the ones that are managing the incentives and they're managing the rate of adoption. If this gets out of control, then it becomes much more difficult to manage for them, especially when it can really shift the flows on a distribution circuit that's usually only flowing in one direction. So that could be a challenge as well. So one of the biggest issues here, of course, is planning the system from day to day. It is quite a daunting task to do it on a transmission system, but it'll be infinitely more challenging to do the sort of next day planning on the associated distribution system. I mean, it'll be orders of magnitude more complex and more granular when you add kilowatts rather than megawatts, right, and having to analyze all that down to the distribution circuit. So that in itself will be quite the challenge. A lot of machine learning and a lot of machine operations will have to take into effect. Definitely some AI will be involved. And then in that case, you'll be seeing quite a bit of dispatchable resources that may be utilized by the utility to offset their generation or maybe even supplement their existing generation. So we'll jump ahead to that a little later. But one of the things that we talked about as well is, of course, standards. There aren't any set standards at a national level. So right now you have states like California, New York, Texas, even Florida, right, that they all have, they all basically operate on their own rules. They have their own nomenclature. They have their own vocabulary and they have their own regulations. So when it comes to the national level, I mean, NERC has a few standards in regards to renewable resources and even storage. But the challenge of course becomes how do you deal with distributed energy resources, which are way below the threshold for compliance and regulatory oversight. So this will be a new challenge. So one of the things we should hope for and maybe strive for is perhaps a national standard or some additional standards itself, regulatory standards that cover distributed energy resources or at least aggregation. Now, we talked about the definite benefit for the utilities, right? And one of the biggest challenges any utility has, of course, is figuring out where to build generation, where to install it, getting it permitted, and of course all the associated transmission that comes along with that. Very difficult thing to build those easements, very difficult to get approved. These site plans take years, almost a decade ahead to be able to put that together, right? With these DERs, if they are the ones that are providing the incentives and controlling where they would prefer some of these resources to be placed, they're now working in partnership with residential, commercial, and industrial accounts to serve as micro grids or again, distributed energy resources that together are aggregated and become a micro grid. For example, this is a couple of pilot programs that already have happened in the west coast of the US where they are looking at or they've already done this pilot test where they were dispatching the electric vehicles as a 15-minute generator, right? Meaning they were discharging over a period of maybe one hour, right? And they didn't use the entire capacity of the battery, they were just using it to supplement, for example, the generation that the utility didn't have. The other interesting benefit there is also emergency power, right? So when you have a certain loss of generation, you can call upon these different resources that are at the residential level and use them as an aggregated generator. So it'll be interesting because that could present itself with a certain type of level of reliability and if it's managed correctly. So the only way that the utility can actually stay ahead of this is they are the ones that are controlling, for example, when, where and how and how much is installed. And the best way they can do that is actually making sure they regulate the permitting process when it comes to starting both solar sites and also energy storage at the residential industrial commercial level. So now comes the third and fourth party into this equation, which is really the, if you have EVs, the automaker has to definitely buy in and approve the use of their product as an energy resource, right? Which, of course, this can get into some kind of warranty issues. But of course, I'm sure that can be worked around given the fact that the automaker will of course, I'm sure benefit or profit somehow from this particular arrangement. So that could be a partnership with the customers, the automaker or the hardware manufacturer and the utilities. There could even be a fourth party now that involves an app where this brings us to the final point that I wanted to make in this case, which is the peer to peer energy marketing. So imagine you are now in a community where you have a certain type, certain size batteries, you have two EVs, you got solar panels, your neighbors only have solar panels. You are then decided to, you're not going to drive for the next couple of days as you work from home and you're relaxing. So you decide to put the stored energy on that car for sale at a certain price. And I guess now you're selling it at peak and it's going to be a lot less expensive. You charge it off peak and now you're going to sell it on peak and you're going to sell it for less than the utility and you'll sell it to your neighbors or whatever pool within your particular neighborhood at a price that's competitive with the utility. So this whole peer to peer energy marketing gets to the level of granularity where you're basically using the low voltage system out there, which is usually the distribution buses to be able to buy a cell power between the close neighbors. Or you can sell your power to an aggregator, which is somewhere up into the distribution system. And of course, be able to participate in these DER aggregator markets. At the end of the day, I mean, not even do any of that. You can just be available for dispatch for the utilities. Say, for example, the utility needs help during what they call the end of the beginning of the lighting peak where all of the solar power goes away and now it has to turn out a bunch of generators should be able to manage, for example, the sunset, which is what they call the lighting peak. Usually a lot of stress in the system. So if you have a lot of resources out there at the load, which is really the best place to have it. Now you can support both the demand that increases rapidly over a short period of time is usually one hour. And I've seen them go up maybe two to 3000 megawatts in a one hour period. And they'll come down just as quickly. So that's an example where DERs could serve the utility. If the utility had the ability to manage them and use them as a generating resource. So that's one example. The other example, of course, is just being available for dispatch should an emergency arise, or should the utility need, for example, additional generation in a real hurry, or they need help with voltage or even frequency, depending on what sort of control or inverter system you have. So these possibilities become really interesting. I think we're only a few years away from that being widespread. Really the only barrier now is the widespread adoption of electric vehicles, or at least widespread adoption of small storage devices at the residential, commercial, industrial level. But the future's not far off and we're going to get there pretty soon. Naturally, there's a lot of uncertainty, right? There's a lot of unknowns regarding these sort of planning studies and how we're looking at this. There's different utilities of taking different approaches as to how to best plan and mitigate and try and predict, because of course, this sort of prediction requires the reallocation of a lot of resources, just by the mere fact of providing incentives for the installation of these devices. That has the cost. I mean, you may offset the cost of building generators or transmission lines, but that only depends on a certain level of adoption. So if you don't have that level of adoption, you're looking at the challenge of, of course, they won't have to make that investment. The other challenge there as well is if people buy these vehicles, are they going to participate on this, what they call dispatch market, right? So that's the other thing. So you also have to incentivize that particular product as well. So usually that has become so many different variables and so much different volatility on all these factors.  They're just trying to predict or come up with different plausible scenarios so you can give yourself room to be able to adjust as things adjust. Now this tells you how difficult it's been over the last five, even five years in Europe, Australia, when dealing with these resources and they've had, they've been far ahead when it comes to legislation and public appetite for it, but at the same time there hasn't, there hasn't been the adoption that everybody was hoping for, especially at the utility level, right? From their perspective. So not as many customers got on board as utility had hoped. So there has to be a different way of looking at this when it comes to providing incentives. So ultimately, these did different topics. We talked about what it is, we talked about where we are right now as an industry or percentage. We talked about the challenges when it comes to modeling and planning and how we come up with studies to be able to do a long-term, near-term and next day. And we also looked at examples of some of those different states that are very progressive and forward-looking that went ahead on their own, but now they all have a different hodgepodge of terms and protocols and procedures that don't quite line up with each other. So that's examples of states I gave, but at the very end, let's talk about the benefits that this could bring if managed correctly and why it's imperative for the utilities to really be at the forefront of this sort of process and with the incentives they can offer. So I've already seen that happening in my state, specifically with the electric vehicle chargers, namely the Level 2 chargers, and those are going to be interesting because one of the plans is, of course, is that one of the larger utilities in Florida is planning to have a Level 3 charger at every gas station in Florida. So that could be a monumental shift when it comes to range anxiety for most of these in prospective EV owners. So once you have the ability of charging your car anywhere you go, or anywhere that there's a gas station, then that sort of abates and alleviates some of that fear and anxiety when it comes to owning an EV. So that's the case. You can see a lot more adoption, but along with that, something everybody always talks about is, can the utility handle, can the system, can the grid handle all this additional load? And when you look at it, it's almost as if you're, think of it, charging any of you, it takes about maybe two to four hours. Think of it as running your dryer for two to four hours. That's how much load you put on the system. So it is significant, right? But so it requires a little bit of planning and a little preparation which is why some of the utilities now are deciding when you can charge your vehicle and it'll usually be off peak, which of course helps them deal with their value issues. So again, that's another idea when it comes to DER integration is learning how to manage this resource and to benefit the utility and benefit the grid. So hopefully we'll have another segment on this particular topic as things develop, but I will be attending a few seven hours coming up on specifically DER integration. So whatever I learned there, that's different from what I talked today or knew, I will be sure to have another segment that will discuss this even further. So once again, I look forward to sharing this. I know that the people in Hawaii and of course the rest of the world are always, always interested on renewable resources and getting towards that net, not just net zero, but real zero when it comes to generating energy and the using energy. So this place like Hawaii, for example, this is really important. So again, thank you all for your time today. I really appreciate the presence and I look forward to some of the questions hopefully in the comments below. So I'll try and get to them and answer them as much as I can. And I look forward to any of our questions. So have a wonderful day and this resume, this pretty much concludes our short for today. Thank you and have a good night. You can also follow us on Facebook, Instagram and LinkedIn and donate to us at thinktecawaii.com. Mahalo.


From New York, extracting the signal from the noise, it's theCUBE covering Spark Summit East, brought to you by Spark Summit. Now your hosts, Jeff Frick and George Gilbert. Hey, welcome back everybody. Jeff Frick here with theCUBE. We are live in Midtown Manhattan at the Spark Summit East. They've got Spark Summit East, Spark Summit West, Spark Summit Coastal, really loud audio in the background, but that's what happens when we're live. But we're excited to have Tamar Hassan back, CTO from WideOps, he was on yesterday on our customer panel, but we wanted to get him back and dig a little bit deeper into the story. I'm also joined in this segment by George Gilbert from Wikibon. So first off, Tamar, welcome back. Thank you, it's good to be back. Absolutely, so for the people that missed the segment yesterday, give us just kind of a brief overview of what WideOps is all about. Sure, we're a cybersecurity firm. We specialize in a very specific slice of cybersecurity of bot detection. So our goal is to verify that there's a human on the other end of the screen for anything that we're protecting. There's a wide array of use cases. Our major focus right now is ad security because of quite a large market for malware there. So the people that aren't familiar with the bots and ad security, what are the issues that people have? Why is this an important issue that you built your company around? Yeah, it's interesting. We never thought as a cybersecurity company we would end up in the advertising space, but it was a pretty clear journey all the way across in a pretty direct one. So the losses are estimated at 7 billion plus and that's conservative to US advertisers, lost to advertising fraud. Now this is essentially automated agents, spoofing interactions with ads, spoofing retargeting engines, a lot of things like that. And you can imagine the amount of dollars in ad and brand advertising. It's a big game to play. Now when you have a seven, so of that 7 billion, about a billion or more actually goes to cyber criminals or organized groups. Now you're talking about a billion dollar black market fueling the spread of malware, right? So anytime you have that level of money you have real talent, real adaptation and things like that. So this is things like I set up a fake account. GM is advertising their new car. I go in and basically fix it. So I'm getting paid for impressions that were really just some computer software banging away and that's how people are really gaming and ripping off the systems. Is that a good example? That's an example of one of the primitive models. Now if anyone's ever been in the ad tech ecosystem it is a very complicated system and very layered. So there's many layers and there's little holes and cracks in a variety of places that get interesting. So there's a lot of ways to make money. Probably the most important principle fueling this here though is that it's one of the few recurring revenue models for cyber crime. Usually you steal a credit card number and you're gone. Somebody's looking for it, the money's missing but this is a scale revenue model that makes money month over month year over year and sometimes for years which has drawn a lot of action away from identity theft and credit card theft.  Right, right. So we're here at Spark Summit. Your company's been around for a while. What role does Spark play? Why are you here? How has Spark kind of changed your game? Sure, yeah, we're early days here in adopting it and there's a variety of use cases. The big one up front is exploratory and ad hoc analysis and it's a difficult problem that's magnified obviously with a scale of data.  We're probably, I don't even know relative, there's a wide range but we collect, every time a page loads, we collect anywhere from 500 data points to 2000 and sometimes it's very unstructured, nested data structures, sometimes it's not. We're talking about 20 terabytes a day of a real time data pipeline that we have to make decisions on and then after that do exploratory research. Now that becomes difficult when it's untyped, when it's unstructured and we have a team of white hat hackers and a data intelligence team that's constantly querying and iterating is our core functions for innovation, for producing these things. We produce algorithms that detect humans and bots. So the quicker that iteration cycle is the more impact we can bring. So that's been the whole drive here is driving down that iteration cycle and all the stages. Who's your client? Is it the advertisers? Is it the network? Who's employing you to help reduce the amount of fraud? Yeah, it's the full spectrum in advertising. Our primary direction is brand advertisers and the Fortune 500 and all the brands. We published this annual study on advertising fraud called the Bot Baseline. This year was the second year. It was a pretty in depth 40 page analysis of all the crazy things that bots do to game the system. And it was done in partnership with a lot of the major brands in their advertising. In addition to that, we work with ad tech platforms in the middle that provide all the pipes back and forth and as well as publishers. Because when you think about it, the money should be going to real content generators and it's not. When you think about the New York Times puts a tremendous amount of money into producing real content for all of us to go visit. Now I can put up a blank webpage and by the end of the day just have as many unique visits as the New York Times homepage just by using fraudulent bot traffic and malware driven bot traffic and things like that. So there is a model of price suppression there when you think about an endless supply and what that does to the market. So we work across the full spectrum. So how does someone who is, who has malware, how do they benefit from sending false traffic to the New York Times? Yeah, so there's a variety of fraud models. There's two of these ones. So let's say your computer is malware in fact and now there's, I don't know how many thousand people are at this conference today but assume it's somewhere from 10 to 20% of infection rate is where we're at now and when you include crimeware which things like voluntarily installed toolbars and adware that view strange things in the background that can get upwards of 25 to 30%. So you're talking about real footprint here. So let's assume that something like that is running on your computer and there's a 20, 30% chance it actually is. It's using your computer's resources, also your identity.  So if the malware is actually using your system, it's also using your identity. Okay. So there's a whole triage and arbitrage of players in the system where any number of traffic flows can end up on the New York Times and everything downstream takes a cut of the money. So even if it's not them and it's not generally not the premium publishers doing this, it helps fuel. Oh, you mean so one of the other publishers might be one of the principles in this? That is the first order fraud.  Now what you see is this arbitrage of four or five resells of these impressions, these users and at some point some of these premium publishers, they're doing their own advertising, maybe they're doing a social media campaign or something else and these pipelines actually end up in those. They're good enough and maybe New York Times is targeting you, you could end up, your malware could be targeted instead, right? So there's a lot of vulnerabilities in the system and a lot of victims in that layer but it gets complicated. So tell us, we keep going back to this issue of how much of this is repeatable versus how much is custom for each engagement? What can you bring with you that you can sort of work out of the box and then how much is it that has to be tailored or either configured or built custom for each customer? As far as our capability and technology, it's generally not built, it's built generically across all customers, the ability to detect and prevent this kind of activity. What gets custom sometimes is the reporting and data speeds, right? And that's where Spark comes in and it's very powerful, right? I can give this ad tech platform that funnels most of the traffic in the industry or a big part of it, a different data feed by setting up a different transform in Spark and pushing them. Maybe they want a more real time feed and I can actually do live feed there or they want a custom format. All that is the back half of a good data pipeline after your data lake. I was what I was going to ask. So sort of at the tail end of the data pipeline and some of the new stuff that might be relevant is where you can run dashboards off a stream, that sort of thing, so super low latency analytics. Yeah, that's a very powerful feature and it's a very interesting thing because right now we process upwards of 10 to 15 billion web transactions a day and we have a dashboard that's up to date within two to three minutes. Now that's generally a very powerful feature, product feature, usually. To have such freshness. Yeah, right, but now you're talking about real time. Yes, it's taking another look. Park the real time thought and for all our practitioner or doer viewers out there, people who are trying to build that sort of thing, how do you get that two minute latency? You know, what are the pieces you have to put together? Yeah, there's a lot of tenants of a streaming pipeline and we use a lot of the modern things. Everything from Kafka, we're starting to move into Cassandra and some very powerful databases. Druid.io is one up and coming data platform that's incredibly powerful and we have Spark scattered throughout that. Now what we're doing now is kind of moving that more in-stream. You talk about the three components of a data pipeline that extract transform load and Spark is really good at a couple of them and if I can unify that and also provide a platform for all of my engineering teams to use easily and accessibility is a very important part of any framework. Then it works well. By uniform, you don't mean to have Spark do all the ETL or do you mean like have Kafka at one layer, Spark at the sort of transform layer and then maybe sort of Spark also at the query layer? Sure, yeah, so we would keep Kafka and things like that. What we're moving to is a model we call a data decorator and what you end up, so our pipeline, we can either, we take this raw bundle of data, we transform things, we add attributes, maybe some reputational stuff, then it goes into a decisioning engine and decision is made and it goes into some kind of, another transform for reporting. Now all those are different parts of the ETL or some part of it. Moving to something we call a data decorator where it's all on Spark and that can do all of those things.  And then what are the actions that are taken once you've just determined that a particular feed is fraudulent, are you shutting that off? Is it just a reporting back to the advertisers and the network? I mean, what are some of the actions? And also your thoughts on real time because I'm looking at, 10 to 15 billion is a humongous number. So where does real time, what does real time mean in that type of world? Because obviously it's not instantaneous. But we always think of real time as in time to do something about it. How do you guys look at it and what do you do about it once you figure out what's going on? Yeah, sure, so we'll classify it as near real time in real time, real time is where we're actually taking action as the thing is happening, right? A real time prevention. So we classify detection and prevention separately. We have separate outputs. So when I talk about a dashboard that's up to date in two to three minutes, that is a monitoring and optimization dashboard. It's a decision tool and a monitoring tool. We have another machine learning driven platform that responds in five to 10 milliseconds. Now this is fast enough to actually prevent the thing from happening. So that transaction never happens. It never happens. You just nip it out ahead of time. Right, so we have this global network of these prevention nodes that all of our customers use. And it's a closed loop cycle. All of that stuff we do in detection powers these machine learning models. And those respond in five to 10 milliseconds. That loop is also quite important and that's where we get into real time blocking. Right, and George has brought up an interesting point on a number of other interviews which is this real time monitoring but the ongoing adaptation of the models based on the new data and the impact really on the machine learning to be able to continuously adapt. How are you guys kind of dealing with that? Yeah, that's exactly right. Right now it's a batch process. It's a fast one, but you know, my product and sales teams want it to be faster. Right now when we see something within four to eight hours, not 48, all of our prevention nodes across the globe are updated with that knowledge to block. Now, you know, we think about bot adaptation. It's really usually on a greater cycle than that. Right, that somebody's going to adapt defenses. But there is a lot of... Grabbing there faster. Yeah, right, well, no, they're a little bit slower.  You're going to do some work to adapt. But it does come into play with new sources that we haven't seen before. So Spark is really interesting there. Now, you know, a lot of the talks here you see, you can actually plug that real world machine learning model into that detection pipeline that's running, you know, over the course of two minutes. And then it can become actually a two minute cycle instead of a eight hour cycle. And that is where the real power of that comes in. Yeah, it's pretty interesting. Fascinating topic and, you know, the ad tech world is so interesting. I think it's often poo pooed by a lot of people and enterprise tech is, you know, it's ad tech, you know, whatever it's serving ads. And, you know, does that warrant the great power? But it's huge amounts, huge amounts of money and a real high performance benchmark to be able to execute these auctions and delivery in real time. It's pretty amazing. I think it was Jeff Hammerbacker who said the brightest minds of my generation going into figuring out how to get people to click on ads. But he missed the point, which was you guys are pioneering a whole new class of applications. So we do it first here, and then sort of that knowledge spreads, you know, in terms of how do we do continuous apps? Yeah, it's a very sophisticated system. I would say only, you know, the only thing that really eclips it from a technology standpoint is real time trading in the financial industry as far as transactional throughput and real time processing. So, Tamara, give you the last word we're running out of time. One is again, where can people go to get the document that you referenced earlier to kind of learn the basics of this world? And what are we going to be talking about a year from now, if we're back here at Spark Summit last 20, or East 2017, what are you looking at over the next six months, nine months, how's things evolving? Yeah, so, check out whiteops.com that's the BOT Baseline and a lot of analysis and in-depth study of how these threat models work. You know, the next 12 months are going to be interesting and exciting. A lot of the groundwork laid here will carry on for the next 12 to 24 months. What I hope to see in the next 12, you know, one to three years is this move towards a unified data platform whereas in the last five to 10 years there's very traditional ETL and warehouse approaches. You might have 10 transactional systems piping into a warehouse running on a 24-hour cycle and things like that and you know, every component of that adds a layer of fragility and also a layer of duplicating data and work. Now I think for the first time in a long ever we have the opportunity for a more unified data pipeline and where we don't have to duplicate functionality and data and that matters at the petabyte scale a lot more than it did at the gigabyte scale the last 10 years. Awesome. Well, Tamara again, thanks for stopping by. Really appreciate it. From White Ops, I'm Jeff Frick. You're watching theCUBE. We are live in Midtown Manhattan at Spark Summit East. Next week we're going to be in Las Vegas at the Mandalay Bay at IBM Interconnect. So stop by, say hello, we got a big production. The whole team will be there. We're looking forward to it. We'll be back with our next guest here from New York City in just a few minutes. Thanks for watching.


While running for president of the United States, former New York mayor Rudy Giuliani ran a campaign ad contrasting his chance of surviving prostate cancer in the US 82%. With the same chance of surviving prostate cancer in England, only 44% under socialized medicine, where they don't do routine PSA testing for prostate cancer. To Giuliani, this meant that he was lucky to be living in New York rather than old York, because his chances of surviving prostate cancer seemed to be twice as high here in the US. Yet despite this impressive difference in this five-year survival rate, the mortality rate, the rate at which men were dying of prostate cancer, was about the same in the US and the UK. Wait, what? PSA testing increased survival from 40 to 40, 82%. How is that not evidence that screening saved lives? For two reasons—lead time bias and overdiagnosis bias. I've talked about overdiagnosis, where a cancer is picked up that would otherwise have never caused a problem. Without screening, let's say out of a thousand people with progressive cancer, only 400 are alive five years later. So without screening, five-year survival, only 40%. But let's say with screening, an additional 2,000 cancers are overdiagnosed, meaning you picked up cancers that would have never caused a problem or even would have disappeared on their own. Since the cancer was harmless, five years later, of course they're all still alive, assuming their unnecessary cancer treatment didn't kill them, and all of a sudden you just doubled the five-year survival rate, even though in either case the same number of people died from cancer. And that's one way how changes in survival rates with screening may not correlate with changes in actual cancer death rates. The other is lead time bias. This is how it works. Imagine a group of patients in whom cancer was diagnosed because of symptoms at age 67 years, all of whom die at age 70. Each patient survives only three years, so the five-year survival for this group is 0%. Now imagine that same group undergoes screening. Screening tests, by definition, lead to earlier diagnosis. Suppose that with screening, cancer is diagnosed in all patients at age 60 years, and imagine in this case they nevertheless all still die at age 70 years. In this scenario, each patient survives 10 years, so the five-year survival rate for this group is 100%. Survival just went from zero to 100%, call the newspapers. With this new screening test, now cancer patients are living three times longer, 10 years instead of three, it's a miracle. Whereas all that really happened in this case was that the person was treated as a cancer patient for an additional seven years, which, if anything, probably just diminished their quality of life. So that's the second way. How changes in survival rates with screening may not correlate with changes in actual cancer death rates, and in fact the correlation is zero. There is no correlation at all between increases in survival rates and decreases in mortality rates. That's why if there were an Oscar for misleading statistics, using survival statistics to judge the benefit of screening, we would win a Lifetime Achievement Award hands down. There is no way to disentangle the lead time bias and the overdiagnosis bias from screening and survival data. That's why these statistics are meaningless when it comes to screening. Yet that's what you see in the ads and the leaflets for most of the cancer charities. That's what you hear coming from the government. And prestigious cancer centers like MD Anderson have tried to hoodwink the public like that. If you've never heard of lead time bias, don't worry, you're not alone. Your doctor may not have either. 54 of 65 physicians surveyed said they did not know what lead time bias was, and then when they asked the remaining 11, okay, what is it? Only two were actually correct. So at this point in the video, already you may know more about this than 97% of doctors. To be fair, though, maybe they don't recognize the term, but understand the concept? Nope. The majority of primary care physicians did not know which screening statistics provide reliable evidence on whether screening works. They were three times more likely to say they would definitely recommend a cancer screening test based on irrelevant evidence compared to a test that actually decreased cancer mortality by 20%. If physicians don't even understand key cancer statistics, how are they going to effectively counsel their patients? Statistically illiterate physicians are doomed to rely on their statistically illiterate conclusions, or on local customs, or on industry representatives and their information.


the 22nd amendment is a curious piece of political thinking. It appears to be an additional limitation that is placed on the executive branch of government requiring a change. Indeed, from the standpoint of other leaders, this appears to limit an imperial president to two terms. This is an amendment for a political oligarchy, where the political party insiders who decide who serves candidates can only have one standard bearer serve for two terms. But when we get by the issue of shared sovereignty in government leaders, there is another and much darker side to this amendment. It is only seen when we address the sovereignty of the people and their right to pick their own representatives. It might still be a good amendment, even with this, but the failure to even consider how it might limit we the people and our choices leaves it in question. It is supposed to be the people who elect the president. It is supposed to be the people who are entitled to representation. Is this amendment passed to limit the right to elect the person of their choice? If those who set this amendment in place really wanted to solve the problem, they would have addressed the right of the people who set demands upon their hired president so that he would not act as a sovereign. Once again, the failure to educate the public in their role as owners leaves the action of government unchallenged. Without that question of representation being raised and resolved, this amendment does not represent the American voters. It represents the political aristocrats who run the political parties, train tomorrow's political leaders, and select those who are expected to see to the party's needs. The 23rd amendment deals with citizen representation in those living in the District of Columbia, the seat of government. It is intentionally not a state, and this has some political limitations for those who live there. This 23rd article is a maintenance amendment, bringing the Constitution to address a detail that had been left unsettled in the original writing. It is an amendment that is well within the purpose for amendments, as noted in Article 5. It should be noted that this challenge had already been met for federal enclaves, territories within the boundaries of the states that had been ceded to federal law jurisdiction by agreement with the states involved. The citizens then affected just voted as citizens of the state then were represented by state representatives. The only difference was that the states would have to agree to have these citizens counted as part of their population for the purpose of voting. Apparently the political problem was so confounding to the leadership that they chose rather to amend the Constitution. And so Congress, which cannot even seem to find time and opportunity to manage its own members, much less senior leaders in the executive or judicial branches, retains its duty to manage the operation of the District of Columbia. The need to do something to address this matter is real, but the priorities indicated by the effort of amending this Constitution seems curious. The 24th amendment is insidious in terms of giving voting privileges to primary elections, purely political constructs. Primary elections were not a creature of the constitutional voting process. The right to representation was recognized in the original Constitution wording, and it had not been modified or removed. Primary elections had no previously supported part in state of the election process. Primary elections are created by the American political industry, giving official recognition to primary elections is a way to assure tax dollars support for the internal processes of these parties. It is a way for political industry to fund its own efforts out of the taxpayer's pocket to serve the political purposes of the parties. The purpose of course presented as assuring the right of the people to get to run for office. The actual purpose is that only the right people get to run for office, and that established political business to get to pick a few right candidates to set before the voters. This is the way for the political parties to determine which of their selected favorites will be most electable. And whatever could not be done to shake the non-professional out of the race would be handled by assuring the great expense would have to be met before even getting to be a candidate. When election is seen as a hiring action then primary election provides authorization for political parties to pick electable candidates who will most likely support their corporate interests. This amendment supports funding those political organizations' internal selection process and further grants them voice in government. And where are we the people's interest in this? The purpose is written into the preamble and they do not address such matters as this and certainly do not concern their funding. That is a political operation. This 24th amendment has little to do with amending the constitution. It supports an election process that has no part in constitutional government. It does not appear to have a valid constitutional purpose, though its enactment may be seen as accepting a new purpose, one of supporting the internal political party process for selecting preferred candidates. The 25th amendment is another maintenance and updating amendment, setting the conditions for transferring the duties of president to others where needed to keep the governing government in operation. It is both sensible and is an ordering of government in full accord with the original purpose of the constitution. The ordering is a little complex and filled with evidentiary requirements for those who initiate actions, but it does seem to provide a consistent and effective working base should the president be unable to fulfill the duties of office. The 26th amendment is another voting rights amendment, like the others it has meaning only in terms of a government that does not answer to its sovereign people but grants them limited permission in place of government services. It is another witness to a government that considers the voice of the public to be very much less than ownership and useful only to continue the career politicians authority to act as sovereign. It assumes that public leaders will be elected to do what is right by the voters and that they run a benevolent government on behalf of the people. It assumes that the same public leaders will be the ones who know best how government is to run. It accordingly is limited to guaranteeing voting, not to guaranteeing or even promoting representation. In short, it still does not much matter who is voting if the leaders available for selection are not intent on representing the voters. The ideal of a voting public selecting only a representative and not a career political leader seems to conflict with history. As a side note, this is only a small part of the cost of congressional action as they also maintain considerable staff, both for their in Congress efforts and for dealing with individual citizen interactions. Going through the process of amendment to set a pay process limit on Congress is a pretty good witness to the improper use of people's resources. What employee gets to set his own salary? He or she can petition the employer for a fair wage or salary with a good expectation of support but does not get to put his hand in the employer's pocket to take what he or she feels is right. That is criminal behavior. This is a constitutional amendment to limit the criminal activities of congressmen. It does not provide a comforting witness to the political condition of the United States. Apply common employment thinking.  Then they would not have to spend their paid time passing laws to assure their own pay. Congress has traditionally acted more as professional leaders than as representatives. They maintain staff to handle problems of citizens in dealing with their sovereign federal government. Personal support for citizen problems can always be used to advertise their value to the public. With performance thinking, it is more on point to have congressional constituents determine leadership pay based on the services that the constituents receive. Modern congressmen would not attach pay to what the congress has achieved for a very good reason. And so we end our constitutional study with another set of amendments that largely witness to the ongoing refusal to accept the sovereignty of citizens. It is a refusal to accept any power of citizens over their benevolent sovereign government. The attitude expressed is that the citizens are given the vote recognizing that they are given the proper people to vote for and should be pleased with the ability to determine which group of pre-selected professional rulers will provide them with the services that leaders determine to be best for them. I note that our government in the early 21st century is not functioning as a republic, even though it may be seen as republican in form. It is a political oligarchy, a government of a ruling aristocracy of professional political leaders who accept their own benevolent purpose as right for their nation. This is neither right nor wrong in any absolute sense. It is reality. They are, after all, is said and done good and effective Americans in their own right. They are the ones who keep the American dream alive. But then again, the constitution is also real. The observations that power and authority and capacity for government come ultimately from the people is also real. The American dream, even though not yet realized, is written into our constitution and it is still a part of who we are, even if our implementation has wandered. Our history, written into our constitutional agreement, also tells us that the American experiment in self-government is real and that we the people are the ultimate owners of the nation and the government of the United States. We face the challenge that what our government has done in our name has not always been what we would do or even what we would legally do. The management rule is appropriate. The one who acts on granted authority is responsible for the consequences of that action. The United States may indeed be a representative government, but it is unclear just who is being represented. We face the question of how much responsibility we then have for the things which our government has done in our name, but without representing us. The legal responsibility is part of the common law, but the personal responsibility that we as owners accept is unwritten.