Okay, move out. It's been said that the Army with superior weapons will win the battle. But there's more to it than that. The American fighting man is the best in the world, not only because he's the best trained, but because the vehicles, weapons, and equipment that support him are the best. And he knows it. The soldier knows he can count on that equipment when the going gets rough. And in combat, that makes a lot of difference. The United States Army understands just how much the infantryman depends on tanks, trucks, artillery, and helicopters. They must be reliable. They must be rugged enough to do the job, no matter how tough that job may be. This is the story of how the Army makes sure its fighting men are back with the most advanced and effective hardware there is. The story of testing at Aberdeen. This is the Army's Aberdeen Proving Ground. The test and evaluation commands most comprehensive facility. The site covers an area of 75,000 acres in Northern Maryland and is equipped with the most modern test ranges and data gathering equipment. Here, engineers and technicians, skilled in a variety of specialties, subject vehicles and weapons to the most grueling performance tests. Aberdeen provides this service not only for the Army, but for other military services and government agencies as well. Testing programs here cover a wide range of equipment, from small arms accuracy checks to analysis of the break up characteristics of a giant missile. But no matter what the test item, the mission of Aberdeen is the same. To make sure the soldiers of the United States Army, no matter where they may serve, are supported by the world's best vehicles, weapons and equipment. Much of the testing is done on specially designed stress courses. This one, called the Frame Twister, is well named. It strains a truck's body and suspension to extremes far beyond what would be experienced in the field. All moving parts must perform free of interference. Tests on severe side slopes of up to 40% grade help determine the truck's stability, steering and fuel system performance. Variety of brake tests are conducted on the vehicle, not only to determine reliability, but also performance under all kinds of emergency conditions. To collect accurate data on a vehicle's dynamic behavior, engineers place sensitive accelerometers at key locations. As the truck is driven over the bump courses, readings from these instruments are transmitted by radio link to a telemetry receiving station nearby. Recorded on magnetic tape here, the data is later processed through automatic reduction equipment which translates it into highly accurate performance information. This information is absolutely essential in determining the toughness and dependability of an army vehicle and its components. The little army mule is known for toughness, but new models are constantly being improved. Here, vibration resistance is chanked on the 6-inch sinusoidal washboard course. The bone-jangling ride continues over Belgian blocks which give the vehicle a complex combination of high and low-frequency random shots. Finally, an embedded rock course pits the mule against rough natural terrain similar to World War II's Burma Road. But probably the toughest tests at Aberdeen are reserved for tanks. Planning begins months in advance, and when the tank arrives fresh from the factory, the first step is a thorough examination. This initial inspection enables the Aberdeen engineer to know the vehicle's condition before testing starts, so he can have a set of standards to measure the results against. It's also necessary to make sure all the tank's systems are adjusted for optimum performance. In the automotive evaluation shop, experienced mechanics go over the tank's engine, making sure all its components are functioning at their best. They check manifold pressure, exhaust pressure, lubrication, and fuel flow. Related systems such as the engine compartment's fire extinguisher are also thoroughly checked. In combat, this system is just as vital in protecting a man's life as a tank's 2-inch armor plate. Malfunctions are quickly corrected before testing begins. Carefully reassembled, the tank is ready to roll out its moment of truth on Aberdeen's grueling torture tracks. Here, the vehicle's engineering will be matched against the uncompromising high-performance standards of both Aberdeen engineers and the United States Army. In the Monson area alone, there are 32 courses and obstacles designed to put the tank through its paces, and then some. First, the test engineer makes sure the tank can move through loose sand without losing traction or steering control. But sand is only one type of terrain used to determine mobility. A host of other adverse natural conditions are needed to verify it. The ability of a tank to forward good-sized rivers and streams reduces its dependence on bridges and means extra speed during strategic movements. Speed that could spell the difference between victory and defeat. The tank is challenged with a variety of obstacles. One of the toughest is the trench with front and rear interference. Here, the engineer must watch closely to see if any part of the tank's chassis or armament impedes his progress. The wall climb is another important test obstacle. All combat vehicles must be able to negotiate walls of various heights. Here, the Aberdeen engineer determines the effect of angle of approach and optimum low-speed power. The engineer is also interested in learning the length of free-spam this tank can successfully cross. Center of gravity and weight distribution are the critical factors here. But the crucial test of tracked vehicle performance is the hill climb. The ability to move up a steep slope at a specified speed. This is where the Aberdeen engineer really finds out if a tank is measuring up. How well the brakes will stop and hold the vehicle. How well the engine as well as fuel and lubrication systems stand up under the stress. Above all, whether climbing or descending steep inclines, the tank must be under complete control. An important related factor is the amount of draw bar pull a tank and generate. This is a measure of pulling power available for emergencies such as towing other vehicles out of trouble, operating in mud, or pushing through a dense forest. Once again, sophisticated instrumentation is used to check these critical values with the utmost accuracy. All of the many factors must be carefully considered in Aberdeen's final decision about this vehicle and whether it is good enough to support the fighting man in combat. But engineering tests under carefully controlled conditions are only the beginning. The beleaguered tank must now face Aberdeen's punishing durability courses. The Churchville test areas consist of a series of cross-country tracks with hills of every kind. There are no level spots here. These courses are especially designed to ruthlessly stress a tank's engine and powertrain to its limit. The test courses include roads of every grade, from those considered passable by normal traffic, to some you could hardly call roads at all. This is the extreme dust course designed to measure the effectiveness of air filters, abrasion of parts, and degree of driver visibility. Effects of temperature extremes are not overlooked at Aberdeen. Sub-zero conditions are simulated with the use of portable coal chambers. And finally, for vehicles requiring amphibious tests, Chesapeake Bay is right at the doorstep. But even when a vehicle completes all the torturous range tests, Aberdeen engineers still aren't satisfied. Skill technicians make an exhaustive study of all the tank's critical internal parts to determine how much wear and tear they have suffered during the tests. Together with maintenance estimates, this analysis is a critical factor in shaping Aberdeen's final decisions on whether this tank is tough enough for use in the field. Of course, the ultimate test of any piece of equipment is its performance in actual combat. But when a vehicle has been put through the testing program and approved for combat duty, there's just about nothing it can't meet on the battlefield that hasn't already been foreseen at Aberdeen. With a grinding across country for hours at a time, clearing a path through dense jungle, or blasting across the country. Or blasting away at enemy positions. The men know they've got the best there is. Delivering firepower is one of the most important purposes of a fighting vehicle. And at Aberdeen, the weapons systems which provide that firepower get special attention. On the many ranges, exhaustive tests are carried out to check accuracy, rate of fire, and effectiveness. As well as human factors such as safety, communications, noise, and fumes. All the things which make up the complex unit that is a tank. At one Aberdeen range, a radio-controlled target operates on a closed triangular rail course, moving from 2 to 45 miles an hour. It permits firing at targets moving at various angles, ranges, and speeds. Enabling the most difficult firing problems to be realistically simulated. Weapons of all kinds, from the smallest to the largest, come to Aberdeen for evaluation. This is the 175mm self-propelled gun, one of the largest caliber pieces in combat used today. Upon arrival, it is given a complete inspection for soundness and dimension. As with a tank, the engineer collects information about the weapon's condition before the testing begins, giving him a basis of comparison for later results. The gun is magnifluxed to locate any surface flaws and bore scoped to check the interior condition of the barrel. The critical inside diameter is carefully measured to the nearest thousandth of an inch, a process called star gauging. The gun must then be checked to see if there is any unusual internal stress during or after firing. To do this, strain gauges are carefully inserted into specially drilled holes. These holes must be so precisely machined that there will be no leakage, even though pressure may reach more than 50,000 pounds per square inch. Meanwhile, ammunition of a type designed especially for test purposes is carefully prepared in Aberdeen's high explosives plant. Then x-rays of the loaded shells are made to assure there are no major cavities which could cause a premature explosion in the gun barrel. The x-rays also ensure that the shells are internally consistent with those from regular production lines. X-ray and cobalt 60 techniques play an important role in many test operations at Aberdeen, helping engineers to spot defects in armor plate and to analyze the condition of ammunition after firing. The propellant shards for the test shell is carefully weighed to obtain the highest pressure within the gun's design limitations. Standard procedure at Aberdeen. A rayon bag holds the charge which is a combination of nitrocellulose and nitroglycerin. Inspection complete, the big gun is driven to the range for firing. Here technicians make final adjustments of pressure and strain gauges used to check ballistics and assure design limits are not exceeded. After the gun is emplaced, the hydraulic loading system rams a shell into the breach. The charge is added and the weapon is ready to fire. Not far away is an instrument trailer containing recorders and oscilloscopes used to gather the results of the firing. Normally, a smooth pressure time curve indicates a properly functioning gun. But if the curve is irregular in the rise portion, Aberdeen engineers know there is a possibility of the gun blowing up. Average speed of the shell is determined by recording the time it takes to pass between two sky screens set in front of the gun. More than one test firing is needed to provide enough data for an accurate appraisal. In the case of a firing failure, the cause is quickly determined in the nearby physical test laboratory before another attempt is made. This projectile is being measured for its degree of dynamic imbalance. Tests go on until every function has been checked. Here, the airburst performance of the shell is carefully studied on a special over-the-water firing range. By firing over water, the engineer has an unobstructed view from gun to airburst wherever it takes place. In another test, an infrared sensor is connected to a chronograph behind the gun so that the muzzle blast and airburst can be seen in the same field of view and the accuracy of the shell's timing fuse easily measured. At the same time, test observers in a tower take transit readings of the burst enabling the army to compile accurate range tables for the gun. Nothing is left to chance. Since atmospheric conditions affect range of burst, these are constantly monitored by equipment carried aloft in balloons. Temperature and pressure readings are radioed back while radar tracking of the balloon determines wind velocity. With the gun as large as this, muzzle blasts is a potential source of damage and a hazard to the crew. To make sure it is kept within safe limits, several types of sensing devices are positioned around the gun measuring intensity and duration of blast. In addition, photographs are taken near the muzzle with a high-speed shutterless camera enabling the engineer to determine if the projectile has been damaged in firing. A framing camera is also set up to record the motion of the gun barrel with respect to the entire vehicle as the projectile leaves the muzzle and the weapon recoils. This half-mile ballistic track may also play an important part in an Aberdeen engineer's evaluation of a weapon system. Ballistic tracks are one of the most effective and time-saving techniques for weapons testing because they permit the study of high-speed action under rigidly controlled conditions. This rocket sled is designed to carry a test item into a target at blinding velocity. At the impact point, high-speed cameras are ready and rolling, recording deformation effects and other impact information. Another unique test facility serving the Aberdeen engineer is this odd-looking structure made of wooden target panels and aluminum foil. With light bulbs hung inside, it can be used to accurately determine the explosive capability of artillery shells, such as the 175-millimeter. A test round is placed inside, and when it detonates, fragments rip through the panels and light from the bulbs is visible. From the film record of the light, the fragments' speed can be calculated. Later, the penetrations are counted and the fragments themselves are recovered and weighed, providing a complete index to the shell's destructive capability. All of these painstaking and sophisticated tests resolve themselves into very real and important meaning when the big guns go into action, providing support for the men in the field. Now all the hard work of Aberdeen pays off, as the 175s reliably deliver shells with pinpoint accuracy on targets over 10 miles away. Aberdeen's work is not confined to ground operations alone. Wherever the defense and welfare of the United States fighting man is concerned, wherever he depends on the support of equipment and hardware, Aberdeen plays an important behind-the-scenes role. Nearly all the weapons these helicopters carry here in combat were thoroughly tested at Aberdeen before being approved as ready. The automatic high-rake machine guns and 2.3-inch rockets in this system were given extensive ground and air tests at the proving grounds. They were flown over and over again through maneuvers that confirmed firing rate, dependability and safety under the most realistic conditions, conditions that left no doubt about their capabilities in combat. Effective and reliable as these weapons are, Aberdeen is constantly working on possible improvements. This is a new helicopter missile system just beginning its pre-flight checkout. In testing a sophisticated system such as this, every situation which the missile might encounter in battle must be taken into account, including vibration, shock, extreme temperatures, sand, rain and dust. None of these must be allowed to interfere with defendable and accurate performance. Although the testing at Aberdeen is practical and real, compiled results add up to mountains of data, statistics and figures. In themselves they mean little. They must be analyzed and evaluated, and only the skill and judgment of the trained specialists here make that possible. Only they can decide if a piece of hardware is really ready. Because Aberdeen is the Army's senior test facility, engineers and technicians can draw on 50 years of experience with every kind of military equipment, every kind of terrain and climate. What's more, they all share the same goals. To see that the United States fighting man is backed up with the equipment he needs. The finest it is possible to build. Engineering tests are tough at Aberdeen, but these weapons and vehicles have a tough job to do. Only those that measure up to the exacting standards are fit to move out into the battlefield to support the American soldier in combat. As he moves into battle, each man knows he's backed by the best-tested, best-built hardware there is. That knowledge makes it possible for him to fulfill his mission with effectiveness and with confidence, no matter what it may be. That knowledge is an important part of what makes the American fighting man the best in the world today.


أنا أماما جيدة بأن تاركات دون ديال أردت هذه المزيد من اوه العمليزية العمليزية للمنزل 2010 تيسي وهذا هو مكان الذي نسمعه يبدأه في حديثه في ساديس الساديس لسه جداً يبدأه في ساديس ساديس ساديس ساديس ساديس ونحن في المنزل هذا هو مباشر من المساعدة ونحن هناك so many things to be arranged things to be trained and things to be put in place ما هو المساعدة التي تأتي لنا ومن then he was challenged with multiple tasks he was able to really help us set the scene for the project at the beginning working closely with Dr. Omish Singh, who is the coordinator of the project for South Asia he was asked to do so many things taking over the administration of human resources financial relations coordination of network partners liaison with the officials in ICR and other government officials and other institutions including universities state governments and so on and beyond that he also extended his skills in helping us coordinating the other aspects of the project particularly the seed network seed production including private companies and so on he handled all these issues with a tremendous amount of patience and skills and also helped a lot in training new people who came to the office TC also have a very pleasant personality for those who has worked with him actually you can never forget him once you see him and I have never seen any of our colleagues who has visited in the office either from here or from outside and let he always mention and admire the help and the kind of relation and support he found from TC TC have been a great asset to stress since you joined us you helped us you helped us set the scene for the project and established a very good and strong network with our partners in India particularly I can't forget to mention that all our teams in India really talk very high on the way you handle issues related to them and your sensitivity to their needs funding, transfer trouble arrangements and so on one of the special characteristics of TC is his enormous patience and skill in handling especially events particularly our meetings of stress and visits to our sites we normally have very large meetings involving so many people from different countries and in the last 3 years they have been closely involved in this meeting and I have never seen any serious problems in the coordination of these meetings throughout these 3 years this has been a great asset to us on behalf of the stress group I would like to congratulate you on this prestigious award I would like also to wish you great success in the future and more awards to come I would like also to congratulate you on your recent achievements of completing your MPA in Agriculture Management


Welcome to Toffy TV, it is the Everton News Daily. Frank Llanpard has given his first press conference ahead of the new Premier League season. Everton faced Chelsea at Goodlison Park 5.30 on Saturday night in their Premier League opener and the manager was asked a number of things as you'd expect ahead of the new season. Mae'r dweud i'n dweud i'r dweud i'r dweud i Dominic Calvert-Lewin yn ymdeg yw'r cyffredinol o'r ddweud i'r dweud i'r dweud i'r dweud i Dominic Calvert-Lewin. Felly, gallwch chi'n gweithio'r ddweud i'r dweud i Dominic Calvert-Lewin? Can you give us a time frame on that injury and how has it upset preparations really? I mean losing a part like Dominic if he's quality in the week going into the first game is obviously going to affect you. I think we're probably looking at around six weeks for the injury. I saw a lot of crazy rumours yesterday but that's what we're, he's been assessed over a couple of days and that's where we're at. So it comes with the territory of having a squad and training at this level and we'll have to work around it and other players will have to step up and do the job and have six weeks passes relatively quickly and we get Dominic back. Yeah, so there you go the manager saying that six weeks, around six weeks for Dominic Calvert-Lewin could have been worse. Hopefully that's the correct timeline and we've just got to try and muddle our way through until then. Obviously the manager said in that press conference Calvert-Lewin was looking really sharp, really strong and he was looking forward to having him right from the off. And it is, it's a huge blow for Evan and one that is called, a lot of people call him for an immediate response from the club to bringing it forward. One of the strikers Evan looking at someone they've been monitoring for quite some time is Armando Brogir and the manager was asked about Brogir. I know Rich Ellison would have been banned anyway if he was still here but does the injury to Dominic emphasise the need to get in further striking reinforcements and with that in mind is Armando Brogir one of those targets that you could possibly be looking to bring in? Well, I wouldn't speak about other targets individually but I think in the area of the pitch, yeah. I think we were obviously aware of what we have, we lost Rich Ellison who was versatile across the front as well so I know we're brought in Dwight but we're very aware of the areas where we want to strengthen and I suppose, yeah, going into the first game with Salomon suspended as well makes it pretty clear that that might be one of the areas we look at. Unsurpris yna, Frank LLampard refusing to be drawn on particular names. Evan definitely need to strengthen in the forward areas, obviously losing Rich Ellison from last season, Dominic Alvaluw and out again injured Salomon Rondon, not available this weekend either. Evan had left with Delhi who will play up front and the manager was asked about him and said he spent a lot of his career playing as a second striker so he can do that role. But it's not ideal, you know, Evan have been linked with players such as Emmanuel Dennis, they've been linked with Mitty Batchway as well as Brojure, they've been monitoring Brojure since February March time. So he's clearly someone Evan very, very interested in and it will be interesting to see whether or not they make that call of staying to the plan and trying to get Brojure over the line or whether they do change course just to get someone in. But I suppose if Delhi does well at the weekend that might calm the whole situation down. Frank LLampard was also asked whether there was any progress on Amadou O'nana o Adrissa Ghanagai. I'm going to throw a few more names that you know anyway. Obviously O'nana is one, another player that's been linked to bringing it in midfield. Adrissa Gai, I wonder what's happening as regards the potential for him coming in and Conor Cody, a reinforcement at the back. Any truth in that as well? I think you know the answer. I'm sure you've got to ask the question but you know I wouldn't. It's standard procedure is it not and I think only right and respectful to not speak about other players individually. I think a lot of clubs with this window going into the season a few weeks will be making movements in the first few weeks of the season. I don't agree with it but it is what it is. Some clubs probably keep their cards close to their chest because of that and waiting to see what happens at the end of the window on deadline day. I don't know. We know where we want to get to. It's much better to keep that probably pretty private at this point. I know that's not the answer that you want. I wouldn't be drawn on that either but you've got to try. You've got to try to get them to commit for a suppose other players, managers don't like commenting on other players especially when the deals aren't at that advanced stage for either of them yet where they can openly talk about them. Hopefully Evan could get those two deals over the line. I think it would be huge for Evan to get on on it and go on it over the line. Elsewhere in the press conference he confirmed that Yeri Mina is fit and in the squad for the weekend. He said ask me a Begavitch is training today and training tomorrow and hopefully will be available to take his place on the bench and said Brasilia Miffeir that Alan is fit and will be in the squad but did kind of say they've got to give him some stronger training sessions because he hasn't really played any games at all this pre-season. He confirmed that Tom Davies, Andre Gomez will both miss the game and Seamus Coleman will miss the game as well although he did say that the Evan captain would play for the under 21s tomorrow night to try and get up to speed so you'd expect Coleman to, if everything goes well, to be back in the squad for Evan's trip to Aston Villa next weekend. Evan have announced a new sleeve sponsor ahead of their Premier League opener. The trophies have signed a deal with Boxth who are a multi-award winning tech platform which allows people to buy home heating at a fixed price. They're an award winning e-commerce site and Evan have signed a deal with them. There is a one year deal. There's a break clause in it next summer but there's also an option to extend. It's thought that Box beat off another strong competitor to take the place on the side of Evan's sheath. They'll be won by the first team obviously the under 21s and Evan women as well this season. It's the first time Evan have had a sleeve sponsor since the Angry Birds Rovio deal ended in 2020 so there you go a lot of people wanting that sleeve sponsor. Evan have got it now so a few more quid in the coffers for the Blues. And apparently just going back to that own on it and garner story Evan have supposedly matched West Amsbyd for the 20 year old Lill midfielder. Evan has been on Evan's raid all summer Evan have liked them but it was thought that the fee which is 30 to 35 million euros was a little bit too prohibitive for Evan given what they've been trying to do this summer. Obviously he got money in for a charlison but according to many different reports now Evan have matched that bit for the midfielder so therefore they must have come to some kind of agreement with Lill. Omnana's camp or Omnana's entourage as it's been reported in France say that he prefers a move to Evan and personal terms have been agreed whether that's variable I don't know. So we'll have to wait and see whether Evan do get this one over the line. West Amsbydd had to play yesterday morning when David was accepted and it was done but they've not been able to do that yet so this could go either way right now. But it'd be a fantastic, fantastic purchase for Evan if he could get this one over the line so it will be a fingers crossed I'm sure for all Evertonians but we do need a forward as well so hopefully that one isn't too long from coming either. That is it for the news day to check out our new website which is now live toffeetvefc.com get over there and give that a little visit. If you want to become a Toffee TV Premier member the link is in the description give the video a thumbs up subscribe if you haven't see you later.


Helo, Helo, OK. So, yes, hi, my name is Alan Woodwards. I'm a Committer on Lucene and I work for Elastic. You can see I've got my T-shirt fully branded. And I'm going to talk about super speedy scoring in Lucene 8. Those of you who are in the previous talk will already have a general kind of an overview of how this works and I'll go into a bit more detail. So, we start off with, we're going to talk about the lowest level of Lucene, how documents are actually collected. We have a class called a SCORER. And SCORER has two jobs. First job is to provide an iterator which will go and find you and iterate over all the matching documents for your particular query. And then it will also give each of those documents a score. It's always in the same order. We're always going in the, in terms of increasing document ID. And as we score everything, then we have a priority queue which says, okay, I want the top 10 matching documents so I have a priority queue of depth 10. As we go through each document, we'll generate a score for it. If it's going to be competitive, we insert it into the priority queue. If it's not competitive, we can ignore it. So, just as an example here, let's say we've got document IDs from 0 to 7. And as we go through each one, we'll say, here's document 0. We know this matches. We're going to give it a score. The score is 2.5. Fine, that's one score of 1.6. 2.5, 0.5 on as we go. And we can say, if we're going to collect, say, the top five documents, then our top documents here will be 0 because that's 2.5 and then 2 because that's also 2.5 and then 1 and then 7 and then 5. Now, if we were only going to collect the top three documents here, you'll notice that we actually fill a priority queue immediately, and then everything else we're going through, we're scoring, and that's just a waste of CPU cycles. None of this information is going to get into our top end. And particularly because even this one at the end here, 1.6, which has the same score as this one here, but because it has a higher document ID and our secondary sorting mechanism is always lower document ID wins, we're still going to ignore that one. So this means that if we want to break things up a bit, then we can skip over large chunks of the index and we can say particularly things like, well, for a constant score, for example, if you say a match all documents query, we could actually just stop collecting after we fill the priority queue, which for a constant score query would just be the first 10 and then you could stop, you could shortcut. That's fine for a constant score query, but obviously for queries that we're scoring using term weighting, we need to use a slightly more complicated mechanism here. And the mechanism we use is we chop things up into blocks. So here we are, we've chopped it into four blocks and then we record the maximum score for each block in the index. So we'll say, again, when we're moving through, we start off here, we collect our documents, we've got 2.5, we have 1.6, we have 2.5, we have 0.5. We know that our minimum competitive score is 1.6. We get to the next block and we know that the maximum possible score in this block is 1.1. That's not going to fit into the priority queue. We can skip straight over. We come to the next one. Sorry, I need to do it. There you go, I can stand my arrow. We come to the next one. The maximum score is 1.6. Again, we know that's not going to fit into the priority queue so we can ignore it and we can keep moving. And in this way we can short-circuit. We don't have to calculate scores. For any of these documents, which will speed things up. So we don't really want to score the actual, sorry, we don't want to score the score in the index because as Diego has said in his question at the end, you might want to change your scoring mechanism. So instead what we can do is we can have a look at how we're going to calculate these scores. Obviously the standard scoring is BN25 in Lucene. But any other scoring that's based on term weighting is going to be, you're going to be able to split the factors that contribute to the score into two parts. You have parts which are global for the index.  Sorry, total term frequency. That's the number of times that term appears in the index as a whole. The average document length, which is used in BN25. Again, that's something that's fixed for the entire index. It doesn't depend on which document you're looking at. And then the per document contributions, we have two. We have the document length and we have the frequency of the term. Document length, we don't, in Lucene doesn't actually store the full document length. It stores something called a norm, which is a kind of a compressed version of that document length. Uwe mentioned earlier that the encoding for that has changed in Lucene 8. And the main reason that's changed is so that's now, I think it's done for document lengths from 0 to 10, are completely accurate. And then above that you start to lose accuracy because we're only storing it in a single byte, but it's a long value. But we have this pair of values, it's norm and frequency, and we call that an impact. Now what you can do is you can, just storing the calculated score in the skip lists, we can store this impact, this pair of values. Now, obviously this comes with a trade-off. And the trade-off is that we need the similarity to behave in a certain way when this pair of values changes. So our constraints now are that if your term frequency increases, the score must increase. This is so that if you're going to calculate the maximum score, we're calculating maximum scores for maximum term frequencies. So you need to make sure that those two correlate. And then similarly with the norm, if the norm increases, then the score must decrease. So we're saying generally speaking, longer documents are less useful than shorter documents in terms of the contribution of an individual term's score. So we are defining that, we're going to say, all right, we'll make that an official definition, we'll make that an official constraint on the similarity. If the norm increases, then the score must decrease. And if you have a similarity that adheres to these two, then you can use this new blockmax functionality. So let's have a look at some individual queries and see how this new scoring mechanism impacts those. So a term query.  And all it does is it has, we have these two, your two methods on the scorer. You have the iterator. And the iterator just basically goes over the postings list for a term. So you have your index. Your index is a big long alphabetically sorted list of terms. And then against each of those terms, you have a list of documents in which that term appears. And if you want to find which documents are matching a term, you go, you look up in the term's dictionary, you find the term you're looking for, and then you just read off the postings list. And that gives you your documents in order. So when we're dividing things up into blocks, we can say, OK, well, we know, given the beginning of this block, we know what the maximum term frequency and the maximum norm, minimum norm, thank you. Minimum norm is we can calculate what the maximum score for this particular block will be. As we're iterating over, you say, OK, give me the next document. You could say, instead of saying give me the next document, you say give me the next document whose score is more than X. And underneath it can go, well, I know, I've got to this block here. I can calculate the, I can extract the impacts from this block. I can calculate the maximum score that this block would possibly give us. If it's not competitive, I can skip over it entirely, go decode the next block. And we already have, as Uwe discussed earlier, and actually as Paul was talking about in his TomTV talk about an hour ago, we already have this structure, data structure in Lucine called a skip list, which allows you to advance quickly over a postings list. So we can just, we can encode this information into the skip list. It's already there. There's not actually a lot of changes that needs to be made to the data structure or indeed to the indexing code. It's kind of already there. There are, as well as not counting all the documents, as well as not visiting all the documents and not scoring all the documents, this also means we don't have to decode all the documents. So when you advance through a block, what normally happens is you get to the next block, it's compressed, so we need to decompress it, we need to extract all the document IDs from this block. But if we know that we're not having to read any of this data from this block because the skip list is telling us that's the scores, there aren't any competitive scores in the block, we can avoid any of this CPU work and lots of this IO work as well. So actually we can get an incredible speed up for term queries. In this particular case, we have a set of benchmarks which run every night against it's Wikipedia corpus with a bunch of fairly sort of standard queries. There's a standard query set and the term query particularly before was running on a nice 33 queries per second, which is perfectly reasonable. It jumped up overnight to 1,150 queries per second, which is a fairly significant increase. I think we can all agree on that one. So that's pretty cool. For constant score queries, as I was talking about earlier, if we're not interested in counting the total number of hits, we just want to shortcut things, we can say, well, because we know that everything's got the same score and because the secondary sort order is by increasing document ID, the first 10 documents that match are going to be the top 10 scoring results. So we can just shortcut and return them straight away. Match all docs query, I don't have actual proper numbers for this because match all docs query isn't part of the standard loosing benchmarks. We did do a, we noticed in Elasticsearch, Elasticsearch has its own set of benchmarks. We noticed that match all docs query had actually slowed down after we implemented all this, the block match scoring. And it turned out this is because it was using a bulk scorer, which didn't take things into account. And once we did do that, we replaced the bulk scorer with the standard bulk scorer if you don't need to collect all documents. Match all docs query sped up by, I think it was something like 4,000%. So that's another useful one. Wildcards and fuzzy queries tend to get rewritten to constant score queries because when you're expanding out a wildcard or expanding out a fuzzy query to all the different terms, it's not obvious how you would otherwise combine the term frequencies of all those matches, of all the terms that could possibly match. So we tend to just replace it with a constant score query and use any other terms that you have in that query to provide the term weighting. These all get, so wildcard query, fuzzy query, prefix query, the general or Thomson queries can all use this mechanism as well. And so prefix query, for example, jumped from 15 to 35 queries per second. That's not as big a gap as the term query, obviously. The reason for that is that for prefix queries, for these queries which are expanded into multi-terms, about half the time the query time is spent actually doing that expansion rather than collecting documents. So these big improvements at collection time don't have as significant an impact for these sorts of queries. Then on top of the term query, obviously the next important one here is the Boolean query. So how are we going to combine all these different terms together? Boolean queries work. They are scored by just summing up all of the matching clauses on a particular document. So the maximum score is just the sum of the maximum scores for its sub clauses. Again, we don't get as an impressive a speed up here because by its very nature, for a conjunction, it's a bit more, it's less of an accurate upper bound because you're just summing up the maximum scores for your sub clauses. So the fact that, oh, this one will match here, but it's a lower one, and then this will match, but it's a higher one. You miss quite a lot of detail by just saying we're only taking the maximum. But still, we get for high-frequency term conjunctions, we're going for 10 queries per second, 25 queries per second, which is again, that's quite nice. Exact phrase queries, again, is basically just a conjunction with a bunch of extra constraints on it in terms of where the positions are. They are slower than normal term conjunctions, so we're going from 4.5 to 7.5 queries per second because, again, most of the time here is actually spent in terms of things like decoding positions lists and intersecting positions lists and making sure things are in the correct position.  The impressive speed up here, the most interesting thing for boolean queries is for disjunctions, so x or y. And here we can use something called weak and or wand. I was going to, Adrian had a nice picture of a wand in all this, but I couldn't work out how to copy it over in time, so make do with a wand in your mind as opposed to on the screen. Thank you. So, we have, let's say we have a query for the or fox. Fox is a fairly low frequency term. The is an incredibly high frequency term. Basically, every single document in your corpus is probably going to have the word the in it. So, generally speaking, for a normal disjunction, what you have to do is you have to visit every single document that contains any of the terms. So, for something like the or fox, in a naive implementation, you're going to end up visiting every single document because every single document is going to have the in it. And then you'll add in the, obviously the ones which have fox in it as well are going to float higher to the top of the list because the maximum score of a term fox is going to be much higher than the maximum score of the because it has a much lower total term frequency. So, what we can say is, as we're going through, we get to a new block. We can say, all right, we've collected this number of documents. We have a minimum competitive score of one, let's say. You can look at the next block. You can say for each of these sub clauses, we're going to try and work out what the maximum competitive, maximum possible score for each of these sub clauses is. The is only ever going to give us a maximum score of 0.2. So, if we have a document that only has the in it, we know it's not going to match. Which means that instead of having a disjunction, we can convert it into a conjunction and say, all right, we're going to go through and we need to find documents that contain both of them. And conjunctions are much faster than disjunctions because you can skip. You can advance. You can avoid collecting all these documents using the skip list structures that we've discussed earlier. So, again, we get a not a bad speed up on this one. So, if we have high frequency or medium frequency, so the or frox, frox, frox, frox would work as well, I suppose. It gets you six queries per second, and now we're getting 25 queries per second. So, again, 300% speed up. That's nice. In addition to these, we now have something called a feature query. Again, Uwe, come with this briefly. So, what we can do is you can store various boost factors for a document if you want to add in extra things like, so page rank is one example or distances. Or you have any number of scores that you want to ensure contribute somehow to your final score. And you know that this conforms to, if this score is higher, then the total score is higher. Then, in which case we can, we can add that on as something called a feature query. The feature query will store that boost value as a term frequency, and it can then use one of these functions. We have saturation function, sigmoid function, or log function, and it can use that function to calculate the maximum possible score that it's going to provide for a given block because it can, again, look at term frequency so it knows, okay, what's the maximum boost value that's in this particular block. That's going to give you a maximum score contribution, and you can then use that, you can then combine that as you would any other boolean query. The nice thing about these three functions is it's not just that they have this simple relationship. So, you know, as the boost value gets higher, then the resulting score from these functions gets higher, but they're also bounded. In particular, saturation and sigmoid are bounded to one, which means you can sort of, it makes it much easier to reason about how your scores are going to change given this particular set of boosting factors. So, we have some fantastic speed-ups, but there are obvious trade-offs here. You never get anything for free. So, the biggest one is, as I said, we don't get these accurate hit-counts any more, and the most extreme case of this is that we're going to stop, we're going to stop collecting accurate hits as soon as we've filled our priority queue. So, as soon as we've got our top end, we're going to say, fine, we'll just stop there, we'll skip on from there, but that means you can't page, and lots of people want to do paging. So, what we can do is we can say, all right, we're going to use the normal, the old-style collection mechanism for the first 1,000 hits, let's say, and then we'll start skipping after that. And that means that you can return to your user, you can say, okay, well, we can page, if we're doing 10 per page, we can give you the top 100 pages. And then beyond that, you can say, well, we found at least this number of documents. Generally speaking, if someone wants to page through 100 pages, they should be doing a different query. Or it means they want to extract everything, in which case you probably don't care about scores. The other thing here is it doesn't work with facets or aggregations, because facets and aggregations, by their nature, they need to visit every single document. However, what you can do is you can do things in two passes, because if you are doing a normal score query, you want your top-end documents, and you also want facets and aggregations, you're still wasting quite a lot of time by scoring all the documents that aren't going to match, that aren't in your top 10. So what you can do is you can do a very, very fast first pass using the block-max method, and that gets you your top-end. And then you can, if you're doing it on a webpage, for example, you can then asynchronously send off this second query, which does your fasting and your aggregations, but doesn't do scoring. So you're going to get a slightly faster aggregation query coming back and then a much faster top-end query. You can do it asynchronously, so you get your top-end results come up, and then the facets might appear slightly later. Or you could do it all at the same time, and some experiments that we've been running do suggest that actually it will probably be faster anyway by splitting these queries into two. I think I have three minutes left. So does anyone have any questions? Yes. So the question was, by default, you don't get your total hits. Currently in Elasticsearch, and the same in Solar as well, you do get total hits. So when Elasticsearch moves to Lucene 8, which we will do in Elasticsearch 7 coming at some point, then what happens? Are you going to not get these improvements? The answer is, in Elasticsearch, it is going to change. So by default, I think Philip, you can probably correct me if I'm wrong here, by default, the top hit count is going to come back. The structure is changing. So the total hits is no longer a number. It's an object, which will have a hit count and then a relation that says either this is accurate or it's a lower bound. You can then opt out of that. So you'd say there'll be a parameter on the search query which says give me the old style so you can upgrade without having to change everything. But then you can then opt into it at a later point. By default, we're going to give you the speed-ups because we think it's worth it. It's a breaking client change. It's the same. It's all the more longer the turning. Yes, this is true. So the hit value on top docks is no longer... Is it an integer or is it a long, wasn't it? And now it's an object. Again, with this long value and a relation saying either this is exact or it's a lower bound. Hello. There might be some cases where doing this approach or something like if I have a lot of documents that have the same term frequency for that particular term and I send a query with that term then you're going to check for each block if the term frequency is competitive but it's always competitive. It's not always competitive because you do one up. So the question was if you have a whole bunch of documents which all have the same score. So for a term that has... Everything's got a single term in it. They all have the same score. Does that mean that they're all competitive? And the answer is no because once you've filled up the priority queue we go and call this set minimum competitive score function. That takes the score value and it does math.next up. So it increases it by whatever the smallest possible value that it gets up to the next floating point value. What if the increase all the time? So yet no. There are going to be adversary situations, yes. So if you happen to have an index which the term frequency gets higher with every subsequent document then yes, you will probably find that things are slowing down. And there are certain circumstances. There are certain query combinations of boolean queries at the moment where things have slowed down. I mean, not a lot but there's enough... This adds enough overhead that the speed-ups you get otherwise is counteractive by this. But we know what they are and we're working on them. Thanks a lot. Thanks a lot. Thank you.


Live from Midtown Manhattan, it's theCUBE, covering Big Data, New York City 2017, brought to you by SiliconANGLE Media and its ecosystem sponsors. Hello everyone, welcome back to our CUBE coverage here in New York City, live in Manhattan for theCUBE's coverage of Big Data NYC. Our event, we had eight, five years in a row, eight years covering Big Data Hadoop World originally in 2010, then it moved to Hadoop Stratoconference, Stratoconference, now called Stratoconference, in conjunction with that event, we have our Big Data NYC event, SiliconANGLE Media's CUBE. I'm John Furrier, co-host with Jim Kobielos, analyst at wikibon.com for Big Data. Our next guest is Gus Horne, who is the global Big Data analytics and CTO ambassador for NetApp, machine learning, AI, guru, just talks all around the world, great to have you, thanks for coming in and spending the time with us. Thanks John, appreciate it. So we were talking before the camera came on, you're doing a lot of jet setting, really around evangelize, but also educating a lot of folks on the impact of machine learning and AI, in particular, obviously AI we love, we love the hype and it motivates young kids getting into software development, computer science makes it kind of real for them, but still a lot more ways to go in terms of what AI really is, and that's good, but what is really going on with AI? Machine learning is where the rubber hits the road, that seems to be the hot air, that's your wheelhouse, give us the update, where is AI now? Obviously machine learning is super important, it's one of the hot topics here in New York City. Well I think it's super important globally, and it's going to be disruptive, so before we were talking I said, how this is going to be a disruptive technology for all of society, but regardless of that, what machine learning is bringing is a methodology to deal with this influx of IOT data, whether it's autonomous vehicles, active safety in cars, or even looking at predictive analytics for complex manufacturing processes like an automotive assembly line, can I predict when a welding machine is going to break, and can I take care of it during a scheduled maintenance cycle so I don't take the whole line down, because the impacts are really cascading and dramatic when you have a failure that you couldn't predict. And what we're finding is that Hadoop and the big data space is uniquely positioned to help solve these problems, both from quality control and process and management and how you can get better uptime, better quality, and then we take it full circle and how can I build an environment to help automotive manufacturers do test and dev and retest and retraining and learning of the AI modules and the AI engines that have to exist in these autonomous vehicles. And the only way you can do that is with data and managing data like a data steward, which is what we do at NetApp. So for us it's not just about the solution, but the underlying architecture is going to be absolutely critical in setting up the agility you'll need in this environment and the flexibility you need because the other thing that's happening in this space right now is that technology is evolving very quickly. You see this with the DGX from NVIDIA, you see just P100 cards from NVIDIA. So I have an architecture that we have in Germany right now where we have multiple NVIDIA cards in our Hadoop cluster that we've architected but I don't make NVIDIA cards. I don't make servers. I make really good storage. And I have an ecosystem that helps manage where that data is when it needs to be there and especially when it doesn't need to be there so we can get new data. Yeah, because we were talking also before camera with folks watching that you were involved with AI going way back to your days at MIT and that's super important because a lot of people and the pattern that we're seeing across all the events we go to and we'll be at the NetApp event next week in site in Vegas. But the pattern is pretty clear. You have one camp, oh AI is just the same thing that was going on in the late 70s, 80s, and 90s but it now has a new dynamic with the cloud. So a lot of people are saying, okay, there's been some concepts that have been developed in AI in computer science but now with the evolution of hyperconvergence infrastructure with cloud computing with now a new architecture, it seems to be turbocharging and accelerating. So I'd like to get your thoughts on tying that in. Why is it so hot now? Obviously machine learning, everyone should be on that, no doubt. You got the dynamic of the cloud. And NetApp's in the storage business so that's stores, data, I get that. What's the dynamic with the cloud? Because that seems to be the accelerant right now and with open source and with the AI. Yeah, I think you got to stay focused. The cloud is going to be playing an integral role in everything. And what we do at NetApp as a data steward and what George Kurian said, our CEO, that data is the currency of today actually, right? It's really fundamentally what drives business value is the data. But there's one little slight attribute change that I'd like to add to that and that it's a perishable commodity, right? It has a certain value at T sub zero when you first get it and that's especially true when you're trying to do machine learning and you're trying to learn new events and new things but it rapidly degrades and becomes less valuable. You still need to keep it because it's historical and if we forget historical data, we're doomed to repeat mistakes. So you need to keep it and you have to be a good stewarder and that's where we come into play with our technologies because we have a portfolio of different kinds of products and management capabilities that move the data where it needs to be, whether you're in the cloud, whether you're near the cloud, like in an Equinox, Colo or even on-prem and the key attribute there is, and especially in automotive in this, they want to keep the data forever because of liability, because of intellectual property and privacy concerns. Let's double click on that. Hold on, one quick question on this because I think you bring up a good point. The perishability is interesting because real time, we see this now batch in real time is the buzzword in the industry but you're talking about something that's really important that the value of the data when you get it fast in context is super important but then the historical piece where you store it also plays into the machine learning dynamics of how deep learning and machine learning has to use the historical perspective. So in a way it's perishable in the real time piece in the moment and if you're a self-driving car you want the data like in milliseconds because it's important but then again the historical data will then come back. Is that kind of where you're getting at with that? Yeah, because the way that these systems operate is they, the paradigm is like deep learning. You want them to learn the way a human learns, right? The only reason we walk on our feet is because we fell down a lot, right? But we remember falling down and we remember how we got up and could walk. So if you don't have that historical context you're just always falling down, right? So you have to have that to build up the proper machine learning neural network the kind of connections you need to do the right things. And then as you get new data and varieties of data we think and I'll stick with automotive because it can almost be thought of as an intractable amount of data because most people will keep cars for measured in decades. The quality of the car is incredible now and they're all just loaded with sensors, right? High definition cameras, radars, GPS tracking and you want to make sure you get improvements there because you have liability issues coming as well with these same technologies. Yeah so when we talk about the perishability of the data that's a given. What is less perishable it seems to me in Wikibon is that what you drive from the data the correlations, the patterns, the predictive models the meat of machine learning and deep learning AI in general is less perishable in the sense that it has a validity over time. What are your thoughts at NetApp about how that, how that data of those data derived assets should be stored, should be managed for backup and recovery and protected to what extent is that, do those requirements need to be reflected in your storage retention policies if you're an enterprise doing this? That's a great question. So I think what we find is that you'll, that first landing zone. Yeah. And everybody talks about that being the cloud and for me it's a cloudy day although in New York today it's not. You know there are lots of clouds and there are lots of other things that come with that data like GDPR and privacy and what are you allowed to store? What are you allowed to keep and how do you distinguish one from the other? That's one part but then you're going to have to ETL it you're going to have to transform that data because like everything there's a lot of noise and the noise is really fundamentally not that important. It's those anomalies within the stream of noise that you need to capture and then use that as your training data so that you learn from it. So there's a lot of processing I think that's going to have to happen in the cloud regardless of what cloud and it has to be kind of ubiquitous in every cloud. And then from there you've decided how am I going to curate the data and move it and then how am I going to monetize the data because that's another part of the equation and what can I monetize? Well that's a question that we hear a lot on theCUBE. We were on the day one we were riffing at some of the concepts that we see as challenged when we talk to enterprise customers whether it's a CIO, CDO, Chief Data Officer or Chief Security Officer there's a huge application development going on in the enterprise right now you're seeing the open source booming there's huge security practices being built up and then it's got this governance with the data overlay that with IoT it's a kind of an architectural I won't say reset but a retrenching for a lot of enterprises. So the question I have for you guys as a critical part of the infrastructure with storage storage isn't going away there's no doubt about that but now the architecture is changing how are you guys advising your customers what's your position on when you come and do a CXO and you give a talk and it's like I say, hey Gus, the house is on fire we've got so much going on bottom line me what's the architecture what's best for me but don't lose the headroom I need to have some headroom to grow that's where I see some machine learning what do I do? I think you have to embrace the cloud and that's one of the key attributes that NetApp brings to the table we have our core software our on tap software is in the cloud now and for us we want to make sure we make it very easy for our customers to go both be in the cloud be very protected in the cloud with encryption and protection of the data and also get the scale and all of the benefits of the cloud but on top of that we want to make it easy for them to move it wherever they want it to be as well so for us it's all about the data mobility and the fact that we want to become that data steward, that data engine that helps them drive to where they get the best business value because it's going to be in the cloud On-prem in cloud I know just for the folks just for the record you guys have if not the earliest one of the earliest in with AWS when it wasn't fashionable I interviewed you guys on that many years ago and let me ask a related question what is NetApp's position or your personal thinking on what data should be persisted closer to the edge in the new generation of IoT devices you know so IoT Edge devices, you know they do inference they do actuation and sensing but they also do persistence now should any data be persisted in their long term as part of your overall storage strategy if you're an enterprise? It could be the question is durability and what's the impact if for some reason that edge was damaged, destroyed or to data loss so a lot of times when we start talking about open source one of the key attributes we always have to take into account is data durability and traditionally it's been done through replication and to me that's a very inefficient way to do it but you have to protect the data because it is it's like if you got 20 bucks in your wallet you don't want to lose it right you might split into two tens but you still have 20 right you want that durability and if it has that intrinsic value you've got to take care of it and be a good steward of it so if it's in the edge it doesn't mean that's the only place it's going to be it might be in the edge because you need it there maybe you need what I call reflexive you know actions right this is like when a car as well you have deep learning and machine learning and vision and GPS tracking and all these things there and how it can stay in the lane and drive but the sensors themselves that are coming from Delphi and Bosch and ZF and all of these companies they also have to have this capability of being what I call a reflex right the reason we can blink and not get a stone in our eyes not because it went to our cerebral cortex it's right because it went to the nerve stem and it triggered the blink and you have to do the same thing in a lot of these environments so autonomous vehicles is one it could be you know using facial recognition for restricting access to a game and all of a sudden this guy is on a blacklist do you stop the gate before we get into some of the product courses I have for you Hadoop in place analytics as well as some of the regulations around GDPR we're still again in the trend segment here is what's your thoughts on decentralization you've seen a lot of decentralized apps coming out you see blockchain getting a lot of traction obviously that's a tell sign certainly in the headroom category of what may be coming down not really on the agenda for most enterprises today but it does kind of indicate that the world is the wave is coming for a lot more decentralization on top of distributed computing and storage so how do you look at that as someone who's out on the cutting edge for me it's just yet another industry trend where you have to embrace it I'm constantly astonished at the people who are trying to push back from things that are coming to think that they're going to stop the train that's going to run them over and the key is how can we make even those trends better, more reliable and do the right thing for them because if we're the trusted advisor for our customers regardless of whether or not I'm going to sell a lot of storage to them I'm going to be the person they're going to trust to give them good advice as things change because that's the one thing that's absolutely coming is change and oftentimes when you lock yourself into these quote commodity approaches with a lot of internal storage and a lot of these things the counterpart to that is that you've also locked yourself in probably for two to four years now in a technology that you can't be agile with and this is one of the key attributes for the in-place analytics that we do with our ONTAP product and we also have our E-Series product that's been around for six plus years in this space as the de facto performance leader in this space even and by decoupling that storage in some cases very little but it's still connected to the data node and in other cases where it's shared like in an NFS share that decoupling has enormous benefits from an agility perspective and that's the key well that kind of ties in with the blockchain thing it's kind of a tell sign but you mentioned in-place analytics that decoupling gives you a lot more cohesiveness if you will in each area but tying them together is critical how do you guys do that? What's the key feature because that's compelling for someone I want they want agility certainly DevOps is infrastructure as code that's going mainstream you're seeing that now that's clearly cloud operates whatever you want to call it on-prem off-prem cloud ops is here this is a key part of it what's the unique features of why that works so well? Well some of the unique features we have in so if we look at our portfolio products so I'll stick with the on-tap product one of the key things we have there is the ability to have incredible speed with our AFF product but we can also de-dupe it we can clone it and snapshot it snapshotting it into for example NPS or NetApp Private Storage which is in Equinox and now all of a sudden I can now choose to go to Amazon or I can go to Azure I can go to Google I can go to software it gives me now options as a customer to use whoever's got the best computational engine versus I'm stuck there right I can now do what's right for my business and I also have a DR strategy that's it's quite elegant but there's one really unique attribute too and that's the cloning so a lot of my big customers have thousand plus node traditional Hadoop clusters but it's nearly impossible for them to set up a test dev environment with production data without having an enormous cost but if I put it in my on-tap I can clone that I can make hundreds of clones very efficiently that gets the cost of ownership down but more importantly gets the speed to doing getting the sandboxes up and running and the sandboxes are using true production data so that you don't have to worry about oh I didn't have that in my test set and now I have a bug a lot of guys are losing budget because they just can't prove it and they can't get it working it's too clunky all right cool I want to get one more thing in before we get to run out of time the role machine learning we talked about that's super important algorithms are going to be here it's going to be a big part of it but as you look at that policy where the foundational policy governance thing is huge so you're seeing GDPR I want to get your comments on the impact on GDPR but in addition to GDPR there's going to be another Equifax coming it's there out there right it's inevitable so as someone who's got code out there writing algorithms using machine learning I don't want to rewrite my code based upon some new policy that might come in tomorrow so GDPR is one we're seeing now you guys are really involved in but there might be another policy I'm going to change but I don't want to rewrite my software how should a CXO think about that dynamic not rewriting code if a new governance policy comes in and then the GDPR is obviously well I mean I don't think you can be so rigid to say that you don't want to rewrite code but you want to build on what you have yeah right so how can I how can I expand what I already have as a product let's say to accommodate these changes because again it's one of those trains you're not going to stop it so GDPR is again it's one of these disruptive regulations that's coming out of AMIA but what we forget is that it has far reaching implications even in the United States right because of their ability to reach into basically the company's pocket and find them for violations right so what's the impact of the big data ecosystem on GDPR it can potentially be huge right the key attribute there is you have to start when you're building your data lakes when you're building these things you always have to make sure that you're taking into account you know anonymizing personal identifying information or obfuscating it in some way but it's like with everything you're only as strong as your weakest link right and this is again where NetApp plays a really powerful role because in our storage products we actually can encrypt the data at rest at wire speed so it's part of that chain so you have to make sure that all of the parts are doing that because if you have data at rest in a drive let's say that's inside your server you know it doesn't take a lot to beat the heck out of it and find the data that's in there if it's not encrypted yeah let me ask a quick question before we wrap up so how does NetApp incorporate ML or AI into these kinds of protections that you offer to customers well for us it's again we're only as successful as our customers are and what NetApp does as a company that will just call us the data stewards that's part of the puzzle but we have to build a team to be successful so when I travel around the world the only reason a customer is successful is because they did it was a team nobody does it on an island nobody does it by themselves although a lot of times they think they can so it's not just us it's our server vendors that work with us it's the other layers that go on top of it companies like Zoloni or Blue Data and Blue Talent people we've partnered with that are providing solutions to help drive this for our customers Guts great to have you on theCUBE looking forward to next week hopefully I know you're super busy at NetApp Insight I know you got like five major talks you're doing but we can get some time on theCUBE it'd be great my final question one personal one we were talking that you're a search and rescue in Tahoe for cases in avalanches a lost skier a lot of enterprises feel lost right now so you kind of come in a lot and I'll bring my dog the avalanches coming the waves or whatever coming so you've probably seen situation you don't need to name names but like talk about what should someone do if they're lost when you come in you can do a lot of consulting what's the best advice you can give someone because a lot of CXOs and CEOs their heads are spinning right now and there's so much on the table so much to do they got to prioritize yeah it's a great question and here's the one thing is don't try to boil the ocean you got to be hyper focused if you're not seeing a return on investment within 90 days of setting up your data lake something's going wrong either the scope of what you're trying to do is too large or you haven't identified the use case that will give you an immediate ROI there should be no hesitation to going down this path but you got to do it in a manner where you're tackling the biggest problems that have the best hit value for you where there's ETLing goes into your plan of record systems your enterprise data warehouses you got to get started but you want to make sure you have measurable tangible success within 90 days and if you don't you have to reset and say okay why is that not happening am I reinventing the wheel because my consultant said I have to write all this scoop and flume code and get the data in or did I maybe I should have chosen another company to be a partner that's done this a thousand times and it's not a science experiment we got to move away from science experiment to solving business problems well science experiments and boiling over the ocean is don't try to overreach build the foundational building block the successful guys are the ones who are very disciplined and they they want to see results some call it baby steps some say building blocks but ultimately the foundation right now is critical yeah alright Gus thanks for coming on the Cube great to share with you great conversation about machine learning impact to organizations to Cube bringing you the data here live in Manhattan I'm Jeff Furrier, Jim Kobielus with Wikibon, more after this short break we'll be right back


Good afternoon everybody and welcome to the day two canvas networking lunch I hope everyone's had a great morning at day two of the all annual conference and that you had a productive afternoon yesterday Thank you for joining us again For those that didn't join us on yesterday's session will do some brief introductions And then we'll get into the kind of the meat of our conversation today. So my name's Sam Wilson I'm a senior account executive here in structure. I Look after institutions of kind of all different stripes from further education colleges vocational academies To training providers, you name it and we have conversations with them I'm looking forward to kind of leading the session with you today But before we get into that like to hand over to my colleague Marina Hi everyone, welcome back My name is Marina Vicente. I'm the regional director for the Spanish market as some we work together at instructor We work with different institutions as well as with corporations as well and I'm really happy to have you again guys and for the new ones welcome and I will leave it to some again Thank you, Marina. So just to cast everyone's minds back to yesterday We run an activity we want to in which we wanted all of you folks to share some of your Experiences about kind of the shift to online over the past 18 months We focused yesterday more on some of the challenging more challenging aspects of that shift And we want to pivot today a little bit. We want to focus on the successes We would like you to share with us some of the things that have been super successful over this kind of 18 months of Utilizing technology potentially more heavily than your institution might have done in the past And that could be for the teaching staff that could be for your students that could be Institutional that could be wholly technologically led it could be a change in delivery method Or it could be an institutional policy that's kind of helped lubricate the gears of change at your institution What we're going to do is Marina will share the link to the mural board Which I think I've seen people log into so that's excellent And if you would like to share some of your successes in these different columns all you need to do is right click your mouse You should get this little sub navigation bar and you can add a sticky note and then start typing And what we'll do is as these points start to kind of get filled up on the board We'll start talking about some of them will also share some of our experience working with institutions Across Europe and then hopefully here from some of you folks as well that would be best I think hearing your experience is your successes things that have been game changers out of these these kind of interesting 18 months is super super powerful. So what I will do is we start to see some of the text Start to fill up. I'm going to throw a question out to Marina just to kind of get everyone's Everyone's minds racing. Marina What have you seen as one of the biggest successes at the institutions you've liked with over the past 18 months where? Were kind of a bigger need for online education has been prevalent So one of like the key things that the university because just like for the ones that you don't know me I'm also a teacher. I'm teaching in different universities here in Spain One of the key successes that we had in one of the universities that I work for was just like to transition from Adobe connect to teams So that was just like a great investment from the university actually because Adobe My students and the university students had a lot of issues just like to connect with Adobe connect because some of them they use They were using like Mac others They were using Microsoft and so so we decided just like the university actually decided to move Into teams right with teams we had better experiences Also, we had the possibility to take the attendance We have we had the possibility to run different reports and integrate those reports into the elements And obviously we had like all the chats, you know, we had like all the historical Conversations That we had together as a class and that was really good to actually Perfect. Thank you. I think it's really good to hear your Perspective Marina not only is someone that works within ed tech within an ed tech organization But also on the front lines as a member of the academic team So I think you have got kind of a two-perch to a point approach to kind of sharing sites Going back to the mural board now I'm starting to see some things kind of pop up and populate and one of the big things that jumps out to me here And I kind of just circulate with my mouse is the kind of the recognition of ed tech And it's definitely something that I've had with my conversation in my conversations with institutions It's often seen that ed tech is maybe something like supplements. It's on the side of delivery methods You know nothing can beat that in person bricks and mortar delivery, which which is true But I think more institutions and more members of staff and more students are starting to see as see ed tech as a way to mobilize progression and where to give different approaches and different takes on their academic content and the way that they interact and Connect and engage with students and stuff alike is becoming becoming far more prevalent And I definitely have felt that in the conversations. I've had that Ed tech isn't just something you know that we have to look at as a as a byproduct of what institutions do But it's becoming a centerpiece of how institutions position themselves Within the the education sector Would you say Marina in your experience you've seen kind of a proliferation of positive opinions in ed tech in ed tech with all the institutions you work with Yeah, actually, yes, I mean You can see now that most of the universities that are investing in ed tech most of them actually they are just like making a chain a change towards Cloud-based elements is for example, they are doing an investment in different Gamification tools as well such as Kahoot, for example our mood all the the tool that we are using Today here at our networking session So they are just like investing in these kind of things right now Excellent excellent. That's really really interesting another cool one. I've just seen pop up on the board It's this this leveraging of video presentations Definitely something we see in the kind of utilization in canvas with some of our clients that we work with in the discussion around some of our tools is How can you take those kind of in-person experiences? Put them into a digital format and then present them in a VLE or an LMS and still have that kind of that same kind of tactile quality and Video is often and and people in the discord chat can go in there and agree and disagree and etc Video is often been seen as kind of a passive experience But what we want to do is make that more Interactive way so if you're submitting a video presentation other ways in which you can overlay Quizzing questions on top of that video or have that kind of dynamic Comments within the video almost kind of like a more robust version of YouTube So you can actually stimulate conversation and engagement within those video presentations Yeah, thank you for that comment. Whoever made the video presentation piece Just going to have a look This one is this one's an important one and often overlooked but the kind of moving to a more Technology-based approach planning the reduction of things like paper Which is going to be such an important consideration for a lot of people as we talk about a more carbon neutral Education sector. I'm just kind of cutting down on printing and posting and and some of the kind of physical Attributes, I know there's always going to be a need to have those within education But if we can do things to kind of reduce those those kind of heavy Physical items that that's got to be a positive move forward. So thank you for that submission I think this one is a good one and this one's a broad one in it it can take many forms but the thinking outside of the box so Sometimes when we're thrown into a challenging situation or you know that the the environment in which we're working gets a little bit more Different and complex we sometimes have to challenge our preconceived notions of how we create content use technology even interact with our colleagues in the corporate sector and Sometimes challenges give you the environment to nurture thinking outside of the box So I know that's a really broad one and if anyone has any specific examples of how Themselves their colleagues or their institutions Fought outside of the box throughout this interesting 18 months Please go over to discord and share your examples there and Marina will probably read some of those out for me as we start To see them pop up. Is there anything in the discord at the moment that I have maybe we have somebody typing Yeah, yeah, we have somebody typing. We will just like wait and I will use that time because last week We were just like delivering a women here with the Spanish Customers that we have here in Spain with instructor and there was one of the teachers that actually As we were just like talking about thinking outside of the box He shared with us that actually as as a type of assessment and he was using room scapes Just like to yeah for as a formative activity and I asked him What was he teaching rights and he said that he was just like teaching computing Something about computers and engineering and Yeah, something like that. So I found this pretty interesting Just like to utilize escape rooms as a way of assess, you know, the knowledge that our students have Interesting Yeah, we have Laura on the chat some And she says I was mind blown when some of my colleagues revealed a new green Screens and what they were doing with them. Some of them were decorative, but some really innovative uses Excellent and Laura you might be able to elaborate online discord Was that when you were in kind of virtual? Presentations and you would augment your backgrounds and then create kind of a more visually engaging kind of experience for your students I'd be keen to know what some of the things you saw throughout that period was that sounds sounds really interesting I'm just moving as we maybe get a follow-up from Laura in discord I just want to move to one of the points I've seen over on the mural board and it's kind of in the institutional best practices great and it's a Clear as standardized procedures now in place And I think this is really important the conversations that we have as members of in structure Take many forms and there'll be the kind of the use of technology and their functions and their features How to engage students and teaching staff and administrators? Do you know kind of a lot of showing of functionality? But also one of the kind of the types of conversations we often have is how does this new piece of technology and your kind of hope to adopt this new piece of technology aligned to your institutional strategy or your institutional procedures and policy and Often we see when things start to kind of get a little bit bumpy is when there's a disjunct between the strategy and The software or the strategy and the tool strategy in the delivery method So I think anything that allows an institution from from my experience You folks will know better has been members of institutions But anything that aligns an institutional strategy with the actual kind of boots on the ground usage of new delivery methods technology VLE's LMS is when you see a kind of a stronger end goal a stronger kind of Adoption rate success rates, etc. So I think to have a clear most on this standardized policy in place and Procedures in place. It is is a great one to hear Excellent anything coming up in discord that I think I should that you think I should address Marina or No, we have Laura elaborating more about using like new green screens She said actually that they were using them as a virtual background as you mentioned some For their slide so they could move around stimulating a lecture based experience, for example It allowed them to be more animated rather than talking heads and She also said that she also saw lecturers Rig up equivalents of overheads projectors so they could draw processes Some things are just based on with a pen and a paper, but it's difficult not in person Cool. Well, thank you. Thank you for Reading that out very annoying. Thank you for Laura for that elaboration. That's really cool I think there's some important factors to address that appearing on the mural board and arguably actually not even arguably just the most important thing that's been successful is the kind of collectively ensuring that the health of our students of your teaching staff of your Institutions has been a high priority. So kind of the comments around, you know, the grip on us that everyone or Everyone who could be is has been in a good position and maybe leveraging technology is allowed to provide a more safer Environment throughout the pandemic is super important. I definitely don't want to neglect those comments. So thank you. Yeah, health and Prosperity of the individuals associated with an institution is super important. So thank you for raising those really really important Points, thank you. We've seen one and I mean it's music to our ears. I don't want to hang But thank you for the comment about the transition from Transition to Canvas from that board We really do try and make sure that every institution that's using our technologies is the power of using our technologies So thank you for that comment Let's see what else we've got. There's comments there about kind of working Cross-working. So if I'm right in thinking please correct me in discord Is that the ability to kind of work more dynamically across different departments across different functions and kind of, you know alleviate some of the kind of I don't know bottlenecks in comms when you're maybe across a big campus by having some of those communications and cross Institutional working within the digital space. Is that just been a little bit more proactive about you? I'd love to hear a little bit more from whoever posted that within the discord and channel. That would be great I'm more involved in okay, so This is an important one And it's in the student column in the highlights and whoever whom ever posted this one said that one of the successes is having students more involved in the planning and structure maybe of their courses and You know students are you know a super important stakeholder within any institution And maybe having their involvement in how the digital structure of a course is Presented maybe considering things like if modules or units are broken up into more bite-sized pieces When we're creating online lectures and online videos are there kind of time-capped for You know easier digestion Is there a multitude of different accessibility features within the structure of that course taking into account different accessibility Requirements and educational needs. I think having a student voice within the kind of the structure of a Educational program and provision is super important in some of the institutions out of the pleasure of working with Over the past 80 months. I've definitely had some level of student delegate within the conversations that I've been privileged to be a part of So I've definitely seen that appearing in lots of the conversations I've been having Coming towards the end of our our session now maybe got time for a few more Is there is that anything else in discord that I should maybe touch upon Marina before we start kind of picking up on the last Last couple of elements in the mural board and then kind of wrapping up We can wrap up. We don't have anything new on the discord Perfect well just before we start to kind of wind it into the last two minutes of our Session I just want to kind of talk about some of the kind of the big things that I've seen in this presentation so far So thinking outside the box, you know if I've been thrust into a really unpredictable environment It gives us the ability to kind of reposition Breathing get creative be some more inspired and I'm sure the workload has been intense And I'm sure it's there's been some kind of difficult moments But sometimes out of those kind of difficulties comes kind of really successful things that have been deployed It is great to hear that there's a higher opinion and more recognized Approach of using ed tech at institutions. It's great to see people are working across departments Using technology to support that cross department working and Seeing all of these cool and creative features starting to pop it into kind of formalized procedures and Formalized policies and all that kind of thing. I think it's really good Really happy to have had all those points shared So what we'll do now is give you a little bit of a peek into what we'll be talking about in tomorrow's Session so in day one as I mentioned at the top of our conversation We talked about some of the challenges that were faced in this kind of really really volatile time today We've talked about some of the successes and to get everyone's kind of minds thinking in preparation for tomorrow's session What we would like you to think about and share with us is any of the things that you will be taking forward it into the quote-unquote new normal things that have kind of Allowed you to institutionalize something different for the future So tomorrow is going to be really set amongst kind of the future of using ed tech Your institution well, that's a big. Thank you for me from me today. Thanks for participation. Everyone's been great Marina Thank you. Thank you everyone For this participation, and we hope to see you tomorrow again, and if you have like any question I mean just like posted on the disco channel Thank you. Goodbye


He said, I have not shunned to declare unto you the counsel of God. So what's an ingredient of a great church? It's a church that gives you practical preaching. It's a church that answers all the questions. It's the church that offends you by answering the questions you didn't ask. It's a church that offends you by answering the questions you should have asked. It's a church that does not hide. The Bible says about Solomon, there was not anything hidden from the king which he told her not. He told her everything she needed to hear. He gave her, he, he, Solomon could say to the Queen of Sheba, I've not shunned to declare unto you all the counsel of God. He said, I've given it all to you. The preaching you get from the pulpit of whole fast Baptist church on Sunday morning and Sunday night and Wednesday night is all the counseling you need. And if you say, well, I'm in that situation where I'm under bondage and I need somebody to hold my hand and I need somebody to be with me and help me get through that. I'm not down on you. We want to help you. We want to be there for you. But let me just make something clear. The reason you find yourself in that situation is because you've not been listening. You've not been applying the preaching from the word of God. Because here's the truth. There's nothing we're going to say to you in the office that's different than what we say behind the pulpit.


worked himself into a heap of trouble in that ninth inning. What did you think of the quality at bats overall, not just from you, but from your teammates before you? They were good. As soon as Graver got up, I think he worked a walk there then Gary with a big hit. Another great walk again by Lamehu. And I was just trying to go up there and try to do damage. I got a pitch 3-1, just missed it. And then 3-2 change-up. So I want to do more of that. Since coming off the IL, you talked about working your way back into things, getting comfortable at the play. Do you still feel like you're seeing the ball well, maybe not getting the hits you want, but still working walks and getting on base? Yeah, I mean, I feel like I'm getting some pretty good swings off right now. And I feel close. I feel close to being back to there I was. And I'm just not too far away. Earlier in the game, Jew or Shella came up with yet another big hit. He's now 4-4-4 with the bases loaded this season. Is it to the point where you just expect him to do big things when there are runners on?  He's been clutched for us this year. And that was a big hit. That was a hit we needed to extend the lead right there. And that's what he's been doing. So I'm excited he's on my team. Aaron, how does his team keep the momentum going in Kansas City? Just keep trying to do what we did here. Win series, win games. And keep the pressure on. That's the most important thing. Aaron, thanks for the time. Thank you.