From Orlando, Florida, it's theCUBE. Covering SAP Sapphire Now 2018, brought to you by NetApp. Welcome to theCUBE, I'm Lisa Martin with Keith Townsend. In Orlando, at SAP Sapphire Now 2018, we're in the NetApp booth and we are having some great conversations, really understanding how SAP and their ecosystem of partners have really helped transform 390,000 plus customers. We're joined next by Sue Waite, who is one of the directors of the Global Center of Excellence for Database and Data Management at SAP. Sue, thanks for coming to theCUBE. Thank you very much for letting me join you. So SAP, 46 years young company, like I said, 390,000 customers and 25 plus industries. You guys have probably many centers of excellence. Give us a little bit of understanding of the COE for Database and Data Management. I'm happy to do so. So the team that I'm very, it's my pleasure to be a part of, focuses on helping our customers understand what are the new opportunities that are out there. Many customers are so driven by the day to day operations. How do we take that opportunity to do step back and look at what perhaps other competitors have done in their space or in completely different industries and what are new ways that they could be looking at approaching their business, approaching their engagements with their customers and helping them grow as well. And our Database and Data Management solutions are the platform that helps enable that in a truly comprehensive data management way. It sounds pretty symbiotic. Where they're actually, you're helping them, but customers are also helping you. Tell us maybe some examples like Data Hub, for example, of one of the things that maybe that symbiotic relationship helped to evolve. Yes, yes. So a little history in our Database and Data Management solutions, of course SAP HANA is a cornerstone to our core platforms. Very much a groundbreaking technology eight years ago in introducing a completely comprehensive platform. But one of the things we've learned as we've worked with our customers over time, is so many clients and in fact SAP itself has our different pockets of enterprise systems. We have our CRM applications, our ERP, our finance, our, you know, supply chain. But in today's environments, we have so much more information coming at us. There's the whole big data space. Everybody's trying to pull and collect information from of course social media feeds. That's the one everybody thinks of. Another new space is internet of things. Collecting information from sensors off their machines, from telemetry from where their trucks are, to facial recognition as people are coming into our stores, or image recognition as we're manufacturing sheet metal on the plant floor. It's amazing the amount of information that is now available to be collected and mined to bring further insight into business operations. So great, we can collect all of that fabulous new data and store it in Hadoop, or Amazon S3, or object stores. But how do we get at that information? Right, and extract valuable insights that they can then use to generate new products, new revenue streams, new businesses. Completely so. Yeah, a simple example is, well, not an example, but S4 and HANA, the journey to S4 and HANA starts mostly with BW. So with the original data warehouse and the capability that that brings to organizations, one of the first things that happens when you deploy BW on HANA is other businesses look up, other business units look up and say, hey, I want that capability, I want that instant analytics, that instant search. Yes. Talk to the evolution of that. After we go BW and the focus is still on analytics and data intelligence. And it should be, you know, it is about making important decisions in an instant now. I mean, everybody looks at their phone when we make a deposit. We expect to see that deposit instantaneously. The business needs to operate just as instantaneously. And with BW, it has a tremendously powerful system that works hand in hand, as you said, with S4, ERP and the whole business suite itself. But then the goal was as well to bring in this larger context from these other large data environments that are being captured in Hadoop or S3. So the genesis of the idea to help address that marrying up of data stored in our classic enterprise data warehouse, like BW, is the solution that we call Data Hub. And what Data Hub does, what's different about it is it truly is an umbrella solution that transcends the big data environment as well as the classic enterprise systems. And in doing so, one of the first problems was we have all this fabulous information collected in our data lake. How do we get to the information that's truly useful to combine with information in BW or even feed into S4 itself? So Data Hub helps pre-process, refine and enrich that information. And the key is doing so where the data lives. Let's not move petabytes of data around, just trying to derive intelligence from it. So Data Hub allows customers to pre-process, refine and enrich that data in their data lake itself. Get from petabytes of information to say gigabytes of data that is useful to combine with information in BW or within HANA or S4 or whatever other systems may be useful to bring that together. And the trick with all of that is having visibility into the information that truly lives within each of those systems, which is also something that Data Hub brings to the table because it has the ability to collect metadata. So information about the data that lives within each of those environments, so the data analysts who are bringing those data sets together can intelligently know, this is the data set I want, this is how I need to refine it and I want to combine it here and they can set that up through pipelines and orchestration within Data Hub. It is tremendously powerful in simplifying that end-to-end scenario and the whole goal is to make it easier for the business to get to those useful insights, really help me have a competitive differentiator because of the great set of information I can now bring together and bubble that up through our analytics tools. Yeah, access at speed, that was one of the things Husted Flatter talked about this morning is everything has to be real-time. We expect it as consumers, right? Yes. And then as consumers who are also business people, which many are, you also expect that. One of the things too that you reminded me of that Bill and McDermott talked about yesterday was customers in every industry need a 360 of their customers, right? But SAP is moving, it's away from the 360 just sales automation to really having a true, enabling a true 360 of the entire customer experience. And one of the things I liked yesterday was in a not creepy way, but we expect that and customers have to connect. If you can connect finance and procurement and supply chain and marketing and sales and extract those really valuable insights faster than your competition, that's what today's digital businesses need. One of the simplest statements I've heard that I think is so powerful is, understand more about your customers so that you can do more for your customers. That's what it's all about, truly providing that end service to help them achieve their goals and move to that. So let's talk about some of the, from a high level, some of the technology to make this capable. When you're talking about petabytes and petabytes of data, you can't move all the data. Different systems have different capabilities when it comes to data transformation. I love the insight that you provided that data analysts need to be aware of the metadata so that they can set up the transformations needed to get the reporting that they need. How does data hub enable the power of metadata to all these different systems, whether it's Hadoop, unstructured data, systems that we don't even control such as social media data. How does data hub bring all that metadata together? So one of the capabilities that enables that visibility into data content is due, what we call a data discovery mechanism and data hub includes metadata crawlers. So literally any time a data hub has a system that it's been authorized to connect to, we can then go out and collect the metadata about the information, the data itself that lives within those environments. And so it comes back and there's a repository within data hub that holds information about the tables, the column names and then things like data types as well as even basic profiling information such as minimum, maximum, how often value is showing up, cardinality, even the frequency of different values that are there down to the ability to even preview, literally look at the content within the tables. And so that's so powerful for the data analysts because they no longer have to go, literally crack open a file to look at the content, it's at their fingertips. And that's just an amazing tool that once they have that, then they can move on to the truly value added activity of how they want to refine and rich, mash up that information to get to those insights that are at their fingertips. With so many, the C-suite, like we've talked about force changing so dramatically, the CDO, the CIO, the CMO, the CXO, they all have needs, different needs, the needs for this data. Your customer conversations, where do you start at the C-suite in terms of, they've got all of this data that they know there's golden nuggets in there, how do we find it? And also exploit insights for marketing, for sales, for finance, for procurement, what's your, where do you start in terms of that conversation within a customer? Unite the C-suite to understand how they can team together? That is always the goal, of course. And it's important to understand each customer's individual, what their business is, what their market is, as well as that company themselves, what their goals are, what they're trying to achieve so that we can truly be, I know you've heard the term trusted advisor, but we really take that seriously because understanding what their challenges are and where they're trying to grow their business, along with the very technical aspects of which technologies they're using today and what roadblocks are they experiencing that are preventing them from achieving those goals? Of course, our objective is to help them cross those roadblocks, cross those bridges and if we can help with SAP solutions to achieve those goals, it's not about rip and replace, it's helping them bridge those challenges to reach those goals, and that's the role we play and I love what I do. So the Data Hub is a great example of a platform that can be expanded upon. Can you share about some of the successes that you've had with the ecosystem around Data Hub to extend, not just the analysts who can interact with Data Hub directly, but what we like to call bolt-on applications that extend the overall capability of whether it's analytics, AI, machine learning, the examples or automation, business process automation, what are some of the successes coming out of making Data Hub? I know it's only a year old, but what are making the Data Hub available to your ecosystem of partners? Yep, so some of the successes have been truly efficiency, obviously, but in that ability to bring those datasets together, for example, we've been working with one customer who's, I'll just say they're a manufacturer, and they have their own team of data scientists and they have petabytes of information they've been collecting in their data lake and we talked with them about Data Hub and what we were seeing, and they're like, love this story, but our data science team is really good. I think we've got this. They literally came back to us six months later and said it's a whole lot more work than we ever expected it would be, because in a classic environment, it's a lot of hand-coding, it's a lot of scripting, it's creating those predictive models, which is the like blood, that's why we hire data scientists, but they were spending so much time in data manipulation and trying to find the right information. They're like, please, yeah. They can't, they're not going to come back to us. It really seems like a great opportunity for the overall market to start adding value on top of Data Hub to basically shorten that time frame for the internal data scientists. They should be figuring out what questions to ask versus figuring out how to organize the data. Exactly so, that's why they're being paid the big bucks, let them do the job that we hired them to do. Well, Sue, you said you love your job and it's evident. Thank you so much for stopping by theCUBE and sharing what you're doing within the COE for Database and Database Management. So it's a great pleasure to speak with you this morning. With Data Hub, we can't wait to hear what's next for next year. All right, excellent. We want to thank you for watching theCUBE. I'm Lisa Martin with Keith Townsend from SAP Sapphire Now 2018. Thanks for watching.


Humanity faces a lot of problems. Smaller problems, such as a dead battery on your telephone, but also bigger problems, so-called wicked problems. And Tuberk University offers the GMSI program, Global Management of Social Issues. And Global Management of Social Issues deals with wicked problems. You're the doctor at the table, you're the professor. What is a wicked problem? What do you guys discuss in class? Well, a wicked problem is sort of a special type of organizational policy problem, one that is characterized by high complexity, so the different parts of the problem are interconnected in a way that we usually have a hard time to understand. Not my parents, but some of their friends, they don't believe in climate change because they were never taught that this was a problem. So I think it starts with the young generation. It's about changing the fundamental moral and ethical values that you have. And rather than having this view of being so materialistic and being so like, I want this car, I want this thing, I want the other one, it's more about cooperation and living your life, but sustainably. So the poverty is different in the Netherlands than, for instance, in Peru. Exactly. But can you say that there are no poor people then in the Netherlands? We started out with this concept of poverty that basically means that you need to have enough to survive, right? But in a country like the Netherlands, you could also argue that a basic need is that you have enough to be accepted socially in society. We all need Wi-Fi, ladies and gentlemen. We all need Wi-Fi. It's a necessity. Your life would be very hard if you would not be able to afford it in the Netherlands because it would be very hard to apply for an employment benefit, for instance. One more question for you, Monica, because you said in the beginning, well, we need to change Venezuela, which is now, of course, an oil country. So what are you going to do? Well, I think the first step that we need to take is that we cannot go into the high demands of energies that developed countries have with the current means of producing this energy. So the first step that we need to bring is produce energy in a more sustainable way. So more innovative ways, technologies, wind, solar panels. Do you have the resources to do that? No, but that's what I was saying before. We need to have a shared responsibility of countries helping other countries, like not only with money, but also with training. Thank you so much for your information. Thank you for watching and good luck with everything, with studies and everything that you do beside the study. Thank you very much. Thank you so much.


All right, welcome to Microsoft's DevSync on July 23rd. So let's get started again with the same format we tried earlier this week. And we'll start with the good and the bad and the ugly, starting with Chris Bayer today. Yeah, you're muted. That's the bad. So the good, I was able to put together a Confluence document with the options for Wi-Fi setup and how we wanna, some decision points on how we want to make that decision internally. I was also able to contribute to the document gets started about the GUI decision. And now we're gonna make that. And I started working on an issue with the Kivi UI before I was abruptly pulled away from my home and now my parents' house. So my productivity has been not great the last two days. That's the ugly. I'm here helping out my family, so I'm doing what I can, but it's not as much as I would do doing if I was at home. So after the documentation, I think I'm going to pull some Salini tickets since I don't have a device right now. I'll do some of Salini work through that. I can do that without the device, some of those bug fixes. And then I'll get back on the device when I get home. Okay, great. How long are you planning on being there? Or do you think you might be there? Right now it's open-ended. I'm hoping to leave though to go home Sunday, but it's not for sure yet. Okay. All right, thanks, Gez. Yeah. So as Chris mentioned, I started the GUI thing, but only that for a separate discussion. Also, we've shifted the TV image to be USB bootable, but I think Derek will probably go into the details there. To get it working, it was a little bit of messing around, but that's because we're working off an existing image. I think if we build future images specifically on a USB, then we won't have the same problem. It's just because the usable space on two different drives doesn't necessarily match up. Are they good things? Well, the other good thing is the boot stuff that I've been looking into, it turns out that sometimes some of our services just don't start up, but the Microsoft.ready message that reports, I guess this is not a good, it's good that I discovered it, but the Microsoft.ready message that gets sent out to say that Microsoft is ready doesn't actually check the majority of services that run Microsoft. It sort of assumes that the other things are running. It's really just saying that the skilled service is running and the message bus because it has to repeat the message. Doesn't that come from a predation or something too? Some place weird? Yeah, it comes from predation. It's a chain of events, and then based on that chain of events, you assume that everything in that chain is running. But it really begs to, well, suggest that a shift so that we're either having an external monitoring something that says that checks in with each of the services and waits for them all to be, properly booted and running, and then says Microsoft's ready or something internal that checks on that as well. So the good thing is that, okay, it's already been working on service hooks, so hooks within each of the services to say that things are booting, things are having that there's been an error on startup or that everything started successfully. It doesn't, some of them have watchdogs, some of them don't. Yeah, that all needs, I'm basically at the moment in the process of figuring out what that might look like from a boot perspective. So just FYI, I'd probably classify that as an ugly issue rather than a good one. Yeah, you've just discovered a giant spaghetti mess of work to do. Yeah, sorry, I'd like to say positive. The good part was that I found out that it's happening. Because it also highlighted why the news and play fields just randomly failed in Boitconk sometimes, because I was able to replicate that when the audio service doesn't start, that happens because there's nothing to stop, there's no playback to stop because there's no audio service. And so, finding out why these seemingly random events that are occurring is really good as well. Yeah, that is good. Again, it's ugly. Agreed. Yeah, no, that's good. That explains some things and getting a better definition on what ready means I think is a great step forward. Yeah. So is this something that you urgently need to work on? I mean, are you going to add it to the bug list and keep cranking on it? Or do you want to set it aside in favor of other things? Well, I feel like it's actually causing a kind of pull together maybe like four tickets, which I think is probably a probably related based on this. And that, you know, will at least be a huge step forward if they can be, they're all relying on knowing that Microsoft's ready to do something. And so, it was like a priority. Okay. All right. Anything else? Just the final thing is particularly in terms of bringing in community PRs and stuff. I think and I had a little bit of a chat with you about this. It would be really useful to document what we think does where and, you know, what should be in Microsoft Core, what should be in an enclosure, what should be in a separate plugin. And in my mind, ideally, we have core being as minimal as possible. So it is, it is literally the core.  So there isn't in its kind of direction with like a plugin system for the audio services and that sort of thing. But I think we probably need to wait until 20, 28 to actually put it into production because it's a big shift. Okay. Yeah, I'd want to review whatever, okay, it's coming up with two to do. Like, I know we've, I like the idea of having some sort of service running that monitors or other services. Yeah, I had that at a, another company that worked out really well as far as, you know, so that services themselves aren't self-aware but something's watching them. But I do want to I'm not going to say this, I appreciate Okay's help but I don't want him to necessarily peek off and doing things that may or may not be aligned with what we want to do long-term, architecturally, right? Yeah, and so that's why, yeah, I think we need to be able to articulate what we want to do architecturally so that we can help the community to know which direction we want them to go. But okay, hasn't worked on that external monitoring service at all. So this is a primetime take for us to get into that. So I think we can outline what we think that might look like that would be really helpful. So maybe Chris, you and I can chat about that and I want to just start straight into it. Yeah, I can lend some input from when we had that kind of thing at another job I was at and how it worked. Alright, cool. Alright, so I did want to add that and I got the volume issues fixed on the new image. So I was able to add that I2C set command into the boot set and I was able to make sure that the Mark II skill that's running does have volume controls on it. So the current image shouldn't have a problem anymore with potentially boring speakers. I did get to that before I left. Alright. So does that set like the max volume? Like the user can't turn it up past that number? Yes. Got it. I have some information on that bug you wrote up. Yeah. I didn't see that update, thanks. Alright, let's go to Ken next. Sure, so good work because I was going to tell you guys I didn't want to say anything because I'm busy right now I want to get pulled into it. But I'm monitoring the log files constantly on a Minecraft core and Minecraft and I'm constantly seeing the message come out and saying I'm done booting, right? And then for another 30 seconds to a minute I see a bunch of activity and I'm like well if you're done what are you doing? So I think you're on the right track there. Anyway, alright, so the good is the database represents the large data store of samples has been backed up. The large store of samples is in process it's a little over halfway through a 36 hour process it's all good. Analyze the data and row code to delete the offensive data when I get that marching order which I got so that'll be taken care of by end of day tomorrow probably. I started looking at how I'm going to partition that data and wrote some code to do so and I have some details on that and I'll update the wiki because that's usually the most efficient way to get that information communicated rather than spending an hour on the phone with everybody or on the call with everybody. I created a hyper parameters document and wiki I think that's good because I surfaced some stuff and was able to learn some industry standard ratios between some of those hyper parameters and what drives their usage and so that will help me reduce the tuning which could have been a combinatoric nightmare so that was good. I have some questions from Matt regarding some hyper parameters that are gathered in the later versions precise not the earlier versions but don't seem to be used and I have refactored the latest version of precise to include the hyper parameters from a command line so that the test suites can be implemented and generate CSV result files that can then be analyzed and possibly even make some inroads into auto tuning but that's still down the rotor piece and what is this change oh yeah and I'll change a bit based upon some of the stuff I've learned. The bad was and ugly was really just that we didn't have that data backed up and it's going to take quite a while to do so but other than that nothing really bad or ugly just a lot of work and a lot of work to do but you know starting to see the light at the end of the tunnel you know the bad is okay the bad is if you want to surface anything bad that I've discovered we've got three distinct versions of precise we have to be concerned about we have version 0.1 which is the version that produced our current production model we have version 0.2 which is what's installed in everybody's system and 0.3 which is what you get if you check it out from the code line and also I believe what is being deployed to the Mark II's so they are not backward compatible you know a model created by 0.3 cannot be read or worked with 0.2 or 0.1 how far up the chain that will work or propagate I'm not sure yet I'm pretty sure models created by 0.1 can be handled by 0.3 but that's ugly and I have to get a handle on that and figure out what we're going to do about that I have been reluctant to upgrade because it will affect the thousands of users that we have out there who are running 0.2 and if it's not necessary I won't do it so I'm just trying to get a handle on that ugliness and that's the only ugliness I guess I have to report okay Derek just quickly Mark II should be using 0.2 as well are you sure about that because last time I spoke with okay he had mentioned he was running 0.3 with a modified 0.2 runner I trust okay then yeah I don't know for sure either 0.2 when I get one it's installed I'll be able to tell you well we should be able to look at the images we're producing right yeah I'm not part of that process but yeah I can dig into it it depends on what Mark II you're talking about Mark II that okay working on in his house was different than the one we produced for project rollovers it's well there you go there's no use the one we did for project rollovers based off of piecraft is using as what project rollover is using we have to be careful what we say but to qualify because there's about 5 versions of a line around out there yeah and at some point and Michael if you want to cut a ticket for this I'm fine with that we can just make it a low priority I should probably put some sort of table together which defines default versions with which image and you know all that good stuff yeah I think we do need to look into that just in terms of what we can do I'm less concerned with the end flavors of prototypes out there that have different versions of precise or whatever in them but I am very concerned with the production stuff that's out there the Mark I can they even be upgraded to version III and that kind of stuff but yeah we should definitely create a ticket for that okay now Derek alright hey guys okay so ugly project rollover prototypes are a little behind schedule yeah we just we ran into a couple blockers I think Monday is probably doable to ship I think the most important one is just not really being able to test it until today as mentioned we got the USB boot going thank you guys and Chris too on pointing towards the rotation of the display so that's awesome that's working successfully but we really didn't get to test anything until today all was looking okay but I saw some of those audio issues that I want to figure out what's going on there and I haven't 100% determined that it is software yet so I need to swap out some parts and do some testing to make sure it's not the hardware that's causing the problem before I put my finger at you guys so yeah I think it would be too rushed to try a ship tomorrow with those concerns plus we still have a lot of assembly left to do the good news is we've got a lot of the parts as of today should be printed and Charlie's working hard to get everything all cleaned up and ready to go so there's really just going to be assembly and testing left to do so but I do plan on running if I get everything working well if we can determine what this I2C audio issue is then I plan to leave over the weekend to really make sure it's good just preliminary heat tests getting around 95 to 100 degrees when you're hitting the top of the device which seems kind of hot but it's really not that bad is that Celsius or Fahrenheit Fahrenheit just for reference in Amazon products is about 90 degrees on top surface as well so I think it's fine and the pie isn't shutting down or anything like it would do if it were overheating but I'm going to do some more rigorous stuff on that tomorrow yeah so yeah we probably I don't know if Josh we need to communicate that to the progress roll over guys for what we've actually promised so that's that and then on and that's really just been kind of taking up more time than I thought so I've made a little progress on the new SJ based SJ201 based enclosure but really not enough to make any noise about yet so just been mostly working on the project roll over bits yeah and there's some things I haven't mentioned about it they're kind of cool that you guys will probably wish you had on your speaker prototypes you can actually plug the ethernet cable in and use the device with an ethernet cable plugged into it that's why the display had to be rotated 180 because it's now exposed towards the bottom you have access to the USB ports and the one thing that I know you guys have been bugging me about forever is you can really truly remove the flash drive without any tools so the USB by switching to the USB stick you can actually grab it and remove it so unfortunately that's probably the last of those types of prototypes that we'll make but got a couple things mixed up for those guys that are better than and are known issues that we've had in the past so yeah that's it for me then okay nothing blocking any of your work going forward no just those kind of setbacks unless and then you kind of to be determined on this I2C issue see what's going on there okay how's notice Charlie's not here today is he everything is going fine I told him to jump on I saw him I was working with him up to about 3.30 and I don't know he's probably just heads down working on the prototype so everything is going fine there okay great well let's see I've only got a little bit of an update we're going to talk with Kevin this afternoon and finalize the order for the SJ201 prototypes so we'll get those underway I'll let you guys know what to expect in terms of timeline which brings me to the point of hey we need to figure out how we're going to test these things so I've created an epic in the ticket system to just list all the things we need to do to get a new enclosure up and running not terribly different from the last one but it is using a different chipset there are things that are going to be different so I passed that off to Chris to get started on just great tickets for all the things that need to be done on a new enclosure I'm going to work with Kevin to just create some test software for the device itself because it can work in a standalone format as a USB device so we'll test it that way to start with let's see there's a number of topics that we talked about last week that we need to put on our roadmap at some point the one of them we talked about the GUI decision matrix the wifi decision matrix coming up with we need to talk about the mark 2 update methodology I think we're going to have a decision matrix about that as well when I didn't get around to writing that's next alright cool and then the next thing I want to talk about is start to put together some metrics for precise and try to set an end goal in terms of how do we know when it's good enough I think we could there's a couple of ways we could do this but we could benchmark the Amazon Google products in terms of how accurate they are missed wake word just basically how often they recognize the wake word and come up with some crude targets and that might be one methodology we can also target it a system whereby we just make sure that it's better than the last model we released stuff like that we have some criteria for when to release it and how to release it I know that there's a fair amount of uncertainty regarding the new model versus the old model and the old model has been around for a couple of years now hasn't been updated so if we did roll out a new model it might change the way it behaves for some people so maybe we want to roll out a new model as the default hey-microft model but keep the other one around as one of those alternate models just call it hey-microft slash legacy or something like that in the Selene options where you can pick a new wake word so we need to come up with that methodology so that's something I'd like to talk to you about Ken or actually ideally just come up with a proposal okay, yeah I want to find out if anybody noticed the answer to this question before I ask Matt um we automatically download the latest version of Precise when mycroft core comes up so each time you bring it up it actually checks to make sure you have the latest version that's been released um if that process is in place for the model as well then this should be a relatively painless process so that's what I'm going to ask Matt if anybody else here knows the answer to that question which is is there a way to say in the cloud here's the new model and then all the devices will automatically update does anybody know if that's in there or not okay, I'll ask Matt I'm fairly sure it is I'll check the code and method you okay, thanks and yeah, Michael I'll work on the pseudo acceptance criteria probably it'd be multi-staged which will be internal analysis like you mentioned against competitive products and against our previous version and against a known dataset but then there should probably be some sort of staged rollout maybe just among us to say yeah, it seems better or it doesn't seem worse in other words, I'm anticipating a jump from about 85% recognition accuracy to 95% with the next model I don't know how you quantify to a human this is 10% better recognizing wake words I call bullshit on both of those numbers okay you're missing wake words that people are attempting to use and are not being recognized I would be stunned if our actual accuracy was more than 30% well I I'm not only quantifying a statement I'm not disagreeing with you a bit the statement is simply against a known test dataset that I have assembled that is balanced between male and female for high and low pitched voices against that known dataset is where those numbers are derived from and that dataset maybe as small as 500 samples so yes, in the wild the numbers are probably vastly different, Josh I just don't know how to quantify in the wild numbers I only know how to bring it into the lab and quantify right and that's actually another topic more things from the wild in right well that is one issue getting more samples from the wild could potentially help with that but also characterizing the nature of the samples that we're getting and that we have testing against if I'm using a headset my recordings are going to be a little bit cleaner than if I'm talking into the microphone on my webcam right and this is a big issue which is I don't know the answer by the way which is are we better served with clean data or are we better served with dirty data in other words is it better that the data has normal noise in the background because that's what the recognizer is going to be exposed to on a daily basis or is it better to deal with really tight clean data what's the SQ, Josh, which one dirty data it's actually one of the reasons we didn't get into fancy microphones with the Mark 1 the concept was we want to collect data in a dirty environment and teach the wakeward recognizer to recognize that environment and then solve the dirty in software so that we're not hobbled by a need to have super clean noise cancellation chips on every instance of Minecraft if it'll run on a Mark 1 it should run anywhere it was coming to thinking that's fair that's fair that we have no problem with most of we do have a lot of dirty data so I haven't cleaned it up which just lets me know that I shouldn't bother building a noise classifier and filtering those out thanks, Josh and as part of this what does precise look like when it's done I would argue that unless we have the entire machine learning loop closed and finished that the project's not done what I'd really like to avoid and my phone's about to die so if I leave that's why I'd really like to avoid a situation where we're back where we are today a year from now and Ken moves on and we need to train more models and we haven't automated this loop I'd love to, the completion for me would be the software stack is automatically improving the contributions from the community at which point we can close this item and it should improve by itself we shouldn't have to continue to develop additional software beyond tweaking how the models are trained and what not which you'd be surprised how many members of our community are willing to reach in and do that piece of it for us I think I agree with all of the above the only caveat would be that at some point and I suspect we're still a ways off from that point we'll have too much data and we'll start overfitting but I suspect that's not an issue and I hear where you're coming from Josh I am working actually on exactly that which is the entire loop from getting the new samples into the system getting them into a business process flow where they can be manually validated getting them into the training and testing data sets from there and periodically at some trigger level retraining models and then running the whole suite in this model better than the previous model and then yes if it is it automatically gets deployed yes I hear you and that's what I'm working on from a high level correct excellent and I'd like to abstract that one step above and that would be that we can reimplement that exact same loop for new records in some kind of automated fashion in other words if we want to stand up a wake word HRVS for example we can add that to Celine and anybody who selects it will automatically start feeding data into that exact same loop for the new wake word and so that would enable us as we have corporate customers step up and want to do custom wake words we could simply enable one in Celine let the community know hey we need help we have some prizes available for whoever tags in most of these queries and it would stand up and improve on its own right that's a very powerful position to be in on the wake word side kit AI sold to buy due for $50 million and they didn't have anything even close to this now you're mad after my own heart I agree so yeah that's the goal the only other piece I'd like to abstract up is I want to make sure that we are collecting the data from before the wake word we can start getting the missed ones right now the entire system is biased towards the ones we actually spotted we need to be collecting the attempts that don't work because without those our accuracy will always be sure that's fair enough Michael can you cut a ticket for me for that that would be one of the last things I do once I have the loop closed but yeah I absolutely agree with everything Josh said just to be clear Josh I ain't going nowhere this is my dream job I could become a watch on the side of the road though which is why I keep creating the wiki pages keep wearing the mask don't go to the grocery store yeah I'm not sure that like in terms of getting in data for people that were not successfully hitting it feels like the precise trainer skill is a much stronger way of doing that than messing with audio from before they've even spoken to the device like I feel like that in itself has privacy concerns and people will be yeah pretty concerned about that we're deliberately having people you know we're communicating what we're doing with it but unless we get those missed utterances we don't know what our accuracy is if my kid tries five times and on a sixth time it works but we don't know a lot of times if he tries five times I don't bother trying the sixth time and then we don't get it at all on the other one we can hit the button and on the mark two they should be able to hit the button too well let's just leave it at this that Chris's concerns are noted and we probably when we have our privacy policy discussions need to surface this and get it out there I agree with Josh that that information is a potential way for us outside of manual intervention to gather some of that data and improve in other words the value of that data is especially in the case where it was a missed wake word or in either case that data is very valuable in other words if I have samples that say hey mycroft it would be wonderful if I could have samples on the negative side that said hey minecraft because it allows the tighter discrimination during the training process so this gives us the opportunity to get some of that data in an automated fashion so if we can overcome the privacy concerns which I agree are existent I think this data is a bit valuable and not that hard to capture I don't view it as a privacy concern at all for me the privacy issue is binary like either the person opted out opted in or they did and so the you know on the privacy side of things the end user should you know we've informed them what we want to do with their data you know we've been up front about it they've consented at that point we need to stop being nuanced we collect what we need to make the software stack go and if they're uncomfortable with it they'll opt out we'll nuke it but you know we can't continue to have these nuanced discussions about it you know once somebody's consented let's go ahead and use the data because our competitors are using everything they're using everything they're collecting 10 seconds before 10 seconds after everything you say in the room they're collecting everything we can you know once we've disclosed to people what we're doing with it once we've asked their permission and they've affirmatively granted it let's go ahead and use the data we need it you know we don't want to be so far on the side of privacy that we can't build a technology stack that's competitive and works nobody wants that right and you know we can add tools we can add tools to the system that allow people to go in and selectively nuke samples or whatever yes that's what I would I would ask for because I think that people as I mean from personal experience seeing some of the data and seeing some stuff that I'm like yeah I don't think I'd want that out there if it were mine you know I don't that's a really sexy option yeah I like that no it is because it's a little bit difficult to implement but it gives the user fine-grained control so that we don't get gross opt-outs we can get just whack these 10 files of mine that that's awesome because there's this issue we are still a small enough community and I've been seeing stuff when looking at data we're like I know who this person is like you know and that's that's a little weird so and I could I mean I can obviously have it within the company but I think it could also happen within our close knit community and yeah there should be some thought into it and not everybody knows what it means when you say we're going to use your data to improve the wake word they might work okay cool I don't care how many times you listen to me say hey my crop I'll say hey my crop a million times for you they don't realize that it's actually more than that and so I just think we need to have some optics on it we understand like it could be a problem but but I like the idea of being able to listen to your own data and be able to nuke it if you don't like like what you hear right and you know to Josh's point I think you know they give consent then they've given consent right I think it needs to be informed consent and you know to Derek's point we should be very clear about what we're collecting with them and and as we change what we collect if we do we either need to get you know nuke a new consent or make it really clear to them the things have changed so but yeah all these issues are addressable and we should not be afraid to collect data when people want us to collect their data and use it to make the system better yeah I think I fully agree with all that I think my concern is that doing that without a way for people to actually see exactly what they're uploading will just say a huge drop-off in in opt-in because I mean I would opt in at that point in time and you know I imagine that a lot of other people wouldn't as well yeah I mean we'd even potentially implement a you know a system where you say like hey my craft you know forget everything I said for the last hour yeah then we don't need a GUI for it then we could even you know we can look at more granular opt-in controls potentially rather than just a single opt-in opt-out like some people might be happy for wait words and not utterances and you know you know like come from people as well you know they're like well I don't actually know what data you're collecting so therefore I opt out but if I could see the data before it goes up then I'd be happy to do that or if I could you know even if I could review it after it's already gone up then they'd be more happy with it so like there's a whole lot of nuance yeah we just we're not in a position where we can actually build that nuance in and what might be cool is having a skill that responds to stop collecting start collecting again and then what you have is a marketable feature that your competitors don't have you can't tell Google stop opting my data in or Amazon you can't say hey stop recording my data you know and then later you can say stop start again that would be a marketable thing you know that we could trump it out there regarding a benefit over our competitors and privacy issues so I think that's awesome I think we could also have a tool that allows people to that we can load the wakewood recognizer onto some sort of web interface where people can you don't have to have a mark one or a mark two to do it you can just go on there and say hey mycroft and if the wakewood recognizer says boop yep I recognize you that's a positive if you tried it and it didn't say that you know there's you know so that way and if you opt in if you do that then there's an agreement before you do it that says okay I agree that my samples are you know can be used for our data purposes but that gives people a way not only they make it they can almost self tag at that point too you know I mean I know we talked about give us 20 samples for example I know we talked about maybe having a cap on how useful it is for one person to have too many samples but you know if we put it behind our single sign on and people sign on and say okay I've given my 20 then you know and they're validated it would also help us with false positives too because they'll know right away that they tried to say and it didn't work so I'm really dig on the skill that hey you know turn off opt-in turn on opt-in I mean I can tell you several times during the day when my wife comes in and aggravates me and I would be using that skill and saying turn off opt-in and then I was done with her turn it back on again so yeah I'm liking that concept and then we just need the event we need the event driven database like the transactional database on that opt-in flag before we do that sort of thing yeah that's true I had some thoughts too on this going back on the conversation a little bit but on our kind of real-world testing aspect of it as soon as we get some of these SJ201s might be cool to write something that allows us to do some automated testing especially if you had two of them that you could run like wakeboard samples on one device at different decibel levels and you know move your other device back away from it and do some benchmarking with the real physical device we did something similar to that with the Mark 1 over a year ago versus an Amazon device and a Google device where we on a speaker played at different decibel levels we played wakewords and tested distances and volumes etc so obviously that's not going to get you the huge breadth of you know examples that you get from the community but it could give you some pretty useful real-world data pretty quickly a great up a really good point which is I don't know if we've been looking at this when we were getting ready to release the PC Junior at IBM I was working closely with the reactors guys at the time on a different project and they showed me an issue they had the PC Junior actually got recalled initially because the keyboards were infrared and nobody had thought to put two PC Juniors side by side and what happened was the keyboards interfered with each other and screwed everything up and had me redesigned have we taken and put two PC Juniors assistants maybe even a Siri in the same room and done a battle of the network speaker phones and see what happens we've done it I've got the 304 on my desk at the moment I mean in our Gladstone office we have a Google home and an Alexa and you know we usually leave them muted but I mean we've done we had a guy who was doing metrics for a while who actually sat in a room with all three of them collected some metrics on that kind of stuff around that wouldn't hurt to do it more often every now and again they can get in a conversation together well so that brings up another that actually brings up another thing metrics wise that could help us too with our Qt vs. Keeve going back to that one of those metrics was time to respond and that's like one of the big things that you want to be looking at with our product vs. other assistants that to me is like the time of response between the two GUIs that's the first step like okay if this if one is vastly superior than the other well then it's no brainer I don't know if is any of that stuff that we did for those I mean I know there was at one point one of our employees was sitting in a room you know stopwatch in hand doing that kind of stuff especially with the Amazon devices we don't have a way to test that other than that we do at one point have some tests like that for mycroft we have metrics for mycroft core that tell say how long it took to get from point A to point B and those metrics are up in Grafana what we don't have is what type of device were you using when you did that not that that correlation is not there yet so if we could add that correlation you know then we could look we could do apples that apples comparison of how a skill reacts on different device types well yeah at least on a short term if we could just do it on one like per one device you know if we just had this one instance of pv or this one instance of acute devices I mean again you can do this stopwatch in hand but I was just curious now if you if you were doing it yourself and you knew your account ID and the database and which device you were using that was the acute version which was the give you version I could get there you probably get it from the log files in the message box log file times are not necessarily the best way to view something like that because the files get written to the log not necessarily at the there's read write problems I've had problems before where looking at log file time stamps can really get you into trouble sure unless you actually have the log message as a crime print and the log message itself but I wouldn't at the time stamp the log message was written yeah you're right Chris we can put some code pretty quickly to run that test we have a metric in core it's just a matter of you know you have to be opted in and you have to be able to know when you were using a mark 2 acute device and when you were using a mark 2 kibby device which devices they are so we can identify them in the database once we have that then I think we can make that correlation I'll double check but I don't think this is make a lot of the tools in place for this I think we just need to make that final step is doing the correlation yeah all right so I don't think we're at the point yet where we need to make a decision on the acute kibby I think we should go through and make sure that everyone's had a chance to put in there two cents on the decision criteria and we should be talking about that soon um in terms of next week how are we looking in with our with the bag of issues that we're calling a sprint um so I did like I said I closed a couple of the volume ones um I mean you in particular I mean like as a team overall like do we need to is it time should we be looking at shifting focus to um you know to a new bigger project or we still have a lot of work to do in terms of debugging um so I think the reason we're doing this is is really project roll over right is to get them as best user experience as possible so I think one thing we haven't done is to go through the bugs that are not that haven't been started yet and say okay these would be really beneficial to get done you know quickly and these are maybe a lower priority bugs that we should be doing something else inside instead of fixing this bug right away right okay um that sounds like a useful exercise because the next two things that I want to talk about are in terms of overall um you know projects that the team can work on um I think that we can take the work that we're doing you know that Ken's primarily doing here on precise and expand that to be a team-wide effort because there are elements that everyone has some knowledge on that can really help move this forward for example if we're going to create a community uh you know a system that involves the community submitting samples or grading samples and verifying and that sort of thing then you know I think Chris can help do some of that work or get the community involved and helping out with you know improving that system you know and you know obviously there's stuff work to be done on the Selene side in terms of you know creating the infrastructure for that both for collecting samples and for you know the opt-in and all that kind of stuff that we were recently talking about so this this could be like a team-wide project that we could focus on you know get this wake word data system done robust and something that we can you know utilize going forward and I think that'd be a great project for us to work on that would have lasting value and you know potentially give us immediate results and improvements so so that's one thing uh the other thing is the the continuous revisit the continuous integration process and and look at turning that into a continuous deployment process because you know right now we don't have we don't even have a deployment process for the Mark II because we don't have a Mark II but we do have a snap package and we don't have a continuous deployment process for that really defined yet right I don't know how often we're updating the snap package but I installed the fresh copy yesterday and you know there were a couple of hiccups in getting it up and running but you know it's pretty easy to get installed right and so that's that's actually a system that we could be using as part of even the wake word data collection system right because it's you know it's right there in front of the user once you install it like it's a really easy way to to get people to to interact with the system and so like if you know if we had a skill for example that helped us collect wake words or grade wake words I mean even just spending you know a human spending five minutes doing that could do a ton of work for us and that would be just super valuable so so having a continuous deployment process I think you know would be really useful in that respect as well so those are some of the next two projects that are on my mind in terms of you know things we can get the team involved in so I I don't really hate to waste the momentum we have mine precise right now we've been we're giving it more attention than we have in a while and it's been an issue for a while so it would be really be nice to you know really put some nails in that coffin and say you know we've got this really cool wake word thing that is useful in many many different ways and you know be able to have that kind of feather in our cap might be nice okay yeah if we could get precise through to completion right so it's a production piece software it creates a lot of opportunities for us as a company and I would argue that precise combined with the initial setup and the wifi setup if we could get those two things squared away and then as icing on the cake get the exact to be stable on whatever hardware we choose we have a viable product that we can shoot and actually like have some customers and some revenue and stop being behind the eight ball of funders that's a very powerful thing I would love to see that and the other thing with the bug fixes is I mean I know the project rollover has a few prototype devices but really I mean we could have another bug fix sprint once we get more of the SGA 201 prototypes out there so I'm sure we'll have a whole new set of bugs and we'll show up with the new the new hardware you know and make sure that definitely you know at least don't send any of those out to anybody and so we're however happy with its you know performance from a UX perspective the hardware the SGA 201 hardware is really you know I consider it almost a Skunkworks project just to prove that we can do it and get something out there and so we can start to test the efficacy of actually having an audio front end and start to deal with some of these issues of clean data versus dirty data and what does that even mean if we're using you know these acoustic echo cancellation algorithms so so I think that's a nice to have but it's you know and obviously we want to fulfill the Kickstarter you know commitments there but yeah but you know we're not going to be able to do that until the software is ready anyway so I don't I don't want the hardware to become a distraction. Well I think prototype is essential for the Mach 2 as well right? Oh of course. Yeah. I think to Josh's point I even have the beginnings of a precise studio that I'm building but you can using the UI you can create your wake words you can assemble your data set you can test your models all that stuff just using a GUI so that would install when you checked out precise not that difficult. As much as possible I'd like to make sure that the precise stuff runs through Selene and verifying and adding feature or adding new models you know being open source is great and I you know I'm a thousand percent behind it but let's not build tools that put our stuff where we put ourselves out of business yeah. I haven't even thought about those issues that you guys will have to guide me on that but yeah for sure the process currently does not go through Selene we could make it go through Selene it wouldn't be that difficult I don't think I don't think the new wake words and all that stuff finding which ones you want to delete and all of that stuff can run through Selene and if a company like a major retailer wants to have that capability you know we can work with them for the community we can provide it for them but you know we are a company and not a charitable organization we do need to come up with the mechanisms where we add value in exchange for getting paid or you know we will be not a company anymore after a while agreed so to get started should we shape up a precise sprint well let's go through the current sprint look for anything that's critical that we need to get done either for rollover or for just you know the system in general are there any critical issues in the to-do column and make sure we close those out and in the meantime let's get started on defining a precise sprint around building this whole the whole system I'd like to be a precise epic and put all the tickets in there we can prioritize I think there's probably a lot of stuff that could be the same thing we're doing with the bug fixes now which maybe break it up into smaller sprints but it won't be a huge make precise worksprint yeah I agree yeah because we're going to have to define all these elements like the salini element the data collection you know storage element the training element the how often do we you know it can still work on the whole algorithm in terms of you know what's the best way to utilize the data all that kind of stuff so there's a lot of moving parts so I agree to identify which of these issues should we go through them as a group in a different meeting should we each take I mean I was thinking that there's a high priority flag on these issues we could use that and set the ones to high that we think are are the most important maybe we all do that between now and Monday are you talking about the current bug sprint or a new sprint current bug sprint and then we on Monday we can go through all the ones that have been marked as high and but then that would be hard to know if nobody missed one somebody else thinks as high but yeah I'm trying to think of the best way for all of us to you know have input on things that we think that really have to be fixed before we move on I think that's fine I mean the tools there why don't we use the priority just set it to high or set it to highest if we have to fix it before we move close out this bug sprint okay and that shouldn't take more than five minutes everybody can go through and if it's not already marked as high priority you think it should be then go ahead and change the priority to highest alright and then I think the way I'd like to proceed with creating the wakeward sprint the precise sprint I think Ken's got a pretty good handle on the overall system in terms of the training and the collecting the data and that sort of thing so I'd like to see him write down like he's been doing with the Confluence pages just an overview of the whole system how it behaves, how the user interacts with that sort of thing and that way we can all take a look at it and make sure we're all in agreement about what needs to be done and how it should work okay I'll take that there's a work item and I'll try to have that document available by meeting on Monday I don't think we should use the meeting on Monday to review the document so no need to do that as it's appropriate and we should have a separate we should have a separate meeting to review it in fact, actually what we should do is we should review it offline like when you're done send around to people to comment on then we have a meeting to go over the comments and you know resolve anything that's not obvious I agree, I guess I'll rephrase it I'm saying I'm going to try to have that page done and emailed out to everybody by Monday that sounds awesome, thanks okay any outstanding items that we need to talk about not here alright cool, well thanks everybody the meetings are not getting any shorter but I think they're getting more focused so I appreciate that hey guys I have a quick question for you before you go have you you say you have like two or three of them in the same room are they all at the same time? was that from me? yeah often they are, yeah it kind of changes pretty regularly so you're on the same time it doesn't create like an infinite battle of the speaker phone and automated calling system? it does sometimes yeah I thought I was right you constantly go into an infinite loop until somebody manually powers one down okay they don't often get into an infinite loop but you know you often get the same response from multiple places but it's also why we have multiple fake words so you know you can have an Ezra and a Jarvis and a Minecraft and that helps you pick one rather than the other that's what we do in the office is I use like a Jarvis on my desk so I don't when I'm testing I'm not activating every other device in the office you should be able to put you should be able to put them in an infinite loop by saying hey Minecraft waiting for it to activate and then say say hey Minecraft say hey Minecraft twice and that should put them that should put them all into an infinite loop and just by my eye of the data set I have already I do have other data other data for other wake words and hey Jarvis is one of them yeah we started some of that collection a while ago we just never got all the way through with the tagging and all that stuff so we just need to be able to I'd like to take whatever that Postgres database is and integrate it into Selene as well so we can take advantage of you know referential integrity and stuff yeah that's all I say we want to get it integrated with Selene not only that but it's MariaDB slash MySQL not even Postgres okay well yeah and then at the end of that that becomes the service that we can charge people money for and then we can pay our own bills which makes me very excited why are we worried about money hey if everybody on this call can stop worrying about money then we can stop worrying about money right I think Ken just volunteered his paycheck alright well I will focus on continuing to go get some money and make sure we keep the bellies full and we'll talk again oh no we're still recording we're still recording okay so the community knows it's no secret we're getting ready to go out and write some money so we can talk about that a little bit later alright we have multiple competing term sheets and anybody listening for this call who wants to get in they better get their check in now we're gonna get them on Monday


And now, tonight's presentation of Radio's Outstanding Theatre of Thrills. Suspense. Tonight, we bring you a classic short story by James Thurber. So now, starring Mr. John Daener, here is our suspense play, A Friend to Alexander. I've taken to dreaming about Aaron Burr every night. What for? How do I know what for? What for, the woman says. You do look tired, Harry. Well, a session like I had last night is worse than no sleep at all. I should look tired. Aaron Burr. He's a funny person to be dreaming about nowadays. I mean, with all the talk about the A-bombs and the H-bombs and the election and everything, I wish you'd go see Dr. Fox. Oh, nonsense. Well, maybe you need some different vitamins. Or maybe some of those new pills. Those, um, uh, Star Axe, uh, Aratrix. What do they call them again? Recerbin, chlorpromazine, one of the tranquilizers. No, no, it's another name. Oh, Aratrix. Aratrix, tranquilizers, all the same thing. Well, maybe you need some of those. They're supposed to do wonders for people. All I need is to stop seeing Aaron Burr every time I close my eyes. I don't see why you see him in your dreams. Where do you see him? Oh, places, maybe Washington Square, Bowling Green or on Broadway. Right here in town? I lived in New York, you know.  Oh? Yeah, and suddenly there's Burr. Bowling and smiling and smelling like a carnation. Harry, will you get me a cigarette, please? Sure. He'll be telling the stories about France and getting off his insults. Here you are, Bess. Hey, when did you start smoking before breakfast? Just hold the light where I can reach it, please. All right. Who is the woman in the Victoria, Harry? What? That you dream about. How do I know people in dreams? There's nobody at all or everybody. You see Aaron Burr plainly enough. I mean, he isn't nobody or everybody. All right, all right, but I don't know who the woman is. Maybe it's Madame Chumelle or Mittens Willard or a girl I knew in high school. It's not important. Who is Mittens Willard? Well, she was a famous actress 75 years ago or so. She's buried in an old cemetery on Second Avenue. Oh. Oh, goodness, you're so well-read. It's very sad about Mittens Willard, isn't it? Why? Why is it? Well, I mean, she probably died young. Almost all women did in those days. Oh, Harry, please, don't pace back and forth like that. You know what he did?  Alexander Hamilton, my goodness. Yes, and then when I look at Hamilton, who do you suppose he was? I don't know, dear. Who was he? He was my brother, the one who was killed by that drunk in the cemetery. Just stand aside there, fellow. Huh? Why? Why should I? Perhaps you don't recognize a former officer of the Revolutionary Army and a United States senator. I recognize you all right, Burr. You may have been an officer, but Washington hated you. And as for winning that election for my friend's father-in-law, but there was something crooked about the way the ballots were counted. More bacon, Harry. Another egg. Did the Giants win last night? It is the Giants you like, isn't it? I wish he'd go back to France and stay there. Who, dear? What are you thinking? Oh, you mean Aaron Burr. Did you dream about him again? I don't see why you dream about him all the time. Um, don't you think you ought to take some loom and all? No, no, no. Last night he kept shoving Alexander around. Alexander? Hamilton, I certainly know him well enough by this time to call him by his first name. He hides behind my coattails every night, practically.  Ooh, that's what they are. There's no mistake about it. We ought to get out in the country over the weekend. Why don't we go to the old drovers in? You like it there. I don't know whether Walter, but practically every guy I ever really liked. Well, that's just natural, I guess. Well, of course it is, dear. Oh, Harry, I do wish you'd go to Dr. Fox. I'm going to the zoo and feed popcorn to the rhinoceros. That makes things seem all right for a little while anyway. No. Oh, you're not going through with it, Burgess! Certainly I'm going through with it. He accepted the challenge. Hamilton had no intention of harming you. He just proved that. Your friend brought this on himself, fellow. Hamilton called me, and I use his own words, a dangerous man of whom I could detail a more despicable opinion. Let this be a warning that Aaron Burr Brooks insults from no man. No! No, don't burn! Alexander, look out! He's going to... Oh, no! Harry! Harry! Oh, dear! Best find a light, please. Harry! Oh, you frighten me so. Yes, yes, there. Oh, dear! What was it? Burr, got him. He got Alexander. Oh, best that dirty drop. Oh, Harry, Harry, let me hold you. It's all right, dear. It's all right. It was just another nightmare, but it's all right. Alexander, he just fired into the air. He fired into the air and smiled at him, just like water. There, there, Harry. Oh, and then Burr, a fiend, he took deliberate aim. I saw him take deliberate aim, and he killed poor Alexander in cold blood. Here, take this, Harry, then you'll be able to go back to sleep. Yeah, yeah. Well, I ran to Alexander, but he was dead. There was just nothing I could do. You better take another, dear. Two won't hurt you. And then Burr swaggered over. He's always a nasty, sneering, foppish man, and he stood over us, and he actually laughed, and I looked down at Alexander, and his face was Walter's face. Oh, Harry. Harry, darling, darling. Look, I'm going to stay here with you for the rest of the night. Everything will be all right, and we'll go and see the doctor tomorrow. Just what seems to be the trouble, Miss Andrews? Nothing seems to be the trouble. He has nightmares, Dr. Fox. Oh, I see.  Are you eating well, Miss Andrews? Getting enough exercise? No, I'm not underweight. I eat the way I always have and get the same exercise. Now, Harry, your appetite certainly isn't good in the morning. Well, naturally not in the morning. You see, Doctor, I think he's worried about something, because he always has this same dream. Same dream, eh? It's about his brother, Walter, who was killed in a cemetery by a drunken man. Only it isn't really about him. It's Aaron Burr and Alexander Hamilton. Mm-hmm. Very few people actually killed in cemeteries. Well, um, would you mind stepping into the next room, Miss Andrews? May as well begin with the electrocardiograph and proceed with basal metabolism, cranial microprography. And, uh, soul from what we can determine thus far. I think we can say that you're in tipped-up shape, Miss Andrews. I make it a point to keep in shape. I very much doubt that the lab will turn up anything. Meanwhile, we know that the heart of yours is fine. Sound is a dollar. Oh, Harry, that's wonderful news. Even sound, or I might say. My bent was toward economics rather than medicine. The bills I gave you will fix up any temporary difficulty you may experience in falling asleep. Well, it wasn't the falling asleep, Doctor Fox. It was what happened after he got there. Yeah. Well, you might call me in a week or so, Miss Andrews. Yeah, I'll do that. Come on, Miss. Goodbye, Doctor, and thank you so much. Not at all. Nice to see both of you. Well, I hope you're satisfied. There's nothing to matter with me at all. I'm glad your heart's so fine. He said it was fine, you know. Sure, it's fine. Everything's fine. And I was thinking, dear, now that Alexander Hamilton is dead, you won't see anything more of Aaron Burr. And the man says, I quit because I couldn't stand the cooking order. Oh, Mr. Andrews, how priceless. Yeah, I thought I was rather funny myself. I failed to see the human. I thought it rather coarse. Oh, it's you, Burr. Why don't you leave, my good man? I'll leave after I've had a talk with you, maybe, not before. I see. Lovely ladies, will you excuse me for a moment? Certainly, Mr. Burr, come with me. Now, my good man.  I presume you refer to the Affair of Honor in which I engaged Hamilton. You know darn well I do. Let me say merely that had I been called a murderer by one more nearly my equal, I should deal with him as I dealt with Hamilton. Just who are you, anyway? Obiquitous Claude. I am Henry Andrews. Harry to my friends. I'm an architect. An architect. And you presume to converse with a soldier, a barrister, the second highest elective officer of the Republic, and a gentleman. Well, you may be all those things except the last one, but you disobeyed your superiors in the army. As far as I'm concerned, your kind of lawyers are on an ethical level with jockeys. Your vice president all right enough, but you tried to double-cross Jefferson so you'd get the top job. And don't go calling yourself a gentleman because you deliberately shot Alexander after he had fired his bullet into the air. But I fired mine with my eyes closed. You what? Certainly. Or as my French friends say, certaine non. Oh, and incidentally, don't you and your French friends try any funny business with that Mexican conquest and settlement deal either? You're liable to end up in court on a charge of treason. We were discussing my marksmanship. Let me inform you that I have upon occasion hit the ace of spades at 30 paces blindfolded. I'll bet. If you were not so far beneath me, I would send my seconds to call upon you. Henceforth, be on your good behavior, fellow. I shall have one of my lackeys give you a taste of a riding crop. More coffee, Harry? Best. Best. Don't. Don't do that. But you were a million miles away. No, I wasn't. I've been sitting right here. Did you have another dream about that man? I wish I'd never told you about it. Just forget it, will you? I can't forget it with you going on this way. Harry, I think you ought to see a psychiatrist. Oh, they're all quacks, a pack of quacks. Dr. Fox told you I was all right? What does he do now? What does who do now? Aaron Burr.  Furthermore, since you asked me, he jostles me at parties now. Harriet, I've simply got to get you away from here. Maybe if you slept someplace else for a few nights. What, what place else? Well, why don't we go to the country for the weekend? Let's go to Lime Rock Lodge. Well, if, if we're going to the country, why don't we visit the Crowley's? You like them, don't you? Oh, of course I do. Bob has a pistol. And we could do a little target shooting.  I should think you'd want to get away from that. Yeah, sure. I just might have figured out how to get away from it. Sir, sir, 50 times is as fast as you can. That's the secret of a martini, boy.  Ah, thank you. Ah, this. Thank you. Alice. Thank you, darling. There you are, Harry. Thank you, Bob. Ha, ha. Well, here's a go. Down the hatch. Cheers. Well, how you been, boy? Oh, never better, Bob. Never better. Gee, it's good to be here. Oh, a nice peaceful weekend is just what Harry needs. We were so pleased when you called. We've simply been vegetating. The servants are getting fed up with taking care of just the two of us. Oh, do you still have Madison and Cathedral? Oh, of course. They are so priceless. Oh, yes indeed. Been busy, Harry? No, not too. Did a big provincial house out in Southampton. We've got a 26-story office building on the boards. Wow, and he says he hasn't been too busy. Oh, you ought to see the building. I mean, it's going to be all bronze and acrobatic glass.  That means with actinic glass and copper, dear, but... I wouldn't know what to do without her. Oh, you kids, you don't change a bit. You're married 14 years and still on a honeymoon. Uh, it's 15, isn't it, dear? Yep. Well, how about refills? Can't let the eyes dilute the vermouth. Oh, as soon as I check those feet on dinner, dear. Oh, want to come out to the kitchen and say hello to her best? I'd love to.  Oh, lots more where that came from.  These are the greatest. How's it with you, Bond? Oh, couldn't be better. At least not your here. Kind of alone some grind finishing the book. Oh, bed. You got it all buttoned up? Just about. Excuse me for bringing it up, Harry, but, um... You feeling better about Walter now? Oh, yeah. Just one of those things. No use brooding about it, I guess. The guy who killed him is put away. Sure. Oh, I know how tough it was, but now you've got the right slant on it. Well, sir, what can we offer you in the way of a pleasant weekend? Just what you always give us, some relaxation. The first thing I want is a good night's sleep. Oh, well, this is the place to get it. Come on, drink up there, sir. Sure.  Yeah, yeah, every once in a while. I got me a pip of a set of new ones, the latest. Let's try them out tomorrow. See if you can teach me to hit a barn door or something. Ah, that's pretty good, Harry. Come on over, take a look. Better, huh? You think I'm getting the hang of it now? Sure, you are. All six shots in the tree and two of them on the target yet. Hey, they aren't that. Well, not exactly bull's-eyes, but look, this one's just a shade above the outside ring. Yeah, that's a lot better. Bob, would you say that bull's-eyes about the height of a fairly short man's heart? Uh, well, just about. Okay, I want to try something. Depends on how short. Uh, well, what are you up to, boy? What's the idea? What are you gonna do? Hey! Hit the target? Hit the target, man, if I hadn't flattened two of them, it'd have hit me. What do you think you're doing? Isn't that the way they used to pace off in the old days when they fought duals? Well, I guess so, but who you gave me a scare. Oh, oh, I'm sorry, I didn't realize you were standing so close. Oh, that's okay. Well, come to think of it, Harry, I don't think they paced off with a gun held straight up in the air like you did.  One, two, three, four, five, six, seven, eight. Look, Harry, no, don't try it again for the love of ha- Hey, Harry! No! Don't! How can I tell if they're on the target when- Hey, look, Harry, never close your eyes. Never, never, never fire with your eyes closed. Well, I just thought I'd try it that way. Good lord, man, come on, give me that gun, will you? Sure, sure, here I- I guess I need more practice. Not with me standing around. Well, come on, let's get back to the house and shake up a drink. Boy, I've got the jumps. I sure do. I need a lot more practice. As I so aptly put it to General Arnold at Quebec, the defensive strategy may save men, but an offensive force wins the battle.  Human lives mean nothing to you. Ah, observe now who says he hates me. Henry Andrews, one Henry Andrews, an architect. Look, don't, don't you ever push me again. One Henry Andrews, an architect. A menial laborer. Now, you just wait a minute.  I failed to recall the subject on the curriculum at the College of New Jersey where I matriculated. Well, maybe they didn't teach it there, but look what College of New Jersey turned out to be. Princeton and your bragging. May I remind you of your previous conversation, the one in which I discussed my unerring marksmanship? May I remind you that you killed my friend Alexander? Ha! A friend to Alexander. Use care, my man. The phrase might well make an epitome. Well, challenge me. Go ahead. I dare you. I dare you! Harry! I dare you, Burr! I dare you! Wake up! Please, wake up there! Harry! Yes, don't, don't. Don't shake me like that. Darling, you were practically shouting, and it's only four o'clock you wake Bob and Alice. One Henry Andrews, an architect. That's what he calls me now. I hoped you weren't going to dream about him anymore. I thought if I brought you up here you might... It's him or me, Bess. I, I can't stand this forever. Oh, Natic and I, Harry. Oh, Bess, dear, it's all right. I'm sorry. Look. Now, look, honey, you go back to sleep and forget the whole thing. It'll be daylight soon. I'm gonna sneak out very quietly and get some air. Yes, yes, Alice. I'm awake. I heard them. Not again. I'm afraid so he's out there peppering away at that dog on tarp. Well, you better get up, Bob. Go out and get him and I'll put on some coffee. Yeah, he'll need some. Where's that other darn sliver? Is he walking his sleep or what? Well, Bess says he never walks in his sleep. Do you think he'll be petrified again? Madison too, I suppose. Tell him what you told him yesterday that he couldn't sleep and he just went out to shoot a little. I'm so glad to see them. But I'll be so glad when they go this afternoon. Me too. Oh, come on, there.  I went out to get him yesterday. I could stand a funny thing. I'll get him one of these nights, he said. I don't suppose poor Bess can sleep through this. Let's see how she could. Better knock at her door and see if she's ready for some coffee too. Bob, what's wrong with Harry anyway? Search me. I guess it's like Clotheater said. He just seems to have the shoots. I'm sorry the weekend turned out like it did, dear. No, it's all right. I thought it might work too. In a way, maybe it did work. Well, it does seem good to be home. I mean our own apartment and our own things, our own schedule. Yeah, this is better. Another night, Cat Bess? No, dear, but you go right ahead. Yeah, I'll have one more splash and then turn in. Harry, why don't you sleep in my room tonight? Well, you wouldn't keep shaking me all night to keep me awake. No, no, I wouldn't, dear. Only if you... You're afraid to let me meet him. Oh, I am afraid, Harry. Terribly afraid. Well, why do you always think everybody else is better than I am? I can out-shoot him the best day he ever lived. That isn't what I meant about being afraid. Furthermore, I have a modern pistol. He has to use an old-fashioned single-shot muzzle loader. Is that quite fair, Harry? What do I care if it's fair or not?  Oh, I'm so unhappy. I'm sorry, dear. Don't you worry about me, Bess. I'll be all right. I'll be fine. We'd better go up, dear. Now, please, don't. Don't cry anymore. Well, I'm trying to stop. Sure. Good night, kiss, darling. Everything's going to be fine. I'm ready to take care of everything now. No matter what happens, I love you, Harry. I've loved you more every day we've had together. Kiss me again, dearest. Kiss me just once more. Very well, Andrews. My code as a gentleman will permit no further insolence. If you insist upon ending it thus... I do insist. I assume you're blindfolded and secure. I assume yours is. And we have agreed upon ten paces. Well, are you ready, fellow? You bet I am. One. Two. Three. Four. Five. Six. You're his regular physician. Are you, Dr. Fox? That's right. I examined him only four or five days ago. So the lady said, that's why we called you in, as long as he's been under treatment within 30 days, you just sign the death certificate and our office doesn't have to bother with an autopsy. I understand. Usual procedure. I know it's tough on you, Mrs. Andrews, the shock and all, but it's the way I hope it happens to me when the time comes. Peaceful, quiet, quick. In my own bed, heart just quits. You know it's extraordinary. His heart was as sound as a dollar when I examined him. His heart was just stopped, as if it'd been shot. They'll go that way sometimes. Dr. Fox. Look, Harry's right hand. Clenched a bit, Mrs. Andrews. Nothing unusual. But the three bottom fingers and the thumb, like they were gripping a handle. Rather, yes. And see the index finger, how it's curved, and we're just about to press the trigger on a pistol. Or rigor mortis, Mrs. Andrews. The hands will take an odd position sometimes in rigor mortis. Harry never even fired a shot. Aaron Burr killed him. The way he killed Alexander Hamilton. Miss Andrews, take it easy. Aaron Burr shot him through the heart. I knew he was. I knew he was. Doctor, what in the name of... Oh, poor Andrews. I should have done something at the time. This could even have been contributory. I'm not too sure I follow you. You see, she came in with her husband the other day. She spoke and she acted most peculiarly. I should have done something. But what is this Aaron Burr Alexander Hamilton business? Obsessive hallucination of hers. Mrs. Andrews, every evidently suffers from one of the schizoid psychoses. Oh, yeah. I'm afraid you'll have to be committed. In which Mr. John Daner starred in tonight's presentation of A Friend to Alexander. Be sure to join us again when we bring you another presentation of Radio's Outstanding Theatre of Thrills. That's next time on... Suspense. Suspense is produced and directed in Hollywood by Anthony Ellis. You have heard A Friend to Alexander, written by James Berber and adapted for suspense by Frank Music was composed and conducted by Fred Steiner. Featured in the cast were Paula Winslow, Ben Wright, Victor Rodman, Miriam Wolfe, Charlotte Lawrence, Joseph Kearns and Larry Thor. As national interest runs high in the conventions and the results, CBS Radio, which is broadcasting these important events, urges you to follow through, to make sure you're registered to vote next November. No matter which candidate you prefer, you are lost in making a choice unless you're registered to vote in a national election. Are you sure the rest of the voters in your family are? Make sure today. Registration laws vary from state to state. Make sure you're in the book. Stay tuned for five minutes of CBS News to be followed on most of these same stations by my son, Jeep. Attend the Democratic Convention with the CBS Radio Network.