Hi, welcome to the session. So, today we are going to talk about automated machine learning. Before we get started, how many of you have built machine learning models? How many of you know how machine learning works? Thanks. So, I am part of the automated machine learning team in Microsoft. My name is Deepak Mukuntu. So, this session we will cover it in three parts roughly. We will talk about what generally machine learning model building process takes and what are the challenges there. And then we will define automated machine learning in terms of how it works and how it helps. And then at the... Is this better? Should we increase more? Can you increase the volume please? Is this better? Better? Okay, thanks. So, we will talk about machine learning process in general and what challenges it has, how automated machine learning can help and how automated machine learning works behind the scenes. And then I will end with a demo showing how you can use it today regardless of your experience in machine learning. Okay, so with that, I think almost every one of us know that AI and ML is a trend now. This just shows one number from Gartner which predicts that by 2022, this much of revenue or attribution will go towards AI or machine learning in enterprise. And where is all this money going to come from? Are there specific scenarios which will bring many... like a slice of this? It looks like we may be trying to predict which area is hot in terms of machine learning in AI, but the answer to that is almost every area across marketing, sales, service, finance, operations, workforce, any scenarios you talk about, there is chance for machine learning to help that scenario. So with that, I am not going to spend a lot of time going through each of these scenarios in detail, but I hope if you look at this slide, some of these scenarios resonate with what you do and what you are interested in doing. When enterprises start looking at machine learning for these areas, first thing they start looking at is they don't have data scientists, they don't know how to build machine learning models. So typically they go for pre-built services, pre-built AI services that big cloud providers like Microsoft offer. In Microsoft we have this concept of cognitive services which is Microsoft built models are hosted and made as rest end points for services, services for you guys to call, where you don't need to build any machine learning models. So if you ask me what is the best way to get started with machine learning, that is probably the best way to get started with machine learning and infusing AI into your application or your workflow, whatever you want to do, without getting into the details of building a machine learning model yourself. But why do then people build machine learning models? It's because most of those cloud offerings are generic. They may not be suitable for your own scenarios. For your own scenarios, you may want to customize models to suit your needs, which is where you end up building your own models with automated machine learning. What we are suggesting is start from this because it's a system which is going to automatically produce the best model pipeline for you and if you want to customize more, then you go and improve that pipeline further. So with that, I'm going to talk about what typical machine learning model building process takes. We are going to take a very, very simple example of car price prediction. So let's say you are a data scientist or you want to build a machine learning model which predicts the price of a car. Let's start with this problem. So typically, you start with what features make sense. So features are basically inputs that makes a good model for the scenario. Good features in this case could be things like mileage, condition, age of the car, make model of the car. Anything that you think is an important attribute of the car or surrounding things that determines the price of the car is a feature or an input variable. Once you identify the features, the next thing is an algorithm. So as there are a bunch of options you have, typically data scientists pick the favorite that they are familiar with and then comes hyperparameters which are basically parameters that help your model produce the result. So these are the parameters that guide your model through the process of prediction. So with these three in mind, typically data scientists start with a good set of features. Let's say I start with mileage, and then I go and pick an algorithm. In this case, I am picking gradient booster trees for example.  So each of this will have n number of values to pick from which means that you have so many combinations to try. Just with one algorithm and those three features for example, you have at least five in two these many combinations to try as machine learning pipelines. So you start with one combination and then you get to a model, let's say the model is 30 percent accurate, not good enough.  In most cases, you go back and pick a different algorithm. In this case, I am picking KN and after gradient boosting. In a lot of cases, data scientists go back and figure out new features to add to get to a good model. So this is a pretty iterative process.  As you can see, this is a building machine learning model is a pretty iterative and time-consuming process and a lot of this can be automated. So as you can see, this is not rocket science. You are trying out different combinations, you can do a for loop with all the three level for loops simplistically speaking. But that means you are basically doing a brute force search of all possible combinations which may not be suitable for your scenario because you are going to spend time and money.  So you need something that can automatically figure out the right machine learning pipelines for you to try given your input problem and your data set. So which is where automated machine learning comes in. So with automated machine learning, this is a system which will give you the best machine learning pipeline for your scenario and all you need to bring is an input data. So this is just a hypothetical view of the system. So think of this, the middle piece as the system. The three inputs you bring is your data. You indicate your data in whatever form you have and then you indicate the metric you want to optimize or a goal that you are trying to optimize for and then for each because the system is going to try different combinations, you also need to guide the system by providing some constraints. Constraints could be things like I do not want to try more than 50 models. I do not want to spend more than two hours. Things like those are constraints. So you bring these three as inputs and the system is going to automatically give you the best model or a good set of models that you can choose from. So that is at a high level what automated machine learning is and how it works. We are going to go in detail on how this middle piece works in a bit but this is a very very high level view of how the system works. So who is this for? Is this for data scientists? Is this for people who do not know machine learning or Python? The answer is that when we started this journey of automated machine learning, we started with data scientists. So the accelerate AI was our mission and the focus there was data scientists spend so much time as we saw building a good machine learning model. What if we could automate that? So that data scientists instead of spending weeks to get to a good baseline model can get a good baseline model in couple of hours. That was the goal which is where accelerating AI as a mission came in and then as we started pitching this to customers and customers started using it, we started a lot of customers saying we do not have professional data scientists. We do not know people who have this end to end machine learning expertise. We have data analysts. We have engineers who want to build machine learning models because we saw in the first couple of slides how the demand is high for AI but at the same time supply of good data scientists is very low. So to meet the supply versus demand problem building machine learning models, you need to enable people who are not data scientists who are domain experts, data engineers, data people to be able to build machine learning models. So that is where we started then from Accelvate AI, we added democratizing AI also as a mission and I am going to show you how we are enabling that at the end of the deck and you can regardless of your experience in ML you can try it. We have different offerings you can try out. And then as we mature and as customers matured through the process, we started seeing patterns around customers saying I have hundreds of windmills and I want to build one machine learning model for a mill but then different mills have different characteristics different inputs. So I want slightly different models for different mills. So I am working with a customer today who is a banking customer and they want to build different machine learning models for different ATMs to predict how much money to put in the ATM on a regular basis depending on how customers their customers in that locality withdraw money. So there is a need for easily scaling out machine learning models from one model to many models which is where we are now investing in scaling AI as a mission. So with that, I am going to spend the next 10 minutes or so going deep on how this works. It may be a little deep. I will try to keep it as easy and as high level as possible. When you look at hyper parameter tuning which is the last third phase of machine learning models. The first phase was feature selection second phase was algorithm selection then hyper parameter tuning which is for the features and hyper and algorithm just tuning hyper parameters. Just for that last phase, how do you solve it? There are various options today grid search, random search and Bayesian optimization and there are there are theories around which one is better or worse but each of this is going to be a time consuming process and even if you just pin it off the machine itself takes so much time to figure out the right hyper parameter combinations. This is just one of the three steps of the problem space. These things work but with caveat right. So these things work well when you have your number of hyper parameters is less than 10 which in most cases not true. In most cases your hyper parameters are a large space and 10. So these these approaches may not work out well you are willing to wait. This is going to try out many different combinations. So you need to be able to willing to wait and there is also an assumption that parameters are continuous and not discrete. As soon as you get into like parameters that are combination of continuous as a discrete you need different solutions and those the three approaches simple approaches we talked about will not work. So now with automated machine learning on Azure which is the team I am part of we Microsoft research came over to the breakthrough research and that is what we are we are using as part of our automated ML offering. So the research had two key intuitions that the whole system is based on. First key intuition is that given there are so many different possible ML pipelines around featureized around pre-processing the first step is typically pre-processing and then your algorithm selection hyper parameter selection the number of pipelines that you can think of is so big that it's a continuous space. For us to be able to make a system which can automatically detect or identify machine learning pipelines we need to discretize it. So that was the first intuition discretizing ML pipelines and then second one was we cannot treat each data set as a separate entity on its own. We need to start seeing patterns between data sets so that when you bring a data set when we look at your data set in terms of characteristics we know that this data set is like this data other data set that we know of where this kind of pipeline worked well. So we can now map and say that your data set is close to the other data set we have seen before. So this pipeline works better for your data sets that's so that's these are the two intuitions on which the system is built the system and the background is like Netflix or any streaming service which recommends things for users based on their interest so this is a recommendation system which recommends machine learning pipelines given your data set. Think of it that way plus it is also backed up by a probabilistic framework which tries to explore and exploit different possible pipelines. So different between exploration and exploitation quickly talking about it. Exploitation means if you have found out a machine learning pipeline that gives you like 70% accuracy you can go ahead and just hyper parameter tune that thing continuously just hyper parameter tune and in the hope of getting to a better model or you can say that no that is going to give me locally optimized approach local maxima I want to get to a global maxima which means that I want to not just look at those features and those algorithm but also try out something else so which is where the system has a good probabilistic approach of balancing between exploration and exploitation. So this slide basically if you are interested in going deep that link is a research paper Microsoft research paper that you can read up but this link is basically showing you how the system works. It's a combination of collaborative filtering and Bayesian optimization and it brings uncertainty into account. So it's trying to the system is going to try to predict the pipeline with the best accuracy or performance minimizing the uncertainty each of the dots here is different pipelines that the machine the system is going to try.  So on the top you're seeing is as the system recommends different pipelines how is the model accuracy of performance increasing over time and on the bottom you're seeing how the selection of pipelines impacts performance and uncertainty and the system is going to try out different things in a probabilistic way to maximize performance and minimize uncertainty. So all the blacks here is minimal uncertainty as you can see and then the light color means your performance is maximum. This is how at a high level system works. So with that I'm going to fast because we have 45 minutes I'm happy to answer questions offline if you are interested and this slide deck will be shared so you don't need to take pictures and I have links wherever relevant for you to go learn more. This is basically when I talk to customers and say bring your data and we'll give you model people are like no I cannot give you my data data is so sensitive. So I want to clarify that even though I say data is one of the inputs we do not read your data. So all we need so this one what is showing is on the left is your system customer subscription or your local machine wherever you're running your machine learning model training this is our brain or the meta model that I described how it works what comes from that side to this side is essentially some metadata from your data things like how many rows of data you have how many columns you have what data type do you have in each column we don't even read your column name because even column name can have sensitive information that you don't want to share. So that's the first input that we get on this side plus what is the problem type are you doing a classification classification problem regression problem forecasting problem you can specify that so that's another input that we take and then the machine learning model the meta model recommends the first set of good pipelines that we believe will help you and then that goes on the on that side and then training happens on your side. So you control your compute you control resources for training and then the results of the training which is in this case accuracy of the model of each of the pipeline gets fed back to the system and the system based on the accuracy of your models recommends the next set of pipelines so this is how it works so I want to reinforce that we do not see the data. Data is with you we only get some metadata at a high level and then the scores of the pipelines with so far we have talked about how automated machine learning can help build a good machine learning model quickly and give you options that you can choose from but then in the real world when you want to put models to production things like transparency becomes super important which is where we we invest a lot in that so for example model interpretability and feature importance what this means for a model when you have deployed in production you want to be able to explain each prediction for example let's say you have a credit scoring application or you have you have a a machine learning based system to approve or reject a loan for a customer banking scenario if you reject a loan you cannot tell a customer that your loan got rejected because we have a machine learning model so you need to be able to explain that this model is rejecting your loan or you don't even need to say this model the system is rejecting your loan because of these attributes going out of bound of what we think is the right thing so which is where feature importance comes in as one of the key transparency features which a lot of customers need before they can deploy a machine learning models to production in addition through the training process even though we say this is a super magical system which give your data bring your data and will give you the best model there needs to be guardrails things could could go wrong your data could have problems like for example if you have a classification problem where you're trying to predict between loan defaulters versus not there is a typical class imbalance problem where number of defaulters will be much much lesser than number of people who are not defaulting right so you need to be able to treat your data before feeding into this process because otherwise the output is just garbage in garbage out but the systems like automated machine learning guide you through that process for example when you put your data in we will through the training process figure out that your data has imbalance and flag it to you in some cases we can automatically fix it for you and tell you that we have fixed it things like missing value so if your data has missing values we have a techniques to automatically figure out the right ways to impute your missing values and we tell you that we imputed this column had these many missing values and we fixed it automatically for you things like those I don't want to go into details here but the meta point here is performance of the model or getting to the best model is not the only thing most customers before they get put a model in production want transparency so with that now how can you use this yes we automatically do feature engineering also there is a simple flag I am going to show you some we can take more questions at the end we do feature engineering also so now going to how you can use this system this is our first version which was a python SDK which really we released in December last year as you can see this is how you specify your input so what this is showing is if you can read it is better yeah so what this is so showing is you basically indicate your task type in this case you are saying I want to build a regression model again the python SDK so assumption is that people who are using this no python and no some level of data science but I have other experiences which are tuned more towards non-data science folks which I will talk through here what you are saying is my task is a regression task and my primary metric is R2 score R2 score is what I want to optimize for and then iteration time out is each of the models that you are trying should not take more than 60 minutes for training and then I do not want to try more than 30 iterations so what they are saying is try 30 models 30 best models you can each model should not take each training pipeline should not take more than 30 minutes and then maximum concurrency meaning you can do two at a time two parallel times all of these are configurable parameters you can specify and then we also do cross-fold validation for example you can you do not have to specify explicit validation data set to us you can say I want to do 5-fold cross-validation n-fold cross-validation we support that and then preprocess equal to 2 this is a simple flag one flag you set and we automatically do feature engineering for you things like to answer your question I do not have a slide but I will talk about it the kind of feature engineering we do is simple preprocessing first imputation missing value imputation is something we do and then if you have text features we automatically produce the right features in terms of like n gram type features word embedding type features is automatically produced if you have a date time column which is very typical in a lot of time series forecasting type scenarios we automatically figure out good features from that date time column things like week of the year things that data scientists typically build themselves we automatically produce it for you and then we also do before the training process we also scale and normalize your data automatically because in most cases you need to normalize and scale your data for the model to do well so that is a model specific thing we do automatically also so all of that is controlled by that just single flag so you just specify it true and we automatically do it for you yes so we have an api which you can call to get featureage data also this is a good question we did not have that when we originally released in December but we had an update correct correct exactly so the idea is that this is the system is going to be magical but it is going to be transparent otherwise you are not going to trust it so at every point where there could be a black box mindset we are trying to open up that black box feature engineering was one thing we did not open up when we released it but since then I think in April or May we announced a separate API that you can use to figure out what feature engineering we did and also download featureage data that you can then use to train your own model for all the pipelines it will give you exactly what feature engineering happened what algorithm was selected and what hyper parameter values it can it can take any pipeline ideas and input and give you the exact end-to-end visibility for that pipeline another thing I am going to talk about which we do not have today but actively working on is generating python code for the training pipeline so that way you can use the system to get to a best model, best pipeline but you do not have to go and recode that if you want to customize that further we will just single click of the button you can download the python training script for that pipeline so that way you will get exact code and then you can go further so we are focusing on transparency which is a big SDK works on local machine also so I can actually run my own Jupyter server here and then use python code to run it requires an azure authentication because to call the metamodel that is the only thing otherwise your data can be here training can be on your local machine but it requires azure authentication just to call the metamodel standard azure auth azure auth service principle authentication ok so this is for data scientists who know python but as we said not everyone is a data scientist not everyone knows python we have some investment around making it easy for those personas first one is we enabled a UI simple UI in the azure portal I am going to show a demo on this where you do not need to know python you do not need to write any code it is just a UI experience where you bring your data everything we talked about in the SDK but through UI and then go through the training process and then you can basically download the best model from here or deploy it directly from here single click deployment I am going to demo it to you this is the azure on azure portal azure ml portal so with that let us go through the demo and then we will come back to other experiences we have a power BI integration SQL integration also the portal is in your subscription so when you sign into the portal you are basically using your own subscription right so it is data it is your slice of the public cloud where you have control on everything we do not see like azure does not see whatever you have there we do sophisticated benchmarking which is to make sure that we are comparing ourselves with other similar competitors I can name them but you can follow up with me we basically say standard we have a good repository of standard data sets and we compare ourselves with other competitors and see how good we do for a given period of time second one is we also try to compete with humans and that is something we are starting to invest more in things like competing in Kaggle competition compete in Kaggle competition and see how good we do versus humans I must say that this is not going to replace humans for sure right this is going to this is going to give you the power give you the productivity you need and transparency so you can use this as a baseline system there I have heard customers talk about when I ask them why are you not using it they are like no I have my own model and then on the side they will say I am still using it because I want to make sure I am not making a simple mistake that an automated system can do so some customers use it in production some customers are like I am using it to compare myself with this automated system just to make sure I am not making silly mistakes so there is a wide spectrum of customers using this stuff but no feature engineering also happens in your side so everything happens in your subscription or on your local machine if that is where you are running so we do not take that is a good question but I had that same question as a PM when my dad was saying I want to do that so it is basically Azure no it is we do not charge anything more than your Azure compute so if you are using Azure then you pay for the compute that you are using on Azure the service itself is not charging anything more for you the key competitors we look at our H2O data robot and these days other customers other companies like Google Auto ML Tables has come up Amazon has hyper parametered as an offering they do not have a full end to end so far but yeah those are competitors we look at so this goes back to the feature engineering question we do look at your data but that looking at your data happens in your subscription because when we do feature engineering we have to look at your data and see missing values we cannot we do not look into your data our code which runs in your subscription as a client looks at the data that is a good question that is a really good comment but I want the meta thing there for we do not look at your data is that you control your data that is the meta point because people can say if I give you my data and you are going to give me a model then you are basically looking at my data and you will overfit to my data so that is not happening that is the meta point that I am trying to make any automation we do on feature engineering happens in your subscription in your control which we cannot look at but we have to look at your data at that point the system has to look at your data without that we cannot feature engineer and I want to reiterate data is on your subscription we do not look at it think of it this way there could be two models one is that there is a system I send it my data and the system does this magic or the system has two components the cloud component and the client component the client component is sent to my subscription and the client component is what does feature engineering the cloud component which is the brain recommends the models the algorithm hyper parameter combinations so that is here in our control which is where I am saying we do not look at your data but for feature engineering the client components runs on your subscription and we do not log anything so your question could be what if you are logging some stuff there and then sending it to your service we do not whatever we log we are very very careful to again abide to the same principle of we do not look at your data so I can share more data with you offline something okay so I think the question was data robot has some number of algorithms at it right how many algorithms we support I can give you data offline those are things that we haven't published publicly yet but if you have a scenario we can we can work with you to say I the only thing I can publicly speak about is that I have known customers who have tried data robot and H2O and chosen our offering primarily because of cost and completeness end to end completeness offering because with Azure ML you get the automatic like deployment and ML ops capability which those offerings the competitors do not provide so it's a single place which has auto ML capability but also has the end to end life cycle management of the model that's what interests customers more but I can I can talk to you offline okay yes we give you the column IDs plus that's again that gets sent to the client so what gets displayed to you is from the client so the client knows your feature name what we know is some IDs so when the ID comes to on the client your subscription it maps it to the feature name and then any visualization that gets displayed uses the feature name that's how it works yes we do so as part of the transparency work we do provide the definition so that you can run it yourself you can run the logic yourself when I talked about we want to provide the end to end Python code for training we do one for the first step is the feature transformation logic say that again yes so EDA there is an investment as part of Azure ML so I will show you a demo if I get time but as part of that we are looking at EDA also to be plugged into here so that way you can start from your data do the EDA through the experience and then bring AutoML so end to end experience will have EDA into picture also but we don't have a good story around will that also be part of the code that we generate that we don't have yet because EDA experience itself is something that we are working on right now can you hold that can you hold that for I do want to make sure we spend time on the demo and then I can I can answer questions okay so this is the cordless experience that we shipped as part of build April May time frame this is still a preview capability as part of Azure portal so basically what you are seeing here is that these are all different experiments or AutoML runs I have done so to start a new experiment I just click on create experiment and then give experiment a name select a compute so I am just going to select a pre-configured compute that I have but if you don't have you can create your compute from here next so this is going to now iterate through all the storage accounts I have so that I can use data that I may already have on the storage accounts or I can upload the data as a CSV file or whatever format you have through this so in this case I am going to just pick a CSV file that I have already uploaded to my storage account which is for the same scenario we talked about earlier so this has a bunch of columns it also has some missing values as you can see here you can easily select or unselect features like you can say I don't I want to minimize my training time so I want to reduce from 20 columns to like 10 columns and you can basically say don't include this column or include the other column and profiling I mean I don't have time to show this one because this takes like a minute to basically what this does is so what this does is it goes and looks at your data but not really will be looking at your data this is running on your subscription so this goes looks at your data and shows trends around for each of the columns how is the data distributed what is the mean median typical things that you would do it through EDA experience this does it I am not going to wait for it this is going to take like a minute or two and so once you have once you have seen that you can specify what is the task type in this case it's a regression task and then target column which is price in this case that's it so this is the only minimal inputs that you need to provide but we want to make sure that this is also catering to like sophisticated people who know machine learning data scientist where you can actually control you can choose a different primary metric you want we have automatically figured out the right thing for you based on what you gave but you can choose different things you can specify a number of iterations you can change job time for each iteration you can change you can provide a different validation mechanism if you cross forward validation mechanism if you want you can also provide concurrency this is an interesting one a lot of customers tell me that I like light GBM I know that for my problem KNN will not work the best so we provide this capability you can select algorithms that you think will work better for you so that way we don't search the whole space but we can we can search only for the algorithm that you are interested in and press next so what what's going to happen now is R to ML the cloud is R cloud is being invoked and whatever you gave as input is being sent and then this will now start running different iterations so this is going to I have done this before for a hundred iteration run on this data set it takes anywhere from like 14 minutes to an hour but I am going to switch to stuff that I have already run so this one is exactly same thing but for I ran it for I think 20 iteration last time so once the run is complete this is what you will see you will see how the model how the system tried different models over time how did things improve the orange line is basically tracking the best metric and then for the next thing you can see is you can look at all the pipelines it has tried so the first the best and sorted by the metric you are trying to optimize for in this case voting ensemble so how many of you are familiar with so ensembling is not only trying a single algorithm but based on good performing algorithms for your run we automatically figure out the best ones and then ensemble the ensembling is basically think of it as simplistically as averaging out multiple different algorithm output into one and then giving you that final output so voting ensemble so ensembling typically wins the most cases we have seen ensembling win because it takes the best of multiple algorithms so each of these is a single algorithm so in this case it's saying it did some standard scalar wrapper transform and then it's using random forest you can also get hyperparameter values through this experience when you go in so let's look at voting ensemble for example so when you look at when you go through each of the pipeline we give you graphs that as data scientists you will typically plot yourself different problem types we have we show different type of charts this is where if you enable the explainability we also show you feature importance graphs here right so with this you can look at it and then we also compute a bunch of original metrics that we show here so it's not only that primary metric we also compute around 20 different metrics that you can type use for tie breaking if you have two models that are performing very similar for your primary metric you want to compare with a separate secondary metric you can use any of these and then you can either download the model as a pickle file which is again a transparency feature we don't we don't do a black box you can download the pickle file and go wherever you want to do to deploy it or you can deploy it single click from here right so if you do that as you can see this is something I did last week last month but basically if you click on this it's simple you just give it the deployment name you are asking it to automatically generate your scoring script that will be used when the model is scored after deployment and that's it so it's a single key deployment so you click on the deploy button so model name is required okay so let's say odsc demo deploy so now this is going to take the best model in this case voting ensemble create a container for you an ACI container in this case and then deploy it so it's going to take 20 minutes so once the deployment is complete you this would turn green like you saw in the just like a few seconds back with a link to a web service that you can use in your application to call the model so this is a very simple like no code experience to train a model get to a web service so web service you can either call invoke in your application or you can we also have deep integration with power BA so if you are a power BA analyst you can actually consume the web service through power BA and I'm going to quickly show you how you do that so in power BA you have this entity the concept of data flows which has the concept of entities think of this as a sequel database with tables so each of the entities is logically table in this case I have car price as a table or entity you click on this to go in the entity to explore so this is going to take a few seconds but once this loads up you will see a new option called AI insights so you click on the AI insights and it will give you options to query or consume any Azure ML models that you have built including models built through automated machine learning in Azure right so this one is going to now it's looking for this user what model this user has access to so in this case this user has access to around 8 different Azure machine learning models I'm going to pick a model that I deployed in the past same car price same flow that we saw in the UI deployed web service and then when I hit apply this is going to now go and create a new column in the same data entity and invoke the model for each row and then populate that last column so you see here so this one is the model populated column price and this one is the original price as you can see original price also had missing values but you can when the model we spent hardly what an hour to build a model with just 20 iterations and that came this close to the label column but you can imagine if you want to try a better model you spend like maybe 2 hours you will get a much better model plus with the transparency feature when we have the code generated you can go and customize that model however you want that's a good question yes currently we support supervised learning only unsupervised learning is on our roadmap similarly we do not support deep learning currently we only support classical machine learning but deep learning is coming soon unsupervised learning in terms of the clustering is slightly far out but deep learning using images and stuff is coming soon that's a good ask a lot of customers ask that we do not support that today because the challenge is that we the meta model the brain needs to be retrained for any new primary metric we add so if you have a metric that you think is generic enough that applies to almost everyone then we can work with you to make that as the primary metric we support but if you have your own metric that's something we cannot support because we are generic service just a minute so before people move I want to show you other experiences we have and then we can take questions give me a minute so we talked about the UI demo and then consuming it in Power BI if you are a Power BI analyst and you want to build a machine learning model in Power BI yourself this is the experience so you have a very similar experience to what you saw in the Azure UI but a much more simplistic one so here we don't even give you all the pipelines we tried we only give you the best pipeline because for analysts we don't believe they have the ability or inclination to compare different models all they are looking for is give me the best model you can for a given period of time so that's this experience for Power BI analyst we also have a visual studio experience for C-sharp developers if you are not a python developer but you are a coding person you are C-sharp.NET developer we have the exact same backend cloud supported in C-sharp that you can use similar to the python experience we saw in the beginning the last one is SQL server a lot of people say oh my data is in SQL and I am a SQL expert I don't know Python I don't know C-sharp but I like SQL we also have a SQL store proc based approach which again uses the exact same backend workflow we saw but coding wise you code in SQL so with that we are seeing so this is the last real slide a lot of customers have multi disciplinary teams some data center some developers some analysts and they want to collaborate so with that in mind what we are doing here is we already enabled this flow this is the demo we saw you built a model using Azure using AutoML and then you consumed it in Power BI that's the demo we saw but the other flow that people are asking is I am an analyst I built model in Power BI using AutoML but I want to give that to my data scientist so the data scientist can go approve review approve or improve so that's where we are working on this one this feature where with a single click of button from here analysts can export the model either the full training code or the best model training code as a python script that can then the data scientist can look at so this is where we are seeing a lot of collaboration capabilities needed as customers and companies are maturing in AI different personas working together and we will continue to support these collaboration experiences so with that like two of customer use cases where they are using automated machine learning in production Snyder electric and BP and we have more and happy to share that is the stuff that I said is work in progress the flow the this arrow so this arrow the intent of this arrow is that whatever AutoML did here I should be able to say give me a training script that I can run redoing the whole thing or give me a script for the best pipeline only as a python script that does this work and it's happening it's we are actually working on it should have something in the next couple of months yes so recommendation scenario is work in progress we currently support the bare bone things like classification regression and forecasting forecasting is one of the meta scenarios we added recently but the collaborative filtering type recommendations we behind the scenes use collaborative filtering for the system but enabling that as a you customer scenario is work in progress to your original question on custom models again answer is same as the primary metric question which is we can support a new model if you think it's generic enough that will be useful for other customers also given we are a platform we it's hard for us to support any custom stuff but that said we are transparent so you can actually use this as a baseline and then use your own algorithms to compare yes yes yes yes it is it is part of Azure ML so it's a web service which has all the STTPS support and any enterprise security related readiness that you can go ahead and use sure I have documentation links where we talk about exactly what kind of how do we impute data so just to be clear whatever we have in production today is based on research right but customers are using it for the real world scenario yeah no we don't have anything kept as for insider community just to be very transparent right DNN so DNN support there is like cutting edge research that's already happened published called NAS it's called network something search new neural architecture search that's for basically searching DNN models given your data what is the good DNN network that works well for that data set we haven't worked on that yet but that's something that research has already published papers on right the intent is not to save that for ourselves it's just that research is always like five years in advance right so we will catch up there and as part of our DNN investment we are looking at enabling NAS research into the product but think of this as this research was published in 2015 we have that in production 2018 so that's the phase that we are going yeah I metadata for like feature engineering for example for feature engineering like column name somebody ask the question right so there we need we operate on column IDs but then we need to be able to show it back to the user in the column name we so we haven't done that we haven't done that we haven't done that yet I don't know if we will do that anytime soon but we haven't done that it's based on like public it's based on public data public models that on those data it's not being retrained it's not being retrained with real customers scenarios yet yes yes say that again so why will you be more correct yes yeah yeah that's a good question that's a good question so as part of the feature engineering transparency I talked about we also give you an ability to override our feature engineering so you can look at what feature engineering we have done and you can say I don't want to do these these things I want to do just these from you plus I want to do this one extra thing we enable that as part of the SDK release so that was a good customer a lot of customers ask that question I want to customize feature engineering everyone everyone so the trend you know it's an interesting question because as part of the collaboration I am seeing patterns around some customers some companies having mixed set of data scientist and data analyst some companies are happy to say for simple like low business impact and low business critical problems analyst can go build a model deploy it on their own but a lot of customers are saying that no no no data scientist needs to review and approve but the trend there are there are mixed trends but everybody almost every customer is saying data scientist resources are hard to find so they are augmenting data science team with these citizen data scientists or analysts who are domain experts who know data but want to learn ML so that's the trend I am seeing it is so the single single click deploy I showed automatically enables that so you click single click deploy and we automatically generate the right metadata for power to understand and query correct yeah so as part of our overall Azure ML ML op story ML operation story we have that covered so this is I just talked about automated ML but there is a like broad spectrum of Azure ML capabilities that you can get for free so that that finishes the end to end thank you


Hey, what's up, America? I'm McKenna Gott. I'm Frida Karan, I'm a military chef. I'm Cody Wall. I'm Luke Moair. You can't even see me. I'm Charlie June. We are trying every single day. I know a culinary specialist in the name. They try every single day to better their skills. Going into the military life, you think it's going to be a whole new world. And it's actually not.  I learned how to read from comics. I was just a little bitty kid.  I'm on call 24-7 during the weekend. How are you? I've always been interested in photography. It's kind of planned on joining the military.  I hope you all had a good time.


Now, let us talk about a bit of basic concepts of analysis. So, the issue is that most of the projects with which we deal they occur in nature and the second issue is that soil is more sensitive and susceptible to environment than any other construction material all right. So, in what way these two concepts should challenge the you know the philosophy of engineering sciences you are sitting in a room not directly exposed to the nature, but think of foundations embankments there is no shield they are directly exposed to the environment is it not. So, that is why I say that most of the projects dealing with geotechnical engineering they occur in directly nature there is no protection even if you are making embankment is getting influence from the water table rise changes fluctuation or from the rain water and soil is highly sensitive we have discussed this issue and susceptible to environmental changes than any other construction material either steel or concrete or whatever you may polymers. So, because of this when we say that all the activities take place in nature we are more interested in long term response unfortunately what we have studied till now in the realm of classical geomechanics is always short term response that is one of the reasons why structures have failed in the past a simple analogy would be how much time you spend when you are doing hydraulic conductivity test say at the most few days or not even few days few hours. So, that is why the question is if you conduct hydraulic conductivity test for few months what will happen to the hydraulic conductivity of the same soil mass it may increase, but I am of the school of the thought that it will decrease I do not know there could be several answers to this to prove your hypothesis yeah, but idea is the common fact is that something is going to change the pore structure itself is going to change all right now when you say soil is very sensitive and susceptible to the environmental changes than any other construction material what we do is we talk about loading is it not mechanical loading. So, we say that loading may greatly affects soil properties until now we have talked about crushing you agree with this or not in what way can you defend this see the best way of doing this type of study would be whenever you are doing a direct shear box test do the test take out the material and conduct particle size distribution again. So, direct shear test without PSD has no meaning you keep on doing this test to understand what type of alterations in the state of the material you have done because of shearing I hope you will appreciate this point particularly when you are dealing with coarse grain materials the after stage of shearing is not same as the one with which you started. So, this concept normally is used when we talk about shear strength of the material where the stress strain relationship becomes asymptote after certain time they are never straight lines the way you have been told in your undergraduate courses is it not why it is so the main reason is because of particle crushing. So, after a certain stress level the crushing of grains will take place the properties of the material are getting changed and you cannot compare the material properties for that shear strength parameters for all the stress range together. So, you have to define this stress range as in which you are working and the parameters which are getting. If I teach your C 6 34 course I spend lot of time in explaining this phenomena. So, that time you should remind me if I if I take that course for you. So, basic idea is loading may greatly affect soil properties here we are talking about mostly the mechanical loading, but it is not only the parameter. So, this is where actually we should think out some other parameters like thermal loading and because of thermal loading how moisture content is going to change. So, as you rightly said that because of heating the moisture gets redistributed gets changed. So, that means the properties of the soil are going to be different before cracking and after cracking and that is why cracking characteristics are studied in details. Similarly, how pollution load see the word missing here is not physically missing if you read this sentence as pollution load intrusion all right. So, this becomes a sort of a loading which is equivalent or much more higher than mechanical loading. So, this is where we say imposition of thermal flux, electrical flux, mechanical flux, chemical flux and so on and then we are trying to see what is the response. So, these are the concepts of analysis which we have been using without bothering much you agree or no anything apart from this which comes to your mind. What are the flaws in classical geomechanics? The first flaw is we always assume specific gravity and Atterbug limits to be constant. Do you think it is so or it should change or what should happen? So, all the time you have been finding out Atterbug limits by using distilled water, but a real life simulation would be when you take contaminated water and see how much reactive the soil would be and what would be the effect of Atterbug limits when you are changing the interaction properties and what is the culprit in this interaction. We are not talking about the purest form of the water, we are talking about the contaminants which are present in the water and how do they reflect in engineering properties of the soil mass. Lot of studies have been done by researchers where they have used organic compounds, inorganic compounds, hydrocarbons to see what is the influence of this type of interaction. Any idea why specific gravity should change? I think I showed you a slide in the previous or previous to previous lecture where you are talking about mineralogical alteration because of the etching of the glass. Remember I had shown you fly ash particle on which some zeolites have got you know generated or developed. Now, this is what is known as etching of glass. Some people make pentings using glass etching, they etch the glass, erase the glass. So, the silica which is present in the glassy form gets etched because of hydroxides of sodium and potassium. It is also known as silica dissolution. Mr. Jha is doing fantastic work in this area. So, whenever he presents his seminars you should come and attend if you want to learn this subject more. So, what he is doing is trying to dissolve the entire fly ash in sodium hydroxide and we are working on SRT silica reduction technology. So, how silica can be reduced from fly ash so that we can get more alumina and iron. So, what this shows is you just think of peeling of onion clear. So, what happens to the denseness of the onion? It increases as you peel it off. The same thing is happening to the soil grain. If you keep on etching it by using regular application of hydroxides, the first layer which gets etched, the second layer which gets etched, the inner layers are going to be very densely packed and that is how your specific gravity increases. Some of the structures which are known as senospheres they have double surface inside surface and the outside surface. Now, if you do this type of etching too much, the ball of the senospheres gets opened up and then what happens? The specific gravity will increase.  So, this volume is more, but the weight is less. You open it up and fill it with water what happens? The volume remains same, but the weight is more clear. So, these type of mineralogical alterations keep on happening in nature and that is the reason why a specific gravity of minerals will not remain same. Like these are the things which we are talking in realm of micro mechanics. We have micro mechanics and nano mechanics interfacing with our materials and our subject. The second issue I think you will agree or you may disagree the void ratio and porosity as the indicator of the soil deformation. How do you define deformation of the material? In your consolidation theory you have talked about only void ratio reduction, but do you think with the background which I am giving you I am contaminating your mind. Do you think that this is valid further? When your skeleton of the soil itself is not stable, it is undergoing changes. There is no sanctity associated with the void ratio and the porosity because these terms are nothing but volume of voids divided by volume of solids, but volume of solids keeps on changing. So, your void ratio, porosity and related parameters do not remain same over a period of time clear. Now, most of the time we consider that soil water is mainly gravity water which is not true. We talk about double layer theory in clays. So, the water which remains adhere to the clay mineral which is very difficult to remove from the soil mass. We do not talk about this viscous water at all. We just talk about the water which is freely movable and this is where actually the need is to consider environmental water. We will talk about these states of water and its different forms like your solid state of the water which is nothing but ice frozen water, gaseous phases of water like vapors and so on as well is it not. So, we talk about hydraulic conductivity at the same time we should be talking about gas permittivity or gas diffusivity and this gas could be the vapors or it could be the contaminated vapors of water. The fourth issue is very important flow through a soil mass is only due to hydrostatic potential, but then the question is how your salt water intrusion is taking place in aquifers. So, this is where actually it is very important to understand water and soil response to imposition of any energy field and it exhibits a coupling effect and this is where you have to consider the thermal flux, electrical flux, magnetic flux, chemical fluxes. So, basically the challenge towards you know new generations or what you guys have to deal with in your professional career would be you come up with a model which says that flux velocity should be equal to coefficient of energy conductivity multiplied by energy gradient. You find that this equation is resembling to what you have studied till now Darcy's law. So, v equal to k into i. So, when you say coefficient of energy conductivity, how do you define k? It is the hydraulic conductivity and that is capital K. So, capital K is the intrinsic permeability of the porous system and on which the energy gradient is nothing, but hydraulic gradient delta H upon L. So, if you change the flux, the type of the flux, what is going to change? The energy gradient is going to change and there will be some equivalent form of the coefficient of energy conductivity. So, when you say flux, if I say concentration flux velocity should be equal to some coefficient of concentration multiplied by energy gradient of concentration. So, this model has to be generalized. In what way this is going to be beneficial? You must have heard of application of electro osmosis for consolidation, accelerated consolidation. Nowadays, some people are working on vacuum consolidation. So, Raj Gopal from IIT Chennai, he has worked a lot in this area. You apply vacuum to the clay and then consolidation gets accelerated. So, what is that you are doing? The free water drains off because of pre-loading, but then the water which is adhering to the clay can be removed by applying an energy which is going to be more than the molecular bond between water and clay platelet. You got this idea. So, based on this concept, you can apply some electrical field, magnetic field or vacuum to suck out that water which is highly viscous and which will not flow out because of application of external stresses. Another biggest problem is that constitutive models are very arbitrarily chosen. What is meant by constitutive models? Stress strain relationship that is right. So, when you are seeing that the material properties do not remain same, this becomes a very dicey thing when you say stress strain relationship is same for the material. So, basically what I am projecting here may seem very revolutionary, but then this is the need of the hour. I mean like you have to really talk about these issues. Some of the major assumptions that require very careful attention are we have always assumed constant seepage velocity. Where do we use this concept or this type of assumption? Seepage velocity does not change, coefficient of something does not change, it remain constant. The coupled process we do not talk about at all that is moisture and heat flow simultaneously taking place in the system. So, the moisture is flowing because of heat which is flowing into the soil mass. There are lot of practical situations even if you think of creating solar ponds. So, one side of the solar pond you have thermal flux which is very high. The other side of the solar pond has no thermal flux. So, heat is migrating what you want to do is you want to maintain the moisture content. So, that the shear strength of the clay liner is maintained otherwise the entire thing will collapse. Flow finds from the soil mass. We have been talking about this quite a lot is it not. This is also a coupled phenomena. The seepage is taking place and there is a mass migration from the soil mass itself. So, we have assumed in all the analysis that control volume remains is a control volume, but truly speaking that is not happening. Either your void ratios are not same, porosity is not same, the finds are migrating out and the seepage is taking place. Another issue is we do not differentiate between saturated and saturated state of the soil. We talk about three phase system soil, water and air, but then what is the cause of creation of the unsaturated state of the soil. When you talk about heat flow in the soil mass, this could create an unsaturated state of the material. So, this is where the characterization of unsaturated state of the material becomes very important and soil mass may not remain saturated all the time. Another interesting thing is cation exchange capacity of geomaterials, we have not talked about much. Why? We always work in laboratory with passive soils like kaolin, white clay or the soils for which the activity is very very less cation exchange capacity is very less. It is also known as ion exchange capacity, but this is the most crucial parameter when we talk about soil contaminant traction and you have to study this attribute very precisely. The assumptions are that we do not take into account biochemical degradation of the material at all. We always assume the soil mass to be you know living forever which is not true as you were saying about the organic soils that is right. So, bio activities are too much or the material is too much prone to bio activity and degradation may take place. There is a reason when you lay the foundation the thumb rule says that get rid of this material filleted with some put foundation material and construct the building on that. So, biochemical degradation of the materials mainly organic soils due to prolonged exposure to manmade environment requires a very special attention. See we all realize that yes these are the major issues and they have to be inculcated in our models. So, the question is that these soil classification with which you are working whether it is acceptable or not. The present scenario or the parameters which you are using are grain size distribution, soil consistency basically is nothing but the moisture content in the form of liquid limit, plastic limit and plasticity index. What else should be added here? Now you have a fair idea about what we are discussing. So, this model do you think is sufficient or good enough to handle the properties of the geomaterials? We use grain size distribution physical classification just see if the sample or do hydrometer that again is an interaction and then talk about its consistency limits where you allow soil to come in contact with water. So, the question is what should be the proposed scenario? The proposed scenario which should include parameters like this percentage passing 200 number sieve, it is nothing but the clay content of the soil all right specific surface. Last I think how many years we have been following this system almost 50 years. So, there is a need to change the classification scheme. So, that is why you will find most of the researchers are trying to reclassify soil mass or geomaterials and we have one of those we are contributing in this direction. Specific surface pore fluid characteristics particularly pH of the pore fluid. See human body is very sensitive to pH you know acidity is a major disease in human bodies the same is the case with soils also. So, their corrosion gets accelerated when pH is even if you cross a limit of 4.5 less than 4.5 or even if you go beyond 7.5 you will notice that stability of the soil becomes a very big issue cation exchange capacity. Now, this is the key word in present day scenario everybody is talking about CEC of the geomaterial how easily a soil can exchange ions with contaminant. So, this is the formation of your soil contaminant interaction. If you want to study how contaminants are going to interact with the soil mass or vice versa this happens to be a mathematical term which will define this tendency all right. Then sorption characteristics I think in second or third lecture somebody was talking about absorption and adsorption. So, put together these two words we call them as sorption characteristics. Our group has a lot of work related to cation exchange capacity and sorption properties of the geomaterials. And now we are working on electrical properties and thermal properties. So, electrical properties when we say these are electrical conductivities and dielectric constant. When you saw these TDR probes and FDR probes in my laboratory I had told you that the basic principle on which they work is dielectric property. So, you add more water to the soil mass what happens to the soil it becomes a good conductor or a bad conductor what is your feeling in your 10 plus 2 physics you must have used semiconductors or the capacitors all right. So, quarts is a goods capacitor it is not allowed charges to pass through clear. So, in a storage charge storage capacity increases. So, that means, when you have more water into the system what will happen to its dielectric constant it will increase. So, for water dielectric constant is 81 and for air dielectric constant is 3 that is the reason you put some dielectric material in the capacitor. So, that the charge can be retained otherwise you would have you would have filled all the capacitors with what with air. So, charge retention capacity will be very less unless you put some dielectric material in it. So, this is a very good parameter on which based on which you can characterize soils and what we have been doing is as I told you the other day we are utilizing these properties to define the fine grain materials and coarse grain materials and differentiate between them. And another leap in this attempt would be if you can identify the level of contamination associated with the fine grain soils and the coarse grain soils. What I will do in this course is I will touch upon these issues a bit under the adding characterization of the soil mass by using advanced techniques. And of course, the thermal properties can be talked about in terms of thermal diffusivity. How easily thermal flux gets diffused from one point to another point. If you go to the old monuments you will find that they remain very cool from inside is it not. Even in deserts like Rajasthan, Madhavpur and all these areas what is the reason? The type of the soil cover which they have used are perfect alright. So, this is a thermal properties of the soils are given due weightage they were given due weightage in the past, but present day generation forward and again we are coming on the track. So, we are talking about the resistivity and heat capacity of the soil. So, if you include these parameters and reclassify the soil that would bring you somewhere alright. So, this is the challenge I had. I will stop here. So, this is what the ideal situation would be and incidentally this type of classification will take care of physical properties.  Poor fluid cation exchange capacity would be chemical properties. So, we have physical, chemical, mineralogical properties. So, option is nothing but a chemical property, mineralogical property and electrical and thermal property. So, this will be a complete characterization of the soil mass based on different energy fields clear. So, if you have input from all these studies you can put this in your PEF particle energy field concept and you can get solutions to the problems which you are dealing with alright. Thank you.


Hi, welcome to our Google I.O. Tech Talk on how communications and contact-centered applications can be optimized for the web and how you can differentiate your solutions by building cloud-native apps on Chrome OS. I'm Roluca Mone, and I am a global partnerships lead for the Google Chrome OS team. Joining me today is Austin David Christopher from our awesome partner engineering team. Today, we're going to share how modern web standards and Google Chrome OS APIs can help empower communications and contact-centered developers to build, optimize, and most importantly, differentiate their applications from the competition. Let's get started. Before we get into the meat of this, let's first talk about the communications and contact center trends that are driving customer migrations to the cloud. Mark Twain once famously said that prediction is difficult, especially when it involves the future. How true? Who would have predicted the past few years? If you would have asked me three, four years ago what a typical contact center would look like today, I most certainly would have not said agents would no longer be in a large facility tied to their desk but instead be highly distributed even in their own homes, taking calls on earbuds and using a Chromebook to get their job done. Yet this is the reality for many contact centers today. In fact, 77% of service organizations are adopting or accelerating remote work options. In the last few years, we've seen a 24-fold increase in migration to cloud technologies, moving communications and contact center solutions to the cloud also allows your customers to embrace automation and rethink business continuity. OK, interesting perhaps you might say, but so what? How does this matter to you and your business? It's an excellent question. As it turns out, there is a pile of benefits to be realized. First, let me start by saying that the web is not a replacement platform, it's an expansion platform. Customers can be anywhere and you are making your experience available to them wherever they are. You can write apps that easily reach a broad audience across desktop and mobile devices, write it once, and it works everywhere. Quickly launch and deploy app enhancements and fixes without requiring user intervention. You're no longer dependent on flaky end users who like to hit the remind me tomorrow option whenever there's a critical update available. You can increase your development and test speeds by leveraging web standards. And finally, you contribute to building a safer, faster, and stabbler way for all internet users. Now, Austin will walk you through a few of these standards and APIs that enable you to develop cloud-first applications to provide differentiated capabilities. Thanks, Roluca. Building for the web starts with how you build applications and, at their heart, progressive web apps or just web applications. Progressive web app or PWAs are designed to provide all the great capabilities you would get from a native installed application with all the reach and engagement capabilities of web apps. Here's a few examples of Google Chrome and the price-recommended communication partners that have optimized their solution for web with progressive web apps. WebEx leveraged web technologies to launch a new PWA by offering integrated meetings, messaging, and calling features, allowing users to join a unified and installable app-like experience on a Chromebook. Zoom recently migrated millions of users to their PWA from the Chrome app, which was previously a meeting-only experience. With the PWA architecture, they have been able to expand the capabilities to better match the full-featured set that is available in their native Zoom application. We will use these examples to see how we can customize these apps for enterprise. First, let's see the difference from the user perspective for both traditional web app or web pages and the progressive web apps. Upon logging into your OS, the typical user experience of launching a web app requires two steps. The user typically needs to launch the browser first. Then the user has to navigate to your web app via bookmark or URL. For PWA, the user launches the app directly from the icon on their home screen or shelf. This provides a user experience similar to launching a native desktop application which many users are accustomed to. Once logged in and on subsequent launches, the PWA presents the full experience that matches the native desktop application. Now, let's talk about how the progressive web app can be installed for enterprise or managed users. In this example, an enterprise administrator applies app-managed policies through the Chrome Enterprise Admin Console. As you can see here, we are force installing and pinning the Cisco WebEx PWA icon for a set of managed users. The Cisco WebEx app PWA manifest provides things like the app icon that will appear on the user's desktop, just like native desktop application. Enterprise-managed PWAs can also take advantage of additional capabilities such as web-managed configuration. Web-managed configurations allow admins to specify things like app settings through the Admin Console. Here, we see that the default login behavior user can log in using the Zoom accounts and Google sign-in. Zoom created web-managed configurations to restrict certain authentication options. In this example, we are applying their web-managed configuration to disable Google sign-in from the Chrome Management Console using a JSON object. After applying the web-managed configuration through the Admin Console, we see that the user can no longer use the Google sign-in authentication option. As a developer, you can expose any of your app settings as a web-managed configuration which will make deploying your app more seamless and customizable for enterprises. There are a few limitations with web app compared to native applications. And Project Fugu is an effort to close gaps in the web capabilities and thereby enabling new applications to run on the web. To learn more about this, please check the IOTalk Advanced Web APIs in Real World Apps. Another great web optimization capability is delivering through the Chromium Web Standard. Web it enables web applications to interact with human interface devices other than the standard supported devices like mice, keyboard, touchscreen, and game pets. However, there are many other heat devices that are currently inaccessible to the web. This API allows web applications to request access to these devices, send and receive heat reports, and retrieve information about the report descriptor. In communication and contact center environments, the primary web-it use case is for computer-telephony integration with headsets. Leading headset integrators like HP Poly, Jabra, and Epos offer several models of headsets that are web-it compatible. The benefits of web-it are no more soloid proprietary SDK integrations by leveraging the new Chromium Web Standard within communication and contact center applications. Providers can easily integrate their web-it call controls into any compliant headsets. It's supported across all major operating systems. Web-it headset controls have been validated with Chrome browser across Chrome OS, Windows, Mac, and Linux operating systems. Supported across all Chromium-based browsers. Web-it is available for any Chromium-based browser. Next, we will talk about screen capture. Screen capture, screen sharing, and screen recording are other great communication and contact center use cases that can benefit from Chromium Web Standard. GetDisplayMedia is an extension of the MediaCapture API GetUserMedia that enables the acquisition of users' displays are part thereof in the form of a video track. In some cases, system, application, or window audio can also be captured and presented in the form of an audio track. This enables a number of applications, including screen sharing, using web-ass TC or contact center screen recording. MultidisplayCapture extends GetDisplayMedia to support use cases where multiple screens need to be shared or recorded with requiring users to accept recording. Our Chrome Enterprise recommended partners like Dialpad that you see here are now integrating this new web standard to optimize the screen recording on Chrome OS. Finally, Chrome OS completes the experience with always-on non-closable screen recording support. Thanks, Austin. It's great to see all of the hard work that's gone into ensuring our communication and contact center partners can optimize their solutions for the web through the power of progressive web apps and Chromium standards. Now, let's take this one step further, shall we? Let's look at how we create a different cheated experience by leveraging Chrome OS. If you've not used a Chrome OS device yet, you really should. It's simple, powerful, fast, and secure. Zero reported ransomware attacks ever. These benefits are inherent to every Chrome device out there, Chromebooks, Chromebases, Chromeboxes, whatever, or for whatever use case, consumer enterprise education. It doesn't matter. But for the enterprise, and because each use case and each company and each vertical all have different security concerns and compliance needs, what if we make the ability to implement policies flexible and customizable? What if we keep all this up to date as frequently as possible in a seamless fashion that doesn't require human action, doesn't interrupt workflows, or mandate significant downtime? That's what an enterprise upgrade license affords you. But more than that, Chrome Enterprise upgrade licensing also unlocks new abilities that allow partners to differentiate their products on Chrome OS and deliver experiences only available on our cloud first platform. Austin, walk us through these differentiations, if you would. Last fall, Chrome OS team introduced a new Chrome enterprise capability called the Chrome OS disconnector with leading partners like Nice and Ring Central. In contact center use cases, 53% of the agents say they use three or more systems during a single call. And at Google, we have seen customers with extreme cases where they are opening over 20 apps and tabs to support a single customer inquiry. This poses a productivity challenge for users as they end up with a cluttered and complex desktop to navigate throughout their day or need to spend the time manually managing windows and apps and getting back to their optimal starting point in between customer interactions. With the Chrome OS disconnector, your communication and contact center solutions can automatically create a new desk for each customer interaction. Once the interaction ends, the desk with all its case specific windows can be closed with one click. Managing the desktop has never been easier. Let's watch a quick demo on how this was implemented with the Ring Central Engage Contact Center solution. A contact center agent makes them self-available to receive inbound calls as they start their shift. Currently, they only have one Chrome OS desk active. A customer makes an inbound call to speak to a contact center agent for support and the call is routed to the available agent. The agent answers the call and a new desk is created to isolate all apps and windows related to this specific interaction. When the agent views their desks, they can easily see that a new desk was created for the call the agent received and seamlessly switched between workspaces. After the call has been answered, a CRM screen pop is delivered by the contact center platform to help the agent with the interaction. The customer is asking for Fitbit support, so the agent opens a Fitbit support page in a new window. After getting more specific information from the customer, the agent opens the help manual on Fitbit battery in another window. The customer now has all the information they need and the agent can now end the call. When the interaction is ended, the agent gets an option to close or keep the windows and desks related to this specific call. In this example, the agent chooses to close windows and declutter their workspace. The Chrome OS desk is closed by the contact center application and the agent can quickly and easily get back to their optimal starting point for the next interaction. The last Chrome Enterprise differentiation opportunity I wanted to discuss with you all today is the Chrome OS telemetry API. The users of your application can often be impacted by device and OS performance and business managers don't always have the visibility into IT monitoring tools that power root cause analysis and proactive resolutions. The Chrome OS telemetry API enables you to monitor the operation of health of the devices running Chrome OS. By incorporating Chrome OS telemetry signals into your communication and contact center dashboards, your customers can easily drill down from app or use case specific APIs into root cause issues with the devices they use. Our Chrome Enterprise recommended partners like Dialpad and UJET are working to integrate the Chrome OS telemetry API into their reporting and dashboarding solutions to better monitor and troubleshoot devices and application level issues that could be impacting customer experience. Now, I'll hand this back to Raluqa to close our presentation over to you. Thanks, Austin. It's so exciting to see Chrome Enterprise powering the future of communications and contact center and giving businesses around the world an opportunity to work smarter, faster, and more securely. To close things out, if you are a communications or contact center partner, consider building or optimizing your application for the web. This gives you an opportunity to become part of our ecosystem and work with our amazing teams at Chrome OS, Chrome Browser, Google Workspace, and others, and also work with great software and OEM partners like the ones shown here. Finally, we shared access to information throughout this presentation to help you along your web development and Chrome OS journey. You can find the links in the description below. Don't hesitate to reach out. If you ever have questions, our team is here to help you along the way. Thanks for attending our tech talk today. We hope you enjoy the rest of Google I.O. 2023.