Aloha and welcome to the State of the State of Hawaii on the Think Tech Hawaii live streaming network series. Think Tech Hawaii broadcasts from our downtown studio at 1164 Bishop Street in the core of Honolulu's district. I'm your host Stephanie Stull Dalton and I have a special guest to bring to our interview today. As you know the election season is upon us and in the state of Hawaii as it is nationally. And my special guest today to tell us more about how she is making her case on the campaign trail one of Hawaii's high executive offices. I'm pleased to introduce council member Kimberly Pine who is remotely connected to Think Tech Hawaii to talk about her campaign for the office of mayor of the city and county of Honolulu. Council member Pine is an experienced campaigner and has shown herself to be a winner. She now serves as a member of the Honolulu City Council from district one and she's in her second four year term. Her experience includes serving as vice chair of the city council and chair of the council committee on zoning and housing. Previously she served four terms in the Hawaii State House of Representatives for the communities of district one like Ewa Beach, Urquay Point, Kapolei and Pula Loa and others on the Leeward Coast. In the house her colleagues selected her to be House Minority Floor Leader. In these roles council member Pine has achieved a record of numerous outcomes directly benefiting Hawaii citizens quality of life as well as tourist quality of visit to Hawaii. So welcome council member Pine and thank you for joining us today for this interview conversation. Hello, hi Stephanie and to all of your viewers. Oh good to see you. Very glad you could join us and we have some questions to stimulate our conversation over what you're experiencing now and we'd love to know a lot more about your goals and your process for achieving them. So clearly as an elected official you have succeeded many times on the campaign trail but this is your first mayoral run and it may be that you are fulfilling your long held aspiration or you've had an epiphany but would you share some about what made you decide to become the mayor to go for being mayor of the city and county of Honolulu? Well I guess I would say that I've had a numerous epiphanies because I never dreamed that I'd be a politician or run for office. I like how you call it you say it's an epiphany because when I first ran for the House of Representatives it really was seeing my community being neglected and not being taken care of with it last in terms of having traffic relief funding or last in the state for having school funding, last in the state for having our police funded and other things that are just needed for success in daily life and so that's when I ran for office in the House of Representatives because I was supposed to be a news broadcaster that's my training and we weren't supposed to win, I ran against a powerful incumbent who was also president of a very powerful union and had a beach at the time and so we just really ran to make a statement to get people involved in their government and to push the incumbent to work harder for the people and stop hanging out at the Capitol and really look at the problems of the community and so when we ran in 2004 for the House of Representatives we were very surprised to not just win but we won by a landslide and it had never been done before to an incumbent like that and then of course I guess you could say had a epiphany again as you say when I ran for city council in 2012 it's because the incumbent at the time was also not taking care of our district he was arguing a lot with a lot of people that we needed help from he didn't accomplish much at the time and so I ran again to get him back and you know you need to start working for the people and we were very surprised that we won by a landslide on that election also and I really truly was going to retire the city council was going to be my last thing to do and because I have been a horrible military spouse my poor husband you know I don't show up to all the things I'm supposed to and he's been so lovely and wonderful and I don't follow him when he is stationed somewhere else because of my service but I really felt that I could do a better job you know as mayor as people who are talking about running as a lot of old names just we have to another position I felt that these last seven years that there's been a lot of introduction of all these projects that were beautiful wonderful nice to have things when a lot of the necessary things that people needed like more police officers a safer streets a better streets better parks and beaches more more lifeguards all these basic things that you need to have a good city was being neglected and so that's why I decided to run in my family and I talked and they agree they agree that there's so many problems that can be fixed if someone has the heart to listen to the people and understand their suffering well let's talk about the campaign a little bit you've your service seems directed to to the felt the scene needs of the community and you you seem to you you're looking at that as your resource for guiding yet your work I you've you've referred to your campaign as an aggressive grassroots campaign so it I wanted to ask you to talk a little bit about what that means to those of us who haven't campaigned or helped in campaign sorry about that but but I'd really like to know more about what that that means an aggressive grassroots campaign how does that work and how is that different from an ordinary campaign well I think an ordinary campaign what I've discovered in in my position and running for this position as well is there is a core group of very powerful people here in the state of Hawaii they're the group that that smokes the cigars in the back room and drinks their whiskey and says okay who are you going to put in the mayor's office who are you going to put in the governor's office and and they may get all their fundraisers together and their people together in their extended business next works together and and say okay we're going to help this person and I've never been that candidate I've always been the one that no one can understand because I don't run in those groups I I come from a working class background and I hang out with working class people just regular people and so what I mean by an aggressive grassroots campaign it's like I've always done and that is you first put your power base in the people because they're your boss you need to listen to the people and recruit people that will help you in your mission to get people that put people you know at the top of their list and they're used first back into government and so that's what I mean by an aggressive grassroots campaign is we believe that the number one place at the top is really towards the bottom and so we're very excited to have 500 volunteers that are ready to go and people wanted to sign wave six months ago and I said no we've got to pace ourselves and so what people are doing is they're registering friends and family they're making sure people vote in this election we have people all over that are putting signs everywhere at this moment we're just very very blessed to have that kind of campaign going on right now well it sounds like you've been practicing this in your in your campaigns and probably in your service as well and so you you've learned a lot about how that works and I it sounds like you're really ramping that up in in this aggressive grassroots campaign but I also want to know if the campaigning now this time for the mayor or the mayor's office is that um does that become a category of its own and present a daunting challenge that's different from the other offices you've run for how does how is that all working for you now with what you already know and do well obviously and succeed with and now you're looking at this this high executive office third highest in the state so what what do you do about thinking with that it really is the core of of the campaign it's just like my my smallest campaign and the house representatives the core is always the same you just need more people and more money and more media time and that's the only difference I would say in this campaign everything's just bigger and harder and you have to work longer hours but the core of a good campaign comes from that grassroots level where you really listen to the people and you inspire the people to bring change to government what do you think that this is unnoticed do you think that those um as you described them cigar smokers in the back room which is a very big tradition in traditional politics right do they notice this and do and do people notice that this is different is that what your experience they're certainly noticing it um they saw that we were able to raise just as much money as their guy but uh we didn't do it all one time you know I don't have a millionaire friends and I'm not a millionaire but we competed with the best and we're my team is very proud of that it's a lot of hard work I think they were very surprised that we actually raised more money than them and uh but it's a great inspiration to the people in my team where they can see that you can compete with people that are very powerful if you have the heart and you truly believe in what you're doing you love what you're doing so to my team we're very inspired by what we're seeing and I have the blessing uh to be the leader of this movement but my goal is that we have more candidates out there and I'm encouraging more candidates to run that also want to change the system and end the system we're just a few people that make a lot of money get thrown in power so they can make more money we have to stop that system well then how does this and and you're not the mayor or have been the mayor um yet but how does this work forecast what your work will look like in the mayor's office so if when you make the lead when you win the election and you go into this powerful position with many other affordances then maybe you we even know now but also with impediments and constraints but have you what is it going to look like how how is what you're doing now forecasting what that's going to look like knowing that you're in a different context or are you anyway could you talk a little bit about that I think that shows because we're doing so well it shows that it is possible to elect a mayor or a politician at a very high level that is going to be putting the people first and listening to the people I think we've seen a lot of things happening make sure we're the forest for example of government not listening to the people who live in that area who should know that district better than anything else I think it's an example of what I would have done on the olawai issue where you had seven neighborhood boards protesting tearing down their neighborhoods to put up six foot walls to prevent flooding in the olawai when they had engineers and architects step forward with a totally different plan than governments in Washington DC had that had the same effect to prevent flooding I would not be a mayor that would say I'm sorry you're just the little people you don't know what you're doing so we're going to do what these big contractors say I think this shows the kind of mayor that I would be and listening to the people and believing in the people in their own talent and not a wealthy contractors and people in power who are really just making decisions for their own pocket book not for the benefit of the people and and a helpful change but when you get into the bigger picture I was going to ask now what are what are your strategies going to be like to manage these daunting goals in your portfolio you haven't been shy about setting up your list of priorities it's the hard complicated homeless and you know and government transparency and crime and roads and beaches and beautification all of those really important issues so when you get into that situation where you have the affordances of a mayor ship then what are you going to do about having to to shift priorities and what how are you going to manage to guide your your strategies for implementing what you want given the the more complicated and numerous forces that are going to be at work on you if that makes any sense at all but anyway in that in that arena how do you see what you've already done and what you're doing play out and how is that going to help you with us the strategic nature of that responsibility there well we certainly have a lot of goals and things that want to get done we shouldn't be 300 police officers short in the state of Hawaii and having grandmas getting robbed at bus stops that's just unacceptable and that's not the city that we should be living in a lot of these things of course that you were saying earlier does cost money but i've proposed numerous things that would allow us to increase our revenue without raising taxes it took me two years to pass the city sponsorship bill with with now a bill that could be supported by people that care about the environment and what that did was other cities across the nation across the world are teeming up with nonprofits teeming up with donors endowment to fix up parks and beaches for example and all that we were going to give them is a small little sponsorship recognition and then blended into the environment wasn't neon flashing it was very respectable some of it would be in you know and maybe plaques or things like that along roads it took me two years to pass that because there was some opposition to commercializing Honolulu but i think the final bill showed that we can blend that recognition into the environment that it would be in but it's been two years since its past and the administration hasn't implemented the bill yet i have so many people that want to help and give money without raising taxes on the rest of the population some cities are raising as much as 300 million dollars which is far more money that we need for many things in the city the other thing that i've proposed recently was how we deal with homeless right now we're spending 10 to 15 to 20 million dollars a year and handling the homeless issue the administration proposed to sit live bill legislation and i was against that from the very beginning because what that i predicted at the time and that was six years ago seven years ago was that we're just moving people from one street to the next street so how does that solve the homeless problem and so unfortunately six years um you know into it they realized that i was right that we were spending so much time really just cleaning up people's trash and then moving them from one town to the next town and causing major havoc in the next town and then we'd spend even more money and more money and more money to handle the increased negative psychological behavior that that caused people that already had some mental health issues called the stress of having them lose their stuff and then move them around so all that money from 15 to 20 million dollars that we have spent you know a year we could have used to put affordable housing in in certain places or partnering up with other organizations to rapidly build affordable housing and we would have had a better result and actually ended their homelessness by having wraparound services in terms of helping with them with their mental health issues their drug addictions other things so yes i do have a lot of goals but i've already showed that you can pay for things we passed in the tod areas housing developments that i required to have a very high number of affordable housing in it and i didn't let anything go through my committee unless it had high affordable housing numbers but each of those buildings brought in five to ten million dollars in property tax revenue a year in addition to what we already had and so we passed about 10 of those buildings so that brings in another hundred million dollars to the city so there's ways that you can raise funds for the city and be more efficient with your funding without raising taxes and so there's a few ideas that i had there's many more but i know we only have a half an hour well i'm i i'm pleased you brought that up because that seems to be our life and that's that there's never enough money to do the things even when we know and have the will and the political will to do them there's just never enough money so talking about the but your budget in that way managing it so that you're using it to leverage more funds and in a project something like your involvement with the kaha wiki village where i noted that there was what you briefly referred to was a partnering of the state the city and county and the foundation aio and i wondered if that was something you would tell us a little more about because as you're saying it you're using the funds to leverage more funds because no matter how big your budget and hamlet was budget budget as i understand it is big it's over a billion but there's never enough so how is it that you can how is that an example or not or suggesting other things that you're thinking about doing that can make that difference and it's a great example of a public-private partnership that helped to solve the homeless problem for certain income populations and especially for families and it didn't take too much city money but it did take resources and it did take state resources and it took private investment and donations and we're doing a two similar projects i'm for the the small tiny house program in villages and we're going to have two one in winy with twinkles of they're the homeless encounter at the winy boat harbor and we're also going to have one kailua next to the us that shelter and how we're putting that together is also public-private partnerships where we have private companies donating the materials for the tiny houses we're going to have the city donating portable showers and and hygiene centers so that once the the nonprofits getting enough money for the infrastructure we can go to the next encampment and help them and so really a lot of partnership is really the solution to a successful government government can't do things alone you just don't have a tax base to do it alone that's uh the important point and and i show i'm i'm sure you'll be learning more about that going forward um so i i understand from the reports that one of the issues of houselessness that might that's part of the cause is that there isn't affordable housing permanent affordable housing so you're going at that piece of it that seems to be um one remedy area to to work on so um in the city council actually seven years ago i said we must focus on affordable housing in a very big way we need to have city-state private sector partnership and you know what some people totally in politics they said kim it's not on a poll no one's saying that it's important to them on a poll we see i represent some of the poorest residents on oahu so we see things first and i saw every week new family either moving to vegas or becoming homeless living in their cars people you never thought that would happen to but they were living so at a tight paycheck paycheck that just one accident one family member getting ill they were homeless and so now what is everyone talking about affordable housing and so this is why i started this many many years ago and we put the first affordable housing legislation together we're now for the first time in history if you're going to build on a wahu if you have 10 units and more you have to include affordable housing in your project and the city will help you to do that by helping you have a little bit more density so that you can sell off some units to pay for the affordable housing we'll give you less fed back when you build affordable housing we'll give you waivers on on fees if you build affordable housing so we really finally got that right formula for that both the builders and and they for affordable housing community were was advocating for it first they were very divided the original bill actually was going to destroy our economy and then we were able to fix it and negotiate with all these different stakeholders to find legislation that they actually believe would actually build affordable housing so we have about three to four thousand units that we know that are going to come up very soon and you're talking here about the big guns you're talking about anyone who's building on a wahu yes correct including kaka a go in 10 units or more yes that was a really big muscle in kaka a go is they use state money hundreds of millions of dollars to put in the infrastructure and they didn't demand enough affordable housing it's a really sad thing really tough yeah well i um i think that um there's another resource in hawaii but in my night editing i and maybe and my research has not been very deep on it but lots of the homeless population are um have other agencies that support them for other things and i'm just wondering if other entities nonprofits or or uh trust are they putting in enough to represent the portion of that population that that really is in their kuleana so to speak so where these other big huts of money are they uh paying their reasonable part contributing to it i i think the government is government and perhaps me the private sector too is not doing enough to help in the mental health area in the drug addiction area in the mental health arena we have fallen far behind where we were in the 80s where i believe there was enough investment from the government sector to ensure we had enough hospitals to ensure we had enough psychiatrist and mental health professionals uh i can definitely tell you that's mixed with drug addiction and god forbid if you're a construction worker which i'm finding a lot of people right now who got injured on the job and have teens and mental health issues most likely they're homeless uh we don't have until recently we're been working with josh green and dr miscovitz he's the first doctor that believes he finally come have come up with a medical formula to help those people who have both pain drug addiction and mental health issues by giving a there's a new pain drug and i'm forgetting the name right now that does not make you addictive oxy cotton is what hold on or was pushed on a lot of these people yeah construction workers so hawaii's that is fair share yeah that's really very very sad and also what's the problem with this is um the state has not spent enough money on our inspection inspection that supports oh and you can see that on new year's eve of almost every illegal firework was like every other house so imagine if that's getting in that's how the drugs are getting in so we have a lot of weaknesses in certain areas well cammy it sounds like you're more aware of those you acknowledge them and you're obviously aware of them and we'll be thinking about how to approach that issue and make things better in that area but we're just about out of time and so we'll have to wrap it up so i'm stephanie stoll dalton this is the state of the state of hawaii on the think take live streaming network series we've been talking remotely with council member kimberley pine about making her case to be honolulu city and county mayor i'll see you again in two weeks on the next state of the state of hawaii mahalo for your attention everyone


Good morning Bavana. Good morning Mary, nice to be here. Happy to have you here and thank you again to Australia, to you as well for appointing me as a champion for gender equality at UPU. What is your reflection regarding this breakfast we had today in this building? Yeah thank you Mary and I think it's really important that we get our colleagues together in the UPU so that we can ensure we move forward in terms of this very important work. As you know it's part of the SDG so we do have a mandate here. The UPU Congress last year also mandated us to have a look at this very important topic so today's breakfast was really an opportunity to get everyone together and just make sure that we can continue on with this very important work on gender equality and empowerment of women in the UPU and within our postal organizations. What would be your main recommendation from Australia towards UPU as a United Nations agency to do more in this aspect? Yeah it's a very good question. I think for me it's just supporting our women as much as possible so are there opportunities where we can provide development opportunities, we can help support their growth as well as supporting women as they as they go through and have families ensuring that they can come back into our workforce and and still move through the organization at some of them or more senior levels. You being a woman actually very important member of Australian delegation I remember you from many years from now. Is it difficult being a woman and having a responsible position like that? Look I see it as a challenge but it's one that I really enjoy so I'm very lucky that Australia Post supports women we're very pro in terms of our gender balance we have a 50-50 gender balance at the senior executive level and there's a lot of programs that we have within Australia Post that help support my development my team's development and the development of women and senior leaders so I'm very lucky to be part of the organization as well in Australia as a whole we're very supportive of gender equality so for me although being in a senior role as a woman is challenging I see it as something I'm very excited about and I look forward to the generations ahead of us being supportive and senior leadership positions as females. In case we would come with a proposal of let's say increasing empowerment of women within this organization would be happy to support it. We would be very very happy to support that we are very pro at gender equality and the empowerment of women and would be very happy to help with any initiatives possible. Australia Post has a number of programs in terms of assisting our women develop particularly in an industry that is generally may have dominated so anything we can do outside of our own organization we're always very happy to assist. It is actually unfortunately male-dominated I've seen yesterday during the innovation forum but again you have our promise from executive management side that you are the best to change this picture thank you very much Bavana and really happy to have you here. Thank you very much Marin I'm very happy to hear that.


Thank you, guys. Let me try to start my screen share. Okay, can you see my screen now? Yep, it's perfect. Okay, great. So thanks very much to the organizers for the invitation and for taking all the trouble to organize this wonderful workshop online. So I'm going to talk about some properties of boosting algorithms and high dimensions and this is based on joint work with Tengwan Liang, who is an assistant professor, professor currently at UChicago. So boosting is an ensemble learning algorithm, which is pretty old. It's route straights back to the works of valiant around the theory of learnability. So what the boosting algorithm does is it's a way, it's an iterative algorithm and an ensemble learning algorithm and in each iterate it calls a bunch of weak learners and then it combines the predictions you receive from the weak learners in a smart way and the earliest and most popular version of boosting was adaboost due to Freund and Shapire, where you have a bunch of training examples that's your training data. So you start with a uniform weight on your training data and at each iterate you up way or down way your training examples based on an exponential loss function, exponential weighing mechanism and the important feature of adaboost is that this weight parameter here, alpha T, is going to be chosen adaptively based on the error you anchor at time T and it so turned out that moving away from earlier versions of boosting to an adaptive weighing scheme suddenly yielded an algorithm which is extremely good generalization performance. Okay, so adaboost was observed to perform extremely well in practice and this is sort of a picture that was observed in multiple works in around 96 and 98. Now what you see here is that this is iteration and we're plotting the training error of adaboost and you can see it goes to zero, this is around iteration five but now the generalization error is here and you will see that this just keeps on decreasing. There is no double descent or multiple descent here and this sort of ties to Diaz-Colis talk earlier. I think, you know, this is because this is an ensemble learning algorithm so somehow automatically the way weights are combined leads to this kind of a generalization error curve. Now this phenomenon of interpolating the training data is now very common and we understand many aspects about it very well but when this was earlier observed for boosting and bagging this naturally picked the interest of a broad community of machine learning researchers and statisticians. So one of the explanations that was put forth in those days was that the key quantity that explains this picture is the empirical margin distribution. Okay, so what is the empirical margin? So given any training example and a classifier F, the margin of that example is defined to be this product and in this paper, Shapir et al, the thing we observe is the following. So on the plot on the right I'm plotting the fraction of examples for which the margin is below some threshold for three time iterations. So this curve is for T equals five, this one is for T equals hundred and the solid one is for T equals thousand. So when you run at a boost, you will see that initially the margin distribution, you know, has some structure but along the path of iteration numbers. What happens is that the fraction of examples with a large margin increases. So by the time you're at T equals hundred, there is almost no point with margin below 0.5 and the margin distribution furthermore stabilizes to some some members, some cumulative distribution function. Okay, so this quantity was put forth as a very key quantity and in fact what they had shown was generalization error bounds. So if you take any classifier of this form and if you scale by the L1 norm, then the generalization error can be upper bounded by in this way and the first term here is your empirical margin distribution. Kappa can be any threshold that you would like to pick and the second term is, you know, the generalization error you incur for a certain threshold and this term is independent of Kappa. So the natural thing to do looking at this bound would be, so if you want to obtain the best possible upper bound that you could, you can fix theta and in that case, you can choose Kappa to be, you know, just minimum of these objects. So this first term will be zero. And then if you wanted to optimize over all classifiers of this form, you would choose Kappa to be this maximum L1 margin. So this quantity is known as the maximum L1 margin. If you do that, you immediately get an upper bound for the generalization error of this form. So it's one over square root of ten times this option. Okay, but and this upper bound has subsequently been improved, but still in the literature, this connection between generalization and the error and the maximum margin is known through upper bounds. But it's so turned out that that this maximum L1 margin is not just important for generalization. If you wanted to study how many steps add a boost is going to take before it reaches zero training error or perfectly, you know, into starts interpolating the training data. One can also provide upper bounds to this quantity. And once again, the maximum L1 margin shows up here. So this this bouncer due to Zhang and you around But we don't really know whether this upper bound is tight. Okay. And then if we follow the literature, this maximum L1 margin comes back to the picture again. If you want to understand the path of at a boost. So Imagine that your data is linearly separable that we're in a classification setting where the outcome or response, if you will, is a plus minus one. Then we say that the data is linearly separable. If there is a hyperplane that perfectly separates the two groups. And then you can define the mean L1 norm interpolated classifier to be if you look at all all possible vectors that separates your data than the one with the minimum L1 norm. And for boosting it is well known that if you take the step size in the algorithm, the adaptive step size. To be infinitesimal in the sense that this if you send out send the step size off to zero. And if you send the time iterates off to infinity, then this scaled iterates from boosting where they're scaled by the L1 norm, this actually converges to this mean L1 norm interpolate. So what this kind of suggests is that in this special limit boosting converges to this quantity, but this also gives other insights in the sense that from these works, you can also read off that boosting in some sense follows the path follows that of an L1 regularized empirical risk minimization problem. And this mean L1 norm interpolate is actually directly connected to the max L1 margin because in this optimization here, whichever theta achieves the optimal value that's actually given by the mean L1 norm interpolate. Okay, so these results seem to suggest that okay both this interpolate and the margin are key players in boosting. But in the past, we only knew sort of upper bounds for these two properties of the algorithm based on this object. So in this talk, we are going to try to provide certain precise characterizations of these quantities. So we're going to ask, okay, exactly how large is this L1 margin going to be. And if we look at the mean L1 norm interpolate, what are the properties of that particular estimator. And then we will switch gears and come back to boosting and try to study precisely, okay, how long does boosting take to reach this mean and mean norm interpolate. And that will give rise to a precise characterization of the generalization error of the algorithm and we'll be able to study certain other properties of this as well. And we'll do all of this in the high dimensional scaling minutes that have featured in the earlier talks today. And here I just want to mention that boosting is an ensemble learning algorithm and there are many other ensemble learning algorithms like random forest bagging. But it's hard to study ensemble learners in general, but for boosting it so it turns out that through this connection with the mean norm interpolate, you can study precise properties of these algorithms. And my hope is that, you know, some of the proof techniques can be used to study on other ensemble learners or, you know, like even when you combine, you know, some of the techniques have also been used for like in the context of neural networks and when they're being on top. Okay, so the inspiration for our work is tied to sort of very both historical and recent literature in statistical physics and in other areas. So our proof techniques are going to be based on Gaussian comparison results that date back to Gordon in 88, and then more recently, what is known as convex Gaussian minimax theorem, which was, which was proved in the context of high dimensional M estimation. Now I want to mention that Max L2 margin is a very well studied problem. So in the case of isotropic design matrices where there is no there's independence between the response and the covariates. The predictions for what happens to the Max L2 margin limit are due to Gordon are in 88 and these were subsequently regularized by Sherbin Andrews in 2003. But more recently, the paper due to Montenari et al and Deng et al studied these objects under more general covariance matrices and characterize their precise limits. So what's different between L1 and L2, it's just L1 L2 geometries are significantly different and the L1 case lacks certain important strong convexity type features that L2 has. So to rigorize the proofs that calls for certain novel techniques and new uniform convergence arguments but I'll probably not have time to go over those today. And of course, as you can imagine, when things, you know, things will be characterized to fix point equations here, as well as in the L2 case and we will obtain different fixed point equations for the L1. Okay, so now diving into into the formal setting. So I'm going to be under the usual high dimensional scaling limit where P by N goes to a constant and this will be the model plus minus, you know, the labels are plus minus one given some covariates. So let's skip over this condition on the signal strength. So we have three problem parameters. But we'll also be in the linearly separable regime asymptotically which basically means that this over parameterized ratio is above a certain threshold, which is a function of the signal strength that happened to. So what are the results we have we have a very precise characterization of this maximum L1 margin. And then that it can be related to, you know, a particular function which is a function of the problem parameters and this function can be explicitly pinned down. This function is also related to the MLE existence phase transition curve for logistic regression but I'm just going to leave that as a comment. So if we move over all kappa non negative and that this function is non negative over that set and this function we can prove that it is continuous and non decreasing so things are well defined. We have a very precise characterization of what this function should be but I'm going to skip that in the interest of time. This characterization itself sort of shows that what are the connections with certain earlier results in the context of, you know, separability of the data when you have logistic model or when you have a general F here. And then regarding the main L1 norm interpolant what we are able to show is you know one can characterize so this will be the generalization error of that estimator and we can characterize the precise limit of this object. YZ1Z2 are random variables which have a specific description, but what are these constants these constants together with another constant as star is going to be a unique solution to non linear system of equations. The equation is parametrized by your dimensionality, the ratio p over n and also the limit of your maximum L1 margin. And these constants are you know they have certain interpretations so C1 star is going to be the angle between the interpolant and the planted direction C2 star is the norm of the residuals of this quantity and s star can be used as Lagrange multipliers. And we can also show certain other properties of this main L1 norm interpolant, you know, which which can only be described through these constants. And now coming back to boosting what does all of this tell us in the past we knew these results about the number of optimization state the steps in the boosting path. So now what we're able to show is the following so we can choose an appropriate step size sequence such that for any epsilon. If we have the iteration time is above a certain threshold, then the boosting solution approximates them in L1 interpolated classifier up to error epsilon. And that can be characterized precisely through this form so Kappa star is the limit that we obtained for the maximum L1 margin. And this threshold has a precise characterization when NNP are both diverging in the particular high dimensional limit that I mentioned, okay and the maximum L1 margin limit shows up here as well. The first with classical results the classical upper bound was this and if we you know just plug in the limit instead of the empirical version, then this is the upper bound, the y axis is the ratio P over N. And for us the precise limit that we characterizes over here, the separability threshold is over here. So you can see that there is some gap, and this into asymptote as the size is increasing. And then again revisiting this result this also characterizes the stopping time precisely. And if we plot this denominator as a function of psi, then we see that this object increases a psi increases. So that says that when the you know the effective dimensionality increases then over parameterization increases then the optimization is faster and you converge to this mean L1 norm interpolant direction faster. And as an aside we can study some other structural properties of boosting as well. For instance, if you were interested to understand okay when when boosting reaches you know zero training error what does the boosting classifier look like, you know because it goes to an L1 direction soon after that. So you know it is expected to have some degree of sparsity. And so we can characterize that if you know we look at the fraction of non zero coordinates in the boosting solution at a certain time, you know, when it first hits the zero training error, we can characterize an upper bound on this object that once again it's related to this maximum one margin, and this upper bound shows that actually you know the solution is going to be quite sparse. And this is, you know, sort of the tightest upper bound we know that exists in the literature. Okay, so maybe I'll start wrapping up. Basically in this work what we try to do is provide precise characterizations of the maximum L1 margin of the male L1 norm interpolant and because of this subtle connection with boosting that let's helps us understand this algorithm much better than before so we can improve the existing bounds and provide precise generalization at our expressions and optimization speed. Our proofs from L2 to L1 the jump requires new uniform convergence arguments but once you can do L1 you can actually go to any LP geometry or proofs directly extend to that. And we can also talk of certain other you know data generating models. And there are many other perspectives and boosting which I didn't touch upon today but I hope that you know this helps understand you know these on some of the learning methods.  And you know this opens up doors to further questions and maybe I will just stop here. We have a we have a draft and archive on this work but we are sort of revising to include several extensions at this moment and I'll be happy to send that around for if someone is interested. Thank you.


Live from Las Vegas, it's theCUBE, covering AWS re-invent 2017, presented by AWS, Intel, and our ecosystem of partners. And we are live here in Las Vegas at the Sands Expo, wrapping up our coverage here. Re-invent, three days strong here going with AWS and a number of great partners within their ecosystem. One of those is Fortinet, and we're now joined by Matt Play, who is the VP of Cloud Carrier and Service Providers there at Fortinet. Thanks for joining us, Matt. Good to see you, sir. Good to be here. Thank you. Tell us a little bit about, you know, first off, what you do, as far as the company's concerned, and about your relationship with AWS. I know you're exhibiting just over our shoulder here, so this is a big week for you and for them. It's, I mean, the energy here is unlike any other event I've been to. It's fantastic.  You have to really be here to really appreciate it. So it's just been, it's my first show being here, and it's just absolutely, you know, great to see all the companies sort of collaborating, people getting together and working together. So from a show perspective, I mean, it's just fantastic. So we're just happy to be a part of it, and Fortinet is, you know, doing a lot of great things with AWS. I think our synergies are really well aligned. We have a lot of commonality in our DNA and our culture and history. So, you know, we love to, we're innovators, we love technology, and we really hang our hat on that. So as a security ISV, you can see, you know, the products, that's always important, right? The products that are involved in it, but it's really about the theory or philosophy behind it that we really, I think, we look towards to accelerate our partnership.  You know, when people come up, what are the most interested about? You know, what's been like, in your mind, maybe that overall theme or that recurring theme that you're hearing a lot from potential customers here. Yeah, it's really diverse. I mean, so it's not just one talk track, it's really a number of different points or elements or what's important.  So that's going to change things quite a bit. So it was really surprising to see, you know, some of our announcements this week were really important. You've had a big week. We had a great week. We had some really special things that we've been working on that got announced this week. You know, Forte Sandbox is on demand now in AWS and so that we're the only sandbox available in AWS. I think that's very compelling and that's a pretty useful thing. You know, the WAF rules, that was a launch yesterday that happened and we're part of the rule set. So you can take some of our rule sets, it goes out to our ForteGuard and forces it and then finally they became a fabric partner and so what the fabric really is for us is an ecosystem of products but not only our products, it's really about working with other collaboration partners but sometimes competitors and that's okay with us because we believe that that's the only really way security is going to be effective. Yeah, we were talking before and you were explaining some of the portfolio approach that ForteNet takes to security. Yeah, we've always been talking about defense in depth as being a thing that you should do with security and really there is no like once magic silver bullet that you can use. You have to have different tools for different use cases and you've got lots of different products that all work well together but they also work well with other products which is quite interesting, that fabric concept. Could you maybe give us a bit more color on what the fabric is and some of the portfolio products are plugged in. So to your first point, we have eight products in AWS and available and it's really about creating a security stack of enforcement because one product necessarily won't do the entire job you need it to do. So we have complimentary products, we have bespoke or pointed products. So we have, like I was saying, eight that's the most out of any other security ISV in the marketplace today. So that's I think a huge competitive advantage and really why that's important is that you really need to have a single pane of glass console to look at your environments. Statistics say around 65% of organizations or enterprises will have a hybrid environment. So kind of the legacy bespoke or the legacy traditional networks and then they're going to have obviously AWS instances and it's really important for security that correlation and automation to see across your entire network and footprint that you have. So really all the products to us are all the same whether you deploy them on-premise, off-premise, in the cloud, private cloud, public cloud really doesn't matter to us. It's all the same sort of look and feel for our products. Yeah, I am hearing from all the security people both on the vendor and on the customer side that I speak to that there is a real collaboration going on in security right now. And we were talking just before we went to air that the security has just blown up in the last sort of four, five years. What used to be a bit of an afterthought is now front of mind for a lot of customers. So they're using some of the products like Fortinet to be able to say, well, I want to solve this and this is something I need to do today but I also needed to work with other things that I'm doing. So it's interesting that Fortinet's chosen to take that partnering approach and particularly with something like the old relationship with AWS with the web application firewalls that you're doing. That's a real partnership approach where you're saying, well, we do something quite well but Amazon can use this to give us access to more and more customers. Is that part of Fortinet's core way of doing things? Has that always been that kind? Yeah, I think the history and sort of DNA of Fortinet it was kind of founded on let's do it ourselves, let's build it because we believe that we can build it the best. And so kind of through the generation of that, like you said, security is one of the things that it was sort of geeky and kind of cool and sort of specific. People didn't really understand security all that well but now it's headline news and it changes market cap literally overnight, right? We see that a lot in the news and unfortunately some nasty things happen to people's information. So if you look at that, our CFO said, talked about digital trust a number of years ago and it's really, you want to do business with companies that you trust. And that's so important. So when you give your credit card information or social security number, that's important, right? You want somebody to take, I think, caution when jotting down that information, right? So for us, we saw it as a competitive advantage because how it really started for us before the fabric was threat information sharing. So we have an initiative where we work with others in the marketplace who are security vendors to share our threat data and to make that more useful for companies because really that's what's going to win and sharing and looking at the portfolio, it really goes back to our ForteGuard platform. Everything kind of points back to that as far as the threat vectors, right? Yeah, you mentioned that there have been problems.  And that's kind of the point of the question I want to get out of here with you is in a way, I think from a consumer standpoint, we're almost desensitized a little bit because I've got here another one, right? Another breach, another problem. So I mean, what kind of mindset are you fighting in terms of you can have a thousand wins but one loss or a million wins, right? But one loss, that's another headline, that's another problem and it's another barrier for you, right? I mean, how do you look at that from a philosophical approach as a company and a mindset approach as a company? That's a great question, right? And so there is kind of this, I think in the industry, there's this consensus that it's not a question of if, it's a question of when. Absolutely. And so that's, I think a little hard to stomach, right?  Because you want to win them all. Right, yeah, you want to win 100% of the time and that's just the reality of life, right? Especially these, yeah. Yeah, of course, right? So, you know, of course, for us, we look at it as a layered approach, right? So, if you, I'll use a very simple analogy but I think it's sort of effective.  They're just layers to ensure that if someone comes by to look at your environment and they go, man, that's just too hard. It's too much work. There's cameras there. I can tell they have a dog. It's way too complicated. I'm not getting into that. And that's what security really should be. Security should be a multi-layer approach that uses complementary products that coordinate and work straight together and automate and those are really important things when it comes to security and keeping the bad guys out. So, you sort of want to have this security posture that just so many layers of defense that it's very hard to penetrate. So, when someone's thinking about what they've currently got in there and like looking at the threat model that they might have and they're looking at what their risk would be at the moment, how would you help customers to evaluate, well, what should I do next? Like, we were talking with someone else on theCUBE earlier today about, okay, you need to do the basics first. So, you need to brush your teeth. How do you help customers identify what is the locking your front door? What is the I need to buy a dog? What is the I need to make sure I've got all my windows locked? So, how do you help customers figure that out? That's a great question. So, always when we talk with customers, we evaluate their environment, right? Very bespoke and sort of custom tailored, right? That's very important to understand exactly what you're trying to solve. However, just like your credit score, we believe that there should be a security competency score, right? So, it's sort of an in-depth evaluation of your network, the holistic security posture, how that looks. And so, we're now offering that and our new platform to come in and offer sort of a security threat score, if you will, to say how effective we think you are. So, I think that helps. It's like a maturity model. What's that? It's like a maturity model. Yep, yeah. Exactly. I think that's going to help a lot of people make sense out of it and there's different parameters in how we report that back to our customers. That sort of makes sense. And then we say, well, we believe these products should be the products that you choose and this is kind of security posture you have.  So, you just have to have that layered approach. It used to be like it was a cost decision, you know, we're back at that. Now, reputations are on the line. You said market cap as you pointed out. I mean, the risks and the exposure and the damage is exponentially worse today than it was just three, four years ago, right? I think it even seems different from like six months ago. Yeah. You know, it's really insane to think that companies could disappear based upon what happens with that information. We don't want to be the ambulance chaser, right? That's not our philosophy, but it's about being protected and it's about being, I think, you know, with security, retrospectively going back, it's not all that useful. With security, it's better to kind of take the work and do it up front. And we believe that that's what's really changing in the market, that pivot to when you design a network, security is arm in arm with networking or, you know, in this case and AWS's case, you know, how you move workloads elastically to the cloud. I mean, those are all considerations now. And I think you see that in the marketplace and AWS's launch, like we said, in the WAF rules, I think that's one step closer to really marrying security with just the function of what you're trying to do in the cloud. Yeah, and it needs to evolve over time as well.  You have to start thinking about it in a different way. So hopefully customers are looking at things and looking at the portfolio approach and saying, okay, today I might need one product, but tomorrow I'm going to need, well, I'm going to need something else. I'm going to need two or three or four. And as you say, if I've got something that works, that plays well with others, then I can make a decision yesterday that, well, actually, no, I can still use this. I don't suddenly have to throw everything that I did a year ago to throw it all away and start again from scratch. Sure, absolutely. And that's the fun of what we do. Working in technology, it moves so fast. That's why we all do it, I think, because to be close to it and to be a part of it, I mean, that's why I get up every day. It's the coolest thing we get to do, right? And so because of that, you're right. We don't even know what's going to happen in 2019, right? I mean, think about the change in just one year's time. The velocity and what we're seeing that AWS is accomplishing in short periods of time, you really need to move quickly. And that's our commitment, absolutely, as a security company. I can say, unfortunately, you're busy, right? And fortunately, you're busy, but because the risks are greater, the threats are bigger, so all the more reason for the success that you've had, obviously, and continued success, we wish you that. And thank you for being here on theCUBE. We appreciate your time. Thanks for having me. Yeah, always good to see you. That wraps up our coverage here on theCUBE for my colleague, Mr. Warren, and all of us behind the scenes. Thank you for joining us here live from AWS Reinvent in Las Vegas.


Updates long overdue, and I mean really long. I will make dedicated videos for some of these updates, but I want to get through them very quickly right now to catch you up. The biggest update is YouTube networks drop thousands of creators as YouTube policy shifts. It was revealed in this article, the link is down there in the description below if you want to read it yourself, that there is a new MCN 50 count that is written right here. The way this is enforced is that if a network has more than 50 abuse events, an abuse event is when a channel is terminated or loses their monetization privileges or gets suspended from the YouTube partner program. In 90 day period they lose the ability to partner any other channel for a period of time. Now, I thought this was secret only for MCNs, but it got leaked. This 50 count is why all MCNs are unlinking lots and lots of channels and creating all this negative emotion around, why am I unlinked? So that is why I hope you can understand we are being very careful about unlinking channels that we feel have a chance of getting closed because there's a 50 count. And that 50 count may change. It won't go up, it may go down. So please work with us and help us understand when we make mistakes on linking channels, tell us why we made the mistake by emailing support at freedom.tm. In Freedom News, we just sent you $2 million a few days ago for all your hard work in February and March. And in case you didn't get paid and thought you should, check your shiny Freedom Dashboard for a catch up button. Click it if you see it. We send catch up payments daily for people who didn't give us their PayPal email in time or had another issue receiving money. That's how the catch up system works to get you paid. Click that I to learn more. We released our first sync album from Music Factory. This is the concierge quirky tracks that we have professionally mastered. And I'll tell you about that in a dedicated video. The link to this is down there in the description below in case you want to listen to it. The short version is this mastering process creates stems that allow any person who purchases our tracks for sync to customize it for their needs. And I'll play a clip. That was the sync version of this original song. We trained all of our full-time composers on how to compose music that's suitable for sync. And we're creating Music Factory as a new catalog with all the previous tracks we've had as Music Factory Legacy. More on this soon. For Crypto Family we have a few finalist logos for you to help us decide based on your feedback which one we should use. This is one that has the togetherness of the Crypto Family with the C wrapped in the C. This is a much simpler, whoa I gotta get myself out of the way. This is a much simpler logo just a letter C with a beautiful gradient and the font Crypto. Then we have the same in different color. The same with an extra dot for some variety that represents the world and all of you. Different coloring. Again different coloring and yet again. We also had this concept where the dot is connected to the C to show more of working together as a family. And then in black and white. We also tried the Crypto logo to look exactly like the Freedom Family logo. This is Crypto in Freedom and right side by side so you can see the comparison. And we tried different variations on the C. What do you think? Tell me down there in the comments below and why you prefer the one you're choosing. Shroud of the Avatar finally launched. This is the game by Richard Garriott the guy who created Ultima and Ultima Online remember him? This is his latest MMO under his company Portillarium. How many of you have heard of Sota Shroud of the Avatar? Tell me down there in the comments below if you're playing it and if you like it. Civilization 6 also launched a new expansion called Rise and Fall. How many of you have tried it? If so tell me down there in the comments below if it's a fun game because I really haven't had a chance to play it myself yet. Okay George good updates but let me ask you the most important question. Why haven't you been making videos? That's what I'm assuming many of you are thinking. Guys I am sorry for not making videos lately. And the reason I haven't is because we are in the process of negotiating a new game acquisition. This is a game studio that has already released two games and they're in the process of building a third game. If this deal goes through we will have a brand new team to work with and welcome to the Freedom Family. And we will have a professional game development studio that's already published games working with us. Is that exciting? I'm really excited but let us see how far we get before we can announce more. We have three other game projects that I will tell you about soon. One we already have it's done. It's a simple browser based game and we are going to improve it with a level editor that you will be able to contribute content and levels to. More on that soon. We also wrote a 50 page game design document describing another browser based game that we are planning to build soon. I'll tell you more about that. And we have a team that will soon begin building a .io game that all of us will be able to play together as a family. Those are some of the exciting updates from MGM Studios, our new game development division of Freedom. In case you missed it click that I to see the introduction from our new head of MGM Studios Dave Frackia talking about our goals and how we can involve you in the game development and gameplay process. And we are crafting a new mission statement for Freedom. How does this sound? Tell me down there in the comments below if you like it. Do you have other suggestions for words or phrases we should use? Tell me down there in the comments below. So who am I? I am long overdue Papa George who hasn't been making videos but wants to. I am George CEO and founder of that thing. Freedom for Freedom and the Freedom family. And I promise to make more videos on a regular basis soon. In the meantime visit our community forums, our Discord chat servers and all the other places that we can interact together with you. Links to everything are down there in the description below. And the most important lesson for all of us is never give up. With all these challenges on YouTube and all these new career path options that we want to create for you. There's going to be a lot of opportunity to grow, a lot of opportunity to make money and build new careers that we hope will become lifelong pursuits of passion and excitement for all of you. Let's see where this road takes us guys. George, you've been watching. Click that I to partner with Freedom and join the Freedom family so we can all grow together. You get many perks like position music, you also get epidemic sound, a lot of other access to royalty free videos, sponsorships and many things to help you grow. Just click the links down there in the description below to get involved in our community, our forums, our Discord chat servers, meet our graphics team, meet our community team, all of that on Discord and the forums. What are you waiting for? Get started. And we will grow together as a family because this is the Freedom family. You are part of it, we are all part of it and we're all growing together. To get more George, click that big F that will subscribe you to Freedom Central, home of the George show. PewDiePie gave one of you, Freedom Family, a big shout out. Click that video to see the shout out and to see our new 3D sets for you and click that video to see what YouTube recommends you watch next.


You get the 10-year note trading up 10 ticks at 1201, the 30-year up 16 ticks at 122.16 and we have the 10-year right now, it probably just snuck back under 4 again. Now, oh look at that, 4.000 and King Dollar, King Dollar is down 195 ticks, trading 102.217 euros at 109, he ends at 144, British Piles at 127 to 1 US Dollar. But you don't even take a look at the spy and there's no doubt, you get percentage action out here. When you take a look at the Dow's up 3.10 to 1%, S&Ps 1.1 and the NASDAQ got 2%. Now we go into the spy first, we take a look at the spy, you know, and one day, you know, spy hit a load today of 468, they rejected it, it's at 473, that being said though, you know, we came down with some volume and we're going up with tremendously lighter volume, yeah, we're coming into like 122,000 shares, 122 million shares rather, sorry, 122 million shares and we're doing 45 million, but you know, as the price spread going, this is saying we're going to the highs once again, that's how it's also set up. We go to the Qs, we take a look at the Qs, same set up inside the Qs, you know, Qs have a little bit more volume also, bottom line though, that's saying also this thing wants highs, Qs are up $7.64 right now trading at the 404 level and then we get over to the dollar again and we have with the dollar, the dollar's having a hard time holding price and that 99, 500 is wide open, meaning that's where it looks like it wants to go, you know, so Friday, you know, you went to higher and the dollar gave it up on price, today you try to go higher again, gave it up on price, stay right there folks, come right back.