So, we have been looking at differential algebraic systems or DAEs and in my last class I gave some examples of semi implicit DAEs. We also defined what is called as index of a DAE. So, we have been looking at semi implicit differential algebraic systems. So, these can be written as dx by dt. So, these equations are typically written by this coupled differential and algebraic system of equations. So, this is 0 vector and x typically we call as differential variables and z we call as algebraic variables. So, these are differential equations which have to satisfy certain algebraic constraints and not all the variables appear with their derivatives ok. Very very common situation in chemical engineering models in chemical engineering unit operations. So, you have algebraic constraints which typically define the phenomena which are occurring at a very fast time scale whereas, the differential equations would represent phenomena which are at a slow time scale. So, in a distillation column for example, this would be thermodynamic equilibrium and this would represent dynamics of compositions temperature on each tray ok. So, we also looked at what is called as index of a semi implicit DAE. So, index is minimum number of times you have to differentiate this equation to get into minimum number of times you have to differentiate to get into a system of pure ordinary differential equations. Now, remember this is G here and I am writing another symbol here S which means that when you differentiate and get a new system of equations this would be different ok. The new system will not will be some function of G of course, but it will be different. Now, we will look at a specific example and then understand this. Last time I talked about a mixing tank example. So, this was a simple mixing tank ok. So, this was the example that we looked at dc by dt is equal to c naught minus ct by tau and c of t is specified that means, beta t is a known specified function ok. So, this is my G of Z and G of Z and X. Now, note one thing here this the first equation contains both algebraic and differential variable that means, see what is the differential variable here c ok. Algebraic variable by you know it is a semi implicit di algebraic variable will be c naught t right algebraic variable will be c naught t. Now, the second equation does not contain does not contain the algebraic variable and this can be a troublesome part. The second equation does not contain the algebraic variable you can get into difficulties while solving. Because, ct the algebraic constraint is an implicit is a function of you know is an implicit function of c naught t and the first derivative here with respect to c naught t is not equal to is not is equal to 0. So, is not non 0. So, we have a problem what is the problem I will just elaborate that. So, this simple example actually turns out to be an index 2 system ok. Let us go and see why this is a index 2 system. So, what is G X G? G X G corresponds to ct minus beta t right. Now, if I if I differentiate this ok if I differentiate this with respect to time then I will get dc by dt minus d beta by dt is equal to 0 ok, but beta is a specified function what is dc by dt? dc by dt if I substitute from here I will get c naught t minus ct by tau beta prime t is equal to 0 this is still an algebraic equation we have not got a differential equation yet. Because, I could substitute for dc by dt in terms of this ok I could substitute and. So, I still have an algebraic equation I want a differential equation ok to get a differential equation I will further differentiate this ok. So, from this what we get is c naught t is equal to tau beta prime t plus ct. So, I just rearrange c naught t is tau beta prime t plus ct and then I can now differentiate this I want an algebra I want another differential equation which is now look at this equation I finally, have eliminated algebraic constraint I have one differential equation in c another equation differential equation in c naught t ok. So, now this this is my this is my S of x z in fact, S of x z and t of time because beta double prime comes ok. So, this is my system with index 2 I had to differentiate twice to get to get a set of consistent differential equations first order differential equations. So, how will you use this index business will come to that soon ok. Now, what is the problem why do we have to worry about why why is it important to have index now let us look at this particular problem well when you have a high index system there are two difficulties one difficulty is that it is difficult to specify or it is tricky to specify I would say the initial condition what you will notice is that c naught t cannot be arbitrarily specified for a pure differential equation which is not coming from an algebraic differential equation ok. You can specify initial condition arbitrarily and see evolution in of course, the initial condition should make sense from the physics, but once you specify initial condition with that makes from sense from the physics you have a unique solution as long as dou f by dou x is differentiable and. So, we had talked about this continuity right in the beginning about existence of solution those things are not true here because of the algebraic constraint particularly for index higher index systems there is a problem. So, there are two problems now let us see where this the problem come from let us look at let us look at solving this particular set of equations using implicit Euler. So, implicit Euler would mean that you know x n plus 1 is equal to f x n plus 1 I am just dropping for the sake of convenience the time argument and sorry this is my implicit Euler would be this is my implicit Euler this is my I have to solve these two equations simultaneously or rearranging this you know you can write 0 equal to. So, you have to solve these two equations simultaneously if it is implicit Euler and if you are solving it using Newton Raphson for example, if you are solving it using Newton Raphson then you will get this matrix Jacobian matrix when you are trying to solve this using Newton's method these two coupled algebraic non-linear equations using Newton's method you will get this matrix this is Jacobian matrix that you know that you that you have to compute during each iterations if you rearrange and then differentiate you will get this now the trouble is with this dou g by dou z if dou g by dou z if this is equal to 0 then you have trouble solving this problem when h goes to 0 for small h if this is 0 you can land up into trouble. So, this the nice thing about index 1 systems is that dou g by dou z is not equal to 0 ok we saw that flash example in flash example if you write algebraic constraints and if you differentiate then you can show that dou g by dou z is not equal to 0 and then you can solve that problem simultaneously and get the get the solution without a difficulty in this particular case dou g by dou z 0 because if you look at here if you look here this is g of this is my g of x z that the differential variable only appears in g of x z algebraic variable does not appear. So, dou g by dou z is equal to 0 and then because this is a high index problem here this is my this is my g of c t c 0 t and obviously, c 0 t does not appear here. So, dou g by dou c 0 t is 0 and then that is why that is why you have a problem here. Now, what is very very important is that when you have a high index system this dou g by dou z should be when you have index one system dou g by dou z is not equal to 0 you can solve it for high index system ok. If you want to solve it it becomes very very crucial then to be able to specify the initial condition properly if you are not going to give the initial condition properly your solutions can diverge ok. So, I will just continue with the same example ok yeah we have to use. So, the solution is when you have high order system high index system ok you should actually differentiate multiple times go towards and then you solve simultaneously all the I will come to that. So, but now you realize there is one more thing you should realize now you should be able to find that thing using automatic differentiation. See now for simple 2 variable 3 variable thing ok I can find the index of the system by you know by hand differentiation and I can say this is order second index 2 system index 3 system index 5 system may be up to 5, 6 variables, 10 variables you will do lot of hand calculations and do it. If you have 1000 equations which is the case when you are simulating a chemical dynamics of a chemical plant section of a chemical plant you have trouble right because how will you decide the index you should automate if you want just given a set of equations you are not able to see what is the index. So, you should have a procedure that automatically differentiates and calculates the index and then does appropriate initialization ok. So, unless you do that you are going to get into trouble ok. So, I will illustrate this and then give the solution which is he has very rightly guessed that you know you should use those differentiated equations to develop what is called as consistent initial condition. But just to show what can happen if the initial condition is not consistent see this is. So, c 1 minus c 0 I am just using for this particular system I am just using the implicit Euler let us say my h is my this is the way I will use implicit Euler for this particular system on the right hand side at time 1 right I am going from 0 to 1 at time 1 ok and then other equation that I have is c 1 is equal to beta 1 right 1 is 1 is you know 1 here means t is equal to h that is what we mean by 1 in our notation of time we have taken t n is equal to n h. So, we use n right to denote the time it is a shorthand notation that we have. So, this c 0 is actually c h minus c 0 ok. So, these are the equations at the first iteration the very first iteration these are the equations ok. So, after you rearrange this you will get c naught 1 is equal to ok. Now, what happens for this equation to be consistent see what will happen with when when h when h goes to 0 this beta 1 will actually tend to beta 0 because h is you know step time from you know ahead of time 0 if h goes to 0 ok what we require is that if h goes to 0 for this equation to be consistent ok we will require that beta 0 is equal to c 0 we have to make sure when you start solving the equation that initial condition for c 0 is given as beta 0 ok. If you do not if you do not obey this constraint and start your integration ok integration can blow up ok. So, giving a consistent initial condition is very very important for a differential algebraic system extremely crucial ok particularly the high index DAE systems ok. Now, what do you do to deal with how do you deal with this problem for high index systems how do you generate consistent initial condition for a high index system no no no see beta 1 will tend to 0 as h tends to 0 as h tends to 0 ok 1 will tend to 0 right because see what is what is the meaning of 1 see this is actually t equal to h as h tends to 0. So, the initial value has to be given correctly you cannot arbitrarily see in a normal differential equation you can arbitrarily give c 0 and it will work here the constraint has to be obeyed that c 0 is equal to beta 0 if it is not obeyed you get into difficulty ok. Generation of consistent initial condition for a differential algebraic system now this is a key thing particularly for the high index systems ok. So, what you do is you write this so we define a variable y or vector y which is actually the x and z stacked up and then we translate this to some h of y y prime t equal to 0 ok. We translate this to y y prime t equal to 0 let p correspond to the index of d a e ok then we differentiate this p times which means. So, this is this is f y y prime t equal to 0 then d f by d t which will which will obviously have y y prime y double prime equal to 0 and so on up to you differentiate this up to p times ok and these are known as derivative array equations y p plus 1 p here means the order of the derivative f prime yeah p plus 1 sorry p plus 1 not p minus 1. So, these are these have up to p plus 1 derivatives of y ok. So, these are called as these are called as derivative array equations and to generate consistent initial conditions we have to solve these equations simultaneously ok. So, higher index system why it becomes difficult to deal with is because you have to solve these equations together to come up with a consistent solution. In fact, if you solve it at time t equal to 0 you will get consistent initial condition if you solve it any time in future at t equal to h t equal to 2 h t equal to 3 h if you solve these equations together you will get solution of the d a e ok. So, if you know the index of the system you can differentiate stack the equations together and then solve the stacked set of equations to come up with a consistent set of initial conditions as well as you can solve them in time and then you will get consistent solution of the d a e high index d a e ok to summarize. So, I think what Vishal was you had guessed right that you have to solve them together that is the solution you have to solve this differentiated equations together to get a consistent initial condition and of course, there is one more way you can go on eliminating high order you can go on eliminating high order derivatives and finally, you can convert it into a form which is called as pure od plus state n variant I will just mention the form and then solve that that is another way of doing it. But solving it at t equal to 0 will give you consistent initial condition ok. So, derivative array equations you have to solve you can you can see that why doing this automatically becomes difficult. So, developing dynamic simulators even though we have very very advanced computers and even though we have lot of knowledge now about solving large scale equations dynamical systems it is still something which is a difficult task because you have to do this business automatically if you look at some of these commercial dynamic simulators they do not ask you to specify what is the index of your differential algebraic equation. Obviously, when you are giving all kinds of constraints on the you know a heat transfer mass transfer thermodynamic equilibrium and the dynamics associated with each of the units you are not expected to know as a chemical engineer what is index whether this is high index system or so you have to automatically internally find out what index it is differentiate and create a stacked set of equations which you can solve. So, generating consistent initial conditions or use some other way of generating consistent initial conditions generating consistent initial conditions such that in consistent solutions is a is a big task is a difficult task and if you make a mistake there things can go wrong. The other approach is to reformulate I think I will again move there because I want these equations. So, the other approach is that you know other approach is that this derivative array equations then can be written in this form this is a pure ODE and this is a algebraic constraints. So, you can reduce by eliminating higher derivatives you can go on eliminating higher derivatives now this business might be pretty difficult for a very large system of equations, but for some simple systems you can obviously do this by eliminating derivatives we just now did this for the you know this mixing tank example we eliminated higher derivatives and so on. So, you can reformulate it like this and then solve it using a DAE solver which is so these are called as state invariants these are called as state invariants and and then you then you try to solve this set of equations using a DAE solver. So, with this I want to just close this very very brief introduction to differential algebraic systems my intention was to give you a flavor of what it is beyond you know just differential or just algebraic systems in reality you get always a mixture and then solving it simultaneously is a difficult task it is not that easy ok. So, you need to develop expertise in solving these and beyond the point as I said working with numerical methods and solving a problem becomes an art it is not just the mathematics it is you learn lot of tricks of the trade which everything is not written in a book and cannot be written in a book. So, for example, you know when you start solving problems you will learn that making variables dimensionless or scaling the variables all the variables helps improving the numerical accuracy or stability of the algorithms. If I have set of let us take a distillation column you know you may have pressure composition temperature appearing in one huge vector ok pressure might be you know Newton per meter square 10 to the power 5 something temperature is in you know Kelvin's 300 and concentration is in fractions mole fractions then you know you have a trouble in numerical integrating such things because the vector has imbalanced you know numerical values. So, it helps to scale them on a similar scale and then work with the scale variables and these things are something which you have to learn by experience ok these things unless you are hit by a situation where everything is fine and you do not get a good solution and you have to start thinking about now what to do. So, that is where you start thinking making dimension defining dimensionless variables and all kinds of other tricks. So, you just it is not enough just to know the mathematical background it is also important to know all these tricks which you can learn only through experience and as I keep saying in every of my instance of teaching this course is that the good part is that it cannot be automated you know that is why we are in business we keep getting jobs you know because you have to know some tricks and that is where the that is where you know you can still otherwise you know MATLAB or some software would be sufficient to solve all these problems. But even though you have very very sophisticated solvers and softwares and you still need chemical engineers who know numerical analysis to go and you know make fixes or make things work that is because everything is still you cannot automate it you have to have some kind of human intervention tweaking or chemical engineer intervention just make the problems solvable. So, let us have a quick look at what all things that we have done in this course I would like to summarize this course by saying that it is not a course on computational or numerical methods but it is a course on numerical analysis. We learn to do analysis here than just learning the methods if the aim was just to make you learn methods I could just go on writing recipes and you know you will not see the threads that connect them and then it just becomes you know you memorize it and forget about it after some time. The reason for developing it as a analysis course is that you should remember the you should understand the fundamentals behind how numerical recipe is concocted or is cooked or is developed and then you should have this confidence of coming up with a new recipe if you are encountered with a new problem. Every problem will be different every problem would require different way of thinking which will not be given in any of the numerical methods book because real problems are very very complex you will have partial differential equations differential equations you will have algebraic equations all coming together it could be partial differential equations in time and space some algebraic equations because you are lumping and saying that the spatial variation is not important okay you know and some algebraic equations because of some constitutive laws or thermodynamic equilibrium and so on. So you have very complex system of equations which you have to solve and solving mathematically modeling and solving it is becoming very very popular in industry in academics in research everywhere because you know you can do an experiment without actually having to go to the you can do a virtual experiment you can develop a model play with it understand how the model behaves hopefully the model at least represents in a respectable way the reality and then if you learn something from the model you know when you go and design your experiments or design your equipment or do control of a system you will have some a priori knowledge about how to go about doing it okay that is what we hope when we do modeling and so modeling is becoming very very important tool and then to develop models you should be able to solve them and get some reasonable solutions which make sense now most of the models that we encounter in chemical engineering cannot be you know the solutions for under different situations cannot be constructed analytically though we do study a lot of methods for analytical constructions of solutions that is more to look at some idealized problems simple situations okay and of course analytical solutions typically which you can find for linear differential equations or linear partial differential equations they give you a lot of insights they help you understanding how things behave they also help you numerical analysis to benchmark your approximate solutions to see whether approximate solutions are close to the two solutions so there are different ways where you can use analytical solutions and in some simple situations analytical expressions can be generated but even if the differential equations partial differential equations are linear not that every time you can generate analytical solutions if the geometry is nice okay if you have cylindrical you know some thing more which can be modeled as a cylinder or it can be modeled as a perfect you know sphere or some cube some nice geometry then you know it's easy to solve those problems but if you have some weird geometries even if you are linear partial differential equations you still have to go for numerical solutions you cannot construct analytical solutions with some weird geometries and the real problems are with weird geometries okay so computational modeling or computational fluid dynamics very very important part nowadays in design of chemical systems now the way we looked at it the difference about this course and most of the other books which present a course on numerical methods for engineers is that we did not we did not look at the methods based on the types of equations we looked at methods from the viewpoint of tools okay so the basic idea was that you have from a real system you develop a mathematical model this mathematical model typically would be you know algebraic equations or non-linear algebraic equations or ODE or PDE some kind of some kind of you know some kind of algebraic differential partial differential or their combinations that kind of an equation typically for the situation for which we would like to study this this coupled set of differential algebraic partial differential equations cannot be solved analytically unless very very rare situations okay so then we said that this we have to transform the problem so we spend a lot of time in understanding how to do problem transformation so using approximation theory you get a transform computable form this transform computable form in terms of its structure could be completely different from what you started with you may have started with a partial differential equation you might get you know algebraic equations non-linear algebraic equations so what the transform problem could have completely different structure from a mathematical viewpoint than the original problem okay what you end up solving is the transform problem typically and not the original problem except for some very very rare situations where analytical solutions can be constructed okay now then we said that to solve this transform computable form we only have you know three or four tools so one tool that we said is solving linear algebraic equations so solving ax equal to b this is one tool so this tool is used then the other equation or other other tool which is very commonly used is solving non-linear algebraic equations so this is f of x equal to 0 okay then the fourth tool third tool is the third tool is ODE IVP solver so this is my third tool and the fourth tool that we did not discuss would probably form part of a advanced course stochastic methods okay random sampling based methods so we have three or four tools it's like you know it's like you are a doctor with you only have three or four tablets with you and you have to create a concoction you have to create a recipe that will cure the patient so you have to use some combination of these four tools okay and then what you get finally is approximate now is it sufficient that these four tools are with you it is not okay you also have to give inputs if I think in terms of another input that goes is to solve a problem you have to have some engineering insights insights from physics chemistry thermodynamics whatever because you have to give good initial conditions which make physical sense okay so this component cannot be ignored this is in fact the most vital component it is not enough to have these four tools you should know limits of these four tools you should know about you know things like stiff differential equations you should know about you know ill conditioned problems and well conditioned problems and condition number and eigenvalues and a relationship to convergence and so all this all this analysis that we looked at should be there in the back of your mind when you are solving these problems one of the focus of this course was analysis we looked at how to do convergence analysis how to use eigenvalues particularly for solving linear algebraic equations iteratively we could use you know the theory of behavior of difference equations linear difference equations and understand under what conditions the error will go to 0 same same you know theory of linear difference equations qualitative behavior of linear difference equations based on analysis of eigenvalues also came to our help when we looked at you know different numerical solvers for OD IVP we looked at convergence of error between the true solution and approximate solution when with it and how do you choose integration step size all that was you know analyzed using linear difference equations okay so these are these are tools that help us well for Newton's method I just touched upon contraction mapping principle no we could not go deep into it so the idea was to give you flavor okay I it is not possible for this this is a course that would prepare you for research it is a course that is between your undergraduate course and an advanced course really advanced course it is somewhere in middle okay what we are doing is a course which is pitched in middle where you know you are introduced to various things like sparse matrices sparse linear systems then how you can speed up your calculations finally we came to you know combine things like differential algebraic systems together and what are the complications okay now things like solving partial differential equations boundary value problems all was dealt by approximation theory okay if I if I go back and see what is what plays most crucial role in this is how do you approximate what are the tools for approximation Taylor series approximation then collocations or interpolation polynomials okay or interpolating functions in general and these squares polynomials or v square functions v square approximations now what is the origin origin comes from we are Starr's theorem that any any continuous function can be approximated with arbitrary accuracy using a polynomial function of a suitable order okay so so this this one idea which was discovered more than a century back you know it actually forms the seed of what has happened later on okay entire structure actually critically depends upon this fundamental idea so basically we cannot really solve most of these problems exactly we have a real system there is a level of approximation when you develop a mathematical model a lot of simplifications when you approximate reality using mathematical model okay the mathematical model that you construct and situations that you develop again you know you cannot solve them exactly you have to further approximate if you want to compute numerically when you are computing them numerically there are further difficulties there is an error committed when you go from reality to the mathematical model from mathematical model to the computable form because typically you we looked at these different spaces associated and we said that the original problem is typically in the infinite dimensional space you are approximating using a finite dimensional approximation so you have limitations so there is a lot of error committed when you approximate problems in infinite dimensions with problems in finite dimensions because finite dimension problems are computable further when you solve using computer computer has limitations you cannot represent every number in the computer it has a finite precision whatever bits you use 128 or 256 you have a limitation at some point and then that's where there are errors coming because of limitations of your computer okay so what you actually want to do and what you finally see there is a lot of difference you have to use this part this is the most crucial part which i cannot teach in the class this you have to develop by solving many problems using all these theory using the analysis which i taught you unless you start using it you know it's like you have been given tools if you don't keep using them then they don't remain sharp you know and then you will not understand why so hopefully you know you understood why behind most of these methods and then you'll be able to carry it with you and so it was enjoyable teaching this course for your class and i hope you have learned something so with this i would like to close this course on numeric analysis just remember this entire diagram and don't forget what is most important is your engineering insights and physics which you cannot forget all these are tools which will help only if you give correct initial guesses only you make correct choices there is no unique way of solving a problem okay each one will come up with a different recipe or different concoction you should have confidence to make a new bilpuri when or a new concoction okay when a new problem comes that is important that's what i wanted to learn through this course


Both blind and trapped, and one of you is hanging by your knee because of the other two. They're really good at keeping up with you. They're the best to be a couple.  But they have to be there when you're done. And then the other person needs to be to know that when she lets go, when she finds herself there, there's a power to change her life. And you can't just do what's best for you. You have to keep doing what you're practicing and you need to practice it. And realize that you are really good at it. And when I talk to you, I think it's really easy. And I think it's just that too. It's not like a blind person. God didn't choose to see that. They just, you've done this, you've practiced it. You know, each other, you start working on it. And our hands are going to be dry. And so they don't go through what they want to do. They just try to do what they want to do and try to do it. And I, unfortunately, don't know what it sounds like. So I see the power to change your life. Now, I'm on this to theHD. I'm on this to theHD. She's... She says, the temperate part is going to be a little way away from... It's going to be a little way... He told me that the temperance was my advice. The temperance was my advice. The temperance was my advice. But your advice to the monster is going to be the temperance. My advice is going to be the temperance. Would you please join me in a moment of centering silence? The ring hymn is 1029. Good morning. Welcome to the First Unitarian Society of Madison. This is a community where curious seekers gather to explore spiritual, ethical, and social issues in an accepting and nurturing environment. Unitarian universalism supports the freedom of conscience of each individual, as together we seek to be a force for good in the world. My name is Dorit Bergen, and on behalf of the congregation, I would like to extend a special welcome to visitors.  Newcomers are encouraged to stay for our fellowship hour after the service and to visit the library, which is directly across from the center doors of this auditorium. In your drinks and your questions, members of our staff and lay ministry will be on hand to welcome you. You may also look for persons holding teal, stoneware, coffee mugs. These are FUS members knowledgeable about our faith community who would love to visit with you. Experience guides are generally available to give a building tour after each service. And I will say that it's a little unclear if we have one now. But if you would like to learn more about the sustainably designed addition or our national landmark meeting house, please meet near the large glass window on the left side of the auditorium right after the service. We welcome children to stay for the duration of the service, but if a child needs to talk or move around, the child haven or the commons are good places to retire. The service can still be seen and heard from those areas. And speaking of noise, this would be a good time to turn off all electronic devices that might cause a disturbance during the hour. I'd now like to acknowledge those individuals who help our services run smoothly. Our sound operator is Mark Schultz. Finally, minister is Ann Smiley. Your greeter was Lynn Scoby. Usher's are Helen Dyer, Douglas Hill, and Ann Smiley. And coffee is being made for us by Jean Hills and Rick DeVita. Please note the announcements on the red floor's insert in your order of service, which describe upcoming events at the society and provide more information about today's activities. And I have three special announcements. Did you know that there are 118 teachers in our children's religious education program? These amazing FUS members give their time, their energy, and their talent to nurture our kids and help us grow our community. This month, we're showing our love for our teachers. On the bulletin board in the commons, if you'd like to thank a teacher, please walk over to the children's religious education table in the commons after service and add a thank you note to our bulletin board. Our ministerial intern, Eric Severson, will be leading services only three more times before his time with us ends in May. He would like to include more voices and be creative with those services and is looking for people, young and old, to help him. If you would like to do a reading or a little theater, tell a story or sing a song, please let him know by phone, email, or in person. Today's video interlude includes some rapid-fire rap lyrics, which are included as an insert today in your program. Eric would prefer that you look over the lyrics before or after rather than during the video so that you can appreciate the visual images as well. Again, welcome. We hope that today's service will stimulate your mind, touch your heart, and stir your spirit. Thank you to our musicians this morning. Our opening words are by Jessica Purple Rodella. Listen, listen to silence, listen to the wind, listen to the stars, hear trees, dance, dance to the beat of your neighbor's heart, dance to the rhythm of your childhood dreams. Sing, sing and hum a wordless tune to the song of your rushing blood and pray. Pray with a fever that makes you sweat through February snow. Pray with a fervor that gives you chills in July.  Howl to the sound of your soul touches clouds and haunts the moon. Come, let us howl our hallelujahs. Come, let us pray and sing and celebrate. Come, let us worship together. I invite you to rise in body or in spirit and join in the words printed in your bulletin for our chalice lighting. We are the certain and the seeking, the lifers and the newcomers, the beloved and the broken-hearted, the insiders and the rejected, all of whom have found home in the extraordinary yet intimate communities of unitarian universalism. And whether you are certain or seeking, I invite you to say hello to your neighbor. And if we have anyone young or young at heart that would like to take part in a story, please come forward. Good morning, everyone. Today's story is going to be a bit different. We're going to tell a story together. Yes, it's true. I think we already have more people than our questions. So here's how it's going to work. I'm going to start a story and we're going to get to a part where I need an answer. We need to fill in a question and I'll go like this. And you guys raise your hands and I'll pick somebody for an answer. We're going to go, there's a lot of that. So we're going to build our story as we go along. When you give an answer, our volunteer is going to give you a sticker. So once you have a sticker, keep your hands down and let somebody else answer. Okay, that might be hard to do, but let's try to remember. And then at the end, we'll make sure everybody has a sticker. We'll make sure. So let's begin. Once upon a time, there was an animal. What kind of animal? There was a cat. Once upon a time, there was a cat. And the cat's name was, the cat's name was Momo. So we, once upon a time, we have a cat named Momo. And Momo lived, where did Momo live? Momo lived in a barrel. And the cat Momo lived in a barrel with, who did Momo live with? Momo the cat lived in a barrel with a cow named Penny. Oh dear. That sounds uncomfortable. So the inside of the barrel smelled like something. So the inside of the barrel smelled like bananas. So let me see if I got this right. Momo the cat lives in a barrel that smells like bananas with a cow named Penny. Thank you. So this barrel is surrounded by something. What was it surrounded by? By sand. So the barrel is surrounded by sand. So Momo and Penny, the cat and the cow, live in a barrel that smells like bananas in the middle of a desert, maybe. Well every day, Momo and Penny had a special day. And what day was that? They had a birthday. Every year, Momo and Penny had a birthday. Let's say they shared a birthday. But in order to celebrate a birthday, you need something. What do you need to celebrate a birthday? You need a celebration. What do you need to celebrate? What kinds of things do you need to celebrate? Candles. Yes, you could say we need candles for a cake, maybe. So Momo the cat and Penny the cow lived in a barrel that smelled like bananas. They had a birthday every year, but they needed candles. And the only place to get these candles was where? Was the grocery store. And how far away was the grocery store? Who hasn't answered yet? It's 200 miles away to this grocery store. And how long does it take them to go 200 miles? Infinity seconds, that sounds really hard. Yes, that's right here. How long did it take to go 200 miles? It went a cat? Huh, it went a cat. How long in time? How much time did it take to go 200 miles? Three seconds? Okay, there's consensus. Three seconds to go 200 miles. So Momo the cat and Penny the cow live in a barrel that smells like bananas in the middle of a desert. They have a birthday every year, but they need candles and they have to go to a grocery store 200 miles away in how many seconds? Three seconds. Wow. So that's a quick story. That's a quick journey. So let's see. They go to the grocery store and they see the candles in the grocery store, but there's something in the way. What's in the way? There's bread in the way. Wouldn't you know it? There's always bread in the way. So let's see. They put their heads together, Momo and Penny, and they came up with a plan. And Penny did something. What did Penny do to get the, Penny ate the bread? What a great solution. So while Penny ate the bread, Momo went and got the candles. And finally, after a lot of hard work in three seconds, 200 miles in three seconds, they got the candles for their birthday and they made their way home. And when they got back home, they were greeted by plants. They were greeted by plants. How beautiful to be greeted by plants in the desert. So they, they got home, they were greeted by, by plants. Momo, the cat and Penny, the cow and their barrel that smelled like bananas. They had the greatest birthday party ever. The end. Thank you all for sharing your story. If you did not get a sticker, see our volunteer right here. Thank you all. Let's go to class. I appreciate this opportunity to speak to you briefly about our upcoming annual campaign. In 1976, I walked into the landmark auditorium on a Thursday night looking to join the choir. I'd never heard of Unitarian Universalism, but I had heard that the FUS Choir accepted non-members. Now I had been raised a devout atheist. It didn't occur to me that joining the choir would mean attending religious services. By the time that Penny dropped, I was enjoying this singing so much that I decided to give the services a shot. After all, I was quite sure that I would be impervious to any potential attempts at conversion. 41 years later, this community has come to mean more to me than I could have imagined back then. It has given me a place to grow in loving-kindness toward others and towards myself, to continuously engage with many of life's most important questions, to join with others in giving service, in celebrating, in mourning, and in learning. I want our congregation to continue to thrive and to be a voice for justice and love in the larger community. This is my spiritual home, and I want it to be here for me, for us, and for others who may wander in for years and for decades to come. I've looked at my finances, and I have found ways, the ways here and there, which will allow me to increase my pledge. One of my particular hopes is that our combined pledges will make it possible for FUS to increase the hours for our social justice coordinator to full time. Finally, volunteering for the annual campaign is not the easiest job to take on. Whatever you have decided to pledge this year, I hope that you will warmly welcome the volunteer who calls you. Thank you. Open your arms, what I'm talking about, for that now. There's a people who's attracted in our soul, all the time, in the master of that time show. It's those people who know what to let me go, when you put their name back, quote, to the throat. There's us who snap people in a team, yo. Open your knees, so that they're a team, a sense for me, a spice for a team. When I look at them today, I look carefully, what do you know? There's me, no more questions and things that I can never see. It's funny how one thing leads to another. I saw that video come across on Facebook and I thought, that works for my service. But it also led me to one of our readings today by the Vice President of Strategic Initiatives at a group called Listen First Project, Kemi Adagoroye. One of the only things Americans today seem to agree on is that there are significant divides within the United States, a real disconnect that separates us from our fellow citizens. Refusing to listen to and interact with people who share different views has shielded us from clashes of opinion and kept us in the dark as to each other's thoughts and concerns. Being kept in the dark, unaware of how large swaths of the population think and feel has left many surprised each time a new political or social development has occurred. The divides started when we stopped listening to each other, but the divide got increased when we actively began to silence each other. People have spent time crafting isolated bubbles where they are surrounded by others who share their opinions and beliefs. One outside the bubble is muted and considered to be an enemy, a stranger, someone not worthy of being understood, only to be condemned. Time and again over the last year, news outlets and social media platforms have displayed vicious and vehement attacks between people who dare to have a difference of opinion. As a result, people responded by keeping their opinions close to the vest or choosing to go on the defensive, attacking opponents first and often not bothering to ask questions later. All I have seen are people utterly rejecting the opportunity to talk to others standing across the aisle, not even taking the time to respectfully ask why they were standing there in the first place. When we shut down, block out, distance, mute, dismiss, invalidate and deny others the right to express themselves, when we judge and vilify people for opinions that we don't fully understand, we only hurt ourselves. Shutting people out and shutting people up does no one any good. And it leaves individuals in the dark as to how large portions of society feel and think, and why they feel and think a certain way. It's a real problem when you don't know your fellow citizens. And that problem started when we stopped listening to and silenced our fellow citizens. The 2016 election cycle has revealed the cracks in our country, the stark dividing lines that are separating strangers, friends and loved ones. The effects of these revelations will not disappear in the night, but will persist so long as we continue to dismiss and deny each other the right to be heard. I don't want to be a part of that.  I want to know my fellow citizens. I want to understand my neighbor. I want to do my part to help us learn and heal and grow, moving past the division of the last several months. So I'm reaching my hand across the aisle to listen and learn. Will you join me? And our second reading is along the same lines, but by New York Times columnist David Brooks. If America were a marriage, we'd need therapy. There has been so much bad communication over the past year, people talking and warring monologues past each other, ignoring the facts and using lazy stereotypes like elites and Trumpians to reduce complex individuals into simplistic categories. Meanwhile, our main candidates are poor connectors. We've got the self-enclosed narcissism of Donald Trump and, to a lesser degree, the mistrustful defensiveness of Hillary Clinton's campaign. As an antidote for all this, I've been reading the work of Martin Buber, the early 20th century Jewish theologian who dedicated his career to understanding deep intimacy. Buber is famous for the distinction between I-it relationships and I-thou relationships. I-it relationships come in two varieties. Some are strictly utilitarian.  But other I-it relationships are truncated versions of what should be deep relationships. You're with a friend, colleague, spouse or neighbor, but you're not really bringing your whole self to that encounter.  I-thou relationships, on the other hand, are personal, direct and dialogical. Nothing is held back. A thou relationship exists when two or more people are totally immersed in their situation, when deep calls to deep, when they are offering up themselves and embracing the other in some total unselfconscious way, when they are involved in mutual, animated describing. In our culture, we use phrases like finding oneself, finding your passion, loving yourself so you can love others. But Buber argued that it's nonsensical to think of the self in isolation. The I only exists in relation to some other. Some people go through life with a detached posture, trying to self-differentiate themselves and be more sophisticated than others. Those people tend to have mechanical relationships. Their feelings are self-enclosed. They don't get to experience the thou. Others adopt a guard down position that is open-hearted and open-minded. They regard others as unique persons and not objects. They have histories in which trust and vulnerability are rewarded. Such people experience moments of genuine dialogue. Buber described genuine dialogue as a sort of social flow. Teachers and students are learning with each other. An audience and an artist are lost together in a performance. Buber's writing reminds us to be intentional and brave about relationships. But it also has communal and political implications. Some organizations and leaders nurture open-hearted bonds. Some communities usually began, Buber wrote, with some sacred thou moment. Like the Exodus story for the Jews or the revolutionary struggles of the early Americans. Teachers connect current problems to that living effective center and set the table for situations of caring and trust. Today America is certainly awash in distrust. So many people tell stories of betrayal. So many leaders model combativeness, isolation and distrust. But the only way we get beyond depressing years like this one is at the level of intimacy. If Americans reconnect with the living center of the national story and they build vows at every level. Thank you for bringing such power to our service. At last week's Saturday service, Ros Woodward and James Morgan left us several questions to ponder. How do I learn what is upsetting to another unless they tell me it hurts? How do I, how do we have open and honest discussion around the issues and matters affecting all of us? What canon must we do? They suggested that finding answers begins not through self-censorship and political correctness but through the power of language with healing conversations, open and honest discussion and by getting to know others as we wish them to know us. Today I'd like to build on those ideas. Author Deborah Tannen in her book 27 Years Ago You Just Don't Understand wrote that we all, men and women alike, want to be heard and understood. But in today's rarefied political atmosphere it seems that many of us aren't hearing one another because we are more comfortable inside our own echo chambers surrounded by people and news sources that confirm our biases. But worse than that, we appear to not want to listen to different views at all. I'm sure you can think of examples you've seen at the local, state and national level. As Ros and James made clear, both our nation's successes and some of its deepest divisions are rooted in issues of race. Our first reading by Kemi Adagoroye pointed out that the recent election has revealed further cracks in our country, stark dividing lines, separating strangers, friends and even loved ones. The effects of these rifts will persist, she says, as long as we continue to dismiss and deny each other the right to be heard. When we shut down, block, out, distance, mute, dismiss, invalidate and deny others the right to express themselves, when we judge and vilify people for opinions that we don't fully understand, we only hurt ourselves. But no, in my experience we hurt a whole lot more people than just ourselves. The consequences of our not listening to one another over the last few years has snowballed through our imperfect political system into national policies that will result in the suffering of millions. Let me stop here to examine these assertions. Have those of us here today dismissed and denied people the right to be heard or to express themselves? Not overtly, I would say. And if we have, perhaps not even consciously.  And I am among them. According to polls by Reuters and Ipsos, the number of people who argued with family and friends over politics before and after the election jumped six percentage points from 33 to 39 percent of respondents. Sixteen percent said they had stopped talking to a family member or friend because of the election. And 13 percent said they had ended a relationship with a family member or close friend. Even couples that had been married for decades have called it quits. Some of you may have noticed that there's been a lot of unfriending happening on Facebook in the last year. Those of us who voted against the administration have become estranged, disconnected from both the 47 percent of people who voted for it and from the one-third of eligible voters who chose not to vote at all. In the shock, loss and grief we feel over losing a future for which we had hoped, many of us appear to have fallen into what the Reverend Nate Walker and others have called otherizing. Identity politics begins very early in life. I'm reminded of the immature othering in my own middle and high schools, dividing into us and them. In my school, the brains, the jocks and the dopers were the major parties. I'm sure your school had its own in-groups and out-groups. One would like to think, one would like to hope that with time comes a certain amount of maturity. Yes. Have we as adults reverted back to such immature, stereotypical behavior? Do we really regard some of our neighbors, relatives, and fellow citizens as alien, as so very different from us? Have Americans abandoned the pretense of civility? Have we Unitarian Universalists put our first three guiding principles, inherent worth, compassion, and acceptance of one another up on a shelf? Perhaps when we are afraid or under stress, we let our lizard brain take control, that oldest part of our brain, the brain's stem, responsible for primitive survival instincts such as aggression and fear, the fight or flight response. It can be difficult to live up to our ideals when we are afraid. I know there have been times in my life when I've been afraid that I have embodied David Brooks' description of self-differentiating to the point of living with a detached posture through more mechanical relationships. I must admit that in the last few weeks, I have been guilty of otherizing. I have thought and said things about people that I regret, that they are gullible and stupid, that they are less sophisticated and intelligent, that they are more easily fooled and manipulated than we. Despite Langston Hughes' dreaming of a world without it, I have occasionally fallen into scorn. I have not taken the high road. In truly elitist form, I have ascribed lesser worth to people who did not vote as I did. I have felt more contempt for them than compassion. I have rejected their views out of hand, rather than accepted them as fellow human beings with opinions born of their own experiences. I seem to have forgotten a lesson taught to me by a counselor 30 years ago that we all are doing the best we can, given our level of awareness. My conscience is calling. Yes, I can forgive my transgressions, but I feel a need to bring myself back to my core values and the fundamental truths illuminated by our religious community. If we truly seek peace, we will need to rein in our lizard brains, calm our fears, reject stereotypes and mend these relationships. There are conversations we will need to have across the divide if we are to move closer to beloved community, back in the direction of our liberal religious principles and the ideals of our constitution. How do we do this? You may have seen a television commercial go by, by Canadian beer company Moulson. And in it, people come across a big red locked refrigerator. Anybody? Has anybody seen that? Yes, a few? So eventually passersby discovered that this fridge is somehow listening and recognizes the phrase, I am Canadian in multiple languages. People cast about to find people in a wide variety of ethnicities to say the phrase in their native language. The key to unlocking the fridge is to find unity in diversity. The reward, as you might guess, is a nice cold bottle of beer for everyone. But diverse voices are the key. Similarly, our story for all ages today was made fuller and richer with the contributions of many voices. Without them we wouldn't have heard about, let's see, moo moo the cat and penny the cow in a barrel that smelled like bananas in the desert. We wouldn't have heard that story without multiple voices. What we did today may not be quite what Martin Buber had in mind with his concept of I and thou, but we had a good time building our shared story together. As David Brooks pointed out, if we are to begin healing the trauma of the election, we should begin by resisting the urge to reduce complex individuals into simplistic categories. We should consider Buber's distinctions between I it and I thou relationships. We should not fear, objectify, or withdraw from others with whom we disagree, but more deliberately bring our whole selves into those encounters. I thou relationships are personal, direct, and profoundly interactive. Nothing is held back. Deep calls to deep when we offer up ourselves and embrace the other in a total unselfconscious way, when together we are involved in mutual animated describing. Yes, it can be exhausting, and yes, we may not always have the energy to take, to engage this deeply with everyone we meet. But perhaps we might start with the relationships we value most, particularly when we don't see I to I, to consider the I thou. I should clarify at this point that I consider the I thou relationship aspirational, like our principles, an ideal that we cannot seek or find in all instances. If a relationship involves an imbalance of power or privilege, for example, say you are hurting me or taking advantage of me in some way, I will be far more likely to escape your presence than to offer myself up to you and embrace you in a total unselfconscious way. I believe we must allow people the right and freedom to define and maintain healthy boundaries, differentiation to avoid enabling the abuse of power, and the onus of responsibility lies with those who hold the power and privilege. But for the vast majority of relationships, those of relative equity, there really is no way around it. We are in this together. Most peoples have known this for millennia, and we affirm the interdependent web of existence in our seventh principle. As Brooks noted, Boober 2 argued that it's nonsensical to think of the self in isolation. The I only exists in relation to some other. Boober's suggestion, solution for our current estrangement, says David Brooks, lies in trust and vulnerability, being intentional and brave. The only way we get beyond depressing years like this one, he said, is at the level of intimacy. If Americans reconnect with the living center of the national story, and they rebuild vows at every level. Unitarian Universalist minister Nate Walker provides further wisdom in his book, Cultivating Empathy. Conflict, stereotypes, and violence, he says, arise from misperceptions and misunderstandings. He goes on to describe the concept of moral imagination. This is the ability to anticipate or project oneself into the middle of a moral dilemma and understand all points of view. A proven remedy for otherizing, he says, is to employ moral imagination as an everyday spiritual practice. He suggests that this will require some soul searching with questions such as, what was it about that person's language or behavior that had so much power over me? What was keeping me from cultivating genuine empathy for those I previously held in contempt? Was it my pride? Was it my fierce need to be right? At what cost? In an essay titled, Degrees of Separation, another UU minister, David Kowalski, goes so far as to say, we have become a nation of strangers because of this breakdown in respectful person-to-person communication. The good news, he says, is that the cure for this malady is readily available. Through everyday acts of kindness and by reaching out to others in a spirit of helpfulness and cooperation, we can begin to reweave the fabric of community. The world's religions, he says, have affirmed for centuries that the best way to bring the world closer together is the old-fashioned way, with patience and tolerance and good will, turning strangers into friends and enemies into conversation partners, one by one by one. And even better, he says, that when we reach outside our personal comfort zone, for example, to encounter someone of a different race, a different age, a different religion, or a different political viewpoint, our actions can have a multiplier effect, can lower the global estrangement more than we might predict. Or interlude today by artists at a Unitarian Universalist intentional community called the Sanctuaries expresses just this kind of reaching out, an action grounded in patience, honesty, and love. We sang about this love in our hymns, that love longs to quiet every fear and seeks to set things right in spite of foes, embracing enemies. When we tell our stories from deep inside, when we listen with a loving mind, when we hear our voices in each other's words, then our heart is in a holy place. For those of you thinking, enough generalities, get on with it already, give me some direction. I have this to offer. There are any number of experts available at the click of a mouse to tell us how to improve our communication and our lives. One such person is Judy Ringer, an author, instructor, and Aikido Black Belt, and here are my interpretations of her tips for listening and being heard. So imagine yourself sitting across the table from that cranky relative or neighbor or stranger with whom you disagree. Begin difficult conversations with mutual understanding as a primary goal. Free that you want to understand one another, allow for some give and take, and forgive the occasional lapse into othering. Nobody's perfect. Offer information that may be of value, reciprocate, and demonstrate that you understand the other person's argument or position, and decide whether you want to win an argument or to solve a mutual problem. It will help, says Ringer, if you understand both your story and theirs. Strive to educate and not blame. Share your hopes and goals, and I would add your shared values. Stay interested and curious. Remain centered and extend positive energy. And understand that in the end you may never see eye to eye on every issue, but you can remain respectful, interested, and purposeful. And I would suggest, too, that as US Senator Elizabeth Warren taught us so effectively recently, when it comes to being heard, persistence is a virtue. Goodness knows I have tried, even as I am guilty of otherizing people, I have also made attempts to bridge the gaps through conversations with little effect. So it's not easy, and it does require persistence. At my home congregation we say these words to introduce the ritual of sharing joys and sorrows. When we are heard, we are honored. When we are honored, we are healed. I don't know that these statements are always true, but they deserve our consideration. When we are heard, we are honored. When we are honored, we are healed. Let's put them to the test. In closing I would say, let us strive to be the mature adults we have become. Let us be fully present to others and show genuine interest. Let us maintain healthy boundaries, but let us also treat people as fellow human beings as thou's and not as it's. Let us try to engage in the unity of being. Let us not dehumanize, scorn, or otherize, but listen with a loving mind and employ our moral imagination to help us understand one another's struggles. Let us return again to our guiding principles of inherent worth, compassion, and acceptance of one another. Like Kemi Adagaroye and the artists at the sanctuaries, let us reach out and trust in love. Let us not only join hands, let us not only dream, but join hands and share the journey of life. Let us build and tell our stories together. And let us be persistent. Blessed be Your Name. Once upon a time, most folks used the offering plate to fulfill their pledges of financial support. Nowadays, lots of folks click on their church websites and set up automatic transfers from their checking accounts. Some still write a monthly check paying their church bill along with all the others. But passing the offering plate has never been just a practical exercise. It has always been a ritual. Even if your pledge is paid up, it is worthwhile for you to bring even just a dollar to drop into the plate as a ritual reminder of that form of love we call generosity. Let it be a reminder that after meeting our obligations to ourselves and our households and the communities to which we belong and are committed, we must still keep our capacity to give. The practice of giving until it is second nature and first response helps bring forth the realm of love. The offering which we will share today with Planned Parenthood of Wisconsin will now be gratefully received. I invite you now to rise in body or in spirit and howl our hallelujahs with our closing hymn number 318, our closing words today are by the river Nate Walker. When we observe oppression, let us develop strategies that free not only the oppressed but also the oppressor. Let us remember that those who use their power to deny freedom to others are also imprisoned and are also worthy of care.  Stand we must, stand strong and bold, but let us choose a new way to balance the scales. Rather than shoving our foot on oppressor's necks, let us instead reach out a hand, lower a seat and show them and even ourselves a new way of justice making by collectively experimenting with the moral imagination. Blessed be.


The Cube at Hadoop Summit 2014 is brought to you by Anchor Sponsor Hortonworks. We do Hadoop. And Headline Sponsor WANDISCO. We make Hadoop invincible. Welcome back everybody to The Cube at Hadoop Summit. I'm Jeff Kelly with Wikibon. My next guest is Ankar Gupta, head of sales and marketing at Metascale. Ankar, you've been on before. Welcome back to The Cube. Thank you Jeff. So for our audience, it's not familiar with Metascale. Why don't we just start with a kind of level set. Tell us a little bit about the company spun out of Sears, kind of leveraging some of the big data skills and knowledge you built up there. Tell us a little bit about the company and kind of the business model. Certainly. So Metascale was born out of Sears, born out of a very large enterprise where Sears started on its big data journey several years ago. And what we have seen that there is a need for a strategic partner like Metascale in the big data space that's growing with the number of vendors that are out there because while there are a lot of vendors who are providing different kind of services, analytics, infrastructure, big data as a service, platform, cluster, everything. But because the technology is so new, you're looking for a trusted advisor who has done it in a large enterprise. It's one thing to do a couple of POC, fire up a few clusters and try a few use cases. But when you actually implement in a large enterprise, you run into pain point that you have not experienced even thought through before. And that's where someone like us come in there. We would, because we have done it in a large enterprise, we were born out of a large enterprise. We have gone through these mistakes, pain points, decision trees and whatnot. We can plan for it well in advance and make sure that you don't have to go through it. So Metascale as a big data company of a large enterprise helps other companies accelerate their big data journey. So they don't go through the same point that we did in our parent organization and they can seamlessly have a long-term strategy for big data while gaining results quickly. So that's where we are. So when we talk about big data, you're talking about, among other things, Sadoop and some of the related technologies. So I know you guys had an announcement that seemed pretty interesting. Tell me about this. It's a big data service. So kind of explain kind of the new offering and how it fits into, how it would be consumed by an enterprise customer. Absolutely. So one of our main offerings is big data service, actually managed services where we provide complete end-to-end infrastructure. So an enterprise doesn't have to think about what distribution to use, what kind of reference architecture to use when you're looking for big data implementation. We provide Metascale appliances that we announced a couple of months ago that's ready to go plug and play. We actually move your data from your data warehouse into the appliance and have you focus on the business side of it where we take care of the infrastructure. We manage it 24 by 7, either remotely or on-premise. What we realize that a lot of companies, especially on the business side, companies that are say marketing organization or finance organization, they don't care what is underlying infrastructure. They want the results. They want that analytics report quickly so they can make business decisions. So a lot of companies that we run into, they're because of a large company bureaucracy or not having enough funds or whatever the reason may be, their big data implementation may be taking some longer than that was expected. So we announced big data as a service at this conference where if you as a company is looking to get end results, if you're looking for the report whether it could be social media analytics or sentiment analytics of customers about your brand or your products, you can get that report from us directly. So we will use our infrastructure, our clusters, our Hadoop infrastructure and then we will use our resources to do that custom development for you and provide you the end report that you're looking for. So again, you don't need to worry about setting up the infrastructure or worrying about hiring resources to do coding or anything of that nature. We will take care of all that and provide you the end results. Yeah, you don't have to worry about waking up at 3 a.m. in cold sweats because your cluster failed and something went down. That's something you just kind of abstract away all that complexity and let your clients focus on their business. Absolutely. Well, at 3 a.m. you will never have to worry about work with us because we will be managing the infrastructure. You might be up at 3 a.m. but they won't be, your clients will. You get them some peace of mind. So something you mentioned there, talking about the on-premise model was that you'll help your clients take data out of their data warehouse and move it into the cluster, which touches on the bigger question that we've been talking about all day here and yesterday as well and in some of the sessions as well about the relationship between Hadoop and the data warehouse. Now, there's 88 plus vendors here and some of them have a very vested interest in the data warehouse market, understandably. So we hear a lot about a complementary approach and that Hadoop is not going to replace the data warehouse. We've heard a few contrary voices on that. But for the most part, its being positioned as very complementary. You're out in the field. What are you seeing in reality on the ground? How are people looking at Hadoop as it relates to their data warehouse? Well, I mean, similar to what you just said, by the way, great session this morning with two very interesting organizations together. Yes, thank you very much. That was a fun... I think you managed it well with the two competing organizations. Yes, that was a fun session to do with Arun Murthy from Hortonworks and Doug Cutting from Cladera, two of the critical players. Certainly, and I think if you ask those guys, they will say that Hadoop will replace the data warehouse. But what we are seeing in the field really is it is a complementary system. So a lot of organizations, including our parent organization, we've used Hadoop for all batch processing, so kind of warm to cold data. But then for all your hot data, or say, RDBMS processing, or your quick processing you're still using the existing EDW that you may have. But Hadoop has fit really well with this ecosystem if you design the data warehousing really well. Or account for Hadoop infrastructure with long-term goals in mind. So what we have seen again in the field, a lot of organizations that started using Hadoop for as rudimentary use cases as just for storage device, move all my log files or outlook PSD files even to Hadoop first. But now from there, they're now talking about can I use Hadoop along with another NoSQL database like Cassandra, HBase, or MongoDB or something like that and do more real-time processing and whatnot. So I don't think that organizations that have already invested in EDW are going to throw everything out and say, let's replace it all with Hadoop. That doesn't seem practical. It may happen a couple of years from today when they're out of the contract. I doubt though that they're going to take everything out and large organizations don't make this. In fact, they're taking too long to have that Hadoop infrastructure come into their existing data warehouse setup today. So really, practically speaking, we don't see Hadoop replacing all of what organizations have today even if it is capable of, it may be capable of today. But what we do see is Hadoop becoming a really good complementary system. The other thing is organizations do not need to spend a lot of money in expensive EDW systems anymore. So instead of growing their investment in whatever boxes they may be using, they could use Hadoop for a lot of backup storage or archival mechanism and then, as I said, for batch jobs and cold data for the most part. You touched on something. It'll be interesting as this market progresses what the impact will be on the EDW vendors. I agree, I don't think it's going to replace the EDW, but I think you're going to see revenue start to stagnate potentially at some of the data warehouse vendors. And it'll be interesting to see how they kind of adapt to this new paradigm because it's a really different approach from a cost perspective, from the way you process the data. That'll be interesting to watch. So another big trend here, of course, is SQL on Hadoop. Keep hearing about this from a 90 number of vendors who have their own approach to this. It can get a little confusing for customers. How does menace scale approach that? You're getting a lot of requests from your clients for those types of capabilities. What's your thought on is SQL the best way to start to interact with data in Hadoop? What's your take? It's interesting, while a lot of organizations are taking time to adopt Hadoop, the organizations that have adopted Hadoop or our existing clients are asking for more. And one of the new asks, or the ask, is now NoSQL. So our clients are looking for more real-time type of processing and looking for databases such as, as I said, Cassandra, MongoDBs of the world. Truly think that NoSQL is becoming more and more mainstream. The challenge is, though, NoSQL is not pretty today. It's your existing DBAs, I have DBAs on my team who are 20 plus experience on managing relational databases. And for those DBAs to move to NoSQL wasn't an easy task. They will learn over time, but it will be hard for them to, you know, the relational databases that they've been used to to move to NoSQL, certainly. But clearly, NoSQL seems like picking up more and more just because our data is more and more unstructured data. You're seeing more video file analytics. You're seeing more audio files such as customer call data and whatnot, semi-structured data. And NoSQL seems to process that data much better. So clearly, NoSQL is becoming more and more mainstream. But I think I could see tools that move data from, say, your RDB-MS to NoSQL, but data from RDB-MS to Hadoop. I think generally people say it's SQL to NoSQL, but I guess it's primarily RDB-MS to Hadoop is what the main term is. Well, that's interesting. So you're seeing NoSQL what's the style of deployment you're seeing? Are you seeing Cassandra being deployed basically inside Hadoop or are you seeing kind of side-by-side? What are some of the deployment models and what are some of the use cases where they're bringing in something like Cassandra or MongoDB alongside Hadoop? Yeah, so for a customer, for one of our customers on retail side, we actually just put their real-time inventory system using Cassandra. And we chose Cassandra because the implementation was, the design for the implementation was done a couple of months ago and it wasn't as strong as that time as it has come a long way as strong as it is today. So what we're seeing is Cassandra, for that particular use case, Cassandra is a standalone system. It's its own cluster. So what we did was use Cassandra, took data from the POS system and used Storm Kafka combination to move data in real-time from POS to Cassandra and then from Cassandra to Hadoop to use Hadoop as an enterprise data warehouse. But we put analytics on top of Cassandra. So one of the analytics engines, whichever one you want to use, there are tons, as you said, 80 plus vendors, a lot of them provide analytics, put it directly on top of Cassandra and once the data is in Cassandra, you can do whatever BI you want. Oh, okay. So you're doing some kind of operational reporting right on top of Cassandra. You're also moving the data into Hadoop so if you want to combine that with other sources and do some more historical type analysis and things like that. Exactly. So what we did for this client was we used Hadoop, moved data from Teradata boxes to Hadoop and built Hadoop as an enterprise data warehouse for them. So you had a single source of truth for that data and then for real-time we moved data into Cassandra but then from Cassandra again, put all the data into Hadoop so like you said, do all the historical analysis and whatnot as you want and store the data in Hadoop. Yeah, I mean it's really, like I said, it's really interesting the deployment models we're seeing in some of the use cases. And it mirrors in a way some of the more traditional ways we worked in the old world if you will with the transactional database in your analytic data warehouse but now the scale is so much bigger. The types of data you can incorporate and the speed, it's got to be real-time. It's pretty much a requirement these days. Absolutely. And if we were talking three years ago about Hadoop being real-time, you would have been laughed at but we're seeing it now where people are building real-time systems. What's your take on just Hadoop specifically on how quickly it's developed and what do you attribute that to? Is it the community? Is it the vendors? Is it a combination of the two? Yeah, so I truly believe that Hadoop is not a breakthrough concept. I mean distributed file system and parallel processing has been there all along but I think what made it really successful is one, cost is major player but then open source community. I think it's, what has been done on top of Hadoop is phenomenal and how, like Duck Cutting said this morning we never expected this to become this big and I believe the part of reason is if it was an open source I personally do not think of it as big as it is today and there's more and more development happening so certainly that's one big reason. You talked about real-time, certainly. I mean in fact at our booth here at Metascale Booth, what we are demonstrating is real-time analytics on Twitter data, sentiment analytics on social media in real-time. So you can actually go, we have put a single node cluster, local cluster, Hadoop cluster here in one of our laptops and you can type the keyword you want. In real-time we are pulling data from Twitter and actually providing sentiment analysis using natural language processing and whatnot to you as you type the keyword and collecting the tweet. So it's phenomenal that how you can use a combination of Hadoop and one of the NoSQL databases. In our case actually we're using MongoDB for this use case but as I said you could use whatever NoSQL you want but certainly Hadoop has come a long way. In fact we were the keynote, Metascale was keynote at Hadoop Summit two years ago where we talked about some of the use cases and those use cases were primarily around batch processing. It's very interesting, I was looking to the keynote this morning and I was hearing that analytics 3.0 and then your discussion with Doug Cutting and Arun Murthy and I was really thinking through two years ago when we talked about it was cutting edge two years ago what we discussed was about batch processing using Hadoop and now you're talking about analytics 3.0 and real time processing machine learning and artificial intelligence certainly come a long way I believe. It is moving fast and you know a lot of it is due to the community so you know for our audience out there that isn't here at the show describe the vibe here what's your sense of kind of the vibe I'll just quickly give you my take and I think it's you know it's definitely got that excitement to it but there's also a sense I find a little bit more serious tone this year than maybe in past years and I think part of that is because we're talking about things about enterprise grade capabilities like security and governance which maybe Arun is sexy as some of the analytics but critical to really make this an enterprise grade platform what's the vibe from your perspective of the show? Yeah so there are a couple of things one the food is great so everybody's love. That's always good because it's a crowd shoot with conferences you know sometimes the food is... When you have a conference at such a large hall you and people are walking a lot you want to make sure that they're fared well but other than that jokes apart the key is like you said the tone is more serious I guess in previous conferences people were kind of testing the water they're still testing the water but in a more serious manner they're here to talk about POCs they're here to talk about use cases I see a lot of large enterprises more than what I saw before it used to be more vendors or typically e-commerce web-based organization that were early adopters of Hadoop now you're seeing more mainstream organizations that and multiple folks from multiple departments within the same organization so it seems like the not only organization are looking to embrace these technologies but multiple departments within the same organizations are you know so probably they have more the multiple use cases or you know a long term view view on Hadoop and what not so it's exciting to see it's exciting to see new development exciting to see traditional EDW vendors you know having their big booths here with Hadoop as part of their solution so clearly I guess they have realized that you know there'll be a part of it be in or be out yeah I mean all the big whales in the industry are here and you know they're some are taking a little they're taking different tax in some cases but they all realize I think that they need to be in this market it's the way of the future I mean it's either get in now or you're going to be left behind I think exactly but you're the one who write about it you're the expert in it how are you feeling about the whole thing well I think it's I think Hadoop is going to be a challenge for some of the larger vendors to adopt it's sort of you know it's sort of the innovator's dilemma problem but I think you know part of it is the business model is different in this environment than a traditional software sale so I think that's one challenge that the big players are going to have a little trouble adapting to I mean it's very different to sell I think into when you've got an open source community and when you're trying to also I mean we need to start moving kind of beyond some of the talks of speeds and fees and talk about business outcomes so you've got to talk to business people you've got to be able to talk their language so that's I think going to be a challenge as well you know some of the vendors are doing a better job than others but long-term I mean it's encouraging that they all know that they have to be in this market you know we'll see it'll be really interesting and you know five years ten years to see which ones were you know in this for real and which ones were maybe not in it first how many of these organizations will merge together well that's true I mean well there's eight companies out here and a lot of them are really small startups and so that'll be interesting too to watch you know some of them are going to get snapped up some of them will hopefully go on to be viable independent companies some of them will go away I mean that's just the nature of a fast moving emerging market but you know that's what makes it fun to cover as an analyst as well well we'd like to read it on wikibon wikibon and quick pitch we're going to be doing a webinar together coming up we haven't set the date yet but stay tuned for that and keep an eye on for that we'll promote that and let you know where you can see that sounds good no wikibon is a trusted research area and we're really proud to have you as a partner in a research webinar where we could provide an enterprise perspective and you provide what you're seeing in the industry so certainly invite everybody to be a part of that research and you can see the details on wikibon website or metascale website yeah when we nail down those details we will certainly get them to you to our community so Ankur thanks so much for coming back on theCUBE appreciate it wrapping up day two here at Hadoop Summit


In this presentation, we'll record a transaction for the issuing of stock for a non-cash asset. So in other words, we're going to issue stock, but not for cash. We're going to get something else. We're going to get equipment. The information for this transaction will be on the upper left. We're going to record this to the general journal here, and then we will post it not to the general ledger, but to a worksheet to give us a quick example of the effect on the accounting equation and individual accounts. Our trial balance is in order by assets in green, liabilities in orange, equity in light blue, and income and expenses, the income statement, dark blue. Debits are non-bracketed, credits are bracketed. The debits minus the credits are represented by this green zero, meaning that the debits do indeed equal the credits. No net income at this time. That means that the revenue and expense accounts are all zero. So this is just a quick trial balance to show us something that is in balance, which is really useful and important when we record these transactions so we can get an idea of the double entry accounting system and what's the effect on the different accounts and the accounting equation. What we're going to do here is issue stocks, as we did in a prior presentation, but this time rather than getting cash, we're getting something else. We're getting equipment. So that is entirely possible. It is just like any type of transaction we have here. Hopefully we transact for cash, but very possible to transact for something else as well. In this case, we're going to issue ownership in the company, which is going to be giving stock, which is going to provide some type of ownership, some type of voting potential rights to the people purchasing stock in exchange for something of value that being the equipment. So we're going to have the issuance of 20,000 shares of $5 par-value stock for equipment valued at $150,000. So first we usually think about what are we going to get? We're not getting cash, we're going to get equipment. So we can put the equipment on the books, the equipment is an asset, that's what we're getting. Assets have debit balances. We're going to make it go up by doing the same thing to it, another debit. So we'll debit the equipment. Now the equipment value note that many problems will just give us the equipment value. It's important to note that we're basically doing kind of a market exchange here. We're selling our stock for the equipment. So we're going to have to agree upon the value of the equipment and the stock. We might use either one of those things to value the other. In other words, if the equipment has a stated value or market value, we know that equipment is selling for $150,000. We might use that then to determine what the market price of the stock is. If on the other hand the stock is very standard, like it's on a public exchange, then we have a pretty good idea of what the stock market price is because it's selling for that market price. We may use that to figure out what the equipment value is. So we're kind of doing a market transaction here and we'd have to do some idea about, okay, what is the correct market price for the equipment? If it's kind of unique equipment, then it might be a little bit more difficult to figure out that market price. If it's equipment that's being sold all the time and it's new, then it might be pretty easy to figure it out. The stocks, the same way, the actual market price of the stocks, if it's a privately held corporation, may not know it because we don't really sell the stocks all the time. We don't know exactly what the stock is worth and if on the other hand we'd have to appraise it possibly or something. If on the other hand it's trading on a stock exchange, then we know pretty good. We have a pretty good idea of what the stock is worth at that time because they're all the same. The beauty of stock, if they're trading for a particular price at any given time, that's pretty much what they're worth at that given time. So we're going to say the equipment's going to go up, then we're going to credit something. Now just like if we were to invest like in a partnership or a sole proprietor, we know that we would invest in this case equipment and then the other side would go to capital, the capital account for an owner. In this case, we're not going to list out the owners. We don't need to list out the owners. That's the beauty of a corporation. The only way the owners are represented is that they are holding shares of stock and however many shares of stock they hold, that's the differentiation between the owners. They can hold more or less stocks in relation to other owners. So all we need to do then is credit here still, but we're going to credit the common stock account representing the fact that there's more stock out there. We're going to do that first at the par value. So we're going to credit the par value that will make things standardized. How do we do that? We're going to take the 20,000 shares times the par value of $5, increasing it by 100,000. So it's a credit balance account. We're going to increase it by 100,000 in the credit direction. Remember that this par value just makes this standardized. It's making this number very uniform standardized number. That's the nice thing about it. That's why using the par value is relevant. The par value number itself has absolutely no meaning, completely arbitrary. Its form, its function is to standardize this number, make it uniform. Everything else is just going to go into the additional paid in capital, the amount that is not uniform. And it will have no tie out to the number of shares that are outstanding for the company because it depends on the market price. The market price will differ. The market price here is being determined, we're negotiating it by the agreement here between the equipment we are getting and the value of the stock. So here we're saying the equipment's worth 150. The par value is 100, therefore we need 50,000 to go into the additional paid in capital in order for the credits to be equivalent to the 150 debit. If we post this out then, we see the equipment, we're posting this equipment here, goes from zero up by 150 to 150, then we're going to post the common stock, it's going to go from 500,000 up by 100,000 to the 600,000. Again note the uniformity here, this is the point of the par value, this is the point of the par value, so we've got the 600,000 divided by 5. We'll tell us exactly how many shares are out there, that's why that nice math is why we have that. Then we've got the paid in capital at 50, it started at 60,000 goes up by 50 to 110,000. This is where the sloppy part happens, we don't know, this means nothing, we can't nicely divide it out by a par value, figure out the number of shares, we can't divide it by the number of shares and figure out the price we were paid all the time because the price we were paid will differ depending on when we sold it because the market price will differ as time passes. So here's what we got then, the equipment is going up, the common stock is going up and the paid in capital is going up, this then is the part of the equity section that just represents the investment by the owners, note there's no effect on net income here, we got something no effect on net income, instead we owe money back to the owners. We're not going to list who paid us, who we owe the money to, we know who they are by the fact that they're holding shares and that's who we're going to end up paying when we pay out things like dividends or if we were to liquidate the company. The earnings side of the equity section is here, so this represents earnings over the life of the company, retained earnings does, less any distributions we made in the format here of dividends, whereas if it was a sole proprietor we would pay out stuff in the form of draws. So here's just the stockholders equity section so we can get an idea of this and just see this long wording can be intimidating, again the format of this can be intimidating because we're not just listing out capital accounts which can be pretty straightforward and just say hey we owe this much money to this partner or this much money to the owner with one capital account for a partnership or sole proprietor. Here we've got this longer setup but remember the whole thing is the same in total, meaning this whole blue account if there's only one shareholder that owned all the shares then we would have the 600,000 plus the 110,000 plus the 658,000. We would owe that one owner 1,368,000 and that is representing the book value of the company or assets, what happened here? Assets of 1,238,000,000,000, 1,238,000 plus the 150,000,000 debits minus the credit or liability which will give us that 1,368,000 so this is the book value of the company. If we see that in terms of the statement of stockholder equity we typically write this whole thing out we say common stock has a five dollar should be but five dollar par value that's what the par value is arbitrary number we could say there's 150,000 shares authorized that means that we have to legal right to issue that many shares doesn't mean that that many shares have been issued and then we have the 120 shares issued in outstanding which we should be able to easily verify with this number coming from here which is the 600,000 divided by five par 120 then we've got the paid in capital paid in capital just representing what we got paid over the par value therefore the 710 the 600 plus the 110 represents the amount that we got in total investment for the selling of stock then the retained earnings represents the amount that has been accumulated over time the retained earnings is where we're going to close out the closing process close out net income to retained earnings we keep those separate because when we pay dividends we want to pay them out of retained earnings we don't want to pay them out of the initial investment that could have different consequences and including tax consequences we want to say hey we earned money we're going to pay back that earnings to the investors and not touch typically that initial investment that's what we would like to have happened so then this total here represents the total stockholders equity