I now have the very great honor of introducing our first speaker, Dr. Benoit Mandelbrot, the founder of Fractal Geometry. Dr. Mandelbrot earned degrees in engineering and science from a coal polytechnic and the California Institute of Technology, and a doctorate in mathematics from the Faculty of Science de Paris. He worked at the National Center for Scientific Research in Paris until 1957. In 1958, he moved to the United States and joined the research staff at IBM. Since 1974, he has been an IBM fellow based at the Thomas J. Watson Research Center, and since 1987, the Abraham Robinson Adjunct Professor of Mathematical Sciences at Yale University. During his career, he has held a wide variety of visiting positions, including those of visiting professor of economics and research fellow in psychology at Harvard University, lecturer in electrical engineering at MIT, and visiting professor in physiology at the Albert Einstein College of Medicine. He is a fellow of the American Academy of Arts and Sciences and of numerous scientific societies and an associate of the National Academy of Sciences. He has won many honors, awards, and medals, including the prestigious Chevalier, the Order of the Legion of Honor in France. A true polymath, he is the author of over 100 articles in professional journals, ranging over a broad spectrum of disciplines, including communication and information theory, the structure of language, thermodynamics, probability, economics, turbulence and fluids, hydrology, geology, cosmology, and art. He has written that, quote, it had seemed too many that each of my investigations was aimed in a different direction. But this apparent disorder was misleading. It hid a strong unity of purpose. Against odds, most of my works turn out to have been the birth pangs of a new scientific discipline, close quote. In 1975, he laid many of the foundation stones of the new science of fractal geometry in his essay in French, Fractals, Form Chance and Dimension. And in 1982, he published the Fractal Geometry of Nature, his marvelous manifesto and casebook of the new science. He is currently working on new books on multi-fractals. Ladies and gentlemen, I am delighted to present the father of fractal geometry, Professor Benoit Mandelbrot, to speak on the fractal geometry of nature and chaos. Thank you very much. I'm delighted to be here and very much honored by being asked to speak first at this meeting. In a certain sense, the topic of my lecture will be followed by that of Heinz Otto Pagan who closed the meeting, which puts me in a very awkward position of trying to tell you about fractals without knowing what Heinz Otto is going to tell you at the end. But let's have been old friends and I'm sure that everything is going to be fine. Now the way I try to organize my lecture is the following. First of all, I would like to introduce you to a large number of fractals. Fractals are geometric shapes and to understand geometric shapes one must see them. It's something very fundamental, very often forgotten and forgotten at very great loss that geometry must have a visual component. And so I was hoping to show you a large number of slides. The best way to do so is going to be to play for you a small part of a program which some friends of mine and myself have organized last April at the Guggenheim Museum. That will come after a brief introduction. So most of the talk will be in terms of projection slides and so on. I'm very worried about the people sitting here and here because they're going to see nothing. So if you can move closer, you'll probably be better off. But that is just a matter of advice. Now, well, so let me begin by the beginning. May I have the first slide? Oh, I see. Can you see me a little bit less? Yes, thank you. Well, I begin by this quote from Galileo, which is something quite marvelous. At the dawn of science, Galileo Galilei described a great book of nature as being written in geometric language. And this language, he says, is made of characters which are circles, cones, et cetera, without which one earns in vain a dark labyrinth. Without knowing these characters, science is impossible. On the basis of these characters, Galileo built the beginnings of mechanics and therefore of science. These characters are borrowed from Greek geometry. And Greek geometry had an interesting episode in its development. If you read, as I did once on some of the advice, The Life of Marcellus by Plotarch, you find a passage in which the following story described two men named Arquitas and Eudoxus had applied the geometry to the science of mechanics and showed that you could, with understanding of shape, understand the laws of nature, and at the same time that you could use the illustration of geometry presented by mechanics as a help in understanding geometry. Plato was indignant at this situation. He said that was a shame, a disgrace, a pure science of geometry should put base usage as to use mechanics, some vile usage, and that a proper geometer is a person who does not need the concrete illustrations of mechanics to do his job. Well, so you see that they were having attention for a very long time mathematics between those who believe in purity, in absence of input from the eye and from science, and those who believe the contrary. Well, clearly Galileo believed the contrary. Now what is the geometry he was referring to? Here is one example of the geometry. It happens to be the IBM Research Center, which I show here not at all because the marvel is building to live in because it's not. It's a typical modern building, but it exemplifies one essential law of geometry in our everyday life. Euclidean geometry is a geometry of shapes around us which are made by man. Man's works are very typically flat, round, in general follow the same very simple shapes of classical school geometry. Now we all know by experience that the world around us, the questions which are primary in the sense of being the first to be asked could not be answered by this geometry. For example, mountains are too complicated for that. And let us look at this mountain. It is not at all a real photograph. The previous one was, this is not. It's completely mathematical forgery, computer forgery, mathematical formula. Mountains are more complicated than any shape in Euclidean geometry. Clouds are more complicated than any shape in Euclidean geometry. Therefore described in nature around us, we have to do something else. We have to go beyond Euclide. How far can we go? Well, if you go too far, you get lost in excess of generality. The two veins of science are lack of generality and excess of generality. There's a certain level of proper generality which is necessary in order to things right. And the geometry which is able to include these shapes that does exist now, it was put together by me primarily in initial stages 15 years ago out of very many pieces which have been around for a very long time. Like everything in science, this has very, very deep and long roots. But they have been a turning of roles. Objects which were viewed as being very, very far from physics turned out to be the proper tools for studying physics. So that is the aspect of my talk which is going to be geometry of nature. And I will describe some more specific examples after this little show. Now about chaos. It's a topic which other speakers are going to describe but I would like to mention immediately that the proper geometry of chaos is the same as the proper geometry of the mountains and the clouds. It is something quite marvelous because might have happened perhaps that different geometries would have been needed to follow that of Euclid, but it's not so. Fractal geometry has two roles. One to describe again the shape of mountains and clouds. Mountains as I wrote once are not cones. Clouds are not spheres. Islands are not circles. Rivers don't flow straight. This same geometry is the proper geometry of everything which is geometric in the state of chaos which you hear mostly from the other speakers. And I would like to show you a few examples of the shapes in which I encountered in this context. This is a very, very magnified version of a set to which my name had me attached. It's magnified in ratio of Avogadro's number. Why that? Well, because it's a nice number. 10 to 23, because as it turned out, this number was a good opportunity for testing the quadruple precision arithmetic on IBM computers. It's very amusing to be able to justify fun and science on the basis of such specific roles. If the whole Mandelbrot set had been drawn the same scale, the end of it will be somewhere on serious. It's enormous magnification. Now you will see later something about that and Hans Otto I'm sure is going to talk about a great deal. Now this shape here is a variant of the same set corresponding to slightly different formula. I will not repeat the formula. I would like to show this shape simply to comment on something which is one totally amazing and extraordinary satisfying aspect of fractal geometry. It is that shapes which are initially developed for the purpose of science, for the purpose of understanding how the world is put together both statically and dynamically, statically in terms of mountains, dynamically in terms of chaos, strange factors, et cetera. The same shapes are perceived by many people as being beautiful. This shape here was not intended to be beautiful. It was just an exercise for going through to try to find something else which we could study with reasonable facility to justify investing time in it. And it turned out to have many features which surprise us to this day. For example, it seems to be three dimensional. In fact it's not, it's completely flat. But to my eye there is like a piece of leather which comes up and goes down, cast a black shadow to the left and the edge of it also casts a shadow. I'll mention that simply as a kind of question. Why are these shapes beautiful? What did they tell us about our system of perception? Because experience has shown us that the same features are seen in them by many different people in some cases. In other cases different people read different things in these shapes. The shapes don't mean what people read into them. Therefore there is a very great deal of understanding of this matter which I think we are going to come in briefly towards the end. Well, you also see shapes of this form like this which is called the snowflake curve or the Koch Island has many names. Was discovered by a man named Helge von Koch a professor of mathematics in Stockholm in 1905. And these shapes play a very important role in the faculty geometry because they're easy to study. They're easy to study but in a certain sense they're very finite. You must begin with them but that is not where the fun begins, the fun begins beyond them. And so how to present the fun? I would like to play a small excerpt from this video. Let me explain how it started. Charles Worrien is a very famous composer in New York very highly very well known police surprise winner, et cetera, et cetera. He called me many years ago and suggested we meet and we had a very good time talking about music, about fractals, has a very, very good understanding of science which very much surprised me and impressed me. Then last summer, last winter, we discussed the possibility of doing something together. What came out was that Charles Peace New York Notes which we see here described was played at the auditorium of Guggenheim Museum in New York on the right side of the stage. On the left side of the stage, we, that is Richard Voss and others whose names will appear in the credits, are prepared to gather a collection of slides. Now so I'm going to start about the middle of this piece and it is not the whole piece but you will and please take it in two roles. One which is just a collection of slides shown very, very quickly after each other and merging into each other better than I can do with this carousel and at the same time as a preliminary to show discussion of fractals in music which I will have after it comes through. So may I have now the video? May I have this slide down please because it will help the video with this slide. Could you please cut the tape now? I'm sorry to interrupt in the middle but we must go on. I will explain to you later about some things about it but now let me begin by repeating again the music is by Charles Warren, the musicians who are playing are, well, many of you must know some of these names. Fred Cherry is the very famous cellist and director of New York Lincoln Center Chamber Music Players and this piece is going to be played there again next March on 8th, 9th and 10th of March. It has become something of fixture in New York musical scene but I have no time to continue for it. I will explain a few minutes how this union of music and fractals came up but let me now come to business. You have seen many, many shapes, all of them computer generated. Each of them had the following characteristics. It had a very simple formula, formula reduced to its essential states, one line, two lines perhaps but out of this formula comes this extraordinary wealth of structure that you have observed. This wealth of structure was taken up by a very fine computer people whose names I'm going to mention momentarily when I showed the slides again and who rendered it. The effects of light and so on are state of the art in computer graphics but are not part of the main point. The main point again is the coexistence of very great simplicity of formula and very great complexity of shape. And so here we are in the middle of this problem, this kind of quandary which science had faced for so long that the geometry was extraordinary effective, extraordinary powerful as a tool in the sciences by geometry, I mean Euclid. Yet everything around the experience was different from Euclid. If you want to go beyond Euclid and create new shapes which are able to comprehend the complication of nature, we must in a way go by small steps. And one of the central tools of science is the idea of invariance. The idea that somehow things are complicated but not infinitely complicated, they're complicated but orderly. In the case of fractal geometry, the great invariance is self similarity, self affinity, self alightness, self symmetry in this sense. One has a complicated reality which has a great deal of structure, the structure being the fact that each part is in some sense the same thing as the whole but smaller. Now anybody who has been attuned to art for over the centuries realizes that this idea had been very common in the arts. The idea that well in Indian paintings very often there are small Buddhas on the robe, a big Buddha, and yet smaller Buddhas on the robes of the smaller Buddhas and so on as far as a painter's brush could do it. In, again, in Buddhist writings, there are stories of big palaces which are such that each room of this palace is like the whole world and in it there is a small part which is like the palace itself and that small part is the room which is like the room in which the speaker or the man who tells the story sits. And coming back to Western civilization, certainly in Aristotle, there are many such echoes, in Leibniz they are very, very strong. Leibniz had the idea that in each drop of dew, a whole world resided. If you look carefully in the spring of the leaf on a drop of dew, you will see a sun with its planets, with their beings, their leaves, and their drops of dew, et cetera, et cetera, at infinity. Therefore, this idea of repetition, the idea of the palace like the whole is one which is very much fabric or are thinking as humans for a very long time. The only trouble with it and a very major trouble is that was scientifically a poor idea that is what applied in context where it doesn't hold. It is not the case that an atom is like a sun with planets, only in a very, very crude way, otherwise very, very different. Therefore, much of the thrust of science over many years has consisted in fighting this, how to say, natural sliding into the notion of self-similarity, self-alikeness, which humans are very prone to entertain. Well, a fractal geometry is based upon the notion that there are some fields of endeavor in which the sliding down is not necessary. And so the basic invariance of fractals is the one I described. I'm going to give you some examples of it momentarily. Now, which is the simplest example of it? This is one. It is due to a man named Shapinski. I called the Shapinski gasket as something of a joke and the joke has stuck. It's very obvious by looking at it, it's made of four parts, or three parts, blue, yellow, and red, each of which is exactly like the whole, except it's twice smaller. Well, Shapinski defined this shape for some purpose, which has been forgotten, rightly because it was not very important. But the main fact about it is it is so simple that in a certain sense it is almost like Euclid. If you come to think about it for a few days, you know about everything there is to be said about it. It's a shape which is rather poor. The formula which consists in taking the middle part of this triangle and so on and so on at the infinitum is elementary and there is not much you really find by studying deeply. So the impression may prevail that if you take some similarity, it's a barren and not a fruitful idea. But to show that it's not so, this same thing in three dimensions, to show it so, let us go a little bit further. First of all, we go to some plants. Some plants in fact have a surprisingly large degree of self similarity. This branch here is completely artificial, computer generated, but each branch is exactly the whole except it's smaller. Well, very many plants are very nearly self similar. And they should be because they consist in branching, branching, branching. Each stage of branching is ruled by the same rules therefore the same things happen. But the bigger the plant, the bigger the thing that happen. That's kind of very rough idea what makes self similarity arise here. It must be so. One often fears that self similarity in this fashion would hold only for a few levels that if you go in greater detail, the branches stop branching, they end up, they haven't ended, it's true. Like very often in science, you have a principle which is simplifying principle of understanding, it does not apply if you go too far in the very small or too far in the very large. Sometimes it does, sometimes it does not. Very often it does not. Now let's look at this shape here, which is a real one. Second photograph of a real object, you may recognize a species, a variety of cauliflower called Romanesco, which is characterized by an extraordinary level of self similarity. If you look at each of the knobs of it, they look absolutely like the whole. And then they carry themselves knobs and so on. Well, the first reaction of scientists looking on such shapes was to focus on all the spirals which exist in it. And there's quite a lot of knowledge and botany about the way plants spiral. Fibonacci sequences play a role in that which is very interesting. But what is more important for us here is the fact that each part of it over five levels of separation which you can see and then many more levels you cannot see but only except magnifying glass or microscope, you find the same structure repeat again and again. Therefore, this notion that somehow self similarity would be a dead thing is not true even in this case. But the most important things go further. The most important thing go when we add an element of unpredictability or an element of nonlinearity. Actually, nonlinearity, which is chaos and unpredictability, which is chaos and different in all the sense of the word are very intimate linked. I will say a few words about that if I think of it. But that is what I'm going to come to in a minute. But before that, I would like to say a few words about music. The reason why Charles Warren came to see me is the following. He said that for many, many years he had been worrying in his own mind about difference that exists between noise and music. Clearly, he would say, listening to something, this is music. It's very bad music. Very bad, but it's music. And listening to this thing, he would say, that is noise, a pleasant noise, but it's noise.  And he was quite incapable of formulating his ideas on the subject. Then he looked, he saw my book and saw the key to it. Now, the one part of the idea of fractal geometry as language, which I have not yet emphasized enough, fractal geometry is a language, a geometric language which can be used to understand, to organize our experience and to go further, to explain our experiences. For Charles, this was a matter of organizing. He always felt that a long piece of music must be in a way composed. That is, if you have 30 minutes of music, you have a fast, a slow, and a fast movement. Each movement will have a loud, a soft, and a loud part. Each part will have a clarinet solo, a violin solo, some other solo, and so on. There must be changed variety at all scales. And that characteristic, he told me, was to him the principal criterion that distinguished music as an organized activity from noise, which is organized differently or is not organized at all. And therefore, he asked me whether he had any kind of inkling of that. Sure enough, had very strong inkling because my friend Richard Voss, who is the author of many of these pictures, I'm going to identify for you very shortly which pictures he did, who is actually a Minnesota boy from St. Paul, not far from here, but who left this state for other places on the east or west coast. Dick Voss had, in his PhD thesis in Berkeley, been playing with one of Raph Noyes. What is one of Raph Noyes? Well, it's a noise fluctuation, which is between hum and the brown motion. I'm going to come to it momentarily in the next slide. It's a form of fluctuation which is very, very common in physics and very little understood in many ways a very great mystery. So Richard Voss was trying to understand one of Raph Noyes and he was analyzing all kinds of things around him to see whether perhaps they were or were not one of Raph Noyes. He found that music, the notes, the loudness, all kinds of characteristics of music are scales longer than a sound that is not a matter of analyzing the sound of a cello or sound clarinet, but the musical part of it, all these characteristics, if properly analyzed, gave one of Raph Noyes's. What does it mean? It means precisely what Warren was telling from Musician's viewpoint. That is, organized music in western culture had this very strong structure was through Bach or Beethoven of the Beatles because the Beatles are just like academic in terms of the writing as Bach or Beethoven. They follow the same rules. He went to analyze some records from a store selling ethnic music from Africa. The same thing was true, one of Raph. He went on to analyze Boulets and Stockhausen and they are not one of Raph. Now, a very general feeling that Boulets and Stockhausen were different from Bach, Beethoven, and Beatles was confirmed in sort of objective fashion. Now, whether you think that it is stronger than whatever you believe before is not a matter. Sometime later, I met another musician who was a legatee, George Legatee, and he told me exactly the same story as Warren. In fact, he went on saying that all musicians have this feeling that some things are music, others are not, and in Legatee's opinion, the feeling is based upon whether there is an element of self-invariance, self-symmetry, self-affinity, more specific in that structure. When there is, it's perceived as being music, good or bad, when it is not, it's perceived as not being music at all. Well, in the music which you heard in that short video, a part was computer generated. Given the scale of Warren, it was not obtrusive. It was not something which stopped the action and said, here I am, I'm a computer generated piece. But it was eight musicians, the seven whose names were shown on the credit line, and an eighth which was a computer generated part. It was amazing speaking with the audience after the performance to realize that most people did not feel that a new instrument has come in. And that new instrument was noise generated according to very simple rules in which it was made sure that self-similarity was maintained. Even at this very crude level, Warren felt that this added an element to his music. Well, let me continue faster with what the fractals are and introduce notion of fractal dimension, which is very fundamental in this context. Now, first of all, self-similarity. You see on top an element, a segment is divided into pieces. If you divide into five pieces, each piece is one-fifth of the whole thing. Then you see a square, a cube is divided into pieces, and the square is divided into four pieces. Each of them is smaller in ratio of two. Therefore, this ratio, which is written both letters in the bottom, d equal logarithm of n divided logarithm over n over r, which is log of number of pieces divided by log of the reduction ratio. This ratio is something which is identical in these cases to ordinary dimension. It is one on top, it's two in the plane three in space. Well, starting from this very broad intuitive idea, which is called similar dimension, mathematicians have developed a large number of notions dimension. One of them is called the Hausdorff-Bezikowicz, because people created it, others, another called Minkowski-Bouligon, et cetera, et cetera. There are ways of implementing this idea of dimension in such a fashion that instead of representing what we ordinarily know as dimension, which is a point dimension zero and the line dimension one and the plane dimension two, et cetera, you can interpolate and have shapes which are in between a line and the plane and have dimensions which are, for example, 1.4, 1.5, 1.7. Well, I would not like to emphasize this dimension, I give dimension because for many people, it's mysterious and perhaps overly mysterious. The main thing is that this is one of the basic technical tools of the study of these shapes. Now, let me proceed in the case of fractals instead of obtaining dimensions which are again integers obtained fractions. So on top, you replace a straight interval by this zigzag curve and you get the snowflake curve in the bottom.  You take this other shape, obtain a space-filling curve. In general, you can manipulate shapes by these very simple recursive mechanisms which give you exactly linear reductions and somewhat dull structures. But I say that the two variants of it, I have no time for, set affinity and multifractals, very important but beyond the time I have at my disposal. I said before, if you want to get to really interesting structures, you must go beyond exact linear set similarity to either randomness or to nonlinearity. And from now on, I'm going to study first the randomness and then the nonlinearity. First of all, randomness. On this collection of pictures, each of them going from top to the right is the reduction of preceding one. That is a blow-up. That is, you take a small piece which is marked by white square rectangle. I hope it's visible from where you sit and you blow it up to see greater detail. You add more detail, more detail, more detail.  I think the impression you must be getting is that there are nine pictures here from all is the same, about the same but very different in detail, but they are of the same kind. And that's the main point. The point is here that by having an element of randomness of unpredictability, total unpredictability added to this construction of recursive adding of detail, one can obtain an amount of richness of structure which was totally beyond any expectation. The same way as again in the case of music by varying loudness or things, you get the amount of detail which was well beyond expectation because nobody could believe that so much richness of sound could be obtained by simple rules. And in this case, of course, the mechanism was chosen in order to represent something about the shape of mountains. And so let us now give a pollute to the second thing, the transformation which I have studied most in the case of nonlinearity is one which goes from Z to Z square plus C. Why this one? Because the simplest you could write. More precisely, two which are simplest. If you don't want to have something linear, you either take a square or take the inverse and I've studied both. The one with a square turns out to be richer and more fun to work with than the other which is why it became so widely popular. Now the first person who thought of this Z square plus C transform, well, it must go back into very dim past. In the 1870s, it was something which was not a new question in a certain sense. But certainly in 1904, a man named Fatou did a great deal about it. Then for many years, it was enormous interest in the study of it only on real access when you get from X to X square plus C. And the work of Michel Fangenbaum is at the center of this investigation of the transform X going to X square plus C. Well, what I did was to work on that in a complex plane Z and I'll come back to it a bit later. Oh my goodness, the music is completely out of line. So I'm sorry, I skip it because, well, there must be a conference, especially chaos, one element of randomness in slides. So you just saw it. Now we go to this mutation of mountains briefly to give credits and then I'll proceed to something in physics which is very musical and expected. The thing which, the question which in a certain sense is a center of what fractals are is the question of how long is the coast of, well, I say Brittany or Britain because it's very nice both in French and in English. The coast of anything. This question has been at the very core of the origins of geometry. That is if one reads about the origin of geometry, that very much of course due to the Greeks, an extraordinary phenomenon that geometry was born in Greece and nowhere else. And very much influenced by navigators who had gone west to explore Sicily and Sardinia and were very much at odds about how large the two islands were. Because in one hand it took less time to go around Sicily than around Sardinia. But it took less time to cross Sardinia on foot than across Sicily. So they're arguing very much, political parties, the parties saying Sardinia is bigger and the parties saying Sicily is bigger. And eventually the intellectuals came in and distinguished two things, the area and the perimeter. So they said what happens in Sardinia is an island which is smaller but has much more complicated coastline. And how they measure the coastline, well like any sensible Greek would do. They would just take a small boat and navigate, circumnavigate the island and see how long it takes to go around it. And they found indeed that in the case of Sardinia the coastline is very long, case of Sicily it was not very long. But if you come down to it, the whole thing was ridiculous. Because why a small boat? Why not a big boat? Imagine this area here is completely imaginary but it's very much like a real coastline.  A small, very flat boat would follow it very closely and get you a longer distance. If you walk around the coastline with seven big boats you're going to get a short distance. If you walk on coastline with ordinary boats you'll get a longer distance. A mass will go into details where you have just two steps and an even longer duration. So if you come down to it, the idea of length, which seemed to be totally obvious, solid, which every teacher of geometry had no doubts about, was in fact very, very soft. And then you go and see in practice did people make mistakes about length? They made terrible mistakes. For example, if you look at the Asicropedia of Spain and Portugal, the length of the common border in the countries is described by Portugal as being 30% longer that what Spaniards say. That's the same line. Drone on it and people have been killed and I don't know how many wars to determine that the border is here and not here. And yet the Portuguese say that 30% longer border. Why so? Very simple. Portugal is a very small, much smaller country than Spain. Classrooms, the maps where people measure the coastline are not the real terrain but maps. Maps of the kind you have in schoolrooms. In the schoolrooms, Portugal gives maps for much more detail than Spain because smaller country. Therefore, details which are not visible on Spanish maps are visible on Portuguese maps. So you see there is an element which is very important of what the structure, the language you describe something with does to your description. By describing frontiers by the language of Euclid or Negeometry, you hid this very fundamental fact. Now let me run very rapidly. This is an relief obtained by very, very trivial things piling pyramids upon pyramids. The most childish model imaginable. A mountain is not a cone but if you pile enough cones or pyramids on each other you get these very lifelike things. Now these mountains which you saw before they are due to Richard Voss again from St. Paul, Minnesota. This one is a composite of different things again due to the Voss you saw it in the video. This is something which is an imitation, if I can call it, which was produced in a science fiction film. There's some people who say that there's nothing against the fractal geometry except the fact that it leads to imitation science fiction films. Well that is meant to be put down. I think that actually it's very amazing that something which was so sophisticated and so esoteric and so difficult before I had a notion that might be a good way of describing mountains turned a few years from being that into being popular exercise but something happened on the way. That is to make these things faster and cheaper they reduce the element of self similarity of self aliveness that this shape has as compared to preceding one. And you see all kinds of defects you see kind of V in the bottom of the enough light. You see a texture of crumpled paper, very, very visible. Here is a case in which something which was viewed initially as being purely an abstract mathematical idea, the idea of invariance being essential that is a shape being run by its own invariances. If you weaken the invariances you make them less powerful then the shape becomes wrong. I had never expected myself that this would be so visible. And again for those of you who know these references there was a man named Felix Klein who in 1870 had a program of science which was based upon the invariance of both mathematics and physics. These pictures here which I've seen are due to Ken Musgrave who's a student of mine at Yale. It's part of his thesis. And this one of course competition between Ken and Dick. He wants to show that he can do Earth just as well plus the clouds which Dick didn't have. This one is a new development which is very interesting. James Bardeen who is a physicist at University of Washington, a cosmologist and relativist of a great renown is also a computer nut. And he has his own Amiga computer and he read a paper of mine in which I expressed a very great dismay at the fact that all these previous mountains however impressive they were from when seen from an angle rather low on the horizon had something very wrong with them. We could have either mountains without rivers or rivers without mountains but to put it all together I had to do something very artificial. And so Bardeen came to think and reasoning very much like a physicist would putting minimal amounts of further information about how the relief is formed. He got some pictures. I'm going to show to them with some apologies because they had done a very small microcomputer. It's remarkable how good they are for it but they're not the quality and finish of the others. So you obtain these effects that are not put in by hand. This relief was obtained by an algorithm which tells you a possible scenario for the formation of relief. Geologists I know are very impressed by this scenario because they think it may well be the scenario that created the Earth relief. But if you want to test these scenarios you must see what they actually give. And here the eye is our tool. Some scenarios if tested by being implemented in pictures vanish instantly. They make very promising a priori but once you see them they are just wrong. This scenario wins on the basis of being likely end of being very reasonable. These have seen our clouds by Richard Voss. Some flowers by Prushin Kiewicz have no time to explain them very much. And I'll go to a chapter of Equiculture and Physics. Well, this cartoon appeared in American scientists. We did the whole room over in fractals and it is very misleading. And I put it here both because I was so amusing because I want to emphasize it. In this cartoon the straight lines like a table and everything of how to say human manufacture has remained straight in Euclidean. It's only the decoration which is fractal. And the two are sort of separated. There's one and the other, they're not mixed. But in every investigation I've been engaged in they are mixed in completely in extricable fashion. Well, let me give you examples just to remind me the matter of distribution of matter in the universe. This distribution is a fractal scaling variant over range which is a topic of great dispute. Some people say it's only five megaparsecs. Other people it's a thousand megaparsecs. The great voids one discovers in between galaxies are a telltale sign of fractals. They are obtained by fractals almost always and to obtain without fractals requires an extraordinary amount of special assumptions. So quite possibly this model to represent distribution of galaxies of very long range. And I mention it here because it's as an introduction to the kind of central issue as I see it of the role of fractals in physics. More precisely statistical physics but in physics in general. Physics has been ruled by some rules which are called the partial differential equation of physics. The Laplace equation, the Fourier equation, Navier-Stokes equation, et cetera, et cetera. As the names indicate they are roughly 200 years old. They arose roughly 100 years after Newton. They are in many ways a consequence of Newton, a development of Newton in 100 years. They have been very powerful, extraordinary powerful, very surprisingly powerful in describing the structure of the world. They suppose a world in which everything proceeds in a very smooth fashion because they demand not only one derivative but two. And fractals typically have none. I have forgotten to make this point the absence of the tangent, absence of length goes with absence of tangent and non-differentiability. So there's a conflict, how does the conflict resolve? How is it that the Laplace equation or perhaps the Newton equation or perhaps Einstein's equation of gravitation give rise to this distribution? In this case there is not much known but in other cases much more is known. This is just a passage to mention that there is something quite extraordinary about surface of the earth that the fractures in surface of the earth have the same rules over extraordinary broad range of scales that the same rules follow for 100 kilometers over Nevada desert and over centimeters. But again it's challenge for geologists, nothing is known. Now I will skip on that turbine, we have no time. I will skip on this because I have no time but just to mention one thing which is that in the case of diffusion of heat which is a very important issue, if you have particles of two colors going to each other, let me try the next thing. So here in honor of the Swedish flag it was done in yellow and in blue. You have yellow and blue particles diffusing into each other. What the theory which I was taught which everybody was taught told us was the thickness of a diffusion layer at one end of all blue, at the other end of yellow and between it was in between blue and yellow and telling us what percentage blue and yellow. The question which one could ask oneself is what the shape of the bond between blue and yellow. This question arose from very practical investigations on soldering as it turns out has given rise to something quite extraordinary, the study of a form which exists between blue and yellow which shows that even in this particular problem the two aspects of smoothness and of fractality coexist. But now I come to the most interesting one because most challenging because of course I'm working on it. It's a study, the structure of dust, the structure aggregation. This here is a photograph of a gold colloid. There are shapes which are little blobs of gold which stick together and which end up by creating shapes which are very complicated like that. The structure of these shapes is fundamental to understand the physics of colloidism, what they do and how they act. One must understand them. That structure is entirely fractal and the fractal characteristics of it, dimensions of different aspects of it, determine the physics. I went very rapidly through another slideshow and percolation, another field in which the whole of physics is determined by the geometry. The reduction of physics to geometry was a great dream of many physicists and of course Einstein has done more on anybody else to realize it in his context of general relativity. But in this very different and very much more modest context the same thing is happening. All the physical properties are reduced, the geometric properties which in turn are reduced to the mechanism that create them. Now how do you explain this structure before? Which there's a model called diffusion limit aggregation due to Sander and Whitten, which I will not explain because I feel pressed by time and this model as in three dimensions gives rise to these kind of shapes. Well, the reason I'm going to now stop on this thing because it exemplifies a question of scientific method which I think is important and which is close to my heart. The very brilliant physicists have discovered this mechanism and have found a way of having particles come and get stuck together and color them by age. So the ones which came last are colored outside and the oldest are colored inside. And after this was done, after the fractal character of this shape was identified because one has seen those pictures and was then able to make some measurements, physicists came back to the natural behavior of physicists, tried to make a theory of it, tried to make measurements. Now they didn't know what to measure really but that doesn't stop a determined person. Many measures were made, it was very difficult to interpret. Many were extremely important, others were dubious and others one didn't know why bother measuring these things. The effort to make a theory has been very, very difficult and very unpromising. Now why is it important to be bothered by theory? Well, because in this case it turns out that in mathematical terms, this shape is created by a Laplacian field. You have an equation which is again Laplace equation, solve it, you obtain what is called the harmonic measure of Laplace equation. Many of you know it, others don't, don't worry if you don't know it. I'm just explaining you a few lines what it does. And in response to the harmonic measure, the boundary of the shape gets modified. So you see something completely new entered into mathematical physics. Before one solved the Laplace equation with fixed boundaries, all with boundaries moving on their own separate will, pushed by a piston for example. Here one solves the Laplace equation in the environment where the boundaries are modified by the solution of the equation plus an element of chance. So the equation itself changes boundaries. And that is the key to solution of the paradox of the coexistence of equations and of fractals. Equations are the smooth part, the Laplace equation is valid outside of this very complicated branching structure. The branching structure itself is a boundary at this fractal. That is the fractals are not contradicted by partial differential equations, don't contradict them, they are created by partial differential equations. Now how does it happen? Well, to do so, we, a postdoc of mine, named Carl Evert and myself, decided to look at these things closer. And so here is a figuration of the different way of doing these clusters. They don't grow from one point out, they grow from a bottom up. That's the way they were shown before. That's the way they were shown before. We solved the equation and showed it. And rendered it. Rendered it not for the purpose of decoration, but for the purpose of scientific research. To be able to understand what's happening, want to see exactly what the potential is doing. We changed rendering constantly, same people, some assistants who work on them, students assistants who work on the mountains and such things, we're working on this physics process. They changed the rendering a little bit. We saw something, we changed again rendering to see whether what we saw was real or not real.  And different people interacting, we sort of hunted this potential in its layer. And so what we got was pictures of this sort. Now, this picture here, for reasons which I have no time to explain, and young specialists wouldn't appreciate, tells a great deal about potential. The fact where the potential is, the white regions are the low potentials. And it was believed the low potentials are mostly in the bottom, but in fact they're very much up there. So here is a case where to study this shape of exquisite complication, we really had to understand what it is. All the theories which I told us was in the bottom were just based upon intuition, upon what's obvious, what's natural, but not about fact. In this world, we must learn, constantly modify our intuition of what is important or not. Well, then we had this rendering for different purpose. This was not a rendering of the potential when it was ever rendered, it never went in the deep fjords. It was just to illustrate some ideas about potential. But we decided that potential was something deserved to be studied much more carefully. We turned the picture around, we didn't want to look at the world from the then dry viewpoint, but at then dry from potential viewpoint. And for potential, this thing goes here. Well, let me go briefly because I would like simply to make, not to teach you a topic as impossible, but to give you an outline what's happening. One of my colleagues at Yale is Peter Jones, who is a great specialist of potential theory and had been teaching for several years a course of potential theory on fractals which had emerged out of pure mathematics for its own way. And he had theorems about the behavior potential. He had never realized what the theorems really meant because he had never seen them in action in a difficult shape. We had not heard of Jones' theory because it was very esoteric. But being colleagues, we met, he saw our pictures, we started talking it over. And there is extraordinary meshing between the very abstract mathematics that Jones and Carlson and others are doing on this thing and the physics that we are doing. We are doing the same thing. The same thing can be called very pure mathematics if you go into mathematical details in the right. It is all done called physics if you search for reasons of the structure. Well, let me now go into different mode. The second part of my talk would have been chaos and fractals, but since Heinz Otto is going to present that, I will just go and show you some pictures very, very quickly in very few minutes. So this is a matter of Julia Setsch, picture some comments. Now Julia, it's not Julia, it's Julia. It was my teacher mathematics when I was a student. And when I was 20, I was advised by many people, my uncle in particular, a very influential man in my life, a very great mathematician, to write a thesis on Julia Setsch. I read that book of Julia and couldn't make heads or tails of it. So I told my uncle, I will never, never want to do that and did something entirely different. But learned about Julia theory. Now Julia was a matter with a great deal of a geometric intuition, but absolutely no computers. And in fact, I don't know whether he would have been used computers had he had them because of his personality and the day and his time. But we did, we started looking at computer picture of Julia Setsch, discovered many facts about them which were absolutely obvious and very difficult to prove. And here I would like to make a point about mathematics which is very important. It's very important and also I must say it's controversial because some mathematicians are very much of opposite direction, opposite opinion. I'm those who think that in mathematics there are facts. The facts can be unproven and well described. They're called conjectures, they can be proven and they're called theorems. But the so-called four color problem was a fact of mathematics for very many, long time before it was proven to be correct as a theorem. Many results about soap bubbles were facts about minimal surfaces for 150 years before they were proven. By observation, one can very often get to facts. One can never prove anything by observing. So to achieve mathematical facts, one must take drawing as a tool. The same way as primitive man I'm sure was drawing things on the beach or counting pebbles and obtaining facts about numbers and facts about elementary geometry before Euclid came to put the facts together. Facts have their own life and they can be objected to intuition. And by playing at length with the Julia set and sets related to it, we discovered many facts of mathematics of which some were proven instantly by the competent people. Others are yet unproven and others are proven more or less completely and have generated great attention. So these shapes here which you saw in the video are by Alan Norton who was post-doc with me for a while. These are again Alan Norton's shapes just for fun. These are cut through them and this man on top and this is the set, this picture here as I said was by Voss. This Mandelbrot set magnified 10 to 23 times. In some corners of it it's self-similar. Here is an example of a corner that's self-similar. In other corners it is very far from self-similar. It's a shape which is most conveniently called fractal but it's at the very, very end of fractals. It's sort of at the very boundary of fractals. It's almost not a fractal but certainly very much part of the same theory. That's my favorite signature version of it. You saw these things obtained by modifying the definition of Mandelbrot set by changing some signs and I showed them just for the beauty. And this again would have been a work of art I suppose of embroidery of some sort but it's again mathematical formula rendered rather simply by color code. This one has elements of India which is due to certain very peculiar mathematical properties which we put in the model not to any effort to simulate Indian art.  This one was a different computer bug. You recognize in the shape outline of it the outline Mandelbrot set as if you should because that's what it is. The rest was the result of just very bad programming which we preserved carefully and this one again is what you saw before except it's turned around. And so let me sum up again it's best to think of actual geometry as being a geometric language. Language is being judged always by not by itself but by the quality of the works to which it gives rise and ordinary language is judged by quality of poetry and the quality of the prose. Poetry would be a language used just for the pleasure without any usefulness. In this case you have already in short lifetime two forms of poetry. One form of poetry which was just purely visual that so many people would think that is art and would be so involved in understanding why it is so why it looks like art rather than just mathematical diagrams and it has great influence on many painters. In terms of prose, prose itself ranges from very utilitarian. Teflon directories are examples of prose. Railroad directories examples of that also. In that sense, fractal geometry has been extremely useful on a very lowly everyday basis to engineers. Very often you deal with messes. Messes so complicated that even most skilled people say throw their hands up and say I don't know how to describe it, I don't know what to do with it, I don't know what to measure. I'm just lost, it's just a mess, it's just chaos. Chaos in the ordinary everyday sense of the word. Very often by being aware of the new vocabular fractals one knows what to measure and one can separate different chaoses, one can organize them. One can do what is said sometimes just natural history. Natural history is a very noble enterprise. It's not the last word in science but it's very important when you deal with very complicated messes. Now, what is the other kind of poetry? The other kind of poetry is mathematical poetry. Again, the fact that by using the eye, by using the computer to help the eye, by, we find that there is enormous number of new facts of mathematics which we can discover. Those facts can be absolutely useless at the time. They can be very useful to physics like the facts of which we discovered about potential theory are. They vary but mathematics has its own standing. It doesn't have to be judged by usefulness because it is one of the great achievements of human mind. And last but not least I think is mathematical physics which I view as being kind of the great prose of science which is again the great equations of science that you have listed Laplace, Navier-Stokes, Fourier, the diffusion of heat, propagation of waves, the propagation of potential of stars on each other and so on. These equations have sat for 200 years and have had enormous influence on our life. It is remarkable that by focusing on the fractal aspects of the world somebody or another one of my friends has been able to add to these equations new problems of extraordinary unexpectedness, novelty, difficulty and interest and to say one word beauty. So we are in this situation of why it is that these things are beautiful. Either beautiful because of the pictures are so much attractive to us, beautiful or ugly but reacting in a fashion which is emotional to mathematical shapes whereas the ordinary action of most people to mathematical shapes is that of boredom or of disgust or repellence. People like myself who lived in love of geometry, I realize when I was a student who were in a very, very tiny minority. So there is a very long discussion about perhaps we have been developed as species living in a world which full of fractals, the mountains, the trees, the clouds and everything of shapes of this form. Therefore if you see these shapes in a different guise, in conditions where the self-similarity is less obvious than for example for clouds or for mountains but is there anyhow, we recognize something familiar and familiarity breeds how to say relaxation and well that's one trivial explanation. Another much more ambitious would be that our whole perceptive system has been influenced by this environment and that it had been organized to analyze these kind of shapes. Therefore it loves to analyze new shapes of the same kind and there is a great deal which can be said about perceptive system on this basis which of course I have no time to discuss. As to mathematical beauty, it is something so elusive that I would hate to comment about it tonight. But what I would like to end on is just the message of about the unity of knowing and also feeling that the necessities of everyday science, everyday work oblige us scientists to be different when whether we do mathematics because we have certain criteria or do physics different criteria, do chemistry different criteria but in a certain sense the division between these categories are not got given that man made that divisions of convenience. In this context which concerns a very simple, very crude therefore a very fundamental invariance namely self similarity, we have elements of everything of mathematics, of physics, of chemistry and we have again this new element of a static, which is certainly a very great surprise and a very rewarding one. So I just could only say but end by saying that I have found that to be a very strange adventure to be drawn into that many years ago and to have gone from one of these fields to another as the chairman said without ever feeling that I was changing my activities. And I hope that you have liked some of these pictures with me. Thank you very much.


I knew I wanted to live on campus because it was closer to my classes. I could really get involved that way and just meet all of the students and make new friends. The room selection process isn't very difficult. They lay it all out for you. You basically go onto the website when it's your turn to register. They give you your time and you should probably already have a plan ahead with your roommates about what floor you want to be on and what area you want to be towards because your rooms fill up pretty quickly. One of my roommates, my main one, is from Tuscaloosa. We went to high school together and we knew we wanted to live together. But the other two, we knew we wanted to live with people we didn't know probably from out of state just to mix it up and get to know new people. So there is actually a Facebook group. For each year, usually people looking for roommates and coming freshmen. So we joined that and just looked at all the different options and found two girls that we had similar interests shared with them and we started talking and decided we want to be roommates and it worked out really well. It was such a great experience living on campus my freshman year that I knew sophomore year I would have the same great experience and I just love being on campus near all my classes and all the activities. It makes it very convenient. They sent us a bunch of emails about moving on campus second year like they encouraged it. I just decided that it would be the best option for me and my roommates and we love the semester, love being near everything as much as freshman year it's a totally different feel but it's still a great experience.


My name is Marcin of Chandel and I'm here to talk about resonating craft. First of all, how many of you actually tried using crafts? It's okay to bet. How many of you found it completely unusable and gave up after a few moments? Ah, no. Not bad. First short introduction for those who didn't try. Craft is a package which has a tool which finds things that should be on your system but aren't, or which are on your system but shouldn't be. And just an example of how it does is you invoke it as a root because it needs to respond to the file system. And after a short or longer while, depending on your system size, it's out there recording which things it didn't like. No, on the things that it didn't like, if all is fine then report is empty. Now how it does it? Craft does its job in a few stages. First of all, it needs to find what files are on the system. And just to make it clear, when I mean files, I also mean all kinds of stuff like directories, so crafts doesn't really care. So it invokes finding all files on the system it can find in turn, ignoring special file systems like ProCo and FSM. How many others? And it just dumps a list of all the files on these file systems to a set of lists which tell what files exist. Then it needs to find out what should be in the system, and that part is taken care of by so-called explained scripts, which could theoretically be provided by individual packages, but so far only provided by craft package or created by local systems, I mean. And these scripts produce currently, oh, another thing. I'm talking about the craft which is currently in experimental use, one with 0.18, something that I could do. Is it version support? Well, the previous also works, but it works a bit differently. So this will hopefully be how it will work. And each subscript is invoked and produces three list of files on different files. First of all, list of files which may exist. That is, it's okay if a file like that exists on the system. Then files which must exist. It's an error if such file doesn't exist on the system. And which must not exist. Examples of the files which may exist are things like logs or spool files, which probably exist on the system, but it's not an error if they're missing, if you delete it, or if they're not yet deleted. Files which must exist are usually files which are installed by the package or are added files or some other things as well. And the files which must not exist are somewhat special, mostly for use by package.com, which purges some files. In general, it's not allowed for a package to delete files from other packages, but it's one of those examples of exceptions. So in that case, a wide explanation can say that a file must not exist while another explanation says the same file must exist. Yes, I'll talk about that later. Then Kraft needs to compare these two sources of information. What is there and what should be there. And it produces another three sets of files, lists of files which are unexplained, or missing, which should be there, or forbidden, which must not be there, but are. And these are created in a single run by a clever, modified method algorithm which does the job quite efficiently. And then these files are merged from the invented output as a report, which you can either Kraft can send by email or just output to standard input so you can see it in a pager, or you can use a Midnight Commander VFS plugin which allows you to see it in a three-like way, which is especially useful if the report is something like 100,000 files to different directories which does happen on the real system because Kraft isn't perfect yet. That was the core functionality of Kraft. There's something more. First of all, there's an additional possibility to do some, I call it integrity checking, but it's not really integrity. It's just a way to take advantage of the fact that FIND already scans all file systems and output some list of some files to another stream and then check them in some way. I will talk about it later. And also there's another, let's say, layer called filtering, which also makes Kraft much more flexible in some cases as well. Let's say about checking first. Maybe it would be easier to tell how it works now. Basically, there's only one such stream currently and it's taking care of simulators. So FIND as it goes on all the file systems just outputs all simulings to a file. Then a special checklist is found on this file which just checks if the file is broken or not. And the list of broken simulings is then appended to the record. You could also imagine other reasons to do such checking for things like directories or maybe it's a nonsense but I've heard that Kraft uses additional metadata in some files to implement translators so maybe we could do such checking as well. Anyway, it's now quite well abstracted and it's easy to add another checklist to this scheme. Unlike it was before. About filtering. Filtering is performed by a simple script which just reads all its input from previous stages and outputs everything it doesn't filter to another output. It's a single program which reads different filter files depending on which part of filtering it's supposed to do. All the filters are pretty simple as you can see. They are using an additional syntax to get rid of all saturated retrieves which is similar to Apache and uses if you know it. Why are we using it? Theoretically it could be possible to just do all the job using explain scripts but as in real life there are some problematic cases like some files moving or renaming files deleting files from other packages or conflicting explain scripts or other things that I don't even want to think about and having such an additional layer makes it easy to just get rid of some reports or some part of reports for this assignment that it doesn't want to care about the fact that some package is buggy or that there is a conflict. If you also let the package use the extra files let Kraft use the package extra files when it is finally implemented and in general filtering files is much faster than using explain scripts because explain scripts usually have to first there are different additional process which is to be created and second what they usually do is just run another fine command to just sort some subtree and then output that to standard output so Kraft can then remove the files from the report but filters make it easier and faster and now a bit about history that was written a long, long time ago by Anthony and even as it was being developed there was Anthony so that there is a need to register some files which I wouldn't register anyway currently a prominent example is if you look for FEC password and using the package search it doesn't find it it's not perfect especially for new users but I think having an additional database of all the files which are installed by David would be good so he proposed an extra file to change to the policy unfortunately his proposal was abandoned and the package was not changed to add this optionality and so he had to slowly be plotting over the next few years with just a couple of non-maintainer downloads curious maintainer, non-maintainer some time ago then that kind of thing in Finland I think I asked maybe if it was okay for him to try and take care of for everyone so he can get anything and come out of it so I imported the source to the subversion repository which hopefully makes it easier for other people to submit changes to the numerous filter and explain files I fixed many bugs just a couple are left and I did some refactoring of some code some of which was just quite ugly some of it was impossible to fix some bugs without changing it so it's now mostly cleaned up and works can be some that does not report false positives on a base install that is if you run the bootstrap and run craft inside of it it doesn't say anything but as soon as you start using the system there will probably appear some files like long files or save files there is still a long way for craft to go but why why the additional words in the title, the subtitle of this talk I found out that the ability to have another database of files which are installed by a certain package is a good way to test the package itself I found a couple of cases where the posting script was buggy didn't do what it was supposed to do with alternatives or the versions somehow the system worked but the files were like as they should be craft detected just from such things it also detects things like random files appearing on your system because of a package bug or because of another administrative address it didn't clean up after themselves and that's another reason we should I think we should have craft just to conclude the links to threads on the game policy and the game development that I could find from past I wish this part for I mean I come under which contains the visual file system plugin which is useful for live reports that's about it, any questions? no questions which is slightly unrelated but what is the status of these extra files? the status is there is a proposal a long time ago and that's it I don't have one on the WD package but you have to look at the list to see if I can find it is there any way to make this file declaration run any faster takes ages since the first round doesn't well, every round actually never tried it twice possibly I recognize that this is just a beginning make it work properly first before optimizing it so it's interesting to me because more than a decade ago I was managing group of people to maintain several thousand Unix machines including mostly HQX systems but also some Solaris and other things we had a system that we put in place as a result of demands by our internal auditors that had a data collection engine that was very similar to this in the sense that it was running big finds over the file system huge lists of files and then parsing those down to eliminate things that were understood to be part of software packages delivered with the original OS and then what would happen is we would take the resulting long list of files along with their permissions owners and all that other useful group and that was all being delivered to the central database from which we had one of the very early sort of web interfaces to anything running and where it got really interesting was when you could see patterns of the same behavior happening across multiple machines or where you could discern a new rule that it would be useful to have in processing the data and I wonder if you thought at all about how to sort of take this beyond the here's a sort of human readable text formatted report I wonder if the future of this class analysis tool isn't somehow to figure out how to hook it into one or more of the interesting system frameworks you know come up with some reasonable database schema for what an exception or what a piece of data which might have exception rules and filter rules applied to it should look like and I think that kind of goes in my mind to the question of what people think the point of a tool like this is and why the other folks in the room would be interested in having it. Is it to help just general systems administration? Is it pure curiosity? Is it because you'd like to see if your packages are broken and doing strange things to the system? Is it because you run a lot of machines that are subjected to auditing requirements and you want another tool for that tool? So I'm curious what other if any of this names anybody else? That was a really nice question. Is this more like for developers to sort of clean up the packages or clean up all the people's packages or is it more for system administration to clean up the system after it's run for a while? It's not just about cleaning up the system, it's more about finding sorts of systems. Well then it really ties into an intuitive detection system which also does things like that. They also scan files and check if they've changed. The problem with intuitive detection systems is that they're not aware of the de-packaged database that has the potential to return a shorter report that's easier to read. But it's sort of some of the other ones that dance around in the middle of all these things. Well then I think you also have to ask the question of why does something show up in a crop report. I don't remember what it was called, but someone did a backup system for them in machines at one point that was interesting because it would only try to back up those files which weren't part of the process. Right. So in fact it was the if it's flagged as croft and it's out in some weird system directory it may be because there's a packaging error. If it's flagged as croft but it's in a directory that contains the files that actually matter to you on that system it may be a good indication that that's what's unique about that machine that needs to be backed up. An additional configuration file that results in running a spice job or I don't know whatever it is. And so this is where to meet. I'm really pleased to see that croft has had some attention because Edgy will tell you something I've talked about at various times way back then. This is the class tool that I think is neat because it's taking advantage of things that are uniquely interesting on Debian systems, but I immediately start trying to figure out, okay if we get all the bugs fixed and it's sort of working what would you want to do with it and how might that drive you to make decisions about what to do next. I don't have a lot of answers, I have a lot of questions. One thing I thought of was currently just as the simplest impossible release have lists of files with one filename in one line and no metadata apart from it. So one line would be to change the protocol somehow to let the sub-processors communicate something more than just a filename. For example because this filter process is not just to filter out but to categorize these croft items. So just one rule or leave it or drop it set of rules. Is it slash file directory? Is it a log file? Is it what? Well that really I think comes back to the what are you really trying to accomplish because if you're doing security auditing what you might really care about is not only that the file exists but what's the owner group and permissions maybe other Apple stuff or if you've got other things going on in your system. It could be that if you're trying to do intrusion detecting but you don't only care about that but you'd like to do the tripwire or any of the files that were delivered by packages on your system differing in their crypto check sums from what they were when they were installed and so this is where I for those of us like me who run a notebook that hasn't it's got a devian image that was first installed many years ago it can be very instructive to run a tool like this just on your own system and get some sense of how much true croft has accumulated but if you do that once every five years or something it'll cool not what else we should do with it it's the sort of thing if you're about to move to a larger hard disk in a few minutes with croft would save you transferring that handful of log files that you didn't even know were there that represent kind of six giga-day or something then it might be worth the effort so the truth you know, very interesting things positives to real positive work that my croft was so you know, saying that I didn't think of any more advanced things until I got it to this process reached when we get to it so what would you like to happen actually, like a stall go try the current version and see what we think well, I mean it's neat to see that you've been working on this, that's great but what would you like from us and what would you like to do next? I think the best way would be to have it work properly on something more than a basing store a small standard system which people really use and it's not just created from the bootstrapping and give it pristine and possibly there would be other things that would need more de-factoring of the design and I think at some point we could get to a point where the design is stable enough to think about other things like adding mechanics support or categorizing or anything else Suki talk a little bit about what these false positives normally are in the system anything that isn't directly installed by the batch which is created or created by a demo or another process having an example of one of the longer reports just finding out the stuff something you may be proud of but the rest of the system needs to be more regularized for example where this extra file instead of there is an opening perhaps there's a bug that's already there's one so while it's going one of the things that I was originally finding before I had just completely dropped it because extra files wasn't going anywhere was still reworking the code so that rather than just run and find it would do the directory traversal itself and only descend the directory if some of the explanations or something indicated that some of the files would perhaps not all of them underneath that directory would actually do all of it which would let you say if everything under slash home is unexplained without actually having to find everything under slash home which is probably more important for NFS sort of stuff too and I'm just running cropped now for the last five minutes I think it's not getting a result yet Yeah it would be needed but I just wanted to postpone any performance improvements after I got it to run Yeah well I thought the same and it's still in the first place it's around 70% Well for example one thing that could be like an answer to your question and Steve of course maybe not the main mode the main operation mode but you could besides taking the data from the real life installs take also be able to use locate dv because you have every file in your system registered there I mean just like crossing information between sources that are already available in the system instead of fetching it every time you run it and that's a good that's a good idea It would be similar integration with intrusion detection system of course and that would not work for intrusion detection because an intruder maybe the first thing would be to modify the locate dv or whatever but it works for package maintainers or for users just looking for cropped or for people like VDAs who have a long living system I didn't mean to integrate locate dv with intrusion detection to integrate cropped with intrusion detection to make use of their databases which might be more data rich than locate dv So one of the things that I found a little challenging the last time I played with it which was frankly before you started working was that it is expensive to do a complete run and one of the things I missed a little bit from this old system unfortunately I couldn't just go fetch again because I don't work there anymore was this notion that the process of collecting the data about the system and the further processing of that data were actually quite separated and so it meant that you didn't have to rerun the big find if you wanted to change exclusions or something like that if you wanted to say okay forget slash on you know I didn't I wasn't thinking when I first ran out I included all that data is that stuff easy to do now does it already okay kind of you see that there are three variables here files reports clean up I think okay so you could so if you can tell it not to run this bit which runs both fine and expensive so you could usually split that into two so you could have it on standard file system once and then rerun expensive because you changed one or something okay it's already been there from the beginning okay I see people are talking about EDS because of security everyone has security in mind but I another point because I tend to work like that for example I set up a compete system okay and I and edit a lot of configuration files and I create a configuration file and many other files in different locations on my disk once I have done this I will take all this data and I want to know what is important and what I have added to the system to make it run and it's very important to me because I have I put this this data and I put it in Puppet or CFNG which helped me to educate my system of network for now I'm using DevSams just to list the configuration file I have modified it's efficient because I get a list of something like I know that I've modified adjacent work and my extra extra and I just copy this file into my into my suggestion the Puppet repository and I begin to edit it to make it integrate with Puppet and I think it could be very it's hard to do if you stand in Puppet change the file and upload it to the system because it's long it's complicated if you edit directly the configuration file try the the service it's faster but at the end you must remember all the changes you have done so could you think that just to give you an example if it's possible I don't know if it's what you have in mind but when I have done something in Puppet just to establish that I have changes using Puppet I upload and explain file saying this file has been uploaded with Puppet it's normal that it has been modified it's here because I just put it here and I can see all the changes except the change I have done with Puppet to my configuration file and other data files that I have uploaded to the system you think it would be useful to use Puppet to list this change currently crap on the case about additions or no modifications at all yes that's the reason why I use DevSend and I think that you cannot cop what DevSend do for configuration file but I have the problem just to give you an example UTC can have image that comes should not exist so it is not listed in DevSend run but I have added to the system because I need it so it's a complementary regarding the use of DevSend just to know if the system can use your system to replicate configuration among many so some combination of DevSend's analysis to know which files crap isn't triggering have been changed combined with what crap finds for the files that are not expected of this yes I think I can use crap because he changed only one for this for this or no it will tell you about the files or no but all the files all the subversions but it doesn't know about files have changed but if we add some methods or checks on support I think it could be okay I didn't know it takes that long it could be because I used it only on my truth just to show you I have more than one that's true in the system so we're all watching a great curiosity whether you wait for it to finish or not my page so what the term is I don't know how maybe I have some old it's still running I have an idea for this this application although this would help a lot wouldn't it be cool if we had a file system that cashed in somewhere except for there well that's fine too but I could do both but then you could use it but then you could use it for rsync and devsums and cruft and a whole bunch of other things you could probably use the xt3 because it has the ability to store we could use lots more bring it up well then you could use you could do it like in some of the journal you could have it, you know, cash that stuff in some other files somewhere that would be really fast you could use the kernel iotify mechanism to have a a demo to do this yeah so in the file chain it would do it right yeah so we've got a two gigabyte file and we've changed one byte of it that's reconcuted, yeah the entire file one byte anyway no, you could do it incremental that's what we'll do with those that's what we'll do with the extra RAM it's got to be pretty fast just to get rid of the distance that's fine we can actually be able to compute you know, texums per per ton well I'll figure it out that way you can just might as well just hook it in the iotify and check to find that as it was created if it should be created but then it's kind of crazy it kind of is a new file system definition to store this along with the other file matter there there's probably a little stuff you can do like that well anyway here's an example of false and lots of false positives so why would those be there so how can those be there in the registry they're all so those would be hard links to a single binary problem that are created on post-hones yes there are all the facts of nasty things that developers do but we can get more than that so the problem is if a package is doing nasty things like those hard links where do you store the information about this not being cropped in the package or in extra files the possibility is packaged to be delivering the way we do this oh yeah it's finished running well basically if it's not installed by the package and it's not something like an alternative well why is it that PY is getting hit no because that's support that seems to me that pretty much everything should be stored unless you want to keep a huge database of everything so in theory it just has a filter saying that anything under valid Python support is controlled by Python support so it's all fine but if you had something under valid Python SUP or RT then that would be mistake because it's a typo so obviously something won't put there accidentally and it's not controlled by Python support so you might want to know about it also Python support doesn't do its job properly there's some bug which you can never find but then you never know about it have you looked at the way the filters work in log chain supposedly intrusion detection what do you call that then what do you mean but it it has just all this complicated system for either marking that something that an oddity is the responsibility of some but package it all of this log chain has been used as regular and quite extensive and all these shazos made of logs as opposed to the logs so it may be actually like what's the certain point good regular expression and it is better than just trying to quantize and craft it I imagine really well if Jean Lebson had actually worked his document at the time he might well have worked his document a bit now there's definitely lots of room for improvement ideas or what to help I have a machine that was installed in 1997 and it's been running on the table ever since then and I've just been totally sloppy about everything that I've installed in there is it useful to you to do a cruft run and get all this garbage back and then send it to you and that will help you to get it back and just fix it okay it might be interesting to realize where you can send the cruft reports like what kind of people are willing to do just some files that are already do you think that there will be an issue automatically I mean just have a comment on that I want to make all my files the good thing about popcorn is that it runs quickly running a cruft in the background well it kind of slows you down a bit yeah yeah it gives us better memory that could have saved you yeah but when I'm not using that stuff it just wasted anyways flushes out the cache that's the tough part I would like to at the moment to work on more packages so do you want to start collecting more rules about what sort of stuff is is it okay so do you want to work on getting speed better or what's the next question the ultimate goal is to have more patterns and trade with if the way the current performance is suffering people from trying to submit in cartridges or maybe improving performance is a more player I think it should be a bit of both because if it gives you lots of false pleasantries still on your own system you probably don't need a lot of input from other people yet you need to sort it on your system first and then you can work on making it more beautiful for more people to learn what do you tell package maintainers now who provide who deliver things to explain the way files that they create what does the same documentation doesn't say they should explain away things that are automatically created or log files I'd say for now the best way is just send an explain speed or a filter file so I mean I'll file it in PGS and put it in crap because I haven't really thought about the way that overrides should work because say a package has an explain speed and then the maintainer about it and the explain speed gets outdated after some time so then I then I ship another improved version of crap which overrides it but then again the maintainer does more changes and then he's got the better version at some point so we need to think of a way to let it work for the other one thing I thought of was to have a one line comment or explain speed or a filter file which would say the last recently changed version of the package last model so I think for most packages you don't need to worry about an explain speed but just a filter file which is just a list of files that you manually delete from a removable purge with the slash star slash double star and I think having a file like that for each few packages would really much get rid of those positives I guess my point is just the mentality of what are the assuming that crap just trying to accomplish of the different classes that we talked about finding junk on your system and these things are different please back them up if you tell them depending on what you tell the maintainer logs may or may not be interesting maybe you want to back up logs but if you're just trying to explain that it's like no this isn't garbage it should be here then you would have that in the filter so you may even want to define multiple classes of like things that are you'd have to come up with use models for craft for something like that you probably want to have a report so generate a report that these are the files I've got no idea about ones that should be here or ones that should be here but that's more give me a list of files that I'm going to be taken care of by deep package saying and then you're just excluding the deep package files, excluding all the files that are taken care of that's something that's where you're going to go again it's like known about outside of deep package and unknown as the two categories and then somebody who is choosing to use craft to back up their system would want to back up the things that are known about but outside of deep package and you would yeah I think that's more easy it's just the matter of the deep package in front of this because that's everything in deep package yeah I think it's still all the packages that you might install previously and I think they're all called files and all the files that you might craft so in theory I've been sitting here thinking about this though and the thing that's happening in the interim of the last few years that makes me wonder how many people would really actually do that very much is the emergence of tools that do Delta-based fundamentals like where it's in effect are syncing your tree over to a server and the servers on the store and the files that differ from the last time you did it which leaves you in a situation where you have a no-brainer way to put the system back to the state it was in at any point within the window you've configured it to keep history for and I wonder if that's sort of truly a generic approach for doing system restoration or replication isn't almost more interesting than something like this where I just keep thinking there's two more special cases you'd have to think about it makes me wonder if this isn't a more interesting idea in the context of either system cleanup or possibly intruding detection kinds of interfaces maybe at least in my mind maybe less interesting as a way to drive a backup or a system and restoration process I don't know different people with different values and different things putting this much energy in figuring out how to handle the stuff that's roughly associated with the packaging system and interesting servers and interesting machines tend to have the vast majority of their content and the other data that's on the list I just wonder how I'm excited about this I've certainly thought about it before a bunch of times myself and it's another one of those routinely appealing ideas but I'm just not sure it really does like it's around the tangent where I work for Windows PCs they use a proprietary tool called connected backup and it backs up a whole bunch of PCs but it looks at only 5 sums of files to figure out what's different and so it's backing up 100 PCs and they're all running the same version of Windows it only has to back up one copy of most of those Windows files likewise if 20 of those machines are running a particular application that it's still it only has to back up that application once and I thought that's kind of a neat idea to see for Linux where you could kind of repair we should ask Keith because he actually uses it I think that maybe something nervous does because he was kind of convincing that I ought to be backing up all of the annoying kids I might have to use a nurse to adjust and then let him act at the table so that we would be directly at the table but it just uses R-Sync but it's also maybe comparing the different machines but it does use R-Syncs to treat the server it's impressive that it's almost the same and it actually does see where it's going so you can actually go back not just per machine but across machines it seems obvious and logical that that would be there what if the code actually does back up and Keith would know I think the connected thing is even smart enough to do if the MD5 sum of the file is the same even if it's in a different path it still does the right thing to connect the backups but in the end we wouldn't have to worry about that exact issue you were mentioning because well in Windows it's regularly usual that low-privileged user installs an application on his accessible directory in a unit system it's not that common although of course in large installations it may be it's a really big deal when you get into production environments because then typically people are wanting to be very careful about how they let things change and migrate it's not, you know, for a bunch of individual developers or mixed population machines you're right they're going to be less similar but if you get into any kind of an office environment or certain kind of large production environments people really do want to control the process by which things are updated no, I mean of course I understand that point that point I completely agree for example with the solution you mentioned at the beginning of the talk that there was a backup system that took only the differences between a regular in the game install and working hardware and it was a package but you're saying it's less of a win on an analytics-based system than it would be on a Windows-based system it's quite strange for a unit system that's not a huge machine to have the binaries in different places specifically for a living environment although data yes and there's data as well so it's about unpacked kernel trees it's not purely filing that you may have 20 different kernel trees that are most of the same you could really win a lot of money ideally what it would do is download the 5-Sum the file oh that would be an easy first to do that would be a really good idea you just dump all of use the NB5-Sum just like Git does use the NB5-Sum as a file into a Git repository alternatively NB5-Sum into a directory that's keyed by the first two digits of the NB5-Sum and then hard-linking that back into the tree so you create a tree that hard-links into NB5-Sum named files and then the files are all shared across multiple pages it's pretty much just using Git to store your entire file system your entire file system that would not be hard to hack out I work with a similar tool that just goes through an entire tree and finds where files are identical and hard-links them and that can be evil but sometimes that's not the behavior you want I think he was doing it when he was building ISOs or you weren't going to change it anyway well the dervish notion of having multiple trees that hard-link the same file across them for multiple generations it's a huge feature for backups I can't imagine doing R-Sync makes it so easy you just make a hard-link tree copy and then R-Sync onto it so it's creating a hard-link tree on top of it it's really, really simple there's a lot of directory entries there who cares? I hadn't gotten around to figuring out what it was doing there was a point in history where I went and looked at a few of these and I couldn't find anything that I thought was better than hers but it's been a while since I looked and I never got around to implementing any of them I have my wife's machine still backup, so that's something actually I've been very lucky to last a couple of times since the previous backup it's been good so I think we're officially on a 10th now are we done with the crop still? well anyway I know there's place for much discussion still but I think it has to be my role to say this buff is over okay thank you


What if educators used memes to help ensure students understand what they're learning? Any matter provides iOS and web-based meme making tools, and teachers get recommendations about how to use these tools with students. Kids that are looking at this, even if they find a teacher to be goofy or the mean to be goofy, they'll remember it because it's goofy. You know what I mean? And if they find it to be funny or actually really good, they'll remember it because it's funny and really good. So I think it doesn't matter. I love that they're doing this. In the late 80s and early 90s where everyone was making a rap video about stranger danger, what to eat, you know, things about health. And they were very cynically done without really understanding what hip-hop was about. And so you had really bad, cringy music that just turned off people and in many ways became memes themselves. Except for don't copy that floppy certified banger.