So we have a big picture out of parade that we have. Oh. Say, I think I found out how many people read that, and we had a recent shipwreck. And they covered the hands of the other shipwreck almost every one of them said they'd read this story. This is Mr. Warren. Mr. President of Detroit. Oh, you're good. You look as good or better than your pictures. It's a pleasure to meet you, Mr. President. Thank you very much. Mr. President, how did you do? Fine. Real nice to meet you. Thank you very much. Mr. President, I'm so happy to see you. You say a builder of thousands of homes and it gives you more than a day of fishing? Thank you very much. Thank you very much. Alright. Thank you. Mr. President, Mr. Barry Zorthiam is a great company, a great company here at Washington. I'll break the camera with Mr. President. Mr. President, let me have a seat and everybody sit down. Excuse me. Do you? Vice President South County is not using it. A few comments about these gentlemen. I just wanted to tell you that I've been using the Deco Blue Pencil. You left the fuel around in the office that I've been able to use successfully. First, as you probably heard, we've gotten ourselves out of that terrible financial mess I found. And I will solicit all your help because I am sick and tired of doing without it. Every president has tried to get it at the national level. They'll never control the budget at this level unless the president has my night in veto. The law is ruling and then they tie that thing to the bill that you can't veto. This is automatically a high veto. The governor knows 943 such items in the eight years that I was governor without one of them being overwritten. And as you know, I brought it up in the Republican Governors Conference in Chicago a few weeks ago. And then once the national governors get together again in February here, I think I'll bring it up again and try to get the national conference on record too. I think they have been in the past, but this will... I guess about 40 out of them have it in the United States. So we want to kind of keep doing a weekend on that story to give you a little more of a hand at that. There's a very interesting little psychology in that. In our own state, I don't know if I'm saying the budget over the two thirds of the budget. But when you veto something, I line out in veto. If the same two thirds votes to override your veto, they will be written. But as I said, never once, when they have to face that particular item all by itself, do they ever have a nerve to vote on it? If they can hide it in something, they do it. We're going to keep working on that. We thought maybe at the start of this session with you that everybody would go around, everybody would quickly indicate who they are and the organization they represent. So you have a little idea of the breadth of the group. And then if I may face it, I will summarize what's happened prior to your being here and then let you and the group have a discussion. I know the breadth of the group because I've read all your names and your abbreviations here. But I can't put the faces with the name. Do you want to start in? I'm Virgil Becking with the Supreme Mayor of the Knights of Columbus. Mr. President, I'm Pete Gallagher, Executive Director of the New York State Federation of Catholic School of Parents. I'm Herb Titus with the Christian Broadcasting Network. Marilyn Mundy, President of Citizens for Educational Freedom. Lendi Fiori, Superintendent of Catholic Schools in the Archdiocese of Washington. I'm Dick Damon, I'm Legislative Director of the Moral Majority. I'm Brother Jack Myers, the President of the National Catholic Educational Association. I made a question for the Governor of Indiana and for the Accelerator of Christian Education, and I appreciate your government. And it's good to see you again. We were governors together a number of years. I'm Paul Irak of Coalition for Catholic. I'm Kirby DeCote, Louisiana Federation of Citizens for Educational Freedom. Greg Butler, National Pro-Family Coalition. Frank Monahan, US Catholic Conference, and I'm also sitting here for Bob Smith, Executive Director of the Council for American Catholic Education. All the wrong answers from the United States Catholic Conference. Bill Billings, the National Christian Action Coalition. Mr. President, I'm Bob Dugan with the National Association of Evangelicals. Don Howard with the Accelerator of Christian Education. We're going to be there. Good to see you. Anathan Mbunski with the Buddhist Israel of America. I'm Dennis College, with the Jesuit Secondary Education Association. Glad to have you all here. I know the last time we met was in many of us in the meeting of this kind. It was September 16th and two months later to the day. We had a vote in the Senate, which was a disappointing vote. But at least in one way represented an accomplishment of us for the first time. We had an up-and-down vote and we know where the bodies are. If I could just take a few minutes and then I'd like to hear your own suggestions and hear from you. We do not accept that vote as the final word on tuition tax credits. We're determined to keep after this. I think we must be careful and not perceptively just to get a vote to go again and risk another defeat. I think we ought to take some action to see if the next one won't be successful. And on that score, I wonder if, while it is necessary to lobby the Congress, I wonder if it isn't also necessary for a very stepped up campaign at the grassroots level. I have often said don't make them see the light, make them feel the heat. And I think that we have a case out there. I don't know whether you're aware of this, but as far back as 1945, Polo was taken by the American people and 57% of them believed in tuition tax credits. Now the most recent poll today is 67%. Now support this idea. Here in Washington, you're up against one of the most powerful and sophisticated lobbying machines, the National Education Association. And very frankly, I don't mind saying my own view on them. It is that it's not just tuition tax credits they're against. I think that their goal has been for a number of years. The elimination of schools like yours and the elimination of the local system. They want a national school system. And I don't think it'd be right that little Willie's mother would have to go to Congress instead of going to the principal of the local school. But the, I think we've got to work at the federal level but also with the Supreme Court decision on that Minnesota ruling. I think this is a time also to step up the action at the state level. And if we get the number of states that are already moving on that, that has a powerful effect at the federal level. But we're going to try and we're going to keep working on this. And could I suggest, you probably already thought of these and are using them, but could I suggest two things or two ideas that I think we should be selling to the people of this country. One, I believe the Americans are basically fair. And I think again, we should emphasize the fact that we're talking about people who are paying double. They're not utilizing the one school system they're paying for. And they're not complaining about that. They are financing another school system. But on top of that, appealing to people's pocket books, the idea that the NEA has succeeded in planting an idea among the people and certainly here in Congress that some way this would represent taking money from the public school system. Well, it wouldn't. But the idea that could defeat that, looking something with something, is that if the people have called their attention, that if your schools close because of financial hardship, this is going to dump an additional burden on the local schools. But it is not going to increase the number of people who are financing that schools with their taxes, because they're already financing the schools with those taxes. And this is one that I think we should hit the people with very hard that what would be the situation in public education if suddenly thousands and thousands of students were turned over to that system and with no additional revenues to support them. And with that, I'll turn to you for ideas and suggestions. Mr. President, in Louisiana, for the sound to get a little less. I just wanted to say something and then I'm not going to take any more questions or anything. I've got to get aboard and go to Indianapolis. But I just wanted to say something about this supposed break-off of negotiations in start and call to your attention that the Soviet Union, this was a regular adjournment that was scheduled to take place. And the Soviet Union in departing simply said that they were not prepared at this time to set a date for resumption of meetings. But I thought also that it might be a pretty good time to state our own position on this and why we're going to continue attempting these negotiations. It was just 30 years ago today on December 8, 1953 that President Dwight Eisenhower made a speech on this very subject of nuclear weapons. And in that speech he said to the making of these fateful decisions, the United States pledges before you its determination to help solve the fearful atomic dilemma, to devote its entire heart, mind to find a way by which the miraculous inventiveness of man shall not be dedicated to his death, but consecrated to his life. And this administration endorses this view completely and this is what we are dedicated to. It also sounds very tough and final. Well, other than in this one, I think if they're pretty careful about their choice of words and all they said in this one was that they were not prepared at this time to set a date for when they would come back. I am very hopeful they will. I think this is more encouraging than a walk out and simply saying they won't be back. He is taking that up with the ministers right there now and I would support such a thing. I think that it would be. And that would sort of answer your question too. I think there's some preparation. There's been no indication from them of any desire for such a meeting. But Senator or Secretary Schulz meets Gromyko in Stockholm at that meeting. And we have not been out of touch. We have kept in communications at a number of levels. President, we'd better get on the way. Moving the Marines away from the airport in Beirut. There has been some talk for a long time about a change in assignments there and that still goes on. Thank you, sir. Would you like them to approve that, changing their position in Beirut? It is a move that is done in a dovetailed in with the Lebanese military force and I don't know what the military problems are or what they might be resolving right now.


السلام عليكم ورحمة الله وبركاته بسم الله الرحمن الرحيم والصلاة والسلام علي سيدنا ونبيجنا محمد وعلى آله وصحبه وسلم يا ربنا لك الحمد كما ينبغي لجلال وجه كوابي من سلطانك اللهم يمقلب القلوب والأبصار ثبت قلوبنا على دينك بسم الله الرحمن الرحيم سوف نتحدث عن التبسير من الثلاثة من الصورة الملك ونبدأ with آية 12 بسم الله الرحمن الرحيم إن الذين يخشون ربهم بالغيب لهم نظفركم وأجرهم كبير إن الذين يخشون ربهم بالغيب will have forgiveness and great reward إذا يخشون الله سبحانه وتعالى لا يحدث حتى أحد يعرف أن الله سبحانه وتعالى والأفضل الذي يعرفه الله سبحانه وتعالى are the scholars الله يقول في القرآن إنما يخشى الله من عباده العلماء فقط من تلك الثلاثة من أجهزه العلماء والأكثر أن تعرف الله سبحانه وتعالىder the expected fear the more fear your will have to Allah إن إني لا أخشاءكم لله وأتقاكم له He is swearing that He is the most person who fears the first person who has as he knows نعلم الله سبحانه وتعالى إلا الذين يخشون ربهم those who fear their Lord إن سورة واقع الله سبحانه وتعالى says وَلِمَنْ خَافَ مَقَامَ رَبِّهِ جِنْلَتَانَ for him who feared the standing before Allah سبحانه وتعالى there will be two gardens so fearing Allah سبحانه وتعالى in the unseen has three forms the first one is that someone fears Allah سبحانه وتعالى and he fears meeting Allah سبحانه وتعالى on the day of judgment because we all know that there is no doubt there will be a day of judgment and we will all be meeting Allah سبحانه وتعالى so this is the first form of fearing Allah سبحانه وتعالى and Allah said indeed you are laboring toward your Lord with great exertion and you will meet Him definitely there will be a day that we will all meet Allah سبحانه وتعالى so fearing that day makes people most of the believers leave out those things that Allah سبحانه وتعالى had ordered the righteous people, ordered people not to do because they know that they are meeting Allah سبحانه وتعالى so they won't do these bad deeds in order not to feel ashamed in front of Allah سبحانه وتعالى when they stand before Him the second form of fearing Allah سبحانه وتعالى is called خشية المراقبة خشية المراقبة is fearing that Allah سبحانه وتعالى is seeing us is over watching us ألم يعلم بأن الله يرى does He not know that Allah sees so whoever knows that Allah سبحانه وتعالى is looking at Him is seeing Him Allah knows what's deep inside His heart or what He says in public Allah knows it all so if someone knows this if someone has this idea with Him always that Allah is seeing Him how can he disobey Allah سبحانه وتعالى the third part of fearing Allah سبحانه وتعالى is the highest actually form of fearing Allah it's خشية المشاهدة and المشاهدة is that you know you feel that you are always with Allah سبحانه وتعالى you feel that Allah سبحانه وتعالى is over looking at you تنظر إلى الله سبحانه وتعالى and this is the highest مقام of إحسان أنت عبد الله كأنك تراه فإن لم تكن تراه فإنه يراك so you are for sure certain that there will be a day of judgment that there will be a day where we will all be standing before Allah سبحانه وتعالى so whoever believes in the day of judgment the day of judgment knowing that the day of judgment is unseen and knowing that for sure this day of judgment is going to happen so this is faith this faith pushes someone to certainty to being so sure that Allah سبحانه وتعالى is with us in this dunya الله سبحانه وتعالى is over watching us in this dunya so if Allah سبحانه وتعالى fails someone in this dunya it doesn't mean that he doesn't know what happened no it means that Allah سبحانه وتعالى is giving a chance for the one who disobeyed him to go back to himself and to realize how bad that thing that he has done and that he has to ask Allah سبحانه وتعالى for forgiveness and the more sins someone does the more he makes stifar the more he does repentance then Allah will accept him someone should not get disparate someone should not say oh I have a lot of sins I don't know how to meet Allah I don't know what will happen to me but a person should not have despair in the mercy of Allah سبحانه وتعالى once we know the story of a man he was not a good person and when he was at his deathbed he ordered his children to burn him after he dies and to take the ashes and to throw it in different areas a little bit in the sea a little bit in the forest a little bit in the garden a little bit here a little bit there so when Allah سبحانه وتعالى asked him why did you do that he said I had fear that you would be angry with me and we know that some once Saeed محمد صلى الله عليه وسلم says لا يجتمع وخوفان two fears will not be at the same time for someone someone will have fear either in this dunya so he will do good to meet Allah سبحانه وتعالى happy with him or he will have fear in the akhirah because he didn't fear Allah سبحانه وتعالى in the dunya and he is afraid he is scared of hellfire when he realizes that this is reality this is what will happen to him so Allah سبحانه وتعالى is saying Allah is talking about fearing him إن الذين يخشون ربهم بالغيب so whoever fears Allah سبحانه وتعالى in dunya Allah سبحانه وتعالى will save him in the akhir Allah knows everything whether what is concealed or whether what is known so we have to learn how to fear Allah سبحانه وتعالى and fearing Allah سبحانه وتعالى starts with the companionship of those people who fear Allah سبحانه وتعالى so we learn from them and Allah mentioned that in Surah Tulkath 28 when he says وصبر نفسك مع الذين يدعون ربهم بالغدات والعشي يريدون وجه and keep yourself patient by being with those who call upon their Lord in the morning and in the evening seeking His countenance so we have to seek Allah's pleasure we have to know that Allah is pleased with us so we have to learn from the people who fear Allah سبحانه وتعالى how to fear Allah سبحانه وتعالى and there are so many ways that we have to be careful about we have to be careful about our money is it lowfall is it have we collected our money completely without any doubts that our money is lowfall some people if they are working and their boss is not there they do not do ihsan in their work they say okay this is okay but if their boss is there then they would do it perfectly and they would overdo it so this is one thing this is fearing Allah سبحانه وتعالى it's not fearing people it's fearing Allah سبحانه وتعالى sometimes people would have pride in themselves so when they look at custodians they would say oh we are better than those people this is pride this is not this is so bad we have to fear Allah سبحانه وتعالى whoever gave us the rank that we are in Allah is able to take this away and make us lower than other people so we have to fear Allah سبحانه وتعالى and that should be especially when we are alone we fear Allah سبحانه وتعالى when we are praying at night so when we are doing our night prayer then everyone is asleep this is exactly the time that there is no one watching us it's only Allah سبحانه وتعالى so when we read the Quran at night we contemplate we reflect on the ayahs of the Quran then we are doing that only because fearing Allah سبحانه وتعالى people would read the Quran and they would think about it and they would cry they would cry when they understand what Allah سبحانه وتعالى has said what Allah سبحانه وتعالى meant what Allah سبحانه وتعالى has prepared what Allah سبحانه وتعالى has given us so they would remember this is the time when people are alone with Allah سبحانه وتعالى and we know Sayyidina Muhammad صلى الله عليه وسلم said in the hadith سبعة يوظلهم الله في ظله يوم لا ظل إلا ظله رجل من ذكة والله خاليا فطابط عنا there are seven people whom Allah سبحانه وتعالى will shade them in the day of judgment one of these groups is a person who remembers Allah سبحانه وتعالى and cries because of the of fearing Allah سبحانه وتعالى that person would cry because he missed some work he missed some days that he didn't do good work he missed some some points that he didn't get good deeds in those days he would fear Allah سبحانه وتعالى he would fear Allah سبحانه وتعالى as he says قد أفلح المؤمنون الذينهم في صلاطهم خاشعون certainly will the believers have will the believers have succeeded those who are during their prayers humbly submissive and the heart does not show or does not practice this fear this khushuwa this submissiveness to Allah سبحانه وتعالى unless this heart peers Allah سبحانه وتعالى and for those people Allah سبحانه وتعالى says let's see another point that when Allah سبحانه وتعالى says about those people who fear him they fear something very important وقديمنا إلى ما عميلوا من عمل فجعلناه هباء المنطورة Allah سبحانه وتعالى on the day of judgment he will get to those who have done deeds but those those actions those deeds Allah will make them as dust dispressed why because their intention was not good because they associated other than Allah سبحانه وتعالى with their intentions so they missed the reward because of having the intention not pure so the righteous people would fear that their actions will not be accepted رضي الله عنهم ورضوا عنهم ذالك لمن خشي ربه but Allah سبحانه وتعالى says Allah is pleased with them and they are pleased with him that is for whoever has feared his Lord fearing Allah سبحانه وتعالى is the key to get his to make him pleased with us so the question now is asked how do we fear Allah سبحانه وتعالى we just mentioned to be with those who fear Allah سبحانه وتعالى to be in the presence of those who fear Allah سبحانه وتعالى so to learn from them another point is to know Allah سبحانه وتعالى and again we need someone to show us the word to show us the path of fearing Allah سبحانه وتعالى and the third point is we have to read the book of Allah سبحانه وتعالى not only to read it but to understand it also because the more you understand of the words of Allah سبحانه وتعالى the more fear you will have towards Allah سبحانه وتعالى then we have also to to think of the blessings that Allah سبحانه وتعالى has given us and the more we know the more we realize how lucky we are how things are prepared for us in the most beautiful amazing way then we feel that deep inside our heart we fear Allah سبحانه وتعالى to disobey him after we feel ashamed to disobey Allah سبحانه وتعالى after he has blessed us with so many gifts لهم مغفرة وأجر كبير for those who fear Allah سبحانه وتعالى they will have forgiveness they will be forgiven and they will have great reward so Allah سبحانه وتعالى will be pleased with those people who feared him in this dunya وأسيروا قولكم أو اجهرو به إنه عليمون بذاتي الصدور conceal your speech or publicize it indeed Allah is knowing of that within the breasts within the heart Allah knows everything whether we mentioned it or whether we kept it inside whether we kept it for ourselves Allah سبحانه وتعالى knows what is what we are thinking of Allah سبحانه وتعالى knows whether we told anybody or we kept that to ourselves and then in the day of judgment في الصدور and that within the heart is obtained the people of Quraish the non-believers of Quraish used to plot against the Muhammad صلى الله عليه وسلم and they used to say today we are whispering so that no one will know what we are doing so nobody would tell Muhammad about what's going on but what will happen Allah سبحانه وتعالى knows what's in their hearts and knows what they are mocking what they are plotting so he would send جبريلا عليه السلام to tell sayidina Muhammad صلى الله عليه وسلم what's going on and in so many incidents that sayidina Muhammad صلى الله عليه وسلم some of the people who used to who did that who did that gathering silently who did that gathering alone one of the people would come to sayidina Muhammad صلى الله عليه وسلم and sayidina Muhammad صلى الله عليه وسلم would tell him you said this and you said this and this is what you are planning to do they know that sayidina Muhammad صلى الله عليه وسلم is always telling the truth and they knew that nobody none of them told him what happened so Allah سبحانه وتعالى knows what's in the heart knows what's in our thoughts and we have to raise our children to this we have to raise our children to fear Allah سبحانه وتعالى because Allah is always overwatching people we have to instill these ideas in our minds in the heart of our children ألا يعلم من خلق وهو اللطيف الخبير does he who created not know while he is the subtle he is the acquainted he knows he knows us deep inside and out loud he knows everything whatever we say he knows whatever we think of knows if someone built a new instrument let's say let's take someone someone developed a new car he knows all the secrets of this car so Allah knows Allah created us all and he knows everything about us all sometimes you say something and people would understand it in a different way other than what you said this is not what you said but they would say oh you meant this wait a minute what you meant is deep in your heart and no one knows what's in the heart except Allah سبحانه وتعالى therefore we have to take the outer the outer thing and we have to leave the intentions to Allah سبحانه وتعالى because he is the only one who knows what's inside the heart who knows what the intentions the real intentions are so be aware of the whisper of the shaitan shaitan would beautify the bad things but Allah is the one who knows what goes inside ourselves or ourselves Allah is the subtle what does this mean sometimes you feel that if you stepped just one one if you take one more step then an accident would have happened who prevented you from taking that step the subtle of Allah Allah please so Allah gives you the different methods of خير with ways that you yourself don't know he is the subtle he is Allah please he is the acquainted he knows everything before it happens he knows everything while it happens he knows everything after it happens but because he is the subtle he gives chances for people who did something bad just to repent and to ask him for forgiveness and he will forgive them هو اللطيف الخبير هو الذي جعل لكم الأرض ذلولا فمشو في مناكبها وكلوم الرزقه وإليه النشور الله is the one who made the earth tame for you he subjected the earth for the earth for you so walk among get slopes and eat of his provision and to him is the resurrection if we look at the earth we have to thank Allah SWT it's still it's not moving imagine that we cannot we cannot stay still because the earth is shaking every now and then disasters will happen but Allah SWT has tamed the earth for us he subjugated the earth for us so that we live on it so that we benefit from it Allah has created us from dirt and we are all going to be buried in dirt inside this earth فمشو في مناكبها so فمشو في مناكبها you have to go in this earth you have to see provision you have to see knowledge you even can go from place to place just to see the wonders that Allah SWT has created and learn remember that take it an easy thing just think about it if you if you go around if you have a walk you will see trees you will see birds you will see the butterflies you will see everything around you remember that the whole universe is saying سبحان الله trees say سبحان الله pebbles say سبحان الله stones say سبحان الله everything is saying سبحان الله shouldn't we ourselves say سبحان الله whenever you see something nice something beautiful something just say سبحان الله so you are on this on this earth Allah SWT has spread people all over in this earth so if you leave your hometown if you travel if you if you are to settle in another place then be sure that you are doing and be always prepared that wherever you are you need to spread the religion of Allah SWT you need to teach the book of Allah SWT if you feel you cannot if you feel you are not able but you have to be sure to be a good model to people to be righteous people so that people even if they don't know your religion they would say they would say oh these are good people we have to learn from them so practice good manners because these these manners that you are practicing reflects the religion you are following وكلهم يرزق so just enjoy the the rizq that Allah SWT has given us travel go here and there and eat and but when you have fun you have to remember that وإليه من شور we are all going back to him so when we are enjoying these bounties we have to keep in mind that he is the one who gave everything to us we have to keep in mind that we have to worship Allah SWT we have to keep in mind that we have to be good people we have to we have in mind that we will be tested in this life on this earth so that Allah SWT will reward or will punish those who do good or do bad those who succeed or those who fail وإليه المشور we are all going back to Allah SWT so he is the third of the earth then we are going to be buried in this earth and we will come back to him أأمنتم من في السماء أن يخصف بكم الأرض فإذا هي تمور do you feel secure that he who holds authority in the heaven would not cause the earth to swallow you and suddenly it would shake do you feel secure that Allah SWT will not ask will not order the earth just to swallow everyone on it so the stillness of the earth of this earth that we are living on increases our topate increases our faith in Allah SWT so don't get secure that if you live on this earth and if you don't follow the orders of Allah SWT that he will not destroy these people we've seen that Allah SWT have destroyed the previous nations when they disobeyed him and when they belied his messengers أأمنتم من في السماء أن يرسل عليكم حاصباً فستعلمون كيف نذير or do you feel secure that he who holds authority in the heaven would not send against you a storm of stones then you would know how severe it was my warning Allah SWT has destroyed nations with storms so those storms are full of stones this storm by itself is a huge punishment imagine that this storm is filled up with stones also and with this it's a reminder that when it's the time of punishment then Allah SWT is not going to accept the repentance of people because the the chance is lost ولقد كذب الذين من قبلهم فكيف كان نكير and already had those before them denied and how terrible was my reproach so من قبلهم means before the nation of Sayyidina Muhammad the nation of the nation of Allah SWT gave them a chance but they did not use that chance so he was so upset with them he was so angry with them وكذلك أخذ ربك إذا أخذ القرى وهي إن أخذه أليم شديد and thus is the seizure of Allah SWT when he sees the cities while they are committing wrong indeed Allah SWT is painful and severe so after saying this Allah SWT is giving us an order to look at the beauty of this universe so he says هل أنتظروا إلى الطير فلقهم صاف فاتهم ويقبضهم ما يمسكوهن إلا الرحمن إنه بكل شيء بصير هل أنتظروا الأطفال مع الأطفال وكذباً أنتظروا أخذهم وكذباً حقاً هو كل شيء so Allah is saying إذا أنتظروا في الغرب and see the birds flying sometimes you see that the wings are outspread and sometimes the wings are folded so who kept these birds in the sky take another example look at the aircraft when an airplane is in the sky with 300 people on board what is it it's let's say a tube a metal tube that has people inside should it not be for the caring of Allah and the mercy of Allah who is keeping this aircraft in the sky some people would say for the wings and the engines yes that's right but who is keeping these things moving in the sky لا إله إلا الله بسبطة اللطيف الخدير سيسبحان الله when the computer of the aircraft is damaged so all these engines will not work at that point no power would prevent this aircraft from falling no one the pilot is there the copilot is there they are holding they are doing all they can but no one can hold this aircraft from falling down it does not will that this aircraft stays in the sky same thing for the birds look at the eyes Allah look at the earth he says look at انظرو إلى الأرض with all these examples we say look at the earth with everything that Allah has created then look at the skies with everything that Allah has created and placed in the skies the moon the stars the sun everything then look at what is in between the earth and the sky so the whole universe is beautiful is amazing everything is saying سبحان الله سبحان الله to the one who made things moving and to the one who made things still who holds our hearts who prevented our hearts from breaking when some of our loved ones die or when some money is lost who keeps our hearts just doing the exact movement that Allah wants who is doing that الله سبحانه وتعالى الله سبحانه وتعالى is controlling the the number of heart beats so it's Allah سبحانه وتعالى سبحان الله ما يمسكهن إلا الرحمن so no one holds anything except the most merciful الله سبحانه وتعالى is most merciful to ourselves to our hearts to our to us than anything else then when we ask الله سبحانه وتعالى when we make dua we say لا تكلنا إلى أنفسنا طرفت عين لا أقل من ذلك واصلح لنا شأننا كلها الله the most merciful لا تفعيلنا لنا نفسنا even for a blink of an eye not even less than that and rectify or affairs الله سبحانه وتعالى تقول to Muhammad صلى الله عليه وسلم when he was so worrying about his nation he says do you want me to give you the do you want me to make you the one who will take care of the of your umma and say to Muhammad صلى الله عليه وسلم no ya Allah you are more merciful than me to them you are merciful to them إنه بكل شيء بصير he knows everything أما هذا الذي هو جند لكم ينصركم من دوني رحمن or who is it that could be an army an army for you to aid you other than the most merciful the disbelievers are not but in the delusion and the more you understand and in the delusion and in the delusion and in the delusion and in the delusion in the delusion and in the delusion و لكن في المصارع. من يكون في أنت؟ من يكون هناك؟ من يكون في هذا العالم؟ اذا الله يمكنه تحديث الله من تساعدك؟ من يمكنه تساعدك؟ لا one! كل شيء في هذا العالم كان مخلق بي الله سبحانه وتعالى و المخلق الذي يكون مخلق، لا يمكنه تتوقف المخلق و that's why we say كمع الله يكون الكون معك why? because يكن الله معك be with Allah then the whole universe will be will be for you, will be with you because Allah is with you إي ينصركم الله فلا غالب لكم if Allah should give you victory if Allah should give you aid if Allah should give you anything good no one can ever overcome إلي الكافرون إلا في غرور or the non-believers are just they are just surprised they know that they don't want to believe they don't want to obey and of course the Shaytan has made these things good for them أما هذا الذي يرزقكم إن أمسك رزقه باللدو فيه و تون و نفور or who is it that could provide you if he withheld his provision but they have persisted in isolance and aversion if Allah سبحانه وتعالى holds provision who is going to provide for you and we mentioned this provision does not mean only money Allah gave us eyesight Allah gave us lungs Allah gave us kidneys Allah gave us hands Allah gave us feet then we go to other than the creator we go to another creation and we leave the creator if Allah gives you no one is going to stop the giving of Allah سبحانه وتعالى and if Allah prevents you no one is going to make you rich with all means باللجو فيه و تون و نفور but they have persisted in pride and in being turning away they don't want to believe أفما يمشي مكبن على وجهه أهدا أما يمشي سويا على صرات مستقيم then is one who walks fallen on his face bending down to earth better guided or one who walks wrapped on a straight path so that first person walks as if he is in a رقور أسطيت bending he looks at the earth he goes right and left so is that better are the one who walks when his head is up and his back is straight he knows where he is going he goes straight he doesn't go right or left we know that in when the journey of إسراء المعراج سيد محمد صلى الله عليه وسلم what did he do when he was in the skies but he was not going right or left مازغ البصر ومعطغه the sight of the prophet did not serve nor did it transgress its limit and this is a lesson for us the path is straight but the dunya has its arrows headed towards us we shouldn't pay attention to anything we have to go straight to our goal to go right or left the path that leads to Allah is straight it's only one it is only one path and it will lead to الجنة but for that who is not on the right path he will feel that he is always humiliated he is always ashamed of his actions and always remember this point that the first step of disobeying الله سبحانه وتعالى is so hard but when someone walks takes that step then everything after it will be easy but if someone's heart is clean then he will know every time every now and then I will remember his sin and he will feel so humiliated that he disobeyed الله سبحانه وتعالى so that person would make استغفار and go on repent feel sorry that that person will feel sorry that he disobeyed الله سبحانه وتعالى قل هو الذي انشأكم وجعل لكم مصمع والأبصار والأفئدة قليل لما تشكرون so say it's he who has created you and made you and made for you hearing and vision and heart made for you intellect little you are grateful يا محمد tell those who disbelieved in الله سبحانه وتعالى those who associated other God than الله سبحانه وتعالى tell them Allah has created you Allah has created you in the wombs of your moms born into this life then you became strong and powerful and then you became old people Allah gave you the hearing Allah gave you the sight Allah gave you the heart Allah gave you the intellect and these are all the things that you would receive knowledge with and after that you believe you spend one other than Allah you believe in other than Allah is this how you thank Allah سبحانه وتعالى you fear people and you don't fear Allah you feel that people would see you doing something not lawful and then you don't fear Allah don't use your intellect that Allah has given you for bad things don't use the the ability to listen don't use this this blessing to listen to something other than the words of Allah سبحانه وتعالى other than something something not good no listen to Allah's order and fulfill them and don't use your eyes to see something that Allah سبحانه وتعالى doesn't want you to see just think of these blessings that Allah سبحانه وتعالى how do we thank Him just we use these blessings to obey Allah سبحانه وتعالى attend the knowledge gatherings attend thicker gatherings listen to Allah's orders fulfill Allah's orders read the book of Allah understand the book of Allah apply what's in the book of Allah use these blessings that Allah سبحانه وتعالى has given us just for His pleasure just to make Him pleased with us وصلى الله عليه وسيدينا محمد وعلى آله وصحبه وسلم يا ربنا لك الحمد كما ينبغي لجلال وجهك وعظيم سلطانك اللهم إنا نسألك من خير ما سألك من هو عبدك ونبيك محمد صلى الله عليه وسلم ونعوز بك من شر مستعادك من هو عبدك ونبيك صلى الله عليه وسلم سبحان ربك رب العزة عما يصفون وسلام على المرسلين والحمد لله رب العالمين السلام عليكم ورحمة الله وبركاته


Good afternoon everyone. My name is Mario Blandini with HGST. Happy to be here on day three of the OpenStack Summit. What we're going to talk about is a demonstration, first of its kind actually, of an open Ethernet drive architecture. Thanks for stopping by to check out this exciting technology, something we just announced here for OpenStack. So as I go through my presentation, you may not even know who HGST is. How many of you know who HGST is? Anyone? All right, more than I expected. Hopefully you've stopped by the booth. And how about you, HGST team? Do you know who you are? That's right. So we're here to engage with you in some discussions around developing on new technology. Now we're a public and traded company. You'll see all my forward-looking statements here. Hurry up and read. I'm going to switch the slides quickly. Close your E-Trade account. Don't go trading stuff. And we're not going to guarantee that we can follow up with you in detail about everything we talked about today. But I would encourage you to follow us on social media or go and register for one of our webinars in the future so you can get more information on this technology. But you are of the population. It's the first to see this out here at OpenStack. So what is an open Ethernet drive architecture? It's quite a mouthful. And if you look at the structure of the term, architecture is the noun. So it is an architecture for deploying infrastructure and giving a new option for applications, especially scale-out applications, to run some services that can really benefit from being as close to the storage media as possible. So there's a couple other terms in there, open, in the sense that there is a Linux environment in which developers can deploy code. And I'll talk a little bit more about that. Ethernet drive is a big part about what it is inside the system. The drive interface is Ethernet. And you likely know why the world is going toward object storage and going toward Ethernet. The reality is these things create a lot of data. And a lot of the applications that we're working on in the OpenStack community are to get to that massively concurrent scale-out type architecture for these type of applications. So it is not a product per se, but rather a building block for these architectures. In our view, from a vendor-specific perspective, I think most folks at OpenStack would agree, having something that's open and flexible is going to give developers the most creative environment in which to deploy new applications. So we don't want to confine scale-out in any way. We want to really enable it. And we do that in a couple ways, which I'll describe here. So naturally, the infrastructure has to live somewhere. And a lot of us who might be developers, actually, let's do a show of hands. How many of your developer-oriented coding-type dudes? Thanks for coming, because actually this is more for you than the infrastructure guys. But from an initial infrastructure perspective, people do love storage as an enabling part to go with the compute and the networking. So we want to, as I mentioned before, enable application developers to distribute their storage services throughout the infrastructure in a scale-out way, much the way that it's done today in a multi-tier infrastructure architecture with applications like Ceph or Swift or Gluster. And I'll go into details on those a little bit more, but part of distributing those services is having some resources available as close to the storage media as possible. So let's go into what those resources are and what the architecture is all about. At the beginning, this architecture is not about a drive in as much as it's about having a Linux environment to run software services. And our belief here at HGST is having that environment available to developers is going to open up a lot of creativity on ways we can optimize today's applications and then even create new applications that can make use of that resource that's out there at the drive. So the resource there is a drive running Linux. Now, also at the drive is CPU and memory resources that are there to allow for code to run on that Linux environment versus running at a higher level on a server. So the example applications that we have today that I'll go through in detail are all open source ones where we just grab the code, we compiled it for that CPU environment, and we're able to run it intermixed with existing nodes from those same applications running on Intel servers. So that's kind of cool. You don't want to have to change out your infrastructure if you're going to take advantage of new architectures. In this case, this open Ethernet drive architecture fits right in to the stuff that you may already have running. And what most people think the most exciting part is this is a drive with Ethernet. Heck, you know, Ethernet is a very cool thing from a search term perspective. It's what really catches people's eyes. And we have a drive with Ethernet that allows then the architecture to work end to end, but it's not just an Ethernet drive. Think of it as a environment where it has Linux, where the resources are available to run storage services and to simplify the solution and allow for a switch fabric to integrate into your existing architecture. The connectivity is Ethernet inside and outside the box. Now, naturally, people want to know what's under the hood. And for my boys over there and my female friend there at HGST, shout out again. See, they want to talk to you. So I'll show you a lot of stuff here on the big screen. Take a closer look over at Booth T5 to get more of a look under the hood. But what it is is a standard hard drive. We happen to use an example of a four terabyte drive, but this technology can be applied to most any type of drive, a hybrid drive, SSD technology. A lot of the folks that we've talked to to start believe that there's a really cool option for large scale storage. Thus, a four terabyte drive is kind of a good medium point right now to start from a development perspective. It has Ethernet connectivity. It has an expansion of the ARM processor footprint that's on a hard drive. Does everybody know that there's already an ARM processor on every hard drive? It's already there to run the drive firmware. So we've expanded that with another ARM and we've got RAM there and we've got the Ethernet complex integrated onto the drive that allows you to treat it as if it's a node, not just a drive inside of a node for a scale out architecture. So what does the enclosure look like? As you go to put some of these things into this enclosure, to make it easier for our application developers to test it and really play around with it at scale, we have an enclosure that allows us to put 60 of these into a 4U enclosure. It has, as you can see on the back, 10 gigabit Ethernet out the back. That's more of a rendering than an actual example. You can see we have 810 gigs on that reference design enclosure there at our booth. So it would connect up into your network, probably to your aggregation or even back to your core because the top of rack style of connectivity is already built into the box and the enclosure does appear as a Linux server. So it gives you that ability to connect it into your environment and intermix it with existing nodes that you might have that are Intel based today. So what's running today? This is really more about software and this being a great conference with a lot of open source software collaboration. We have a lot of examples of the types of applications that are running today. So we'll go in and look at some of those. We have worked with Morantis. We're using some of their fuel technology to create a visualization just to see what you're looking at for a demo here. So it was something we could put together really quickly and you'll see that we have showing in our booth, Swift, Seth and Gluster all running in a environment off of the same enclosure, which is really cool. Going a little bit deeper into Swift itself, this is some CLI output from the demo that shows that we have multiple nodes. The proxy is resolving to three nodes for replicas. One of those is an Intel server. Two of those are open ethernet drives inside of our architecture. And if we look to see what services are actually running, we actually didn't have to talk to anybody. We can go to the internet, which is totally cool, download the code, compile for that environment and start running it. So you'll see here, this is essentially the storage node in a Swift cluster. And the node is not necessarily the entire enclosure, but rather the individual drive. And going forward with things like erasure codes and having to plan for lots of different failure scenarios, having that granularity is something we've got some good feedback on. But really we're here today to open up the concept and get folks to think of great ways we can either optimize existing applications or develop new ways or new future versions of these applications to be even more optimized with those resources running at the drive. A quick look at Ceph. We have it visualized here. You can think of the OSD from Ceph running on the drive itself so that each one of those becomes their own OSD and they're connected to your network through that switched fabric. From a cluster perspective, we also have that. You can think of the BRICS services that would be there in a cluster running on the drive. So in this case, we're not advocating that you eliminate servers per se, but rather optimize the deployment of the application where you can take advantage of those resources closer to the drive. Naturally you'd always need controllers or proxies or those other parts of the solution in the environment. And with more talk in the open source community about erasure code options for these open platforms, there's certainly going to be no less processing power required. And that's where we see an exciting opportunity to take advantage of those resources. More than just for software-defined storage, those happen to be some easy ones to do because it's open source and we make those demonstrations. But we see it as an opportunity for data-centric applications, whether it be around search or analytics or other types of things where you can ship processing to where the data is and leverage those resources there as a part of a scale at architecture, is being something that's interesting. People often ask, hey, when can I buy one of these things? And the truth is, until we as an ecosystem come up with a great horizontal application that combines software with the hardware that you could take advantage of, that's when you'd see it productize. The reason for us being at the show, really, as I say here in the goal, we want to work with developers and operators of OpenStack and other distributed scale-out environments to really work on ways to really exploit and leverage the architecture. So if you're a developer yourself and you want information on how you can get in hackathon style, we will be putting one of our systems into the OpenStack Swift community test cluster here in the near future. Not sure if you saw the press release today, but HGST and Swiftstack have partnered up to put a large public test cluster in place so you can test some of your applications running on top of Swift. We're using our industry first helium sealed drives, our UltraStar HE6 drive, in those enclosures. Intel's also donated equipment there to put that infrastructure together, so we'll be able to test that and we'll expand that test cluster with more equipment from our open ethernet drive architecture for those folks that are interested in doing that. But we'll also have a lab that we can do online and work with folks. I'll be your point of contact if anybody's interested in learning more on how we can work together in that regard. But before I go ahead and close up, I'll say that you couldn't see the live demonstration, it's live over there. I encourage you to go over, look at the equipment, open up the door, see exactly how it's deployed and touch and feel our hard drives that have the ethernet interface, but don't rub your feet before you do that. ESD and all that sort of stuff. But do go ahead and check that out because it's really exciting. And I want you to visit some of the other companies that are working with us. So Ink Tank over there, they're not going to give a shout out because there's nobody over there, but they are excited about the opportunities of this type of architecture, Red Hat as well, and just on the other side of where HGST is, the folks at Swiftac can tell you more about Swift running on this architecture, as well as talk more about that community test cluster that you can take advantage of. Because most oftentimes when we're doing our development, we're developing on VMs and it's not characteristic of big equipment, it's hard to carve off some of that big physical iron to do some of your testing. It's why we've made that investment in that community test cluster. So with that, I want to thank you for your time and encourage you to go see my friends over at HGST. They're ready to talk to you and show you more about the technology. Thanks again for your time, folks.


Hello everybody. This is Jason Wang from Red Hat. Welcome to the Q&A forum. Today I will give a talk about how VDP is supported in the Linux kernel. Here is the outline. We will first go through the Word.L architecture. And then we will try to introduce a new type of device called VDP device. And after that we will discuss the design and implementation of the VDP framework in the Linux kernel. And we will conclude the presentation and will be a Q&A session. So here is the Word.L architecture overview. So you can see that Word.L architecture could be split into three layers. In the upper layers, Word.L defines several different types of devices. For example, it could be a networking device, SCSI device, block device, etc. In the middle is the core device model. It could be split into the definitions of the Word.Qs, teacher beats, and config space. And on the lower layer is defined several transport, which ties to a device type to an actual bus. So the spec defines PCI, transport, MML, and CCW transport. So several different types of Word.L devices has been implemented in software. The first device implementation is done in QML, but its performance cannot satisfy our requirement. Then they move the data plane to the kernel by using the host protocol. It can do better than QML, but it's still not sufficient. So we offload the data plane from QML to another dedicated remote process through the VHOS user protocol. Then it can achieve the best performance that a software data plane can even achieve. So with the Word.L specifications and software implementation software device, we get good application usability. We get a unified device in a faithful guest, and we even get live migration support. But there are still several drawbacks. The first is that the software implementations requires extra CPU cycles to be spanned. And it requires extra management costs for settings such as CPU or memory affinity. And the last and probably most important one is that it can't be reached the bare speed due to the software overhead. Consider the high speed network become available. In order to address all the limitations born in the software Word.L implementations, some hardware vendors start to implement hardware implementation for Word.L, which means the device is fully compatible in both control paths and data paths with the Word.L specification. Then it could reach bare speed, and there will be no CPU overhead since all the data plane has been uploaded to the hardware. The unified data was preserved, and there will be no vendor log. But there are several issues of hardware Word.L implementation. The first issue is that the current Word.L is not designed to be virtualized. There is no API for save when restored device state in the current Word.L specification. This means if you just expose raw Word.L device to the guest, it can't be live migrated. The second issue is that Word.L is same and simple, which means it will be hard to be integrated with existing hardware stack. So more than real hardware is much more complicated. For example, as every cable is not current, it usually have embedded speech. This means vendor may have their own specific API to config, to program the speech. All of this API was missed in the virtual specification. And to be fully compatible in the control path also means a redesign of the control path, which tends to be a challenge. And it would be very hard to add vendor specific values, which really requires vendor specific extensions. And the manageability is also bad, since there's no management API defined in the Word.L specification. So in order to address all the limitations before the hardware Word.L implementations may introduce the concept of VDPA. So what is VDPA? It's short for we host data pass accelerations originally. But then we realize we host this trust cancels of virtual data pass of load. So we change the definitions to the virtual data pass acceleration. VDPA device is basically a kind of hardware that has a virtual compatible data pass, which is defined by a virtual spec. But it loads a vendor specific control pass. And it was required that such control pass should be functional equivalent or subset of the virtual control pass defined in the spec. In order to support live migrations, the VDPDIS is also required to help part of the work we host features, such as device recovery or dirty page tracking. Note that the dirty page tracking is not of must. So from hardware perspective, VDP device is a functional superset of the virtual device. So it contains the VQs, the virtual features, the host features, and the vendor specific config method, which is functional equivalent to the virtual config set. And beyond that, it was allowed to add vendor specific features on top. So why we need VDP? You can see that we gain almost every advantage of the hardware Word.L implementations. For example, it has a unified data pass with open standard and it can reach wire speed. Besides those advantages, we also gain more. So we gain live migration support by supporting the host features like device data recovery. It was also allowed vendor to add on features on top. But if we just expose raw VDP device to the software, there could be still several gaps for the end-to-end delivery. For example, do we really want to expose all the complexity and difference of the raw VDP device to the app layer? Or do we want to integrate the VDP device with the existing systems or revamp the view for a new dedicated subsystems? And also how about manageability? Is there a vendor specific manage API or it could be a unified one? And how about heavy weight drivers or lightweight drivers? So in order to answer all of those questions or these comments, we want to introduce the VDP kernel framework. The main goal is to bridge the usability and manageability gap with the raw VDP device. So it's basically a framework with the following features that is required. First, it should hide the complexity and difference of the layer device and present a simple same device API to the software. And it also tries to present a unified manageability to simplify the task of the app layer stack. And it will try its best to be integrated seamlessly with all the existing subsystems. Which means it will try its best to reuse the calls in both kernel and user space applications. And this framework should not be designed for user space drivers only. It should serve for both kernel and user space drivers. And the framework should be designed to be a bus or device agnostic. Which means it will allow any type of soft device such as non-PCI device, FPG device or even software emulator device. And it will try to keep the drivers as lightweight as possible. So here's the overview of the VDP framework. So you can see that on hardware level there could be several types of VDP device, which is all connected to the VDP framework. And to the app layers, you can choose to connect the VDP device to both VHOS systems and mortal drivers. So when connecting the VHOS subsystems, it will present a VHOS device and let applications to use VHOS UAPI to control the device as if it was a VHOS device. And when you connect to the mortal drivers, a kernel-visible virtual interface will present to the kernel IO subsystems. So the applications can choose any of the material UAPI supported by the kernel IO subsystems to control the VHOS device, sorry, the VDP device as if they were a virtual device. And the framework will also try to present a unified management API for the management applications. So as discussed, the framework tries to allow several different types of device and different types of drivers. So it's nature to consider to introduce the bus. So the VDP bus is the core concept for the VDP framework for abstracting the hardware, which allows different VDP device and drivers to be attached. And the VDP bus also defines the communication protocol between the bus driver and the device. So those communication protocols is a set of callbacks, which is called VDP config operations. And VDP device is the device abstractions provided by the VDP pirate device driver, which have several common attributes of the VDP device and also the implementation of the VDP config operations. So on top of the VDP bus, several different types of VDP bus drivers were allowed to be attached. Those tasks is to connect the VDP device to the existing kernel subsystems and use the VDP config operations to talk with the VDP device. So you can see from the view of the VDP bus driver, you can only see the VDP device and VDP config operations. All the complexity and difference was highlighted via the VDP device abstraction and bus. So VDP device is for the common abstractions and VDP parent is the module that provides such abstractions. So it needs to provide the common attributes and to implement the config operations of the VDP bus. So the config operations usually contain several different types. For example, it will contain the word help specific operations such as the word queue, attribute setting, the device state, feature negotiation, and something, etc. And it will also contain the interrupt and the doorbell acceleration method for fast access to the interrupt and doorbell. And in order to be more generic, it will also contain the DMMA map and NMAP method, which could be very convenient for the device that has on-chip MMU or have a sophisticated DMMA mapping logic. And it will also contain the V-host operations for device state recovery and dirty-page tracking. So the parent can be any type. For example, it could be a real parent device driver that talks to the VDP device directly. Or it could be an intermediate layer on top of another device driver framework. Or it could be even a software emulated VDP device or a proxy or relay of the VDP protocol to some other modules or even user space. So they allow several different types of VDP bus drivers to be attached. So we will first talk about the V-host VDP bus driver. So this bus driver is used to present a V-host device to the V-host subsystems. So it serves mainly for the user space virtual drivers. For example, it could serve for QML V-host backend. For QML to present a virtual data pass to VM. Or it could serve for the DPDK virtual PMV, which serves for NFV use case. So the idea is trying to reuse as much V-host generic UPS as possible for the data pass setting. But it also requires some dedicated UAPI extensions for full device abstractions, which is missed in the generic V-host UAPI. So those UAPI usually contains something like configures, space access, device data get and set, can be interrupt, etc. So the traditional V-host user applications only need very minimal changes. Then it can use the V-host VDP bus drivers to control the VDP device as if they were a virtual device. The second bus driver we provide is the VDP bus driver. So its goal is to present a V-host device to the virtual bus. Then this PISODO or proxy virtual device could be prog by the virtual drivers. So the virtual device will be visible to the kernel IO subsystems. This is done by introducing a new VDP transport for the virtual bus. Then the kernel IO subsystems can use VDP devices as if they were a virtual device. This means the applications can use, for example, TCP, IP stack, storage stack, IOU, XCT, or any kernel IO subsystems to transfer data between cells and the VDP device. The main use case for the virtual VDP device is for bare metal applications or containerized applications. And for the management API, we will try to introduce a dedicated VDP-specific netlink protocol for the VDP device management, which mainly contains the first is life cycle management to create, destroy, enable, disable, and also to set in attributes or provision the VDP device. The idea is to introduce a new VDP programs that will be integrated into IP route too. And then the management API will use either these programs or the netlink protocol directly for unified configuration interface. All VDP device, Pyro device is required to implement the VDP netlink protocol. So current Linux kernel have supported three VDP parents. The first is the Intel FCVF. So from the hardware perspective, it draws a virtual device plus Intel specific extensions. And the VDP is implemented through a dedicated VF. So it's parent driver is simply a PCI-VF device driver. The second VDP parent is the Manilox file VDP parent. So this device is also implemented in a dedicated VF, but it has a total vendor-specific control pass. This parent is an intermediate layer on top of the existing Manilox file core model. And the third parent is the VDP simulator, which is basically used for device testing, feature prototyping, et cetera. So this parent is implemented purely through a software emulation. And then we are working with vendors for more types of VDP parents, such as the ADI, which complies the Intel Scalable LB specification, or device or vendor-specific device like such as Soft Function, or even a PCIe endpoint device, which means the VDP is implemented via a remote SOC. So here's basically the status of the VDP support in the currently internal. So basic functions such as VDP core bus drivers and 3 VDP parents has been merged. And the basic QML function has been merged by QML. And then we are working on, for example, the net link-based main beneficiary, which would be posted soon. And the live migration support is also under development. For live migration, we will probably start from a software-assisted live-making first. This means it doesn't require any device support for dirty-page tracking. QML will try to assist the device for dirty-page tracking. And after this, we will try to invent new API for supporting dirty-page tracking from hardware. And you can see also the control queue work is being developed on the upstream. And we are working with vendors to make sure that the framework and the drivers can work for the device rather than networking. We will probably start from the block device. And for the future, there are several things in our mind. The first is we will need to finalize the documentation in the kernel source, which contains both the VDP device API definitions and the host VDP UAPI. And we also plan to co-op with the platform vendors to support shared virtual data address or even virtual shadow search address. And then we also plan to extend virtual specifications for some VDP-specific extension. Okay, so let's conclude these presentations. First, we introduce a new type of device called VDP device. The VDP device has the virtual data pass with vendor-specific control pass and the host features. And we introduce the host framework in the Linux kernel, which tries to hide the difference and complexity of different types of VDP device and present a unified device and many of the API to the upper layer. The VDP framework contains the VDP bus and the device for abstracting the device. And we also allow different types of VDP bus drivers for connecting the VDP device to various kernel subsystems. So we support both V-host and virtual drivers to light the VDP device to be used by both the kernel virtual drivers and user space virtual drivers. With the help of both VDP device and VDP framework, we could achieve well-speed virtual with the best usability and measurement ability. So there will be no vendor log and there will be live-migrant support or even cross-vendor live migration. A unified management interface was provided for ease the task of the management stack. And we will get material softwares stack in both host and guest, since we present VOTEL or V-host device to the upper layer. So here are some good references. First is the preditated band by Steve in the previous KVM forum. And the second is two series of blog wrote by us, which contains almost every aspect of both VOTEL and VDP. And it also contains several deep dive for the VDP kernel framework and is the typical use case. So you are welcome to go through those blog series and give us feedback. And it's also be useful for review and have a look at the VOTEL specification. And if you want to ask or hear from what is recently being developed for VDP aspect, you are welcome to subscribe the VDP development mailing list.  It's not a concept in the paper. You are welcome to consider to deployment the VDP device in your cloud or you want VDP based hardware. And you are also welcome to test and contribute to the VDP framework. Please contact us if you have any questions. For example, the hardware design, driver implementation, deploys, increase creation and management issues or even feature request. You can drop a mail to either the VOTEL networking mailing list or a private mail to me. That's it. Thanks.