With that said, we're going to be looking at chapter 9 here in the book of Daniel. And because we're having Communion tonight, I wanted to make sure that I left ample time for us to be able to enjoy Communion without me rushing through the study. And so what we'll do today is we're going to be dividing Daniel chapter 9 into two segments. We're going to be looking at verses 1 through 19 tonight, then next week, God willing, as we gather, we'll pick up at verse 20 and go to the conclusion at verse 27. And so today, we're going to be looking at Daniel's prayer, Daniel's prayer that's found here in the book of Daniel chapter 9, and it's found in verses 1 through 19. Actually prayer is found in verses 3 through 19, but we'll be looking at verses 1 through 19 as we continue our series through the book of Daniel. So I'm going to read to you out of chapter 9 verses 1 and 2, and we'll get into our study.  It's going to take a while to do. And then I'm going to pick up on the prayer in verse 3 and go to and conclude at verse 19. So we'll look at verses 1 and 2, give a prolonged introduction and foundation and then move into verse 3 and speak of the prayer of Daniel. So Daniel chapter 9, beginning at verse 1, verses 1 and 2, in the first year of Darius, the son of Ahasuerus, of the lineage of the Medes, who was made king over the realm of the Chaldeans, in the first year of his reign, I, Daniel, understood by the books the number of the years specified by the word of the Lord through Jeremiah the prophet, that he, that God, would accomplish 70 years in the desolations of Jerusalem. And so we'll look at verses 1 and 2. Again, I'm going to lay a foundation for you, give you some information and remind you of a few things that we've already looked at. And then we'll move into verse 3 and look at his prayer. So what we have, here's your introduction in chapter 9. Chapter 9 reveals to us what is called the third vision of Daniel. The third vision of Daniel. The first vision that we have that he recorded for us was found in chapter 7. The second vision that is recorded for us is chapter 8. And so here we are in chapter 9 and once again, we have a third vision. And so chapter 9 begins by referring to a prophecy, a prophecy that had been recorded by a prophet by the name of Jeremiah. Now Jeremiah prophesied in Israel from 627 to 580 BC. Jeremiah, in his prophecies, revealed a judgment. He revealed that God was going to bring a 70-year judgment on the nation of Israel, and that he was going to do that through Babylon. If you take notes, Jeremiah chapter 25 verses 10 and 11 says, I will take from them the voice of mirth and the voice of gladness, the voice of the bridegroom and the voice of the bride, the sound of the millstones and the light of the lamp. And this whole land shall be desolation and an astonishment. And these nations shall serve the king of Babylon 70 years. And so Jeremiah had prophesied that it would be a Babylonian captivity that would last 70 years and the Lord brought the judgment upon Israel. And the reason God brought judgment on the nation of Israel is basically because he disregarded his law. You see, God had made a statement, God had actually warned them that if the nation were to reject his law, he would bring judgment. In the Old Testament book of 2 Chronicles chapter 7 verses 19 through 21, this is when Solomon had dedicated the temple. In that point, in that place of scripture, God said, if you turn away and forsake the decrees and commands I've given you and go off to serve other gods and worship them, and then I will uproot Israel from my land, which I have given them and will reject this temple I have consecrated for my name. I will make it a byword and an object of ridicule among all peoples. This temple will become a heap of rubble. All who pass by will be appalled and say, why has the Lord done such a thing to this land and to this temple? People will answer because they have forsaken the Lord, the God of their ancestors who brought them out of Egypt and have embraced other gods, worshipping and serving them. That is why he brought all this disaster upon them. And so when the dedication of the temple was taking place, and Solomon had prayed that God would bless the temple with his presence, God had warned them, as long as you keep my commands, my presence will be with you.  And so they had broken his law. And God, being true to his word, brought judgment. What had they done? Well, specifically, again, for those who take notes, they had disregarded what are called his land sabbaths or the sabbatical year, which was, and I'll read the scripture to you in a moment, but it's related to the resting of the land every seven years. They had disregarded his land sabbath, and they also had entered into idolatry. Now, the land sabbath was to allow the land to rejuvenate itself, to regain its fertility. They would work the land for six years, but let it rest the seventh.  And what it was intended to do was to allow the land to rejuvenate itself because it was being over farmed, but it also taught Israel to rely on the Lord. And what they would do in that year of sabbath is they would rely on the Lord by taking that which was produced naturally on the land. You see that in Leviticus chapter 25, verses six and seven. In Leviticus 25, three through five, it says this, it says, for six years, sow your field. For six years, prune your vineyards and gather their crops, but in the seventh year, the land is to have a year of sabbath rest, a sabbath to the Lord. Do not sow your fields or prune your vineyards. Do not reap what grows of itself or harvest the grapes of your untended vines. The land is to have a year of rest. And so God had warned Israel to observe the year of land rest, but they had not. Again, in Leviticus 26, 33 through 35, he said, I will scatter you among the nations and will draw out my sword and pursue you. Your land will be laid waste, your cities will lie in ruins.  Then the land will rest and enjoy its sabbaths. All the time that it lies desolate, the land will have the rest it did not have during the sabbaths you lived in it. And so the result of them not observing that particular law was that they were exiled to Babylon for 70 years. Second Chronicles 36, 20 and 21, he carried into exile to Babylon the remnant who escaped from the sword. They became servants to him and his successors until the kingdom of Persia came to power. The land enjoyed its sabbath rests. All the time of its desolation it rested until the 70 years were completed in fulfillment of the word of the Lord spoken by Jeremiah. And so one, they had not observed the sabbath rest, but they also entered into idolatry. There's a question Jeremiah asks in chapter two verse 11. Has the nation ever changed its gods? Yet they are not gods at all.   Has the nation ever changed its gods? What do you think? We see that even in our day, don't we? Has the nation changed its gods? Absolutely. Well, in the case of Israel, judgment came. The Lord dealt with them. Judgment happened. Though judgment occurs, God also has promised mercy. You find that in Jeremiah 29, 10 through 14. It says, thus says the Lord, after 70 years are completed at Babylon, I will visit you and perform my good word toward you and cause you to return to this place. For I know the thoughts that I think toward you, says the Lord, thoughts of peace and not of evil to give you a future and a hope.  You will seek me and find me. When you search for me with all your heart, I will be found by you, says the Lord, and I will bring you back from your captivity. I will gather you from all the nations and from all the places where I've driven you, says the Lord, and I will bring you to the place from which I caused you to be carried away captive.  In wrath, God remembers mercy. So Daniel was taken captive in 605 BC. It is now 538 BC. It's approximately 67 years later and the time promised by the Lord through Jeremiah is finally approaching. And so what happens is Daniel is revealing something to us. We'll be looking at this now. He's revealing to us his trust, his trust in God, but here's something if you wanna know something about following the Lord, his trust in God as revealed by his trust in God's promises. His trust in God is revealed by his trust in God's word. And that's what we're gonna be seeing here because as he's reading through the word of God, it says in verse two, as he's reading through the word of God and he's looking at the book of Jeremiah, that brings him peace and that brings him hope. Again, it says in verse two in the first year of his reign, I Daniel understood by the books. When he says understood by the books, he's speaking of the scripture, understood by the books, the number of the years specified by the word of the Lord through Jeremiah the prophet, that he would accomplish 70 years in the desolation of Jerusalem. Where did his hope come from guys? It came from the word of God. That's where your hope always comes from by the way. It will always come not by some encouraging friend. It won't come from any other source other than the word of God. And that's where it came to him. He's reading through Jeremiah. And as he reads, he sees that God had made a promise of restoration and that God would accomplish 70 years in the desolation of Jerusalem. And as he's reading that and realizing that the time is about to come, he begins to pray. In verse three, I set my face toward the Lord God to make requests by prayer and supplications with fasting, sackcloth and ashes. I prayed to the Lord, my God made confession and said, oh Lord, great and awesome God who keeps his covenant and mercy with those who love him and with those who keep his commandments, we've sinned, committed iniquity, we've done wickedly and rebelled even by departing from your precepts and your judgments. Neither have we heeded your servants to prophets who spoke in your name to our kings and our princes to our fathers and all the people of the land. Oh Lord, righteousness belongs to you but to us, shame of face as it is this day to the men of Judah, to the inhabitants of Jerusalem and all Israel, those near and those far off in all the countries to which you have driven them because of the unfaithfulness which they have committed against you. Oh Lord, to us belongs shame of face to our kings, our princes, our fathers because we've sinned against you to the Lord our God, belong mercy and forgiveness though we've rebelled against him. We've not obeyed the voice of the Lord our God to walk in his laws which he set before us by his servants to prophets. Yes, all Israel has transgressed your law and has departed so as not to obey your voice. Therefore the curse and the oath written in the law of Moses, the servant of God have been poured out on us because we've sinned against him. He has confirmed his words which he spoke against us and against our judges who judged us by bringing upon us a great disaster for under the whole heavens such has never been done as what has been done to Jerusalem. As it is written in the law of Moses, all this disaster has come upon us yet we have not made our prayer before the Lord our God that we might turn from our iniquities and understand your truth. Therefore the Lord has kept the disaster in mind and brought it upon us for the Lord our God is righteous in all the works which he does though we've not obeyed his voice. Now a Lord our God who brought your people out of the land of Egypt with a mighty hand and made yourself a name as it is this day. We've sinned, we've done wickedly.   Oh my God, incline your ear and hear open your eyes see our desolations and the city which is called by your name for we do not present our supplications before you because of our righteous deeds but because of your great mercies.  Do not delay for your own sake my God for your city and your people are called by your name.  I remember when I prayed that prayer, no, all right. Notice how he begins in verse three I set my face toward the Lord God to make requests by prayer and supplications. And so what happened as he was reading the word of God as he was reading the prophet Jeremiah he was moved to pray and he was moved to fast. And as he began his prayer, I want you to see this. Notice how he begins, he made a confession of sin. Now we're gonna look at that in a moment but let's think about prayer and some of the aspects of prayer because as I was going through this and as I was preparing my heart I began to think of how prayer is so common in our own minds that sometimes we generalize it to the degree that we may miss some things that the Lord would have us to know about prayer and how it is when we pray and those kinds of things because it's been said that prayer in its most basic form is simply communication with God and as believers as those who have trusted in him as believers we have access to God and we've been given as Christians we've been given access to God through Jesus Christ his son, right? No one comes to the father Jesus said but by me Jesus Christ is our mediator and so we go through our high priest Jesus Christ as we pray to the father and so access has been granted to us because of the blood of Christ that was poured out on our behalf to washes of our sin and to make it possible for us to have a communication a relationship with God through what is called prayer in the Old Testament you have God making various promises to those who pray Jeremiah 33 verse three call into me and I will answer the I'll show you great and mighty things which thou know as not it's an invitation call into me I will answer you and so God gives us an invitation to come to him you see a similar kind of thing in the New Testament in the book of Hebrews in chapter four verse 16 for example where it says let us then approach God's throne of grace with confidence so that we may receive mercy and find grace to help us in our time of need there's an invitation that has been given to us by God to approach him and a confidence that we have because of Jesus Christ his righteousness and the forgiveness of our sins through him so we can now approach the throne of grace because of Jesus Christ and so prayer is between the father and his child when you read your Bible you're gonna see that in scripture there are various forms of prayer I'm not gonna go through all of them there were several of them but I'll remind you of a few things that relate to prayer as I developed this one of the things about prayer is that when you're approaching God in prayer it's actually an act of worship when you're approaching God in prayer it's an act of worship because you're worshiping God for who he is when you look at these verses for example we're worshiping God verse 14 because of his righteous works when we approach him in prayer there's an act of worship because in verse 15 it speaks of his mighty hand in verse 16 that verse speaks of his righteousness in verse 18 speaks of his mercies and so because he's righteous he's mighty, he's merciful that gives to us some insight into what it's like to approach the throne of God to obtain mercy and help in our time of need because God is approachable and as we do so and pray very often what we also do is we're giving him thanks for all that he's done when you pray I would encourage you by the way when you're having your time with the Lord and you're praying and speaking to him remember to thank him for how good he's been to you many people sometimes, well many of us forget in many ways it's like I just have such needs I forget to say God but how good you've been you've answered so many prayers how many prayers has he answered for you so many of them, so many and you say oh I don't remember the ones he's answered I only know the ones he didn't answer shut up cry baby aren't you glad that he sometimes said no you ought to be, you ought to be because if God answered all of my prayers I'd be married to the wrong woman because I used to say that, I used to say God give me her in Jesus' name I claim her, I read somewhere you would say all I need to do is ask and it's mine no I'm grateful I thank God for the unanswered prayers so the Lord has his will we come to him with thanksgiving we approach his throne with a confidence but we pray according to his will and as we do so the Lord has a way of making sure that his will is what he's done and so we have this heart of thanksgiving like it says in Psalm 100 verse four enter his gates with thanksgiving enter his courts with praise gift thanks to him, bless his name and so we come to God and we pray we lift up our thanksgiving but we also make our supplications to him you see that in verse 18 where he speaks of making supplication that the word supplication as he's applying it here in this prayer is to humbly plead with God with humility it is to plead with him and Philippians in the New Testament chapter four verse six Paul said it like this he said be anxious for nothing but in everything by prayer and supplication with thanksgiving let your request be made known to God and so you come to the Lord and you supplicate you ask him humbly you plead you beg with him, beg to him humbly God I have a brother who's very sick Lord I have a marriage that's on the rocks Father I have a child who's not doing well Lord my health is going down the tubes I don't know what I'm going to do God I'm going to lose my job Father I can't pay my bills how many times have you I how many times have we approached the throne of grace asking for mercy but pleading with God for his help and that's what we do so prayer is not only just remembering who he is and how powerful he is and it's not simply the attitude of thanksgiving being aware of the fact that he hears and does respond but there's also this time of pleading with God and saying God I just I need your help Lord I don't know what I'm going to do and I frankly I just have to just drop it on your lap Jesus because I don't know even how to pray Paul speaks concerning how there are times when our prayers we don't even know the right words he says this to the Romans and he says that the spirit actually intercedes on our behalf making groanings that are unutterable there are times that the spirit of the Lord actually is working within you saying the things you don't know how to say aren't you glad that you have that ability there are times when I've prayed the Lord and my prayers have been as simple as just God you know, God you know there have been times and I didn't have the words I didn't know how to speak I didn't know how to put into words the things that I was going through or experiencing I didn't even know how to ask but I did know that he knew and seeing that he knows the words that have yet to be even formed on my tongue he knows all things there have been many times when I've simply said to the Lord Father you know, God you know and one thing I can say about the Lord is we can trust him because he loves us and Daniel is praying and there are certain ingredients that you see in his prayer but in this particular situation and I want to highlight something here because in this situation as he's praying he's offering a prayer of confession and repentance now when I was in Bible college I had a professor his name was Dr. Mitchell and Dr. Mitchell was teaching us through the book of Daniel and he a marvelous teacher a great Bible scholar and as he was sharing with us he said something I've never forgotten let me share it with you he said in the book of Daniel you never find a sin attributed to him you don't you never see it saying and Daniel stubbed his toe and cussed I mean you never see a sin attributed to Daniel it's not that he didn't sin of course all have sin fall short of the glory of God all because of our human nature we are all by nature sinners so I am not saying and my professor did not say that Daniel was a perfect man he simply said this and it has impacted me I was 23 years old when I heard this and it has impacted me all these years since hearing it and that was very simply that Daniel may not have had a sin attributed to him but Daniel as a righteous man identified with those who were sinners because he starts saying several times we have sinned we have sinned keep that in mind because sometimes we can fall prey to self righteousness where we begin to ask questions like how could you do something like that? Have you ever said that or even thought that? How could you do something like that? Well, they can do something like that because I can do something like that why is that? Because I am still a person who battles the flesh and because there are circumstances sometimes and conditions sometimes that lend themselves to me making bad decisions and a long time ago the Lord began to teach me and hopefully he's taught us no, you're no better than that other person there never forget that they fail and so do you and Daniel's a great example of this because even though there's nothing here in scripture that ever points to a sin he committed yet he begins by saying we have sinned against you notice how it says in verse three I set my face toward the Lord God to make requests by prayer and supplications, fasting, sackcloth, ashes those are all signs of mourning I prayed to the Lord my God and made confession and said, oh Lord great and awesome God who keeps his covenant and mercy with those who love him with those who keep his commandments we have sinned and committed iniquity we have done wickedly and rebelled even by departing from your precepts and your judgments he didn't isolate himself but he identified himself as somebody who was very capable of being exactly what he was praying about this is what has been called a model of a model prayer of confession and repentance again in verse five he said we have sinned, committed iniquity done wickedly, rebelled when he uses the word sinned we have sinned that word sin means to miss the mark to miss the goal or path of what is right what is proper we have sinned we've missed the mark when he uses the word iniquity the word iniquity means to be twisted it even speaks of perversion and being unjust when he uses the word wickedly we've done wickedly the word wickedly speaks of doing something that is morally evil when he says that we've rebelled we have voluntarily rejected your law and your commands and that's what he's saying we've sinned, committed iniquity done wickedly, rebelled even by departing from your precepts and your judgments we have disobeyed you notice verse six neither have we heeded your servants the prophets who spoke in your name to our kings and our princes to our fathers and all the people of the land we have disobeyed those whom you appointed to speak for you we have rejected what they have to say we are rejecting the words of your prophets we refuse to listen to you through their word that you gave to them to communicate to us we would not listen to those whom you appointed to speak on your behalf and as you read this and you hear this you say to yourself we say to ourselves yeah that was pretty stupid of them to do that they should have listened right Jeremiah had warned them Isaiah had warned them you know so many had given warnings God through his word and by his law had warned them it's all there and when the prophets like Jeremiah would stand up and say 70 years are determined for desolation they refuse and so we today we say man they didn't listen but guess what neither do we neither does the church even today and I've discovered after many years of ministry I can begin first with myself how I've had difficulty hearing when God speaks a word of conviction to me but I can also speak as a servant of the Lord as a pastor of a church as a teacher of the word how many times people have refused to hear what the Lord is saying through his word listen when God's word is rightly divided and rightly presented we need to remember that it is the Lord by his spirit who is speaking to us we need to remember that remember a moment ago we just saw in verse two how Daniel said that he was going through the word and Jeremiah who is God's prophet had spoken a word that he received well even so when the word of God even in our day is being divided the word of God is anointed by God inspired by God and when rightly divided and presented is the voice of the Lord speaking to his body of the church that's what it is in Matthew in chapter 10 verse 20 Jesus said it is not you who are speaking it's the spirit of your father who's speaking in you and so the Lord when his word is rightly divided and we're listening to it or reading it ourselves that's really the voice of the Lord speaking in Hebrews 13 verse seven it says remember your leaders who spoke the word of God to you consider the outcome of their way of life imitate their faith and so what was going on then as he's confessing it I have to be real with you when I say it continues to do so today God had spoken clearly but they rejected the message and in rejecting his message they rebelled and came under judgment he says in verse seven oh Lord righteousness belongs to you but to us shame of face as it is this stage to the men of Judah to the inhabitants of Jerusalem and all Israel those near and those far off in all the countries to which you have driven them because of the unfaithfulness which they've committed against you oh Lord to us belongs shame of face to our kings our princes our fathers because we sinned against you the Lord our God belong mercy and forgiveness that we have rebelled against him so he's continuing his prayer and he's simply saying God you're righteous we deserve everything that has happened to us we cannot blame you in verse nine when he says to you belong mercy and forgiveness he's appealing to God's mercy on behalf of the people so he's intervening he's interceding on their behalf God be merciful and he says in verse ten he goes we have not obeyed the voice of the Lord our God to walk in his laws which he said before us by his servants of prophets yes all Israel has transgressed your law and has departed so as not to obey your voice therefore the curse of the oath written in the law of Moses the servant of God has been poured out on us because we have sinned against him and he has confirmed his words which he spoke against us and against our judges who judged us by bringing upon us a great disaster for under the whole heaven such has never been done as what has been done to Jerusalem we've rebelled against God and God you brought judgment God you have been true to your word you've done what you said you would do notice how he says in verse twelve he confirmed his words which he spoke against us and against our judges he confirmed his words when you look in Joshua chapter 24 verse 20 it reads if you forsake the Lord and serve for in God's then he will turn and do you harm and consume you after he's done you good now though we are under the grace of God and isn't that a sweet thing to know we're under God's grace though we are under the grace of God that doesn't mean we can get away with things it doesn't mean that sometimes we seem to think that we we can simply because we've been saved by grace I I think of the scripture that speaks concerning God's discipline Hebrews 12 6 and 7 the Lord disciplines the one he loves he chastens everyone he accepts as his son endure hardship as discipline God is treating you as his children what children are not disciplined by their father there are times when when you may be going through something and I know this isn't pleasant for the moment but I'll share it with you anyway that you may be going through something and you begin to think God doesn't love you anymore you know sometimes what you're going through is because God loves you God is disciplining you and you may not like it and who does discipline for the moment is not pleasant you know but afterwards it yields up what is called the peaceful fruit of righteousness of those who have been exercised by it I'm being chased by the Lord whom the Lord loves he chastens he's Alice therefore scripture says in repent and so sometimes you may be going through something and you may think that it's because God doesn't love you but in fact what it is as God's chasing he's spanking you why is he spanking you because he loves you now I'm not saying go home and say God beat me today I'm not saying that I'm simply saying that that's part of the way that the Lord does deal with you why because if he didn't deal with you then the writer of Hebrews in the same chapter that I was just quoting out of chapter 12 the writer of Hebrews would say if he doesn't discipline you that that's because you're not his child he disciplines you because he because he's your father he disciplines you because you are his child sometimes we may do something that really deserves a good spanking and uh... and we don't understand it so we try to get out from underneath the the chastening I I am constant remember a conversation I had over forty years ago now with a young woman that I used to know at one time been part of our fellowship and she approached me and she said to me pastor could you pray for me I said of course what can I pray about she says well I slept with a guy and I think I'm pregnant and I asked her I still remember asking her what do you ask me to pray for what is it do you want me to pray for because in fact what you was asking me to pray for was for her not to be pregnant now is that the proper thing I should have prayed for oh god may this baby vanish disappear have its personal rapture what am I supposed to pray for and so I had a conversation with her about that and I said listen what what we will pray for is that the Lord will give you wisdom in how to deal with this but I also will especially pray that you will become aware of the fact that sin has repercussion that you reap what you sow and that when you sow to the flesh from the flesh you will reap corruption and you need to be aware of if you enter into a relationship that is not sanctioned by God that you ultimately may have a price you paid that you didn't bargain on and so instead of asking me to pray that somehow you not be pregnant perhaps we ought to pray that you get right with God because that's the real problem we have right now because if you were right with the Lord you would want to honor him and you would honor him with your body and your spirit which belong to him which means that you would avoid fornication and you would yield your body to Christ as a living sacrifice to be used by God for his service that's what I'm going to pray for but not that a baby miraculously disappears from your womb because if you're pregnant you're going to have to deal with your pregnancy now that may sound cruel but I don't think that it was what I was trying to do was encourage her to repent and do the right thing before the Lord you can't just magically wish away the deeds of the flesh and not expect the Lord to chase in you and sometimes people get mad at God because they think God is treating them unfairly when in fact God is simply true to his word he's keeping the promise he made to us that he would chase in us that he would deal with us why? because he's our father so what's the best thing to do? the best thing to do is do your best to follow the Lord as his word declares and walk in his spirit that's what Christians do anyway, amen that's what we're supposed to do is walk in his spirit that's the key I know that sounds simplistic but that's the truth and so here he's speaking to us and all and he's making this prayer to God and we're reading it rather and he goes on in verse 13 and he says as is written in the law of Moses all this disaster has come upon us yet we have not made our prayer before the Lord our God that we might turn from our iniquities and understand your truth therefore the Lord has kept the disaster in mind and brought it upon us for the Lord our God is righteous in all the works which he does though we have not obeyed his voice God is true to his word and God has brought this upon us and we haven't repented you see the Lord had no options he had to bring judgment because God keeps his word and it's our fault he's saying we've brought this upon ourselves we're reaping the consequences and verse 15 he says now oh Lord our God who brought your people out of the land of Egypt with the mighty hand and made yourself a name as it is this day we have sinned we have done wickedly so he's made his confession of sin he's recognized God's righteousness Israel has deserved what has happened but now he begins to move towards asking God for his mercy you see in the past God you have been merciful to us please be merciful once again you delivered us from Egypt please deliver us once more even though we have sinned verse 16 oh Lord according to all your righteousness I pray let your anger and your fury be turned away from your city Jerusalem your holy mountain because for our sins and for the iniquities of our fathers Jerusalem and your people are reproached to all those around us now therefore our God hear the prayer of your servant and his supplications and for the Lord's sake cause your face to shine on your sanctuary which is desolate oh my God incline your ear and here open your eyes and see our desolations and the city which is called by your name for we do not present our supplications before you because of our righteous deeds but because of your great mercies oh Lord here oh Lord forgive oh Lord listen and act do not delay for your own sake my God for your city and your people are called by your name what a beautiful prayer and what a beautiful way for him to close remember Solomon when I had read the prayer of Solomon and the response that God had given to him and in that response God had said people will be appalled when they see the temple well Daniel is saying that when God restores him it's going to reveal how great God actually is because the restoration is going to resulting glory to God once again Israel is going to be able to be there in Jerusalem make sacrifices to him and so in taking away Israel's reproach God will be seen by the world as merciful he says in verse 18 we are not righteous but you are merciful and then he says in verse 19 here oh Lord forgive oh Lord listen and act and do not delay this prayer of confession and repentance this request for restoration is the kind of prayer God delights in answering and because Daniel lived a holy life and because Daniel with humility confessed on behalf of the people including himself and because Daniel had a knowledge of the mercy of God Daniel was able to approach the Lord and say God on behalf of Israel I pray that you would move I pray that you would restore us I pray that you would act and I pray that you would do it soon and these are the things that are going to move the Lord and we're going to see this next time we get together that's moving the Lord to answer I would encourage all of us and I'll close with this because we're going to have communion now I'll close with this one when you look at the life of Daniel you can look at his life and you can say Lord I'd like to have a faith like Daniel I'd like to live a holy life that's one thing too when you look at him confessing sin and realizing that he really doesn't have a recorded sin but identifies with those who have sinned God I want to have a humble life I never want to be a person who thinks of myself more highly than I ought to think help me to be help me to be humble help me to be humble God has a way of humbling me guys he humbles me all the time I don't like it I was at a prayer meeting for the city the cities of Chino and Chino Hills and there were five or six pastors who had been invited to pray and I was the closing pastor to pray at this particular city prayer meeting and so all these guys are going up and they're praying and it's wonderful and all of that and so I go walking up and the fellow who was MCing says and now we have and I was standing up to the side they're ready to go up and pray to close he says and now we have and he looks at his notes and he says to be honest with you I don't even know his name sorry I don't have your name down here and the Lord says you're important aren't you he has done that to me so many times I laugh now I do I laugh now it's happened so many times I don't know your name that's okay listen there's only one name that needs to be known and that's the name of Jesus that's the only name that matters anyway right if you he reminds me of that all the time I had to change my name to Jesus just so that so my name would be remembered you can call me chewy but you know humility God has a way of keeping you humble you never think of yourself as better than you really are never and so we know that but we also know that we should trust in the mercy of God do you want to be used by the Lord live a life that is separated live a life that has humility and live a life aware of the mercy of God and when you pray because of those realities you're going to learn how to pray according to the will of the Father not trying to dictate what he'll do but trusting that whatever he does will be best because there used to be an old TV program you can still see him on some of these old shows and he knows best and he does your Father always knows best so trust your Father and so that's why you come to him and you humbly say God I'm a sinner but you are merciful on behalf of my friends and on behalf of myself Lord forgive us restore us show yourself strong on our behalf and as you do we pray for the glory of your grace to the watching world and they will know that these people are people who are blessed by their God in a land of barrenness in a land that is filled with idolatry may we stand in this land as bright and shining lights in the midst of the darkness may we show the light of the Father through our humility and dependence on you God help us and I think that Daniel's prayer is still appropriate for us today


All right, good afternoon everybody. My name is Matt Fuller and today I'm going to be speaking about Presto and Cloud Native SQL on anything. Before I get started, I just kind of want to get a lay of the land, who here raised your hand, who's heard of Presto, the open source project Presto? Okay, great, cool. This is great, because today I'm going to be speaking about Presto and sort of the basics and background behind it, so by the end of the talk you will have learned about Presto and of those few hands who have heard about it, who's actually used it or tried it. Excellent, cool, awesome. All right, great. So in this talk, we will learn about Presto, which is an open source project, learning those background and architecture, and then after we go through that, we'll learn about Presto and Kubernetes and using it on Red Hat OpenShift, and then finally we'll talk about the Kubernetes operator and how we can participate in the open source community with Presto. So to kind of start off and cut the chase, we'll talk about how we got here, but in collaboration with partnering with Red Hat, we now have a Presto Kubernetes operator that you can deploy to Kubernetes distributions such as Red Hat OpenShift. So we'll talk about that, we'll get to that by talking about Presto and what the operator is, and this might make more sense to what it means and how you can use it. So first of all, it's Presto, well, it's a community-driven project, and you can think of it as SQL or anything. It's an open source project, and it looks like a database because it speaks SQL, but it actually isn't a database because it actually stores any data. What you can do though is by issuing SQL queries through Presto, you can reach out to virtually any data source on this particular diagram or some examples of data sources that you can reach out to, whether it's files on SAF or other distributed storages like S3 or relational databases such as MySQL or Postgres or even non-relational data sources, whether it's Cassandra or Kafka. And we'll talk about more about how you can accomplish that with Presto. So it's a community-driven open source project. It was originally created and open sourced at Facebook. So at the time, this was back in around 2012 or 2013, there was a 100-petabyte data warehouse using Hive, which is another SQL tool, if you're not familiar. And the problem with it is it wasn't performing to scale to Facebook's needs, so they set out and they created Presto. So fast forward a bit and it became a really popular project being used by companies not just Facebook but LinkedIn, Airbnb, Uber, Netflix. So a lot of companies that had large amounts of data that they needed to run SQL analytics on. And over time, it became really hard and battle tested to really work at that scale. So from the beginning, it was really for this high performance scale, high concurrency and so on. But one really cool part about Presto is this notion of separation of storage and compute. So unlike a traditional database that's managing the storage, Presto doesn't store anything. All you do is you issue your SQL queries to it and it will reach us out to the different data sources. So this is really neat because it works really well in a variety environment. So for example, whether it's public cloud or private cloud, you could keep your data in an object store like SAF or S3, Azure's Flop Storage or Google Cloud Storage. So you keep all your data there and then you can just provision the compute layer when you want. We'll talk about how we can do that in Kubernetes, but you can also do it in cloud environments as well. You can deploy it practically anywhere. So why that's really neat is now you don't have to have the system running all the time. You can provision it when you want to. You can scale it out and in as you want to, right? So if you have a lot of demand on the system, you can just add more horsepower to it. We'll talk about that more when we talk about Presto's architecture and how that works. But because of this, it gives you SQL on anything. Another piece we'll talk about later is how you can integrate data from different data sources. So if we go back to the slide where I said you can issue a SQL query and go to these variety of data sources, in the same SQL query, you can actually reach out to multiple data sources and join it together. So it eliminates the need to move data around if you don't have to. And then finally, there's no vendor lock-in. You don't have to run this on a Hadoop distro. It can query data from Hadoop like HDFS, but you don't have to. Or you could, but you can run it on MapR or CloudAir or Hortonworks or outside of Hadoop. There's no storage engine lock-in. It's very open. You can run it wherever you'd like. And it queries open data formats, whether it's ORC, Format, or Parquet, which are a type of file that you can keep data in. And then finally, there's no cloud vendor lock-in. You could run this on the public cloud. You can run on a private cloud. So it gives you that optionality and flexibility of the system. And as I mentioned, it's used by many well-known presto. There are many well-known presto users, whether it's Uber, Twitter, LinkedIn, Slack, Netflix, Facebook, of course, and many others. This is really just a small sample of the amount of users in the community that are using it. But a lot of these are using it at a pretty large scale. So now that I've given the background about presto, I'm going to talk about the presto architecture. Can we give you a better idea of how this system actually works, how it actually scales, and also kind of provide the background for how this will actually work on Kubernetes as well. So there's really two main components in presto. There's what's known as a coordinator and what's known as a worker. You can think of the coordinator as the brain of the system and the worker as the muscle of the system. So the user on the left here sends their SQL query that they want to query data source. Could be data that's in Oracle or Postgres or data that's in SAP or S3 or Hadoop data. But the query comes in to the coordinator and it really has three primary responsibilities. So it parses the SQL, which is basically just a text string and it transforms it into an internal data structure that presto knows how to operate on. And it goes through an optimization process. I'm not going to talk about cost-based optimizations and databases today, but you can think of it as SQL is a declarative language where you're declaring the data that you want to get. You're actually not actually specifying the steps. You're not saying do this, this, this, you know, you're relying on the database system to actually figure that out. And so because of that, there are many different ways to process the SQL query and the optimizer is task of figuring out the most efficient way to get you the results that you want the fastest. So that's what the optimization phase goes through. Then finally, it goes through scheduling. This is where it takes what's known as the plan, which are the sequence of the steps that you have to process the SQL query and it will schedule that work on the muscle of the system, the workers. So again, I was saying, you know, Presto doesn't store any data, so it's not technically a database, it's really a SQL query engine. So how does that work? Well, there's this notion of Presto's connector architecture. So in order to query any of these data sources, you, Presto has to have a connector for it. So the coordinator will reach out to the data sources via use of a special connector. And what this connector does for the coordinator, for example, is it can return metadata because Presto doesn't store anything, it doesn't have metadata. It doesn't know the table names, it doesn't know the column names, it doesn't know the column types. It has to get that information from somewhere. So that's the connector's responsibility. Reaches out to the different data sources. They all provide the metadata in different ways, but it transforms it back into something Presto understands. You know, you can think of it as, you know, a connector from going from HDMI, right, into my laptop, right, as a kind of a crude analogy, but it's translating something into something the other end understands, right? And so once it has the metadata, it processes the processing to happen on the workers. And that also goes through this connector architecture to actually get the data from the system. So in the case of distributed storage like HDFS or SAF or S3, it's actually reading those files and streaming them through back into the workers. In the cases of relational databases, it might be issuing SQL queries. So if you're issuing a SQL query to Presto to query data from Postgres, it will push down part of that SQL query into Postgres to get the results back to the workers. Now, Presto is a distributed system. So you could have one worker or you could have a thousand workers. The more workers you add, the more horsepower you add to the system. So if you wanna get more performance, you can add more workers. And this is where it works really nice on cloud, private cloud, and Kubernetes because you could set up what is known as auto scaling. So based on the load that you're putting on Presto, you can add more workers and then queries will get faster. It's a distributed system. So the plan is basically cut into pieces and in each worker, well, you can think of as like a piece of the plan to work on. It'll work on chunks of the data at a time. So when you're doing that in parallel, you're gonna get much greater performance rather than having something read all the data at once. Naturally it makes sense if you can split it. If it's parallel in some way and you can split it, you're gonna get better performance. So this plan, these workers could be much more complex. You've got a really complex SQL query. If anyone here is familiar with writing SQL, they can be really simple or they can be these massive pages and pages of queries. Presto will do either. It can handle pretty much any SQL query you could throw at it. But the more complex, the more complex the plan is and actually the more important query optimization is to make sure that you can get good performance. So the data flows through these workers and depending on the complexity of the query, it may have to redistribute data, meaning piece of the data might be have to sent over the network to other workers in order to compute the query appropriately. So when the query is done processing, it will go back to the coordinator and send the results back to Presto. So let's double click into like what this connector architecture looks like. So here's another way to look at it. If we wanna double click between, you know, into these arrows, these red arrows where the data sources are. We have the Presto coordinator on the left and the Presto worker on the right here. And this is, you know, if you were to look in the code, it's not gonna look exactly like this, but conceptually you could think of it this way. And there's what's known as an SPI and each connector has to implement certain required methods in order for Presto to work. So for example, the Presto coordinator will, you know, what to say it calls a method, get me table names. Well, the Hive connector will have to implement the method called get me table names that returns the list of table names in a format that Presto expects. Same with Cassandra and Kafka, MySQL. And because Presto is actually pluggable, if you have some sort of data source that Presto can't query from or some proprietary data source or custom data source, you could write your own connector or if it's data source that just Presto was in ship with, you could write your own connector in the complexity of it varies depending on what your data source is. If it's a relational database, they're relatively straightforward because relational database has rows, tables, columns that kind of map naturally into Presto. But if it's something more complex that isn't naturally relational, let's just say Kafka, for example, it gets a little bit more tricky. So if you're familiar with Kafka, it's basically a distributed PubSub system and you can subscribe to topics to read from messages or getting pushed to the topic. So in that case, the implementer of the connector has to figure out what is a table, what is a column, what is a row. In the case of something like Kafka, the topic, the thing you're subscribing to appears as a table in Presto and each message will appear as a row. And then it's up to you what you wanna call them to look like. So there's data stats, SPI. So if you want your data sources to work with the cost-based optimizer in Presto, you have to provide data statistics to it so it knows how to operate on the data. The data location is, where is the data located? What is the, for relational database, what is the JDBC endpoint for distributed storage? Like where is the physical location of these files? So here's like, if you double click into Mars a little bit more technical, I'll just kind of briefly go over this, but each of these workers has an operator pipeline in them. So these operators could be, read me the data, do a filter. So if you have data with, maybe there's a state column in it, Massachusetts, Rhode Island, California, but you only want to return the California rows. One of those operators will be doing that filter so that only pulls out the rows where the state is from California. Might be doing an aggregation if you're doing a sum or a count or standard deviation or something. So each of these operators have a task for what they're doing. So I'll talk a little bit about the Presto ecosystem now. And then I think at this point, you have a pretty good basic understanding of Presto and we can talk about how this fits into Kubernetes. So the most popular and widely used connector in Presto is called the Hive connector. Now it's a bit of a misnomer. It was originally written to query from the Hive data warehouse that is HDFS. But it is just a list of files, right? So if you're using the same sort of Hive table format where if you think of files and directories, right? A directory represents a table name and all the files in it could be one file or multiple files in it represent the data of that table. So as long as you replicate that on the different distributed storages, whether it's SAF or HDFS or Google or Azure or AWS, the Hive connector will work there. So you can think of Hive as three things. First of all, it's a SQL engine that was developed before Presto's time. And it was really clever where it took what is known as MapReduce jobs, which is a compute engine on Hadoop and actually translated it to, you'd run SQL, it translated to a bunch of MapReduce jobs to process the query. I'm not gonna go into too many details about Hadoop and MapReduce, but just take for granted that that existed and it was slow, but that's what was done. And, but what came out of that was this notion of a Hive data warehouse and that's how data is particularly formatted there. And that's sort of the background behind the name. Now there are really three parts to Hive. There's the actual way you're storing data on disk. Then there's the metadata catalog and then there's finally the execution engine. So the Hive connector uses two of those three. It uses the metadata store and knows how to read this particular table format. What Presto does not use is the Hive runtime because Presto is essentially replacing that Hive runtime because Presto is developed to be much more fast, performant, efficient than Hive. But Hive has a really good meta store and a really good way of representing tables. So it leverages that. But the other cool thing, this is where separation of storage and compute comes into play, is that you don't have to move the data. If you had your Hive data warehouse and you've deployed that in your infrastructure, your company, you don't have to do it. You don't have to migrate or anything. You can just point Presto at it and it can start querying the data. The other public connectors are relational database connectors. So Presto will connect to these over JDBC. You don't have to worry about this Presto figure this out how to do. So when you issue a query to Presto, Presto will know how to issue the particular SQL query to this database. So to your end users, it actually might be transparent that they're even querying data from Postgres or even querying data from Oracle. All they see is just its tables in Presto. So this can also solve sort of the data silo problem where you have to remember, oh yeah, for this data have to go over here and for this data have to go over here. Now you can point your users at one system that's Presto, kind of access all your data. And that's one of the values of the relational database connectors. And for performance optimization, you can push filtering down. So the example I gave earlier about filtering on state columns, you wanna only return the users that are from California. You could pull all that data back into Presto and Presto does the filtering, but the more you're moving data across a system, the more time and effort it's gonna take, right? So if you can eliminate data earlier in the processing pipeline, then you're gonna get better performance. So you can push down these filters to the database to return minimal amount of data. And then finally, there are non-relational data sources as well, whether it's a key mill over a Cassandra. Elastic search is one that went in recently, MongoDB, Redis. And the community is constantly contributing connectors back. So this list is only gonna grow over time. But if, again, if there isn't a data source that you wanna query from, you could always write your own connector and drop it as a plugin. And of course, contribute it back. So now that we have sort of a background of Presto, I wanna talk about Presto and Kubernetes now. So again, I wanna do another attendee poll. Who has heard of Kubernetes? Way more hands, cool. And who has tried or uses Kubernetes? Okay, less hands, but still more hands than the Presto. Question. Cool, so we're gonna talk about how these come together. So it seems like most people know Kubernetes here. I do have some slides to kind of set this up, but I might go a little bit, I'll still go over them. I might go over a little bit quicker. So it seems like a lot of people have knowledge of it. But yeah, so Kubernetes is a Greek word. When I looked it up, I was like, what is Kubernetes? Where did this word come from? It's apparently a helmsman, pilot, navigator. And finally, after reading through the internet and it clicked on me that it's a container orchestration. You have the helmsman of a container ship, right? So it's also, of course, an open source container orchestration engine for automating deployment scaling and management of containerized applications. So we're gonna talk about how this relates to Presto. So how do we containerize Presto so that it can work on Kubernetes? You may see in the slides K-8S, which is just shorthand for Kubernetes because having written it a lot of times, it actually becomes annoying. K-8S is much easier to write. So as I mentioned at the beginning of the talk, we Starburst partnered with Red Hat to provide a Kubernetes operator and Presto container on Red Hat OpenShift. And so now, going through the container catalog, you can use our operator and container and actually run Presto on your Kubernetes distribution, Red Hat OpenShift. And why is this important and why are we involved as well? So Presto is an open source project. We have a community addition. This is the free version that you can get everything in open source. And we at Starburst we constantly will be patching as you kind of get a very stable and tested version of it. Now, if you're an enterprise organization, this could be important because you can try Presto out, you can use it on Kubernetes. But if you want those extra enterprise features or the kind of the high touch support that we provide, you could come to Starburst and get that initial features, long-term support. So not forcing you to do a major upgrade because some bug fixes in a much more recent patch, we'll do patch back porting and so on. So you can start out using the community addition, but if you kind of need that extra enterprise touch, you can come to Starburst. So briefly why Kubernetes, I actually like this picture. I did not draw it, I gave credit so, but I got it from Kubernetes website.  That is inefficient, right? You might have to over provision for resources or those content resources. So then VMs came out, which are better, you get more efficient use and better utilization of your application. You can isolate the applications from each other. But the really cool thing about containers is you can think of it as like a lightweight VM where it's not packaging the operating system and all the libraries you need and the application. It's packaging exactly what you need and it can run on top of the operating system. So containers made kind of deploying applications really beneficial, but one thing is the complexity of maintaining these became complicated. So imagine if you had an application that has many containers, right? How do you actually orchestrate them? So that's what Kubernetes helps with is sort of the orchestration of and management of these containers. So as a brief concept, Kubernetes cluster is made up of notes and kind of adding these notes to the cluster increases the CPU and memory available. But the Kubernetes, it doesn't actually run the containers where applications like Presto runs, it actually runs pods and these pods run containers. So skimming forward, we've containerized Presto to run within a Kubernetes pod. So if you remember the diagram from Presto where you had a coordinator and workers, coordinator could running in a pod and then we use what are known as replica sets to run the workers. So you can, as a pod becomes more popular or has more demand, you can configure it so that you can auto scale the amount of pods. And therefore the amount of Presto workers to add to the system. So let's take a look at what Starburst, Presto on Kubernetes architecture actually looks like. So we have what is known as an operator, which I have a slide in a minute to kind of describe exactly what that is. Then we have the Presto coordinator in a pod as well as the Presto workers on the pod. We also provide the Hive meta store service. So if you remember from a few slides ago, I was describing how if you're querying from distributed file storage, there is no catalog. You have to have a catalog that tells Presto, what are the table names, what are the column types and so on. So if you want to query from distributed storage, we'll provide that catalog for you so you don't have to provide it on your own. And then finally we work with the horizontal pod auto scaler so that you can scale up and down your Presto worker nodes. So again, like the really cool thing about Kubernetes is it's platform agnostic. You could run it on Redhab and Shift. We have the certified operator for it. But if you happen to be running on Azure or Google Cloud or Amazon web services, you can move the application to and from there, right? So if you're on Google Cloud, and you want to move it onto OpenShift, you can do that. You don't really have to reconfigure much. It kind of makes the hybrid cloud a multi-cloud, whether public or private, really transferable. So you typically don't just launch the Podrick when the cluster uses abstraction called deployments where you kind of declare the layout of how you want Presto to work. And that's what we have to help deploy Presto on Kubernetes. So remember when I mentioned earlier that SQL was declarative. You're kind of defining the results you want and then it figures out how to get the results. I think of Kubernetes as declarative where you're just kind of describing exactly what you want. And Kubernetes handles the management of how to do that, how to deploy containers. If a container goes down, how to bring it back up so it's kind of self-healing. And so Kubernetes eases the burden and complexity of this. So going back to here, I want to talk about the Kubernetes operator, which is sort of the key to how we have Presto working on Kubernetes. So as mentioned, is non-trivial, to deploy a non-trivial application on top of Kubernetes is hard, especially if it's like a stateful application, right? Prior to this, you'd have to somehow manage all the bootstrapping, the complexity and lifecycle management, failure recovery, all these different scenarios on Kubernetes. So this concept of an operator is meant to kind of encapsulate this level of abstraction. And so you can kind of focus on the logic of what you want to do and it reduces the complexity and boilerplate code you might do throughout. So this is sort of a pattern for building Kubernetes native application. It runs as a container. And so we did is take the operator framework, we built a Presto operator to handle this. So the operator does a lot of things, but the four kind of main things that are unique to Presto that are worth mentioning is auto-configuration of the Presto cluster. I know I didn't see a lot of hands raised about who's used Presto, but you could imagine with a distributed system like Presto, it's pretty hard to configure. You have to tell the workers where the coordinator is. You have to specify how much memory to give it, how much, what thread count is for the CPU utilization, configuration of where to get the data. You have to tell Presto where the data is. So there's like a lot of tweaks and knobs you have to do, but we can look at the system, the CPU available, the memory available and do a basic auto-configuration of Presto to kind of get that base configuration done for Presto. So you don't have to worry about that. Also the coordinator high availability. So if the coordinator becomes unresponsive, if you remember from the diagram, I said there's one coordinator and any number of workers. So if a worker goes down, it's really not a big deal because you just have one less worker now. Of course, if a lot of them went down, then the performance gets slower. But if the coordinator ever goes down, that's a single point of failure, which means your system becomes interoperable. And so the real cool thing about Kubernetes that helps here is if the coordinator goes down, it will just bring up another one in a different pod as long as there's availability on the Kubernetes cluster, of course. We can figure out worker auto-scaling. So based on CPU utilization, for example, you can start adding more workers so long as there's availability on the Kubernetes cluster. And then finally, there's this notion we call a graceful scale down. So what happens is when you issue a Presto SQL query, all the workers are processing the data. So let's just say the demand on your cluster has gone down. The Presto workers may still be processing a query, maybe not as many queries, but still processing the query nonetheless.  So what we have this notion of a graceful scale down where when we determine, okay, we're gonna go from 100 nodes to 25 nodes, we may mark 75 of those nodes, let's help Presto, hey, don't take any new work, finish up what you're doing and when you're done doing, shut down. So what that does is any new queries come in, they're only gonna be running on the 25 nodes and when the other 75 nodes finish up what they're doing, they'll shut down. Other things that we'll be working on, some degree of operator metering, this is another thing that's important in the enterprise, I per se, is they want to know usage report or even to tag users to see how much resources they're using on the system. There's a variety of reasons that they may want to do this, one could be charge backs, if the IT org has a Presto cluster for a bunch of departments, maybe they want to charge back to the different departments based on usage. Or as simple as just knowing how much they're using it. You know, there are a variety of components. First, there's the Presto Community's custom resource definition. This will redefine the resource of a Presto type. An instance, like when you instantiate this instance, that represents a Presto cluster on Kubernetes. There's the Presto operators continually monitors the Kubernetes resources and it will create and remove a Presto resource when asked for. So coordinator, a worker, and so on. I think we've covered what a coordinator and a worker do, but again, the coordinator's the central point responsible for issuing the queries and implementing the queries and the Presto workers are actually doing the query processing. There's the coordinate services where we expose an external IP so you can actually connect to the Presto coordinator to actually issue queries on the system. We have a network policy, it's really for security that allows the inbound traffic to the Presto workers from the Presto coordinator. The Metastore, which I spoke about, this is for if you're using distributed file stores that doesn't actually have the catalog, you can keep it in the Metastore that we provide. And then now if you wanna persist, so if you're using distributed file storage and you wanna persist your table names, columns, comm types, it would be wise to have a database that's backing us, whether it's Postgres or MySQL. So you can connect to one that you can access outside the cluster or if you just kinda wanna get up and running fast and try it out, we do have this notion of an internal Postgres that just runs on Kubernetes, but it's life cycle starts and stops with the Presto clusters, which is really only for kind of demonstration purposes. And last is simple. With a few commands you can deploy and I'll do it so in the next five minutes I can demo this. So sorry, it's a little hard trying to see my screen here. All right, so first of all, we'll use, let's make sure there's nothing there. Oh yeah, of course I already have it running. So let me delete it. Oh yeah, sure. Let me get this deleted first and I'll work on that. I don't like it, huh? Get bigger, can you see that now? Is that good? In the back? Is that even, is it getting bigger? Yeah, that is getting bigger, okay. Is that good? In the back? All right, cool.  So what we do is I have this YAML file that defines what we want to deploy for Presta. I can show that in a moment too. And now we've created it. Let me see if I can bring that example over here too. All right, so it looks something like this.  You specify the type of CPU you want for the coordinator, workers. I'm choosing nine workers in this case and so on. So I'm not gonna go through all today, but that's sort of how you define it. Now, so if we, do we get pods again? All right, you'll see there's a bunch running now. And now what we wanna do is we're gonna do expose. All right, so we are setting up the IP for external metastore. It takes a few seconds. So an observer will see that there are only eight workers running because the Kubernetes cluster wasn't big enough. Well, anyways, well, that's starting a lot. Let me just go back to the final slides here. So if you wanna customize the solution, we do have as long as a bootstrap script. So if you wanna set up security or download additional software, you can. Or of course, for more heavy customization, let's say you wanna install additional software on there or do something else, you can use a custom Docker image. You just pull from the one we have and then you build your own and then you can specify it in the configuration. So you can join the community as mailing lists, there's development Slack, GitHub. You can follow on Twitter as well. And then we at Starburst, we have a monthly newsletter. So I highly encourage you to sign up for that. If you wanna learn more about Presto, we're just kinda seeing what's going on in the community. Presto news, events, how to, we just kind of aggregate it all and put it in your inbox. Then of course, contributors welcome. So if you wanna learn more about sort of the vision and development philosophy, contribution process to Presto, you can go to presto-sequel.io and learn about that. All right, let's go back real quick to the demo here. I realize I have only a couple minutes but I think we can do this. Did I copy that all? Is it highlighted? All right, I'll figure it out. Oh, I see. It says hard for me to see. That's, didn't like that, huh? And really, so that's 34.73, is that 230? Yeah, 130. All right, so here we are. Presto's running nine. Okay, yeah, yeah, sure. So anyways, yeah, that's Presto running nine worker nodes on a Kubernetes cluster. And I'm told I'm short on time so I can definitely take some questions. I guess one final piece or plug of course is at Starburst we're hiring. So if anyone here is interested, reach out. Cool, can I take some questions? A quick question. Does Presto have a reduced like SQL language that you have to use as it supports so many different things? Yeah, it's a great question. So no, actually Presto follows the SQL standard quite close. So the reason for that is you can use your, your favorite BI tools or SQL developer tools. So they all kind of work seamlessly with those. So the Presto connector will handle any sort of nuances or translations to the underlying data sources. So you use standard SQL, but if there's some, my SQL or Postgres nuance, Presto, the connector figures out that kind of translation. A good question. Hey, Matt. So you mentioned that Presto is not doing any storage, but is there a way to set up any sort of caching mechanism to improve like query timing or anything? Yeah, yeah, great question. So there's a open source project called Aloxio. And you can essentially just deploy it with Presto. So that's really good for cloud storage or sort of like hybrid or multi-cloud scenarios where the data isn't necessarily close to you or you have to go over the network and reach it. So it has a variety of caching algorithms it uses and based on your workload, you can choose which one you want. But so if you issue queries and the data becomes hot, then subsequent queries will speed up. And we are actually a partner with them as well. So if one is looking to deploy both, we offer starburst with caching, which is essentially that. Does Presto use any integration with the scheduler on Kubernetes to schedule better the workers based on load and the execution plan or something? Presto itself does not natively integrate with the scheduler. But I would like to talk more about with that if you offline maybe after the chat. I'd be interested to know what you had in mind. Probably the last one I'm imagining. Just a quick question. You mentioned JDBC as a connector tool for some of these data stores. Are there any shortcomings in using JDBC? Are there better methods for faster access? Yeah, that's a great question. So JDBC really isn't meant to be a big data pipe, right? It's of course the easiest way to write a connector to a data source because it's a standard interface. But so some of the proprietary connectors that we have at starburst, we would say is like a native direct connection. So for example, our tear data connector we have actually connect directly to the amps that we bypass JDBC entirely. So the amps, if you're familiar with tear data, I'm sure people in here are not, but the amps will then be pushing the data to Presto. So we do it in a completely parallel way instead of a single pipe way as well. And we're doing that with Snowflake as well, our Snowflake connector. But great question. I think we're out of time, but thanks everyone for coming to the talk. And I'll be mulling around I guess out there later if anyone has any additional questions.


Also, Action 8 Nigeria has commended efforts of the present administration in Quarra state at improving the socioeconomic lives of women and children. The country director Action 8 Nigeria, Andrew Mamudu, and other speakers who spoke at the partners meeting in Ilarien, the Quarra state capital, noted that the organization had seen the willingness on the part of the state government to support issues of gender-based violence, women economic empowerment, and women political participation. Mamudu maintained that a group has also seen a couple of laws, child rights acts, issues of violence against women, persons, bill and act passed in Quarra as well as the commitment of the state government to the appointment of women into political positions, noting also that the state government is currently pursuing a 50-50 target. We have seen a couple of laws, child rights acts, issues of violence against women, persons, bill and act that have been passed at the state, and then we have seen commitment of the state government in terms of appointment of women. You have the 50-50 targets that the state government is currently pursuing. You have women currently, six women in the state house of assembly, which was zero before. Also speaking, the state commissioner for women affairs, Abosede Buraymo, said investment of the Action 8 Nigeria in women and children in Quarra state in the past 17 years has been beneficial to all. I want to commend what the Action 8 is doing in Nigeria and especially in Quarra state for investing in our women. Of course, the Quarra state government is so passionate about the welfare of the citizens, especially the women and children.


what's up guys today we're gonna be seeing if we can profit on three boxes of the newest set phantom rage hope you guys enjoy it today we have phantom rage the newest set until next week and maximum gold comes out yeah it's gonna be hype the giveaway for this video these three cards gotta revive king hades i really like that our hades here if you want to call him black wing elf and the raven secret rare and a number 20 all you have to do is like this video be subscribed and let me know your favorite card from phantom rage and what you're excited for or and or what you're excited for about maximum gold so i'm super excited for maximum gold this set i haven't paid too much attention to but i did pick up a few boxes to open up and see you know if we can find some cool stuff obviously starlight is the goal that's the main goal here otherwise i'm just gonna check out the cards we have three boxes here if we do pull a starlight we'll probably not open all three but we'll see we will see because i mean well maybe we'll open all three i don't know we probably will actually we probably will because then i don't want people being like yeah well you're gonna sell the other box do you know there's no starlight in there they're like okay all right dual avatar feet dual avatar feet what is this that's pretty weird super rare okay so we got a feat next pack here we go prank kids meow meow meow yeah so there's no uh no rears again so interesting so meow i saw that uh they didn't really map these so there's just gonna be kind of random where the foils are it's pretty cool virtual world and juju so i'm hoping that there will be something epic in here but we can pull uh let's see the best cards in this set are the uh the Zeus i've heard of that guy oh dual avatar empowered con gaio all right nice check him out kind of looks like he's from like i don't know some anime show or something okay ultra rare so yeah we got the Zeus we've got uh the alpha Zeus and alpha are both pretty high phantom knights of the torrent scales i've seen him he actually looks really cool the phantom knights of the torrent scales so far we've pulled an altar but no secret i actually saw i think you can pull like more than can you pull more than two secrets in a box now i think it might be like you know pretty rare but i think you can oh two two packs whoops so i've opened up i usually open up like three boxes before the before i open a case if i open a case sometimes i don't open a case but i've never pulled a starlight before oh there we go myutant ultimus let me see myutant ultimus that guy looks like he's about five dollars so not one of the big old older cigarettes not one of the big cigarettes yeah so i've never pulled a starlight before i open the case i've pulled him out of the cases we pulled a few full dd crow triple tactics talents we pulled the 10k dragon if you count him as a if you count him as a starlight even though he's technically a little bit different but yeah never pulled one of the three boxes and i've done that i've always opened three so we got a mutant evolution lab let's see what the best ultras are in here we've got a lulu looks like the best ultra rare tri gate tri bugade stuff okay are there any good super rare's prank kids meow meow mew is actually is actually worth something let me find that card so it looks like prank kids meow meow mew is actually over a dollar so that's like actually a decent card with all pretty much the only good super it looks like let me know if there are any other like commons or supers that i'm missing that are worth something so i can pull them out okay um conductor of nephis yeah so the super rare's are just now the new rares it's kind of weird so far we've pulled what two ultras and a secret that seems pretty normal for one side joyous melphis yeah the uh the melphis all right here we go let's see if we can pull something insane all right we got mutant beast ultra not ultra rare super rare so far we have not pulled something insane we've pulled some uh pulled some pretty average stuff okay i didn't go you but here we go ray raptor super rare come on give us something insane yeah we want the alpha or the zoos worst obviously star lights number one raiders night okay cool that looks really cool actually check that out the raiders night that's pretty awesome let's see what we can pull it with it okay so well we have one more ultra and one more secret is that the deal here rock rock bandzino guitar all right i'm going to play some rock band prank kids meow meow mew all right super rare i'll take it i'll take the meow meow mew this dog does not look happy to be cuddled up by this by this cat that's kind of funny all right arc rebellion xc's dragon all right secret rare this guy's like 570 okay so he's a little better than the last one so not the craziest box in the first try that's okay well it's not over yet because i have seen that you can get three old or three secret rears so maybe you can maybe it'll happen all right we got a super rare again all right let's get rid of this box we've got four packs left here here we go mutant blast gizmek coming all right also tomorrow guys you guys will be seeing the tribe of great fractal okay tribe of great fractals actually like four dollars that's pretty good ultra rare that's a good pull tomorrow you're going to be seeing the blue eyes white dragon tin opening which is going to be pretty awesome and then that's sunday then on monday the battle versus team sam which is going to be crazy we're opening up some really epic stuff a lot of old packs it's going to be really good it should be a pretty long video too so it's going to be it's going to be good i think you guys are going to like it hopefully we will be um we should be at 30 000 soon soonish so we can do the six tins from 2002 opening as well so that's going to be that's going to be crazy guys it's going to be super crazy so i hope you're looking forward to that one hopefully we'll have a little better luck than we have with the 2003 tins we had one good pack out of those one but that's all it takes just need one to have something crazy all right next box let's see what we can pull here yeah we got a call i somehow didn't turn on airplane mode or sometimes you can turn on airplane mode and leave the wi-fi on and then it's just might as well not be on so that's what happened there but let's see what we can do can we pull something up the first box was not fantastic we got a couple of decent cards we didn't get anything crazy there's only a few cards worth like over 10 bucks so we kind of got to get lucky to hit those i would love to pull starlight that's all i'm saying i would love to pull starlight i would love it oh there we go armitile the chaos phantom is in here phantom of fury okay this is a new version that's pretty cool that is an ultra rare okay okay armitile the chaos phantom is that a okay let's see what the what the star lights in here phantom knights of torn scales tribe brigade alpha heat of the fire charmer and divine arson are okay super rare so that'd have been pretty cool the armitile was one but he's not let's see if we can pull one though probably not probably not i'm really looking forward to maximum gold i don't know about you guys but those gold rares look absolutely awesome they look super good joyous nephis all right one second all right there we go here we go there's gonna be oh dual avatar invitation i don't think this is one of the big ones let's see dual avat oh man i'm it's not even showing up on the on the top page this is not good two dollars nice two dollar uh secret rare that's fantastic that's just what we're looking for two dollar secret rare no okay not a good start all right so so far this has not been our lucky set that is for sure we've been pretty lucky with new sets recently well bridge we're all we weren't lucky we didn't we didn't pull the raw we still haven't pulled it mutant m o five okay the mutant ninja turtles yeah that happens mutant ninja turtles let's go all right raider raptor phantom rage come on a lot of rage recently rage of raw phantom rage you know somebody's angry over there can i'm i don't know what the deal is let's just these boxes are killing me i'm gonna pull these out of there oh yeah that was that went everywhere all right oh i just completely destroyed that pack not that we're preserving these packs or anything okay next pack here we go here we go here we go fernity doom wait fernity do march fiend all right come on oh my gosh what has happened what is happening virtual world so far we haven't even hit that that nice super area so this box has been even worse than the first one who would have thought who would have thought dog matica is she in is she in okay that dude's got some really long fingernails check it out just kidding it's wolverine 2.0 wolverine dog matica rock band i just i love the name is rock band that's pretty funny come on secret rare can we get a good secret rare out of here come on give us some fire okay that's not a good secret it's not a secret rare at all actually that's nothing yeah we're kind of flying through these because yeah we're just are we're trying to get something good divine arsenal Zeus the number one card okay besides starlight number one secret rare in the set the divine arsenal double a zoo sky thunder all right there we go we finally pulled a good car it's beautiful it is beautiful oh i missed the Zeus has been pulled now starlight dual avatar fists okay all right that's pretty good box okay we got a two dollar secret and like a fifty five dollar secret so it balances out a little bit dual avatar fists makes back come on the brigrand big brigade brigrand the glory dragon all right cool ultra rare and two more packs in this box two more chances at a star like a if there's a starlight in here and the zoo so it'd be pretty nuts yeah nothing nothing nothing in here let me know what you guys think about this set i don't really honestly i don't care too much for it because there's just nothing that makes me interested in it you know like the the main series sets are like less my thing because it's just i mean it's just geared toward the meta you know there's if i guess i like to rise the dual showcase it had the guy that was pretty cool but here it's just like just kind of new stuff and it's just i don't necessarily dislike the new stuff i just don't like it as much it's not as interesting that's why like maximum gold is gonna be cool even rage of raw even though the set was terrible it had the ghost or wing dragon raw chance you know stuff like that and had like genzo in it and all that stuff that i like more personally so last box singing bullstar i mean star lights are still cool no matter what no matter what they are so see we can pull one of those all right yeah i am super excited for maximum gold searching for blue eyes dark magician and red eyes and apparently they're not easy to pull either which is cool which makes that very cool the meow mew the last one didn't even have one yeah so i am looking forward to it i think the new gold rarity looks awesome too i think it's pretty sweet um and it's not too hard to pull out that just the rarity in general so we should see a bunch i think it's is it one every pack or something like that i think because i mean there's not very many packs virtual world phoenix fan fan all right fan fan oh here we go star light come on dual avatar all right all right yeah total i've pulled four star lights i've never pulled one when i didn't buy a case so that that's gonna that's gonna be crazy if that ever happens because that's actually like really tough you know pulling it out of the case is still tough because it's not guaranteed but you have a much better chance oh alpha the master of beast the second best see career this video is picking up you pulled the best two cards and besides the prismatics of course yeah check that out let's see okay let's find the best guy we have alpha and zoos top two cards that's pretty cool that is pretty cool they look good i'll give them that even if you don't you know love the new stuff they look pretty good okay virtual world i'm gonna continue on this side so far it's been pretty normal from what i've seen it's been like one secret inside something like that so pretty pretty usual gizmak makami here we go here we go here we go virtual world magical broker oh drop the pack drop the pack alert i dropped the pack libero raiders wing ultra rare cool final pack let's see oh yeah by the way we will do a little we'll see if we made money on this i don't think we're going to probably i think i paid what was it it was 70 a box i think it ended up being 210 plus tax maybe so what it was so it was like 230 i think total 230 bucks so we're gonna make back 230 bucks that is probably not gonna happen even if the big two cards i think that makes like a hundred and what does it make a hundred and five hundred and ten dollars back that's about half the value but the rest of the value is probably not gonna happen unless we hit that starlight so i'll kind of show you guys we're gonna do however much we got and then we'll do minus 230 to see if we got it the myutint st 46 and we'll see if we can uh even get close if we can get close because that's 70 it's kind of hard to break even unless you pull like the best stuff here because there aren't a lot of valuable cards in this set let's see if we can do it dual avatar fists yeah we still have one more secret rare so we pulled like a if we pull one of the big cards again like we pulled the best box and pulled the zoos we would probably break even just because of that oh towards scales okay so that's not the best one but this one's like the third best secret rare so we pulled all the top three this is a super good box the second and third best secret rare in the same box so while we might not break even we are gonna do pretty good i think so unless we pull another secret like this is like a triple secret box and it has you know the other guy in it the big boy zoos that would be insane actually alpha zoos and phantom night of the torn scales in the same box would be pretty cool okay all right we have what three more packs three more chances at a starlight the chances are very low the low to begin with with only three boxes here we go virtual world my he may lulu is a little pretty good i think lulu is pretty good oh no they're stuck all right virtual world roshi what is this master roshi can't leave roshi's in here all right final pack our last chance full of prismatic probably not gonna happen i would have seen it on the side okay let's see what we got let's see how much money we made or lost probably lost all right from three boxes we pulled meow meow three meow meow mutant evolution lab we got a dual avatar and powered congyu brigham brigham the glory dragon arm entire the chaos phantom we got a uh fan fan raiders knight dogmatica ishian raiders wing lulu let's call lulu frank tail double myutin we got a dual avatar invitation the worst secret then we got a uh ultimus xyz xyz dragon we got a torn scale phantom night torn scales alpha and a zoo so overall we'll pop up what we got and then we spent about 230 bucks so we're gonna we're gonna lose a little bit in this video but i'm gonna show you guys what exactly how much we lost up here and you guys can see kind of what you'll get out of these boxes and we actually got pretty lucky in terms of secrets because we got the three best cards we didn't get a prismatic or a starlight if we get a starlight you're gonna plus probably so i'm really looking forward to maximum gold tomorrow we're gonna be opening up the 2003 blue-eyed stand and monday we're battling sam so make sure you guys show up for those this is gonna be pretty awesome see you guys later thanks for watching peace it's the original army