Why did the Ravens choose to stick with Greg Roman for another season? Should the Ravens bring back Dez Bryant? Did the Ravens waste their passing weapons this year? These and many many more questions on this episode of NFL Questions from Subscribers. YouTube team keep it clean, what's going on, it's Aang Raven here with another video and another episode of NFL Questions from Subscribers. This is a series where you can ask me any NFL question you want to based off of any NFL team and we answer in a video just like this. Now if you want to be part of NFL Questions from Subscribers, then you just send me an email at teamkeepitclean at gmail.com and we'll answer your question in a video just like this. I love y'all team keep it clean, special shout out to all the patrons, all the new patrons. I mean we ain't been having a patron that long so everybody's pretty new but thank you. Thank you very much. I love y'all team keep it clean. Make sure you check out the podcast. If you ever want to send something to team keep it clean, the PO Box is in the description. If you ever want to get a custom made mask that's down below in the description. If you ever want to get merch that's below in the description. The description has a lot of stuff in there but one thing that I need to describe is that I really appreciate y'all. I seriously do. We are almost at 38,000 subscribers. We as of this recording of this video, we are exactly 200 away. Like literally 200 subscribers away. And on the podcast channel, by the time this video comes out there should be a new episode of the podcast that came out this week. So y'all make sure I check out the podcast channel to the team keep it clean podcast. One thing that we're going to be doing, I ain't even going to say too much. I'm going to just do it. I ain't even going to talk too much because I don't want to do that but anyway, team keep it clean. I love y'all and I appreciate y'all. Let's get into your questions. First question came from my boy Rodeo. He said, my guy, good morning, hope all is well with you and team keep it clean. Just came across something that I thought may or may not be interesting. While stats and odd numbers can sometimes be deceiving or misleading, did you know that David Coley was our passing game coordinator? Well, of course you did. And you knew he was under Andy Reid for 14 years in Philly as a wide receivers coach and then followed him to KC for four years. Did you know in his time with the Eagles chiefs and our Ravens, he never had a wide receiver who earned an 80 plus PFF grade. Now, I know G-Roll is still the play caller, right? But this should have some sort of significance. G-Roll's passing ranks usually rank at the bottom of the league, but maybe just maybe for the Ravens sake, it wasn't just G-Roll this time and Coley contributed. I don't know. Maybe I'm just wishing, but maybe, like I said, we can get Eric B in here at that position since the rest of the league is doing them wrong. That's not happening. I wouldn't mind it if Eric B and me could be our assistant head coach, passing game coordinator. You could be all that. And I know a lot of Ravens fans have been seen in the comments section. Y'all been going crazy with it. But anyway, I don't see it happening. I don't because it would technically it's like. Assistant head coach. Is that really higher than an offensive coordinator?  But is it really higher than an offensive coordinator? I don't think so. And would Eric be into me? The next move I expect him to make is not to be an assistant head coach. It's for him to be the guy. So while him being an assistant head coach, it could be a stepping stone. I just, I don't see that happening. I really don't. And we've talked about a lot on here, how David Culley. It's not just Greg Roman, but so yeah, David Culley, he got his share. Lamar Jackson, he got his share. The receivers, they got their share. It's a mix of everybody. But the people at the top, that's where everything starts. That's where everything begins. So that's why, as y'all know, I wanted the Ravens to go in another direction, but they're not. As far as offensive coordinates, okay, cool. Let's just hope for the best. Let's hope they can bring in a passing game coordinator to replace David Culley now, who will really help this offense do as much as they possibly can. And Greg Roman will take it up a notch. Lamar Jackson will take it up a notch. The receivers will take it up. Everybody will take it up a notch. And we, then we can go from 32nd ranked passing to 30th ranked. No, I really do hope they improve everybody all across the board. Next question came from a boy, Captain Kirk. He said, what's good in Graven? Love the content. Been watching for a few years now. Keep up the great work, bro. Appreciate that, man. Well, Captain, he said, my question is about your offense. With so many great options we had after the season was over to get a new offensive coordinator, why do you think the Ravens stay with Greg Roman? Doug Peterson was out there, even though I doubt he was going to go back to offensive coordinator after winning a Super Bowl, LOL. I think he actually would. I think he actually would because if you ain't got no options and you still want to coach, you're willing to sort of take that step down. And enough times too, some of those guys may not want the extra responsibility that comes with being a head coach. They may want a lot off of their plate. Possibly, not necessarily, but you never know. He said Anthony Lin was out there before the Lions scooped him up. That's true. That's another one. Even the Steelers are looking to bring in Hugh Jackson out of retirement to call play shaking my head. Well, yeah, they did end up promoting their QB coach. I want to say Matt Canada. I know his last name is Canada. I don't remember his first name, but they got that guy now too. So with so many great offensive minds out there on the open market, why do you think the Ravens are so bent on keeping Greg Roman? Ooh, I love this question. This is a really good question. One, they're comfortable with him. They're comfortable with Greg Roman. We know the Ravens, they broke all these records running the ball. They're comfortable with Greg Roman. The Ravens also John Harbaugh.  And usually when it comes to offensive coordinators, we don't really bring in anybody who's really the best of the best. So I think that's a part of it too. And Greg Roman is somebody that's more low-key. He's a low-key guy. And he already had a reputation for, we saw the numbers in San Francisco with the Bills and all that. And then he still had those same numbers with the Ravens. So nobody is looking at Greg Roman like, oh, you might have to take over for John Harbaugh if he don't get it right. I think it could be one of those instances where the Ravens just, they don't want to think outside the box with this one. And I don't even think, I don't even think you really even got to think so outside the box. But I just, I would really love them to take the reins off of this offense. Stop making it child's play and bring it to the adult section. Like really take the reins off, man. Like really, and really force these guys, man. Because I don't want to hear that because I know some people say, well, maybe it's because it's Lamar, that's easy, I can't even talk because it's so frustrating. Maybe it's because Lamar is just so limited. Maybe that's why they run the offense the way that they do. Well, you need to unlimited him, force him to be that, open it up, open it up. Stop holding back, stop doing the same, open it up.  We just want to be more balanced. We were, and we've been talking, we talked about this before this past season even started. We want it to be more balanced. I was in a group chat with some fellas and one guy was talking about, well, when the Ravens were passing earlier this season, that everybody was calling for them to run. But then Ravens, they just run, run, run. Now people calling for them to pass, what is it? And somebody responded, we want balance. We just want balance. And what I responded with is, yes, we want balance, but we want to be able to consistently do both. We want to be able to do both. And especially in games where one of those things is taken away, we want to be able to do the other consistently, continuously. That's what the Ravens need to do. So as far as why they kept Greg Roman, I don't even know. Next question came from Shazab. He said, in Graven, this is my first email to team, keep it clean. Paul is well with you and the fan. Recently, I was made aware that Allen Robinson liking tweets about possibly playing for the Ravens.  Like Robinson, not really. I'm not sold on them doing that, I don't. Do you think this is any indication that Allen Robinson will want to sign with the Ravens if they gave him an offer based off of his Twitter likes? Allen Robinson looking to get paid. Ravens, they don't look to pay the top receiver money. That's not them. So if he's looking for it based off of that, then he looking in the wrong spot. He also liked tweets about him going to Miami and I think there was another team he liked tweets about him. So I wouldn't take the Twitter thing too seriously. It is what it is. Because he also, he did like a tweet about the blank check. About, oh, there it goes. The Ravens should just hand Allen Robinson a blank check. He liked that tweet. So, but anyway, if the Ravens don't get Allen Robinson based off of money, who do you think they will go after? Personally, I'm tired of these cheap aging veterans. Love your vids and keep doing you, appreciate it. I'm tired of it too, but I think the Ravens will still go in that direction. I wouldn't want them to, but I could really see them signing AJ Green. I could see them signing him after the deadline passes to where these a free agent that's leaving his previous team counts against your comp pick formula. I could see them signing AJ Green then. And even if they signed him, I don't even think they're gonna sign him for anything that would really even count against the comp pick formula. They ain't gonna sign him to no crazy deal, anything like that. But I could see them signing AJ Green. Healthy AJ Green, prime AJ Green will be a perfect fit, perfect receiver for this offense. And I'm sure he can still do some things. And maybe he'll have less wear and tear being in the Ravens offense than any other offense. Cause there will be, he'll be asked to do less. Well, he'll need to put in more effort than he showed with the Bengals. Cause it was a big yikes. It was a big yikes. And just in them two games where the Ravens played the Bengals, he ain't wanna be there. He was done. He was, he was way done. But anyway, with AJ Green, I feel like the Ravens, that that would be a move that they would make. So I, like I said, I think he would be a really good fit. Prime AJ Green would be. This AJ Green now, well, hopefully we won't see, but I just, I really wouldn't be surprised if they did it. Next question came from my boy, Javo. He said, how do you feel about bringing back Dez Bryant and getting Odell Beckham Jr. and Antonio Brown, or one of the two instead of spending lots of money on an Allen Robinson or another type of sever? So about bringing back Dez, I don't think it's gonna happen. I would like for it, well, you know what? I would like for it to happen, but if they're gonna bring him back, use him. Use him, use him, use him, use him, use him. But I don't want him to be brought back if it's gonna be like it was this past season. If it's gonna be like that, let him go, let him go. But if you're gonna actually use him, okay, welcome back Dez. But as far as Odell Beckham Jr., no, Ravens, they, and I know you can find ways around the salary cap, but Odell Beckham Jr., nice receiver, good receiver, would give us a legitimate guy opposite Hollywood. That could be something, but I don't know. Odell just, all the talent in the world, he just doesn't seem very Raven-like to me. He just doesn't. He's nice, but I just, I don't know, man. I don't know, I don't know what it is about Odell. I like Odell as a, I really do. I don't know what it is about him that just doesn't seem very Raven-like. And then the Browns trading Odell to the Ravens, I don't think that would happen anyway. And then he said, he said, get an Odell Beckham Jr. and Antonio Brown. And Antonio Brown, they should have already been there, done that, but man, well, you know how they, anyway. All right, so maybe trade for Zach Erz and use draft picks to build our offensive line. Now I did see where it came out today actually that Zach Erz is not gonna be playing in Philly next year. So whether that's via trade or whether he's cut, you know the Ravens wanted him before. Sometimes when the Ravens want something, they may revisit it again. We'll see, but you know, you know, if they want something on offense, they don't revisit those again.  We going back, we getting that play on defense, but on offense, they're like, oh, we tried. Okay, nevermind, let's move on. So with Zach Erz, maybe if he's cut, Ravens could pounce. That'd be nice. Little Mark Andrew, Zach Erz, Mark Jackson would be drooling. He'd be like, yes, tight end, let's go. But anyway, and he said, a last move I like is to try to get JJ Watt from the Texans. That's another one that I could see happening. It couldn't hurt, especially if we lose Panel McPhee. JJ Watt would give us an edge guy, but I feel like he would be one of those situational players. I feel like he wouldn't be an every down defensive end. I feel like he'll be a situational guy because whenever I watched him, whenever I watched the Texans this year, especially when they played the Ravens, he just looked tired, like tired, tired, tired, tired. So JJ Watt, if he was really cheap, okay, cool. If you're gonna spend big, no, don't spend no big, please don't. And he said also, I think Lamar needs to discuss passing schemes with Roman or sign a coach to aid Roman with the passing game. I really hope Lamar takes the right approach with his upcoming new contract to help build around him. Yes, Lamar needs to tell the Ravens, I'm not signing anything unless y'all show me that y'all gonna sign something in somebodies to really help this thing get turned around. Next question came from Hendo. He said, what's good? How's the fam doing? Oh, we good, we good. Hope your fam doing even better. He said, hope all is well. I would just like your perspective on two players. Do you believe Brandon Williams is worth the money for a two down off injured player? Off injured, I wouldn't say that. I know he did get a little banked up but his biggest injury this year was a whole C19 thing. But yes, because when you look at the run defense without a Brandon Williams, it's a big yikes. But then you look at the run defense with Brandon Williams, it's like, oh, okay, there we go. Much better, much better. So do I think the Ravens may have overpaid Brandon Williams slightly a little bit, but he's somebody that is often underappreciated and undervalued by a lot of Ravens fans in my opinion. And he said, and what do you feel about Andrews getting a big contract? I just feel like he disappears in big games and in the playoffs. Whistle. Mm. Now, Andrews, whoa. Yeah, Andrews is a good tight end, not great yet. Hands, they're shaky.   But yeah, sometimes he can't end up getting lost in these bigger games. And we've seen it time and time and time again. But it just, I would love for them to bring in another tight end too. Bring in another tight end to pay with Mark Andrews and see how he does then. Like a legitimate receiving tight end because Nick Boyle's already there. He's a blocking tight end though. He can catch now too, but bringing a legitimate receiving tight end, somebody that can compliment Mark Andrews and then see how he does that. Even though that would actually be, cause how do you explain it? You don't want it to be to where he only does well if somebody else, another tight end is doing well too. But at the same time, you want there to be options and you want them to not just be able to take Mark Andrews out the game. But that's also where receiver comes into play. You have more than one legitimate receiver on the field at the same time. And the opacity scheme, if it's a legitimate one, then that'll open it up for everybody. So with Mark Andrews, I would rather them keep him than lose him, but I would definitely want it to be a reasonable contract because again, them hands, they be getting shaky, baby. They be getting shaky. Mark Andrews is nice though, man. But that's a tough, tough question. I'll leave it for the comment section to take care of that. Next question came from my boy, Jen Nereepa. He said, what's going on in Graven? So my question is, what type of plays would you like to see implemented into this Ravens offense? Oh, we've had this conversation a lot this year, but I don't mind having it again. He said, I would love to see more RPOs running back runs in a spread formation and play action off of those runs in spread formation. Most importantly, wide receiver, bubble screens and trips formation. PS, I was furious that Josh Allen got that freebie touchdown to digs on a screen pass. Where was that for Lamar? Screen passes is one of the biggest things for me. More plays on the center, but the screen passes would be something that could just, if those were implemented, it could, it's something so simple.  You don't gotta do anything that's too wild to make the offense that much better. It doesn't have to be anything crazy. More runs from under center, more passes from under center, coming out in the eye formation, the more be under center, there'll be Patrick Riccardo and either Gus or JK, or whatever running back, the Justice Hill, whatever running back they drive, cause you knew they were gonna drive one. But you got, it's simple stuff, man, simple stuff. And plays that with all the receivers, they not going into the same place. Devon Duvenay, I just, my thing, I would love to see so many different types of plays, but I would just really love to see so many different types of players get involved. And I would love to see players become legitimate threats, legitimate threats to where teams are like, oh man, oh, I remember Duvenay, he caught a slip and earlier, we gotta watch out for him. Besides the jet sweep.  Oh man, we can't have that again. Keeping an eye on him. Boykin, oh man, Boykin caught that fade right in the back of the end zone. Man, we can't let that happen again. Hey, double team him. That's what I want. Next question came from Eastside Live. He said, what's up in Graven? Sorry if I didn't spell your name right, but I love what you've done this year. It's been a long season. Hopefully we can have a bounce back here. They appreciated me. He said, the reason why I think there's Brian wasn't involved in the offense as much as people thought he was going to be was because he came late in the season. So he really didn't have a whole off season to prepare for the Ravens offense. But what about Miles Boykin? What about Devon Duvenay? What about James Pro Shae? Those guys were not involved in the Ravens offense much. Well, Miles Boykin has a blocker, but as a pass catcher, as a receiver, those guys were not involved in the Ravens offense much and they were here the entire off season. So what's the excuse then? So I just, I came by into that since there's Brian came in the middle of the season, excuse me, then that's why he wasn't involved. But anyway, he said, I think that by next season, Hollywood or there's Brian will be fighting for that top receiver position. And I think there's Brian is going to get it because he's way more experienced and he barely has dropped the ball this year. Well, he's barely caught any passes too. But, and he was actually looking like his old self and they start to connect with him more. But I think next season, LeVon Dez are going to look like Josh Allen and Stefan Diggs, I don't know about all that poor, but anyway, he said, that's just my opinion. Can you give me your thoughts on that and team keeping clean? Sorry if the grammar is a little bit off, but before I go, I'm not saying that Hollywood was a bad player this year, but if he wants to keep the leader and see the role, he's going to compete with Dez Bryant if Dez Bryant is here next season. All right, so that would be nice if there's that competition, but I still think Dez is gone. I don't think Dez is coming back. I wouldn't mind him coming back, but I don't think he's coming back, especially with Greg Roman still being an offensive coordinator. I just, I don't see any way where Dez, he comes back to the Ravens. So if he'd buy some chance does though, and he would end up being the number one guy, him in Hollywood, one A, one B guy, cool. But to make him, for him to really be a threat, he got to be involved. For anybody to really be a threat, they got to be involved. Simple as that. Next question came from a boy, Ryan B. He said, hello. Hope the family as well. Yes, we doing good. He said, ready for our kids to get back to school full-time. My question is, Harbaugh says that he expects both coordinators to be back next season. The passing game and Lamar Jackson can't succeed with these passing concepts. How is this team ever going to move forward? And the playoffs, thanks for everyone, or thanks for everything and hope the best in 2021. Appreciate it, Ryan. But again, they just got to, they got to start doing stuff this outside the box. They got to get out of their comfort zone. I think that's the best way to say it. They got to get out of their comfort zone. We know you can run the ball, but now it's time to really, really compliment the run game with the pass game. And like a real complimentary pass game too. Yeah, that's it. They need to get out of their comfort zone and find a way, because in the regular season, everything's cool, but come playoff time, things change quick. They change quick.  But it almost seems like it's crazy because regular season Ravens will be coasting. But then come playoff time, that's when things turn into a big yikes. But at the same time, now that I think about it, we lost that game to the Patriots. Patriots took away our run game for the most part. But the pass game, Lamar had a pretty good game that game, minus that interception, but he had a pretty good game that game. And then the Titans game, we were running the ball okay, but then when it came to passing, Ravens just, I don't think they passed that well in that game. So maybe it's that those better teams, when it comes to those better teams, the Ravens start to lose their focus a little bit. Just a little bit. Well, maybe a lot of bit because they just get imbalanced. They get imbalanced, imbalanced, whatever the word is. When it comes to those better teams, things, they get imbalanced. And those better teams present a better challenge. So we need the players, the coaches, we need everybody to step up to the challenge much better than they have. Much better, everybody. It's a group effort. The next question came from DJ Bill. He said, did the Ravens waste their passing weapons this year? A engraving and team keeping clean. I hope everything is well. I'm still processing this loss against the bills. It makes me think about the entire season. Once again, Ravens failed to show any creativity in the passing game, but this question is about personnel. Did the Ravens basically waste their passing weapons this year? What I mean is, I think everybody would say yes, but what I mean is think about how much we were able to learn about who we have. We come into the off season once again, saying that we need a number one wide receiver. But we didn't even get the chance to see if Boykin, Pro Shade, maybe Duvenay could be that guy. Do you think the Ravens wasted an opportunity to see what they have? This should have been the season where they really got a chance to see what these additions added to the team. That's very true because you drafted these guys both last year or two years ago and then this last season as well. And you failed to really get them involved consistently. It's the same old story, man. And he said, as we always say, the defense got to see what they had in everybody. Think about it. Yannick may not be the answer. Wolfe is an underrated contributor. Tramon Williams is a step slower than we probably need. Avid has promise. Queen is a keeper. Elliot is super solid and Chuck Clark should never be in coverage in one-on-one situations. Oh, man. Now, bring it back to the offense. What did we learn that we didn't already know? Gonna keep it to the additions. There's his locker room leader, but did he get a chance to show what he could really do? He was really on the field. Is Proshay any better or worse than Willie Snead? What's Duvenay's biggest receiving contribution? But of course we did learn that JK is a stud. I say all of that to say this. Did we waste our opportunity to see what we had in the passing game? Cause none of our additions made it to the field enough and nothing was schemed differently. Anticipatory throws or shots down the field. I love how you put that. That was just perfect. I don't have anything to add to it. You covered literally everything already. You covered it, 1,000%. And he said, second question, is our number one receiver right in front of our eyes and we just aren't getting the opportunity to see it? Have we really put the pressure on anyone but Hollywood and Andrews to showcase number one ability? Boykin is in, but a glorified blocker. There's never felt like he was in during big situations. Snead was so up and down. One game he's a leader and the next he's ghost. Proche barely hit the field but at least he can catch a punt, right? Do we have another season to figure out with a new coordinator? Well, that ain't happening. If we can create our own number one receiver. Welp. We just gotta see again. We just gotta wait and see again and hope. Hope. Yeah, we just gotta wait and see and hope. And that's it. I'm hoping for the best. Again, my expectations are not super sky high or anything like that, but I'm hoping some things change around. Let's see what the Ravens do a passing game coordinator, but let's see who they bring in and replace David Coley there. And hopefully it can be somebody that has a great track record and just is really gonna be able to help turn this thing around. I'm like, well, Greg Roman again, he has what he's done. He has his past. He has his history. Hopefully his history can be changed, but I don't know, bro. I don't know. So with a passing game coordinator, let's just hope that they can make a big passing game impact because it just hasn't been it, man. It hasn't been it. And we, this is, it's crazy because this is something that we even talked about when the Ravens were winning. We talked about this when the Ravens were winning. We talked about this when the Ravens were losing that the Ravens, they just, we need better. We need better, we need more consistency and we just wanna see guys be involved. I think that's been one of the biggest points from this video and from a lot of these questions. We just want guys to be involved. We draft these guys, we sign these guys, we bring in these guys on offense and they're just, they're not involved and I love how he brought up that we got to see what these defensive players, man. We got to see what they got. We got to see who they are. But when it comes to the offense, it's so many unknowns. It's so many head scratches, so many questions. But this has been a consistent with the Ravens, a consistent. So we're hoping that that consistency can change. We'll see what happens moving forward.


President, we'll be right with you outside. We're getting him. Just a moment. This is Lyndon Johnson. I had a call from you and I tried to reply to it a couple of times. Savannah and different places. They said you were traveling and I got to traveling last night. I just got out here to meet the Prime Minister of Canada this morning. I had a moment and I thought maybe we better try to reply to your call. Well, I certainly appreciate the time that's all that I don't want to take. But that's a good sign. I'm sure it'll be great to try. I'll tell you what our problem is. We've got to try with every force at our command, and I mean every force, to get these education bills that go to those people under $2,000 a year income, a billion and a half, and there's poverty that's a billion and a half, and there's health that's going to be $900 million next year, right at the bottom. We've got to get them passed before the ambitious forces are concentrated and get them a coalition that can block them. Then we have got to, so we won't divide them all and get them hung up in the filibuster. When we get these big things through that we need, Medicare, education, I've already got that hearing started at 22nd in the House, 26th in the Senate. Your people ought to be very, very diligent in looking at those committee members that come from urban areas that are friendly to you to see that those bills get reported right out because you have no idea, it's shocking to you how much benefits they will get. There's $8,500,000,000 this year for education compared to $700,000,000 when I started. So you can imagine what effort that's going to be and this one bill is a billion to have. Now if we can get that and we can get a Medicare, we ought to get that by February. Then we get our poverty, that will be more than double what it was last year. Then we've got to come up with the qualification of the voters. That will answer 70% of your problems. If you just clear it out everywhere, make it age and read and write. No tests on what Chaucer said, or Browning's Portrait or Constitution or Memorizing or anything else. And then you may have to put them in the Post Office. That's Postmaster, that's a federal employee that I control. They can say he's local, he's recommended by the congressman, he's approved by the senator. But if he doesn't register, everybody, I can put a new one in. And it's not an outside Washington influence, it's a local man. The Post Office likes to buy a stain. Now I haven't thought this through, but that's my general feeling. I've talked to Attorney General and I've got them working on it. I don't want to start off with that any more than I do with 14B because it wouldn't get anything else. And I don't want to publicize it. But I want to just know the outline of what I had in mind. Well, I remember the other day. Well, your statement was perfect about the votes, important, very important. And I think it's good to talk about that. And I just don't see how anybody can say that a man can fight in Vietnam. But he came both in the Post Office. Yes, Mr. President, I think it is a main conversation. With me, the first move I made was to put one on the Security Council and to put one in the charge of every bit of the information and went to all of the 120 nations and taken out of an important ambassador post. And I am trying my best to get to the housing and urban and city problems which is the number one problem in America as I see it made into a cabinet post. I have a good chance of getting it done unless I get tied in with a racial thing. I'm going to concentrate all of the executive power I can to get that done. I'm pretty halfway committed to putting in a weaver who I consider to be a very able administrator and done a good job and who we respect pretty highly. And I'm trying to bring in others as assistants and devotees. I talked to them no longer in two hours ago about trying to get one in charge of maybe African affairs if Williams left. I don't know whether you know him or not, but I'm just giving consideration. I don't want to get it around, but it's this fellow Carter that runs an African desk at the Peace Corps. Do you know him? I just don't know him well. He's very, very able and we've got George Weaver over in the Labor Department and I'm bringing him in Justice Pass again. I gave Carl Rowan the top job over, I would guess, eight out of the ten people I talked to felt like that I had problems there. But up to now, he sits with the Security Council on everything. He participates just like Secretary of State and I'm going to, I don't want to make a commitment on it because I don't want to get tied down to the Congress, but I'm going to shove as strong as I can to get the biggest department there. Housing, urban affairs, city, transportation, everything that comes in that department that involves the urban areas of America in one department. And then if I can get that done without having to commit one way or the other, my hope would be that I could put the man in there and probably it would be Weaver because I think we have a more or less a moral obligation to a fellow that's done a... He's done a good job and he hasn't disappointed anybody. If we put somebody into a job and he failed, we lose three steps when we go ahead one. And I haven't had any of that if you'll notice it. We haven't had any mistakes or any corruption or any scandals of any kind. And I've moved a man, I mean, by the wholesale, both women and men. That's a very good public reception. I have seen where they considered Whitney for... Whitney Young for a place with a cop job, with Sriver. He's running two shows and maybe as a kind of associate director with Sriver with the poverty group. I thought that ought to get underway a little bit. I don't know what Sriver said about it. I have a very high regard for Whitney. I like him. I don't feel. I honestly don't feel that with Roy Wilkins or with you or with Randolph or with the man from Coer that meets with us I don't really think I have a moral obligation to any of them like I have to Weaver who's been in there. And it's kind of like you've been an assistant pastor of your church for ten years with the understanding of your decans that you would be take over and then they lose and they don't get to make a pastor and then you continue to carry on and then finally when a good day comes they say, well, you get back to sit at the second table. I just don't feel like saying that to Weaver. Weaver's not my man. I didn't bring him in. He's Kennedy man. But I just think that there'd be a pretty revolutionary feeling about him. Roy is not my man. He's a Kennedy man. But he's got the biggest job in government and it's a it's a it's a it's a it's a job. He sits with the captain every time. He sits with the security council every time. And I did it the first month I was in office. I don't throw it around to cause him to be attacked by his appropriations because the Southerners handle him. McClellan handles his appropriations. But after we get by pretty well this year and I get this reorganization through I will not only have people like Weaver and Carter and undersecretaries places but we'll have Roy and head there and we'll have Weaver and perhaps some other folks on the order of Whitney and whoever you are. Thanks, Bill. I do too. I do too. You know he's worked very closely in our in our equal employment and he's done a very good job in about 60 cities where his people have branches on the employment. I rather think that that that there's been substantial progress. Not enough. I rather think he's been substantial progress with industry on a higher level. Don't you? I think. Every corporation I talked to and I talked to about 30 of them yesterday. They are looking for our Negroes that can do the job that a George Weaver does or a Carl Rohingya does or a fellow like Weaver does. If we have some of them and if you have some of them and you get them to Hobart Taylor we can find companies that will use men of that quality. When they get in they can look after the ones blowing like you looking after your people. There's not going to be anything though doctor. All of them. I don't get you a message at all the eloquence in the world.


It's endeavor to push on green to give you a brief on what indeed does indeed is the world's Sorry, am I not audible? Okay, I take it. I'm audible Okay, so indeed is world's number one job site. We help people get jobs. That's our mission we are spread across 14 countries and 29 cities over the globe and This is some brief stats to give you an estimate of the scale that we deal with 250 million unique monthly visitors 150 million resumes 180 million ratings and reviews 25 million jobs How different are we from the rest of the job portal firstly? We are not a job portal We are a job search engine you search for a job click on it apply interview hire Those are the five steps to get a job and we put job seeker first before any other thing in our Organization and what do I do I work with the apply block over here So I work with the indeed apply team where we handle the complete flow right from the point a job seeker clicks on apply Till the application has been delivered to the employer Now coming to today's talk. It is about push on green the agenda is divided into four Schedules today one is what is push on green? Why didn't we need it? How did we do it and what are our key takeaways from it? What is push on green? Push on green is also known as continuous deployment or rather the other way around continuous deployment is also known as push on green in the CI CD world continuous integration continuous deployment continuous delivery are three different important categories or aspects we consider and today we're going to talk about continuous deployment in this world What exactly continuous deployment means if you're confident with your code? Deploy it without any manual intervention. That is what exactly continuous deployment means Now why do we need that what is wrong with manual testing or what is wrong with existing processes that most of us follow To give you a context of this things let's understand. How did we grow as an organization? We grow from somewhere less than 500 past in 2012 to somewhere around 9,500 employees today We had an explosive growth in terms of the number of engineers working for Indeed and the number of users using Indeed Now what did that Get us into we had a long list of features to be delvered or products here to be delvered At the same time the number of as the number of members increase in a team You'll also see some issues popping up issues like if you merge 8 to 10 Requests feature requests into one QA branch. What would happen? You're obviously get into conflicts how to resolve that how to prioritize that see you're going to run into some Inevitable issues with the large teams. Now. How do we solve that? We can't have the engineers spend their valuable time on this These are mostly manual operational tasks that can simply be automated Though the effort that would take to automate this is large in the initial stages, but we soon see the fruitful Fruitful responses results of it in the future What would happen when I automate this obviously it would increase our engineering velocity by that I mean the more productive work that an engineer would be doing is increased How does it? Engineer velocity is fine. But what is it contributing to the product? The product quality is enhanced when we grow with this initiative How does that happen? Manual testing is ultimately a human judgment that we are going to rely on and human testing is always error-prone Error-prone meaning if two people are working on the same testing There could be different perceptions of the test scenario or there could be different rigor From deployment to deployment. It may not be the same rigor that we Show while testing the product hence the consistency differs Now to give you a small sneak peek on What did we achieve doing this one of our project deployment time has come down from 98 percent? Sorry by 98 percent from 32 hours to 32 minutes Though this number is very large and we understand It's not possible for every project, but this is something really good that we started off with and that we achieve So we'd just like to show it off But on an average we have observed that teams who have taken up with this initiative have Decreased their deployment times from 30 percent to 50 percent That's really a good number if you consider it in terms of the engineers time Now we understand what is push on green? Why push on green? But how do we achieve this? How do we get it rolling with the existing code base with the existing systems in place? It's all about the confidence you need to have in your entire deployment change Deployment change right from when I say the deployment chain It means right from your coding tell the point you put your code in production and monitor it How do we build that in confidence because now we are all used to manual testing and we are all used to having a human judgment in place How do you let go of that judgment? How do you completely rely on your automated systems? This are some baby steps that we need to be taking for the push on green initiative To gain confidence in your continuous deployment Test coverage is one of the important thing and to have the test coverage We cannot have large deployables large deployables are always time-consuming to deploy our error prone So we need to have small deployables reasonably small deployables and then comes unit us There's a myth or there is a wrong assumption amongst most of us engineers Having X percentage of unit us will ensure us a good stability of the system Rather from my experience, I would say any X percentage or any defined percentage of unit us is not going to give the conference It is all about how confident is an engineer About his or her own code and the systems around it to monitor your environment Some projects may need 80% of test coverage some may need 95. It is here as a team your Collective effort that you collaborate with each other discuss and understand the complexity of your product and come up with the number That may fit your team better One size may not fit all Integration tests something that in a very rapidly changing environment most of us let go of this Integration tests are not mostly used but if you want to save time ultimately if you want to Do a better use of your time? Integration tests are very much needed. How do you rely on your downstream systems? Or how do you test your failure scenarios? It's all based on the integration tests and Then adequate logging Logging is one common thing that I've seen varies from engineer to engineer in all my career either we see lot of logging excessive logging or Scares logging I would say excessive logging is still fine if you can afford for the infrastructure than scarce logging Because logs are ultimately the only evidence and witness to whatever happens within your application Now having said how to achieve it or how to gain the confidence in the deployables But how do you verify your changes? How do you replace? What is existing? How do you change your roles and responsibilities within your team? Developer as the name indicates is responsible primarily for the feature development and then unit us Unit us are the only way to verify any small piece of functionality in isolation Then come integration tests. This is a slight change in the existing process for most of the teams We want a developer to write the integration tests Meaning get creative write stubs or mocks or whatever you think is necessary To perform an integration test from an end-to-end within your own ecosystem Then what does a QA do if developer writes all the tests and the devil the code What is the QA's responsibility? Can we get rid of QA? No our on our answer to this question is manual testing is the responsibility of QA in the past But today it is to improve the robustness of the product Functional testing can be automated by the developer But when it comes to load testing performance testing or stability testing or cross browser testing, there are multiple other phases to the product They will be performed by the QA. The QA is going to improve the robustness of the product They're going to be the gatekeepers of our product quality. There are no more the manual testers They the title truly indicates at quality assurance. So we're going to stick to their title as quality assurance Next comes how do we verify this deployments? Now that we've divided the responsibilities. How do we automate the verification? There are certain basic things that you have to inculcate into your application for it to be completely automated First thing is health checks Every system may depend on one or the other external servers Health checks are a way to identify whether your downstream systems are working properly or not while the startup of our application We at Indeed have decided to come up with three different levels of health checks. One is weak strong and required We indicate that there is a system. There is a dependency that has failed But the application can still run with it We may want to log it and just leave it at there for a developer to come back and see Strong is we would send proactive alerts to the developer. That's one. So dependency has failed But we don't want the application to stop. We would still run the application and Then there's a third level required Just fail the deployment altogether. We can't run the application without this downstream system So these three levels have really helped us in segregating or prioritizing our concerns with the deployments I'll rather I'd say separate our concerns on the level of our dependencies Then exception in logs as is mentioned earlier with adequate logs We are now able to understand where an Exception has occurred or what is that anomaly within the deployment? Now having said that we also need some dashboards to know the system level metrics the application level metrics Meaning we want to monitor all this CPU utilization or memory utilization or response times Now, how do we do that? We use data doc dashboard for that It is a third-party tool that we use to analyze all our metrics from system level to the application level Then we use canary analysis For teams which are chain which have their product changing very rapidly They would want to go with canary analysis. What does canary analysis mean? We deploy the latest version of your deployable to only Very small subset of the production receive the live traffic on to this latest version and analyze the performance of the deployable if you think the Deployable is good to go with the rest of the production then we promote it to the rest of the production But if you think there's an odd behavior or there's an unhealthy behavior of the application then we would revert back As an organization we support this as well as blue-green deployments For teams which undergo changes very rapidly and which cannot Afford to have a lot of other infrastructure. We'd suggest go with canary analysis But the teams who have stabilized for teams like us who do not want to risk Any customer interfacing products we go with blue-green deployment Now these are ways where we Perform the verification. So if any of this verification fail, what do we do? It is automatically rolled back That is all about continuous deployment. If you fail with one of your verifications, you're going to roll it back Now all this is good in theory. How do we do it? We already have a stable almost a mature product. How do we Stay at this stage that we want to adopt this completely automated testing You can't do it at a full go at one stretch Now We have to take an incremental approach to it. So for that reason what we have come up with is We rely heavily on Jira for our process. So we've said we are going to integrate Jira with our push-on-green initiative Any team who wants push-on-green to be taken up can set up their deployment pipeline according to the standards We have set in place have this test come up and then on the ticket You can mention a label which would indicate the pipeline that this particular ticket would be deployed automatically When I say that that means whenever a developer has coded it tested it If he or she labels the ticket with this label and puts it in a pending merge state Then we're going to initiate an automatic deployment Once the teams have enough confidence that automatic deployments are good By that I mean they have set up in place all the verifications all the required verifications all the monitors and Whatever we've seen earlier in the verification steps, then we go for push-all full push-on green What are the key takeaways? We have increased the product quality. There's no room for inconsistent testing as I mentioned earlier We have increased the reliability Kennedy analysis and other techniques have helped us increase the reliability of our product and Then the operational efficiency. This is very crucial. We no more have contention to merge to QA. We no more have to resolve conflicts Then The last or the ultimate thing that we've achieved is engineering velocity has been increased drastically Thanks for the talk Anyone any questions So in the process of push-on green you mentioned that you completely removed the manual testing process So is it like completely removed because only a human being can give new new new testing scenarios and all Because automation can do only repeated scenarios. So how did you achieve it? Yes So as I mentioned earlier, there are two parts to it the teams which are in process of increasing their push-on green coverage We still have manual intervention where a QA engineer or a developer would pitch in and Write scripts to automate every scenario that they would want to execute. Okay, so they produce new scenarios also Yes, so these scripts don't get generated automatically, right? We have QA or the developer writing these scripts So any any test scenario that you think has to be executed has to be in the form of a script There's no manual testing over there. Sure. Thank you Amul, yeah, I'm a audible. Yes, okay You share the best practice about the continuous deployments in your project experience I want to ask Do you see any challenges in terms of canary deployments and also your release cycle? I hope you have two weeks or three weeks of Release cycle of your application, right? So the whole point of moving to push-on green was to decrease this release cycle We now no more have fixed release cycles But we in fact have teams who do multiple times the deployments in a day and we have teams At least my team does twice a day. So that's where we've moved to with automatic Continuous deployment. The whole point of it is you don't have multiple Features going into the same deployment so that you don't run into issues if there's a deployment failure You know exactly which feature has been and what to roll back So we've now done away with the release cycle concept. So you can you recollect me the second question you had in mind? It was about the release cycle So, yeah, now we don't have the release cycles anymore. And how did we get to push on green the obstacles? Yes The teams who have already who are already in the critical path meaning who are customer-facing ultimately for teams like us Any change we make is going to be very much visible to the job seeker So for teams like this We choose to go with blue-green deployment rather than canary analysis because we don't even want that one percentage of users to Be affected but for the teams who can afford that risk or for the teams who can take that risk of Having a duration of test they do go with canary analysis So we do that is the reason we support both of these are deployment techniques. Does that answer your question? Thank you Hi, hi, I'm Olya. This is Anup here. I have a question in the case of a blue-green deployment and you know you push a deployment to the production and It involves a database change for example There's a table entry that you make now There's some problem and I want to revert it But in the actual productions another you have a few data which came into your system during that period of time Now you want to reward the reward those changes. How would you do that? The whole point of blue-green deployment is to avoid running into this situation. So let me first define blue-green deployment Blue in in a blue-green deployment. We would deploy to us a new set of instances and Observe the behavior of the deployable for the let's say n number of instances This would be the same number that are going with the current live traffic now once we think that the deployable is stable That's when we are going to route the traffic to this new set of Instances and destroy the old instances so in this case Whenever you make a DB entry, there's no new traffic coming on to these new Instances, it's only going to be our test that we run on these new instances to observe the behavior Had it been a canary analysis It would have been a different Thing to do. Does it answer your question? Thank you