I think what's so interesting here is how nimble they were and how willing they were to risk in a completely different materiality as a result of the availability issues that they were encountering. They weren't simply frozen in their tracks. Welcome to the Smarter Building Materials Marketing Podcast, helping you find better ways to grow leads, sales, and outperform your competition. All right, everybody. Welcome to Smarter Building Materials Marketing, where we believe your online presence should be your best salesperson. I am Zach Williams, alongside or right across from Beth Popnikov, and today we've got a great show lined up for you. You know, every year we partner with the Farnsworth Group to do a building products customer guide, which basically means we do a bunch of research, we catalog all that data, and we put it in the form of a document and a big event where we bring on some of the best people in the industry, as well as actual audiences that you all target, architects, builders, contractors, et cetera, and share with you insights that we've found. And so in today's show, we've got a really cool show lined up for you. We're going to be taking findings from an actual panel that Beth and I held and bringing you excerpts from that to share insights about what we've seen and heard about the industry. Specifically, we interviewed at one point, I think it was a panel of a builder, an architect, or an architect-ish. We'll talk about that here in a second, and a contractor, and we asked them questions about what they saw in the industry, what was changing, how manufacturers can be smart about marketing to them, and want to bring you those insights today and talk about how you can take those findings, those learnings, and apply them to your business this next year. I mean, anytime you can hear directly from your customers, that's valuable, right? So it's one thing to hear it from us. You trust us. We appreciate that. But there's nothing like hearing it directly from the people that you're targeting, selling, marketing to. And I think, remind me who it was, Zach, but I think the contractor was actually on a job site. Oh, yeah. We convinced him to take time out from his actual job site while participating in our panel, which we, like, over the top appreciated, but if that's not, like, on the job training or, like, direct from the horse's mouth or however you want to say that, I mean, it was just, it was awesome. It was very meta. Yeah, it was very meta. It was very meta. I'm a contractor, and here's how I can prove it. Here are my credentials. Well, one of the trends from the last year is that everyone is slam busy. Yeah, exactly. He literally had to be on a job site in order to be part of our panel, which makes sense because it was the middle of the workday, but still. Right. Yeah, it was moderated by Mark Mitchell, who always brings great insights, who brought his great industry experience, asked really good questions. And so I'm excited. I'm excited to be able to present to our listeners today some of the best and pieces from the interview. That's great. Cool. All right, let's get into the first bit here. Yeah, let's do it. How have you seen sourcing change? So I'd like to start with David, David, you know, are you hearing anything from architects?  The architect starts putting it together and all of a sudden, you know, there's, and I'm just thinking that is the architect, I'm wondering if he doesn't really know about it until all of a sudden the general contractor and the subcontractors are coming back saying, you know, those windows that we wanted, well, you know, they're going to take two more months than we thought to get. And so, so I'm thinking about sourcing, not from all the ridiculous price increases we're seeing, but from just simply, where can I get things? So, so, David, what have you, have you seen things or heard things from architects about, you know, how, how they're dealing with this? Yeah, absolutely. I think it's a, it's a really big challenge that makes construction and the specifying process in general a lot more complicated. I think that architects and designers and builders, everyone throughout the entire process, everyone's trying to be resourceful and come up with the best possible design solution given certain constraints, you know, what's our budget, you know, what's the intent, you know, what's going to last a long time. And I think that, you know, architects have never really confronted the industries, never really confronted this sort of complexity and this extra challenge, like this extra constraint as it were on like, how do we get things built? And I think it's really stretching architects. You know, I think a lot of architects, I'm not quite sure what the the the stat is, but I think, you know, quite often it's like, you know, 65 to 80 percent of their specs are copied from previous projects. You know, there's an architecture firm where I stop by and they have one box and it's like the partner approved finishes, right? Like we use these tiles, like we use this paint and now all of a sudden the partner's tiles are no longer available. What do we do? So I think it's it's it's made something that was already hard and there weren't good resources for even harder. And I think a lot of architects are really scrambling. They're looking for good advice wherever they can find it online from the subs, from the GC, even from the owners at some point. So like I think everyone is really working hard to try and find not even the best product or the cheapest product, but just something they can get to keep things moving because, you know, having your 200 unit condo tower held up in extra months, the carrying cost of that is is immense, right? Way more than just, you know, one or two change orders if that's your bottleneck. So yeah, it's just a whole new level of complexity to project management. I love David. He's awesome. Man, anytime he talks, I listen. I'm just I'm just going to be honest. He's really, really good. Yeah. Yeah. I remember being in that session or I think you are kind of on the sidelines because Mark was leading it and just like you aren't looking at each other going like, like David is so, so, so smart. You know, isn't really good. But you know, I think I think this is important here, Beth, because like we're all tired of talking about availability because it's not a fun thing to talk about. It's really not. But it's something that as, you know, David kind of hinted at this is like people want you to be more forthcoming. They want you to be transparent. And the more transparent you can provide actually can be a value prop to your business that you're willing to be, you know, a partner, if you will, to his architects too, right? Yeah, exactly. In the same lines with with supply issues and with availability issues. One thing we've seen is that the audience and the channel is trying new products because lack of availability, either supply issues and or the cost of things has risen so much. People are trying new products because some things that were previously more affordable are now more expensive. And we're going to play a quick clip for you. Quick clip. Try to say that five times fast. Quick clip for you where Bill, who's a contractor, talks about trying different products because of things that have changed over the last year in reference to supply as well as cost. Let's play that quick clip. The other thing and David brought this up to is we've now fully cycled on framing the materials. We built with wood prior to COVID. We went into the steel business when wood escalated and went so high. Now steel is at three times what it was 15, 18 months ago. Now we're back to building with wood because we've seen some relaxation in the random length crisis on dimensional lumber. So, you know, we're still getting kicked through a lot of different doors right now and each day is a new challenge. Yeah. So, so Bill, you bring up a point where I try to tell manufacturers, you know, if let's say wood is a challenge and you thought that people should residential builders should build with steel frames. Now may be a good time to talk to them. Where in the past they maybe didn't want to talk to you, you know, now may be a good time. And so, so if I'm tell me if I'm correct here. So my thinking is that when you're facing a shortage of something or a or a significant price increases that you are open to not just alternative sources of supply, but alternative ways of doing things. Oh, absolutely. Yeah. Yeah. We've had to and, you know, builders have a reputation for being a laggard industry, not moving along very quickly with new processes and new technologies. But, you know, when you when your income, your daily income is being jeopardized by the inability to move projects forward because there was an endless supply of wood, two before and all of a sudden there's a supply of two before, but there are three to four times what they cost. We tend to turn in and hang up our laggard belt and try to figure out ways to do things do things differently in order to adapt. I mean, I think what's so interesting here is how nimble they were and how willing they were to risk in a completely different materiality as a result of availability issues that they were encountering. They weren't simply frozen in their tracks. And I think of all of those in the channel, contractors typically have the worst reputation for lack of flexibility or being willing to try a new product. And what we've seen is for one reason or another, COVID, they simply have been so willing to adapt over the last 18 to 24 months. They haven't been just stuck where they've always been, but they've tried different solutions. And a lot of them have found significant success. And we didn't just hear that from Bill. We saw that as well in the feedback that we got from the customers that we interviewed as part of the building product customer guide as a whole as well. I mean, one thing we heard too and saw this from the data, Beth, from that from the research was that people were willing to try new products more today than ever before. The last last two years specifically, people were trying more new products and not only trying new products, but how they're finding them, how they're sourcing them. Even like, I think it might have been Bill or the the builder who mentioned, hey, I bought stuff online. I've never done it before because it was the only way I could get product. You know? Yeah. And so many of them are reporting that not only are they trying new products, but they also like the new product. So even when their previous brands that they were maybe loyal to for years come back and stock, they're just simply not switching back. So really exciting opportunity or really scary, depending on which side of the fence you land on there.   Which I mean, it's a very direct question. Very mark. I know it's very, very mark. He's not not pulling any punches, but, you know, let's let's quickly listen to that response and a little bit of the conversation that happens around that. There's been quite a few, I'm not sure what the biggest is. I think so quickly, I believe so many people panicked and they almost immediately quit holding pricing for more than a day. And so that really threw us for a loop. That that was huge because then some of the projects that had been post upon that I was trying to get going, I'm saying, hey, guys, this is what it costs. But none of my suppliers will hold pricing. They won't give me 30 days anymore. They won't even give me a week. So that was that was huge. And, you know, it's a little scary for the owner to we're both in a tight spot, right? Yes. Yes. And so so your thing was was number one thing was pricing. And Bill, what about you? What's been your biggest disappointment or frustration with? I'll just say, you know, suppliers that you've had a history with, you know, it could be a siding company. It could be a dealer. Yeah, probably on the labor side. Just talked with a fellow who was building a house today up here in Flagstaff and his normal crew, drywall crew of 10 is now reduced down to two. And so I think the problem of these trades weren't in the same predicament. We were trying to hire really at all skill levels within our company well before the pandemic. We've only been able to hire administrative help essentially the last two years. We can't get anybody that's really willing to move regardless of what we say and any ads or any interviews from one company to another. And I know the tradespeople are having those same issues right now. So not only are we seeing slippage in jobs due to these extended build cycles. You know, a few months ago, we had to stage the trade because we didn't want more than one or two trades in a house at one time because of COVID. Now that everybody is back to this new normal, we could pack as many trades in there as we can, and we can't get them because they're so dang busy with everybody else. Well, Beth, what do you think about this? I mean, I think it's telling that Matt starts it off by saying there were several disappointments. And he just had to pick one. But I mean, I think if nothing else, we've all just felt so compassionate for tradesmen and tradeswomen over the last 24 months. And it's just really put into this very perfect anecdote here. He's like, I can't even get pricing for more than a week out. So he's bidding on projects. He's having to make commitments for his own timelines and budgets that he's not sure manufacturers are going to be able to uphold. That is incredibly scary. There's a ton of risk there. And probably his business took a big hit on one end or the other. At some point, you get it wrong. So I just think it's interesting. It'll be interesting to see how the continued demand for the construction industry and continued supply chain issues over the next 18 months plays out in scenarios like this, where it's not always, I can't get product, but you can't commit to what a product that you do have costs. That puts a lot of strain on relationship, a lot of strain on project timelines, and strain all the way down the channel of relationships, right? Not only between contractor, builder and manufacturer, but also between the end user. What do you think, Zach? Well, I think the other thing that's interesting here is the fact that they're talking about not only supply issues and communication, but just what is happening on the job site as a whole. I mean, you're talking about the amount of people working.  The lack of labor in the market is impacting people as well as the lack of products, imagining having 10 people in your crew. And now there's only two like you talked about. I think, you know, for manufacturers, the takeaway here is that the sensitivity to the multiple different types of problems that are happening on the job site is not only being sensitive to that, but also trying to provide solutions. You know, the more you can speak to and provide value and insight around the problems that your audience is dealing with, the more valued the partner that you're going to be seen as, which is ultimately what we all want to be, right? This final segment here we're going to share with you is a question that got asked by the audience to the panel about frustrations. What can manufacturers do to help the frustrations on the part of the audience, aka an architect to build their contract or whatever it might be? Grant asks this question. Let's listen to the question as well as the answer. Mark, there's a question coming in as we're talking about availability. I want to go back to the previous question. This is kind of the opposite. Maybe Matt's starting with you and then moving over to you. With availability, whether something's on back orders, isn't available, whether you're on allocation. What can the supplier do? What can the manufacturer do to reduce your frustrations and make the experience as good as possible, given those circumstances? Matt.  We just blame COVID and it's not here. It's the pandemic's fault. You know, we'll let you know when it gets here. It's not on this week's truck. It'll probably be on next week's truck. But if not, I bet the next one, right? So that's pretty frustrating. This sounds like when we're little kids in the car, we'll be there in five minutes, five more minutes, five more minutes. Absolutely, absolutely. So that's what we're living with. Communication would be very helpful. So to follow up on that, what type of communication? How do you want them to communicate? Just be honest and upfront. You know, I know that they really have no idea when the stuff is coming, right? And I understand the issue, right? If the auto manufacturers with all the money that they're generating, waiting on chips, I understand we're going to have to wait on things like bathtubs and trusses, right? But again, if they get prepared as much or when they see it coming that, you know, hey, we're about to run out of these. Like you were saying earlier, I've got suppliers I've been loyal to for the entire time I've been in business. If they could, you know, give us a heads up, say, hey, this is coming, be prepared. That rounds out the segment. I think it's really interesting and, you know, this is a shameless plug to you all. If you want to listen to the entire interview, as well as get the entire product guy, which is, gosh, what is it, over 100 pages, Beth? So the data is over 100 pages, and then there is a report with actionable insights, takeaways, marketing strategies, recommendations for going after your audience and what your audience wants from you in 2022. You can go to venvio.com slash 2022 to access it. Yeah, it's really, really great data. Again, I'm plugging it because we believe in it and you get access to all of that stuff that Beth mentioned. But we hope you found this content information valuable. If you want more of this content, you want to subscribe to our podcast, make sure you go to venvio.com slash podcast to subscribe and get more. Until next time, I am Zach Williams, across the table from Beth Popney Glove. Thanks, everybody.


Everybody for a syrup in 2023 Bowman Chrome hobby 12 box case number 34 picker team Andrew P with the rays Andrew H Phillies Andrew M reds Brad with the Braves Charles Nationals Chris Cubs David D pirates Donald O a's Ezekiel Mets Gary a White Sox George S. Guardians Holly with Astros Hudson is the Tigers Jeffrey H. Diamondbacks Dodgers Yankees John M. Marlins John M. Rockies same person Jordan W Twins Joseph D. Blue J's Josh H. Rangers Johnson with the Royals or in W has the Red Sox Piedras and Mariners Payton H. Cardinals Rob W. Giants Russell G. Brewers Zufan has the Orioles and you on has the Angels. Here we go Let's hit another super red solace red solace red solace Quantum of solace What's your favorite movie about will hunting?  So bad the non-auto checklist. What's a non-auto checklist? I came out like Me non-baseball this guy's clearly not ready to rip tomorrow Together mix in a water Get good. Just say the non-auto checklist Sam I hair collected inserts. Yeah, if you guys don't want your base ship. It's an Ithaca sports car 99 dime bags. Yeah, we'll give you guys Sam's address and phone number Yeah, I know it is fire first gold auto Twins REL Castro 15 of 50 Dude old-time hockey is fire though shimmer first is touring for the dime bags. That guy is like a tick-tock goat Guy makes you really want to be in the Canadian wilderness and drink some hot chocolate and play like old Nintendo games You don't worry about right get a Carter young first woman's speckle for the Orioles out of 299 Gunner Henderson iconic It came to the League of Ghana First base auto Philly's Ricardo Perez. I don't know any songs like Donna And if I do I don't know like the names Pena does it though large new bar to 499 going to the Cardinals World Baseball Classic flag I found a few dude. I gotta show you some of the videos I found There's this one Yesterday Chiropractors like people like the video themselves doing like practicing Show me right now. Show me right now. Like you gotta have audio. I don't care. It's funny. I know that I may have seen I just want to know if I've seen it It may not look bad Gone forever What happened I Don't even know what below deck is That is a first refractor of Christopher Toran. There you go. Diamondbacks. They deleted the one 499 Orange shimmer first moment auto Rockies Jordy Vargas at 25 We go Rockies you two members. Don't forget to use your coupon code Purple shimmer first is Duno 250 for the Reds There we go red solid start with the Alfredo Duno purple shimmer What up, Dan? Top of the morning top of the morning. I know it's afternoon the top of the morning top of the morning I'll show you See Oscar Hernandez mariners will baseball classic flag to 499 that pretty much sums up the Dominican World Baseball Classic is just looking upset standing in the dugout Gold young Kiehl Fernandez invicta for the Rockies the 50 Rockies good box here Slap you're just living in the past is what it sounds like to me Nice John. Good luck, man. Wickelman Gonzales first moment auto Red Sox He's gonna be really good, right? In yellow off going to the a's the 99 real baseball classic flag nice Wicklman or is it Wickelman? It's probably Wickelman Wickelman You know from If you go out No, I don't I really don't know what is open season The line it's a movie about a bear and a deer Bambi no, no the bear is the one dude from bad bad boys not will Smith the other guy Martin Lawrence. Yes, and then the deer is the guy from that seven I learned so many things when I break with Jake that 70s show. What's this one? What's the main guy? What's her name? Ashton good. Yes. He's they're married by the way or married. Sorry I probably have you have what is happening right now? Please fill these breaks up guys. This is getting ridiculous. Please fill these breaks up Someone tell me Jake is talking about open season right now Yes Yeah, I know what I know what you're saying slap I know what you're saying Is my aya base and mr.  Good morning to you, Anthony. I know you're in the you're in somewhere. That's not the East Coast Somewhere between the East Coast and the West Coast Got a Verdugo Red Sox to 499 we're about Central Coast from a small classic flag Dude Jake is being insane recently dude first auto is Connor stain for the Rockies Sam probably doesn't know he's green shimmer first the 99 they need shade of al daze for the Coupon code for YouTube members in the community tab Sebastian Walcott refractor Rangers nice card instead of 499 so make surface I Don't know what's going on ever set a boxer rapper. I don't know if they'll replace that but I think it's where the shot with Walcott refractor Yeah, this is like late-night streamed is during the day Although I do feel like it's still last night. I feel like I didn't go to sleep first auto Mets Diego Mosquera You went to sleep First speckle Raymond Mola for the Pirates out of 299. All right through quarter of the break I see some spots coming in. Let's update here. Let's see where we're at So the Reds are left the Guardians the Rockies a lot of teams on sale everybody every team is on sale every single one Mark up now a little more for you Yeah, why not a lot of teams left that hit a lot as well can't believe We've gotten to this point Jake There's no longer reality getting worry buddy Sam you should wear a lean-on messy jersey and try to play on Sunday Sam with a bunch of professional football players out there Sam could not attempt a bison kick none of us could attempt a bison kick and live to tell the tale None of us could do that Sean would die jumping I think blue rookie Zack neto angels nice card to 150 Celestine base I just mark teams down more on the next case Invicta cutter coffee Red Sox Came to the League Riley green first auto Javier Rivas for the Pirates Pirates Aqua Roderick Arias for the Yankees to 199 or 125 actually 125 in The bowman chrome Mountain Dew and Sparrow Reminds me of like high school. I haven't had some Ali Rutschman iconic. Yo, Andrew Vargas There's a yellow Raymond the muller first bowman color match for the Pirates the 75 Just the Sam were you here for the new the new stick that Jake came up with 299 first speckled auto Joel Diaz for the Mets actually it was Chris but Jake sang it Joel Diaz for the Mets on the first auto speckled at 299 Shimmer of Meyer. Let's go guys. We got flawless. We got some bowman to crew Yeah, Sam does that he would be in chaffer. He's never in chat for more than like three minutes at a time few show rookie Brett Beatty that's numbered to 299 Mets Brett the Met Yellow Ariel Castro first that one has some like scuffs from a roller. I'm gonna send a boxer rapper with the twins here Ariel Castro number 40 of 75. I wouldn't say there's any bangers in this case yet There's been some nice hits though a speckled first auto Berryhill for the Astros 299 Yo, Andrew Vargas base shimmer of Munoz Hey, it's his loss makes so much sense Blue refractor is a Almeida nice true blue first for the Orioles the 150 Yeah, the one time we won Corbin Carroll it came to the league first bowman auto Ethan solace The Draze the Draze with the solace nice base hit here. This is going to Orin. There we go, Orin March 15th, don't forget Wave rookie Michael Bush for the Dodgers number to 100 and a lot of base Celestine in there So does a brand of chat like jacos Jeffrey H for the spot in each of the bowman chrome choices Loving that tend to go in the next one now four to go in each Divisional choice case I guess we are behind we got to get somebody spilled up Everything's on sale including the flawless breaks Plus you have a 10% off coupon. I mean You could be saving money. You could be getting big hits great deals You could learn about the the bear Jake was talking about Mr. Something Yeah, very memorable clearly If you go out What are you what are you printing with your with your mind tell telekinetic printing Probably hally That's the one thing about uh the sports card shop is nobody in here actually knows how to get to the correct printer You can print but always which printer is that I don't know tough one. It's like a maze It's so confusing Nine to go again I marked these teams in the next one down a good even more like even more so So like the guardians are 114 now the Rockies are 54 the Tigers are 74 the Astros 104 Royals 54 Brewers 149 twins 109 Mets 144 and Pirates 94 You got the tweets Let's go I still haven't eaten anything today. I need to go eat something after this break. I think Although the dinner I had last night was uh Gigantic Dude, let me see if I can find the picture so you can see it real quick.  That looks amazing. I'm not a lot that looks Refractor to 499 bobby wits.  Invicta Henry bolds Not much you can do is Francisco alvarez plus our guys are getting hurt in dp so you can't be running around in there too First refractor auto guardians. Well been francisco to 499. Well, it's a pretty good one and a blue refractor Loisiga going to the Yankees to 75 old baseball classic like nicaragua color match too other than lasagna. Okay So lane got mosaic p y t's listed off fanatics live everybody. So if you are looking for a team that you don't see on The site check fanatics live Lane just listed a bunch of p y t's over there for tomorrow and instead of like The six box if you want to take a stab at a team Uh, that's a little more pricey in that type of break like that. We have some three. We have three boxers listed So we're going for some bijan or some like brice love or anthony richardson or cj stroud Any big receivers then the three boxers might be a decent decent option. You know get some silvers Maybe some maybe even some numbered cards of those guys orange termar johnson. That's awesome pittsburgh Sweet orange 10 of 25 Sweet orange sounds like a bath and body works candle scent First refractor auto mets dm gobo scared out of 499 All I heard was laughter. It's all orange shimmer samuel munoz the 25 dodgers That back to back. No every other pack with an orange here Got a whole grove out here. You know what i'm saying jake. We're in florida because there's a lot of oranges like a grove We're near the citrus tower What's the citrus tower? Oh that piece of junk? Oh did I offend you jake? Oh an orange mookie Come on now. What is going on? Oh my god Dodgers one of 25 real baseball classic flag I'm getting the citrus tower my mvp mookie bets It in it. Yeah you go in it Is equal tovar on the uh Bowman ascensions rockies rookie short prints Come on orange orange orange orange orange First auto reds alfredo duno There you go base auto and a purple shimmer for the reds nice guanipa and maya And a green rookie nice volpe here for the Yankees 10 99 All right, that was a very good box a lot oranges Jake he's working publics. You know, you know a lot about the produce section And the prices are wrong and you got to go back there and talk to every single person in the Jake's complaining about a job he doesn't have anymore, dude.  Yeah jake's 21. He's clearly had So many terrible jobs I'm just kidding jake. All right guys again teams in case 35 big time on sale We got we got the 10 off for the membership code there. Make sure you check the uh Make sure you check What am I trying to say here the um community tab for your discount code I want to mark teams down again I want this breaks to fill up All right Next team outing we should do like a Broadway show I just want to see how shana react when we tell him that the team outing is like Oh, we're gonna go see wicked at uh, dr. Phillips performing uh center for performing arts It's like oh, I'm sick that day I'm not doing that. I'm a man Nice a zagvin orange patch card Orange going crazy out here Rocky's fall league game use patch 25 Gavin cross refractor royals to 499 Base auto melt in for the astros Shimmer first is duno for the reds What we should do though is uh Field trip to a savannah bananas game Got a refractor to 499 Javier Baez that goes to the tigers or flag world baseball classic flag No, we're not talking about sam He was here though got outman on the um moment ascensions dodgers rookie short prints This is a first refractor auto tigers dany serretti 72 of 499 pink fuchsia vaporwave nice louise guanipa for the braves here number 2199 I can tell By reading the lips of the people's commercial and how awkward it is that it's a jg. Well. Oh, yep a jg one to commercial You don't even need the audio fragile green cosme first auto for the orioles. I was like, what are you zooming in these people for? 77 cars. No Tanner bb rookie refractor at a 499 guardians first auto white socks louise reyes first shimmer maia the Yankees Yeah, yeah, you have to call in that Rick taking the a's in a couple of breaks while grabbing the Mets next So guardians Rockies tigers astros royals brewers twins And the pirates are left There's a lot of emails. Let's keep going iconic iconic atomic is erin judge to 99 for the Yankees Sorry to 150 What game we got coming on jake? Follow me rush minute came to the league The only team worth watching if you ask me jake, let's go Yellow refractor first woman auto hazes galees to 75 of the Dodgers a line left. What does that mean? louise serenade first refractor Yankees the 499 So guardians Rockies astros six to go now six. Hey guys, I could have been saying I gifted some memberships too Sam gifted a membership.  They're scheduled through saturday. I'll get the rest scheduled later when we're done here But flawless is on sale teams are on sale at woman chrome and there's a coupon mosaic as I said allen again turn is listed more flawless this weekend So make sure to check out all the breaks everybody. It is a single use, but I think it's the whole order. So Get some spots 1159 p.m. Eastern if you're gonna Wait and check out the breaks over the weekend If you're busy right now 1159 p.m. Eastern, so you haven't till midnight eastern rice terrain rookie refractor from Milwaukee 499 Man jake we should be at the top right now rip in these cases Refractor first auto to 499 Henry Ramos Royals Let's just pack up and go We'll hire an uber and we'll just break from the back of the uber on the way there too shimmer Jackson holiday Orioles Ethan solace just give me your credit card. I'll get the uber What uber to the trop and back We can get there by like I think the seventh inning A pink fuchsia vaporwave of jose irardo for the marlins Don't ruin rips by watching the rays. Oh man Travis is literally always talking smack you Orioles fans get good once and they're all just acted insane It's like the lions fans got cartaya and victor for the Dodgers Volpe it came in the league do know first auto is one benjamin for the guardians And a speckle of jackson meryl the 299 for the padres They're not a bad move. I'm not saying you're wrong to do it by the way Travis definitely not saying that See I was saying like look at all of us all as competent adults None of us know where to send things to a printer like you don't know how to figure it out That's fine All right, y'all four to go four to go Yep, rocky's ashtray. Yeah, he's ashes person twins. Yeah Yeah, you don't have a ton of top screen baseball left at all. He's always fighting. What are you talking about? They're always fighting Yeah, it's definitely not staged. Well, you're right. You're right. You're right I'm just saying anybody I know Sometimes it's funnier when it's staged There we go, manny Appreciate you man Manny We're gonna hit some franciscous though Yeah, we fit two franciscous We had an atomic in the first case and then a refractor in this one of autos so Even something like that would definitely do well for really any spot. You hit a refractor auto of the chase player Or even a base on it for some for some instances, then you do pretty well How you doing today, manny? Yes, let's do it Franciscous super It's a 499 for the twins Invicta of mason hour for Tampa Bay I can't believe the rays got a new stadium and it's going to be in freaking st. Peter's work again Why would you do that, Jake? Celestine Cheaper, I'm guessing Got an Osvaldo Osorio first atomic out of the 100 Dodgers Nice card Dodgers Four to go everybody teams on sale Member of members only coupon in the community tab speckled james wood at 299 for the nap Like the stream sir Like the stream in honor of cocoa crisp Yeah, that's what uh, cocoa crisp and terry friend connell will be known for is being part of the guardians Yeah, we're doing good manny john lester oakland a's legend rickie wave is michael bush to 100 for the Dodgers Nationals cardinals and a's legend Yeah, I mean He's just like marmagh wire, dude a's and cardinals legend john lester First auto is blade tidwell for the Mets blade tidwell Hope he did well Yeah, that's true travis. I would I'm shimmer first torrez angels I'd rather stay in Oh, yeah, that would be that'd be miserable That's that would be the dumbest thing ever You'd have like barely any support in both places.  What would you in the playoffs? Long games in Tampa Doesn't work like that They would for sure have to designate a site I pretty sure the mlb will I just like not allow it anyway Oh, could have been in Tampa though could have been in Tampa But I don't play ramon james. It'll be like open calls see him when the when the raiders just play there Just the basal infield on the on the field I like Darren McFadden running through clay to get to the end zone Got a rookie fuchsia ohape angels to 299 Do I think shawn has shtick nightmares? Yes Atomic prospect process is vocaro gnats number 150 Tissue for the debacks davis and elosanto says the guy but they have a few other nice ones too like I think torrin is solid First auto busty dust for the Yankees. They just have a lot of bats that are have some potential But davis and elosanto says the big one. I believe a fuchsia shimmer blaze jordan the 199 red sox I have not andrew Yeah, manie. We're doing good, dude. Hope you're doing well Your giants had a big comeback last week No, sake one for a bit now Plus to 125 for the pirates I see orders Twins gone Rangers Just the Rockies and Brewers left everybody just the Rockies and Brewers up on the next one They're both on sale Rockies 20 bucks off Brewers are Something like that Huh interesting. Yeah, I don't even I don't even know what that is honestly Giants will be the Niners Michael Harris There's a better chance of me walking out there And uh, they're being a full steak dinner ready for me then There is of that happening first speckle auto to joining on louis serena for the Yankees Yamada Word to Yamada it's a 499. Do you see you see get that you get that It's 499. I believe he is non MLB. So we'll random that real quick. What's his name? Tsutsugo? Tsutsugo Yamada Pretty sure he is just Npb I ran into everybody right here real quick.  I was trying to think of something else, but you came up with a better one We should have like a shtick contest Sam No, I know he wouldn't his his aren't even good. Um, they just annoy Sean. Which is why it's funny Uh, 10 whoever's up top gets the Yamada one two three four five six seven eight nine and 10 Orioles Jake what do we got for a recap here? Wait Oh, wow. That was a very bad strike call there That should be a walk. That was very bad Now it's full count. Oh, yeah And then he struck out. Yeah Grinchick is pissed Grinchick might get tossed. He's you should see the pitch that was called a strike before that Here it is No, that's not it. It's show that all right raise broadcast show the pitch raise broadcast All right. Yamada the 499 This is sorry Baez, Verdugo, Newt Bar, Teosca Hernandez Buxton wit BB Terang cross Serna Walcott and Torin It was at least like five or six inches inside Uh, to 299 is Wood, Merrill, Mola and Young Ohapi Beatty to 250 Duno to 199 Yuri Perez Uh, Jordan Yerardo Guanipa Sin How are you? Good day. Hello, sin Uh, I don't want 50 is Vakero judge Neto Almeida to 125 Arias and plaza to 100 bush and bush to 99 Valdez Geloff Jones Volpe to 75 Luiziga Castro Mola to 50 Fernandez three oranges in the same box were Munoz Mookie to Mar Johnson and an orange patch of vene autos of Melton Bastidas Tidwell Benjamin Reyes Bencosme Duno Valtine Rivas Mosquera Stain with Kelvin Gonzalez Perez for fractures to 499 Ramos Serretti Mosquera and Francisca Magda Francisca You got speckles to 299 of Serna Berry Hill and Diaz atomic to 100 Osorio 75 Galiz to 50 Castro 25 Vargas and Ethan Salas base auto Thanks again everybody. We are moving on now to Case number 35


What's good Josh bull rocks back again with another video, so we're gonna check out ten secrets to a guarantee pop in wrestling now We all know there are certain things that you can do that's gonna get the crowd to liven up. You know, sometimes it may be Saying a curse word here or there or sometimes it, you know Just calling out the the city that you're in gets you a cheap pop sometime So we're gonna check out some of these moments I wonder if they're gonna be on this list appreciate all the love and support you guys have shown on the channel man Let's get right getting over isn't easy. It can take years and in most cases it does It's a combination of patience and perseverance not to mention bookers finding the right spot and executing it with a talent That has home their abilities to a sharpened point getting over and mastering one's craft is a slow and complex process Even for those destined to be great. Yeah, is it I'm cypher what culture calm and these are ten secrets to a Guaranteed pop in wrestling number ten getting the tables WWE is several weeks away from a premium lime event and there isn't a great deal going on Which means the bookers can pretty much phone this episode of raw in so for example It's Dominic Mysterio versus Carl Anderson no disqualifications in front of a motor Liam of a crowd in some backwards Market nobody really cares about the action a few fans are bought and a we want tables chart begins to murmur out And then one of the stars draws a table out from under the ring and the fans go bonkers Doesn't matter how bad a match is doesn't matter that they don't do anything else going on This is a generation of passive fans who have been programmed to go wild at the admittedly very satisfying sound of compressed sawdust Snarky, but it's not actually hyperbole at head and a cell last year It didn't matter that Cody road his body bruised internally to a disgusting extent was entering the most heroic performance of almost anyone's life When he was about to eat a table those fans turned feral Removing an article of clothing a generation of wrestling fans those who make up a not Inconsiderable part of the audience these days was raised on Hulk Hogan tearing off his yellow vest and conveying his vast Superheroic power to the audience as that audience matured Vince McMahon realized that booking women to show off their skin would also allow that Audience to react. It would definitely get a pop back in playing sunny dee quaffing boys Who delighted in this sort of thing amid the attitude era the squeals of women were also heard throughout arenas when Jeff Hardy took His top off to get his demented aerial stunts all the way over though No, we're near on the same scale Angel Gaza initially got over as one of the few highlights of the early NXT on USA era by Midway through his matches removing his tights throwing them at his foes and working the rest of the match in trunks Kazuchika Okada generated one of the loudest pops in the history of New Japan pro wrestling by switching from flared trousers to his classic trunks in 2019 it's not particularly big nor clever, but it is relatively over. It does work saying a naughty word I just said it. I just said it when you start cursing Simultaneously very complex and very simple in a warped way It's almost wholesome or reassuring that people still clutch the pearls or express shock when they hear a certain word in a Public setting saying the word sh it on national television has been permissible for several years at this point hell Some shows do a lot worse, but it's a no-no in school and in the workplace when a wrestler in a w and it's always a W let's face it says that word. It's guaranteed to generate a reaction Can they say that well they can because they do so virtually every single week Yeah, it's still a vote take big massive war Reaction the words has somehow retained the power to momentarily turn everybody into Mary Whitehouse and virtually every AEW wrestler Is brazen in their quest to wield its power? That's the thing even though they can you know, they're allowed to curse I do think it should be it should make sense. They do curse a lot and there's nothing wrong with it There's nothing wrong with it at all. I'm not gonna be one of these peers or anything like that but I'm also about Moderation when it makes sense like when Daniel or Brian Danielson was Right before Their match with right before his match his Ironman match with MJF and that promo even though They had to cut it or whatever But what he said it had so much impact the crowd went crazy for it Cuz you know, you felt the passion behind what he was saying, you know, and that's why I mean by certain There's nothing wrong with curse words being said it just has to make sense and in the right setting at the right time It shouldn't just be something that's thrown out all the time But if it makes sense and it's it's good to enhance the feud and maybe get a laugh here and there Whatever the situation is I'm all for it. So if they can work on just making sure it's not over used Cursing, you know and using the hard, you know the hard F and all the other stuff, you know They can make it work seven saying another naughty word the word crap exists for a very obvious reason For example, our editor just bleeped me saying the previous curse word But I can get away with that one Scott free, but it's not very exciting And so some wrestlers will try their hand at seeing what they can and can't get away with Jungle Boy reportedly got in trouble for cussing out Christian Cage on TV and Rick Ross's AEW appearance Moment where he called Keedley a big I told you that that F word you gotta really be careful with that For national television television purposes MF a which will never ever happen again So what's left why the big old B word? Of course the one every woman in wrestling uses to describe each other for emphasis It's eternal the hard B sound adds emphasis to the disrespect It's fun to say and to listen to a wrestler can get themselves in superb Cardovascular condition and perfect their difficult craft over a painstaking span of years But most of the time they're not as over as a hard consonant number six Insulting the local sports team Certain ancient wrestlers will harp on relentlessly about the lost art of getting heat and to a certain extent it is lost Because people don't really care about much anymore Desensitized as they are by the conveyor belt of horror that is everyday life Ultimately a Twitter user is more likely to get a toxic reaction for burying a wrestler Arrival with whom that wrestler is currently feuding but mostly when the heel mocks the baby face the reaction is at best Performative with rare exceptions the psyche of the general public is out of step with wrestling's traditional method of evoking emotion Unless those fans really feel something when their local sports team gets insulted Sport is real closely bonded to the DNA of those who love it as a family tradition and makes up their regional identity It really hurts when the local team fails It penetrates the calloused husk developed across this hellscape of a century and even the most basic heels grasp this concept That's an easy straw. You talk about a team that's doing bad.   You're gonna get some reaction. I've saying something reprehensible Message threads of wrestlers is an amusing way to pass the time There'll be some boring nuts and bolt stuff in there as they toss around ideas for their upcoming match But the etiquette of the insult is something else They have to delicately phrase what they'd like to say as an insult to avoid situations like the one that famously arose between Eddie Kingston and Sammy Guevara last summer now I would never dream of suggesting that you're out of shape But there seems to be the sentiment online, you know how those marks get all that said can I call you a fact Disgusting blob on TV it'll get a pop and a pop it does get which is why it happens and the thing is a wrestler Is considered a mark themselves if they don't go along with it, too Which is why you hear things like your beloved family member died recently and that really gets me off the taboo of which is a veritable pop generator executing you when you definitely Get personal get disrespectful That's when crowds they they they tend to come alive. Oh It's maybe some real stuff here You want to be able to blur the lines of what's real and what's fake? Yeah, a lot of times, you know, obviously they let each other know what they're gonna say and kind of what bullet points They're gonna say but sometimes, you know saying even if they know that They got to be willing both parties got to be willing to you know be able to take the heat of the other person's giving the promo on them and You know that can it could create some great stuff or Sometimes you can end up with a seam punk in an atom page where he ends up going off script and pretty much saying screw you On live television and you know, you have that debacle so that can happen But either way it gets it's entertaining for the fans Canadian destroyer if you ordinarily wouldn't in a typical week of pro wrestling these days The fandom will see a classic or near classic match an unbelievable unscripted promo Returning all debuting talent a crazy table spot a crimson mask and promises for yet more great matches next week The modern wrestling fan is inundated with brilliance constantly across countless facets and genres of the medium Enjoy the wrestling world as it exists right now because it's almost impossible for it to get any better So how in the face of this normalized wonder can a wrestler ever hope to get over there? No, you don't see that every day moments left unless the wrestler is smart about it One could always execute a Canadian destroyer But only if they're one of the 15% of wrestlers who don't include it in their standard repertoire It's as much crowd appeal as wrestling move at this point sucking up in the coolest way possible John Cena should have tried it between 2006 and 2014 he didn't but the very savvy Dustin Rhodes did in doing so he got over in early AEW as an anti-bad-faith actor willing to respect and mix it up with the new generation of wrestlers to get over with these Shifting tastes of the fans see also bad bunny who drew a gigantic pop with a destroyer at WrestleMania 37 Which is crazy an athletic movie seemingly had no right to execute I was a crazy spot on the apron. Okay. Well, here's the truth of it The apron isn't the hardest part of the ring that metal ring post over there is definitely the hardest part of the ring Still, it's all a work and commentators have insisted that the apron is more or less a concrete floor for so long that the fandom has long Accepted it as a fact and because fans readily accept its danger a pro wrestler will bump themselves Stupid on the thing knowing that their agony won't be in vain Scots like this are so popular in fact that AEW configured its very ring in order to facilitate as many apron bumps as possible Between the ropes and the actual brutal edge of the ring is by design Sufficiently large enough for wrestlers to work on it as they would the actual canvas Emables the talent to appear that they have mastered the impressive art of balance and they bump in most cases without quite smacking their heads against the Sharp awful corner moderately worked or otherwise as much as people complained about excess in wrestling the apron bump still elicits A guaranteed pop into it always makes me cringe. I don't care what type of apron brunt. I just Don't look good and T23 number two kicking out of a finisher Well else fails let somebody kick out of your finish works every time Majority of pro wrestlers do in this day and age rather often to even though I'm not the biggest fan of it It should only happen in certain situations I do think it gets overused because the finisher is your finisher should be something that finished the match It only should happen if it makes sense Chase that high of a molten crowd under their complete control However, greats like Kenny Omega needn't rely on the trick the man is such a genius at structuring a match that he doesn't have to Do it he can orchestrate a louder pop by teasing a move by registering how much the execution of a move is going to be Unhinged in its apparent danger before it's even struck He's perfected the pacing and rhythm of a match so that everything within it matters Consider the wrestle Kingdom spot in which he battered will Osprey's head through an unforgiving Japanese table It was actually tamed by the standards of the wider match anyway But the visuals were so stunning and the danger level had been set so high that it registered as nothing less than the baby face fight For Osprey's life since few others are this clever if they want to make a TV match feel big and turn up the volume the 2.99 kick out and shocked face hasn't stopped working yet I can hear Michael Cole's voice bouncing around my brain yelling two and a half two and a half and number one Performing a rare intergender spot. This is criticism of intergender Wrestling more an observation it's pointless to enter that debate especially in this form because of course it always explodes into a massive Conversation also read arguments. Of course, it's all risky simulated man-on-woman violence is something sponsors will not Tolerate and when the roles are reversed the conversation takes a phenomenally bleak turn by those who could do with developing meaningful Relationships to grasp a better understanding of how the world actually works all that stated. It is a guaranteed pop Rearly is more over than most WWE acts outside of the top stars and she frequently takes out men on the November 28th 2022 raw mere year execute a body slam on Finn banner to an ultra rare eruption of a Monday night pop or whatever Reason done sparingly an intergender spot wakes up the dead Perhaps that's the point and something the business can take on as a lesson Even if it isn't applied literally wrestling is so excessive in every area between gimmicks returns and back-and-forth high-end action It's something the audience hasn't been One of the best Let me know do you guys agree with? Everything that's on this list as a guaranteed pop and if you have something else that you would add to this list that you know We'll get a guaranteed pop or reaction for my wrestling crowd put it down below But I appreciate all love and support you guys are shown on channel Well 250k and I'm still getting speedy YouTube wrestling champion of the world and in the coach will heavily champion Appreciate checking in with me. See y'all next week peace


Today we're going to talk about implementing full-stack test automation for Drupal 8. It's all applied to Drupal 7 or basically any other system you're using. The whole point is to just do the test automation part, but I'll talk about myself briefly. My name is Anastasios Lascalopoulos, and yes, I am from Kansas, despite the name. Yeah, we've been in Kansas for over a hundred years. We've moved to South Texas, basically, but yes, I am American. And if you want to reach me, this is an e-mail, DOSCO. This is how I go by DOSCO. It was pinned on me when I was like four or five or something at exo.fi. Or on Twitter, on An DOSCO, just to tell about myself briefly. I've had several careers, which is from university teaching to the military. And I've actually learned to apply a lot of what I learned in the military to testing, to bug finding. There's a lot of overlap. You're looking for problems. It's threat elimination. We can go into this in more detail, but my training worked out in testing very well. My original education in IT was as a Java developer, which I've never done. I've actually never done any Java developing professionally. But nothing, I ended up having a very parapetetic life. I ended up briefly in education in Finland. And as a lark, I applied as a software tester at Nokia. And I just applied and got the job. It was basically that easy.  They just needed people. But I stuck with it. I stuck with the software testing. I found it very interesting, very fascinating. A lot of us like it better than development, but as we'll see later, there's no real divide between testing and development. We're both doing the same things. But again, test automation, I started at 2006 with QuickTest Professional. Nokia used to use the Mercury suite of tools, Quality Center, QuickTest Professional, LoadRunner. And they did not allow open source at all. To them, back then, open source was unreliable. It was just made by stoners in Eugene, Oregon, just trying to be rebellious. Serious software development meant you paid Mercury a lot of money. And after that, I've been using Robot Framework, Nightwatch.js and Phantom.js. I'm currently on codeception. Now, you'll find out that there's no one size fits all tool that will work with anything. You have to be able to adjust from one tool to the next. And it's not like one cookie cutter. You have to find the right kind of cookie cutter to implement the right kind of test automation. But moving on, I like to start with this one. Anybody have a Galaxy Note 7? Yeah, I often wonder what happened here. Was there a tester who just didn't notice this problem? Was there a problem with the requirements? There wasn't a requirement that said the phone will not burst into floors eventually. Actually, this morning, I found out that for, what is it, the Galaxy S8? There's a patch already to fix a screen. When did they release it like Saturday or something? They already have a patch for a problem. And the funny thing is I've been seeing all kinds of commercials about how important quality assurance is to the Sansung Corporation. And all of this happens. The important thing is like, they often say in the Midwest, probably here too, you have to lock the barn door before someone tries to steal the horse. You can't quality assurance, so you can't get an afterthought. Going on, let's talk about the real cost of bugs. Well, the funny thing about the word bug is there's no one definition of the word bug that satisfies everybody. Basically, the happiest term for bug is any unexpected or undesired behavior. So any undesired behavior can be a bug. That's the most prevalent definition everybody can agree on. And as I say, buggy software is very expensive, much more expensive than we think. An article I read said the National Institute of Standards and Technology. It's a part of the Commerce Department. It says that software bugs cost $59.5 billion, yeah, billion with a B every year just in the US. So how can we reduce this cost? The thing is, as I said, bugs are inevitable. You can't get rid of all the bugs, but you can reduce as much as possible. You can make sure your critical features are operating as expected, but you just have to reduce the problem. Let me say losses from buggy software will be reduced by continuous testing as part of the development process. I've been talking with people around here. A lot of people have never heard of the idea of continuous testing. People, yes, heard of continuous integration, continuous development, but there is a continuous testing. And we'll talk about that. But yeah, here's a graph about the cost of bugs. The cost of bugs is to be defined in two ways, two things. There's a cost of bugs identified. In other words, the cost of paying people to find bugs, the cost of finding bugs. And then there's a cost of fixing bugs. As you can see, it's a lot cheaper and easier to fix the bugs here in the documentation stages than it is to fix on the right way over there. And this is kind of an old slide now, because with the whole idea of DevOps, this development and testing slash QA is going to look a little different. But the thing is, we want to start testing like right around here. The QA part will be around here. And we want to avoid the post-release bug fixes as much as possible. Now again, the two costs, remember to keep in mind the cost of identifying bugs and the cost of fixing bugs. Unfortunately, by experience, a lot of projects try to eliminate this part, the cost of identifying bugs. What that does, it makes the cost of fixing bugs a lot more expensive. If the thought is, if you just take away bug finding, you'll also take away bug fix. Projects manage your logic. But as you can see, the latter becomes much more expensive. The cost of fixing bugs becomes much more expensive, much more expensive for the project overall. The best thing to do is to invest in finding the bugs early. And the takeaway, as I say, identifying fixed bugs as early in the process as possible. Even in the paperwork process, you know, you're also testing. And again, don't assume that by removing the cost of identifying bugs, you'll also remove the cost of fixing bugs. And I would think about what causes bugs other than actual coding. I'm starting to think that a lot of the big bugs like you saw with the Galaxy phones, I think it's more of a political problem than a coding problem.  And so what other ways can we see that bugs come up in software, any kind of software? I found very often a keyway process doesn't exist, meaning that there are no professional testers or just no one dedicated to really looking for bugs. You have people dedicated, of course, to coding but no one dedicated to finding the bugs. And often there's no plan. There has to be a plan. There has to be some way and in the other one there's no procedure. There is no process. You have to have some kind of process. Everything can't be just ad hoc. And too often there's a reliance on developer-driven ad hoc testing. As I heard someone once say, this is a my quote, developer testing is basically no kind of testing. And I will say a project can't have all or most of the above and still incest that their application has been tested. Now let's talk about mindsets. Developers, as I say, need to show that the application works. When I've been a test manager, I didn't allow the testers to say that an application works. The best thing you can say is you didn't find any bugs. It's not up to us to say if something works or not. And often when developers test their own software, they're not really looking to reveal problems and issues. The thing is testers really are looking to find problems. We like finding bugs. Dust bugs are good. And we need to show not just bugs as this, but how many exist, what kind of bugs are they, and where are they, and what happens. It's not just looking for a bug. You're looking for what is the problem, how do you get it? You record what happens, you record how to find it, and you record how to fix it. And the thing here is it's an issue of critical distance. I think it's a psychology term. Developers are too close to their own creation to search actively and closely for problems in their own creation. I kind of call this the meatloaf effect.  A lot of developers are, yeah, other developers can't search for bugs in their own software, but I can find bugs in my own software. It's never really the case. Testers, however, can stand back and look objectively for unexpected or undesired software and user expectation issues that the developer himself may not think. And there's also the idea of fresh eyes on something. The more eyes on something, the better. And as I say here, just in my own way, testing is a complex and creative skill and not just the last of many tasks development needs to just move the project along. This is one thing that I really like about testing. To me, it is creative. I know when I first started, testers were often regarded as the people who just weren't, like, talented enough to really become developers. But luckily, you know, at times change, the field has changed, situations have changed. And now testers need to be able to develop in some way, in some language, scripting language. You have to develop too. So the walls are kind of breaking down. And by doing this, you know, I'm trying to break the walls down even more. As I say, testing should never be an afterthought. Solution or automated tools. Automated tools now make it possible to create tests during development. That's the whole idea I'm trying to stress for the whole DevOps thing. You can code to develop the features and also somebody else codes to find bugs. And the way I try to sell it is test automation is a development project. Don't think of it necessarily as testing. Think of it as development where you write code that finds bugs in a specific feature. Now, again, don't just pass tests. You have to write tests to find bugs.  That all pass. And there's a big problem if all your tests are passing. You want bugs. You want to find bugs, not just pass the tests. Again, and this is where creativity comes in. You have to write the kind of tests that find bugs. A good test finds bugs and not just shows pass. If you have too much passing, there's a problem. If there's too many fails, there's a big problem too. You don't want everything to fail. You want to make sure that there aren't any script problems, but you have to make sure that there are bugs being found. In other words, you have to make sure that undesired behavior is being found. Okay, so what can we do? I've seen the whole idea of test automation in the past 10 to 12 years change. It used to be just regression tests. Test automation was done at the end, sort of at the regression test stage where you take all your past manual tests and turn them into automated tests. And you keep executing those. And you also use test automation for features that have, looks at a lot of repetitive actions. Like you have to enter a lot of fields, drop down making use push buttons, radio buttons and everything. But test automation is changing. And we're going to concentrate on the first three things. Actually the second and third, we're going to see what happens when we build and test. And we'll also see how test automation impacts these aspects of DevOps. Okay, this is a V model. The only thing that's important for me are these ideas here, verification and validation. Verification means you have the system is working correctly, the system is right. Validation means you have the right system to begin with. You also have to test that this is what the end user wants. Because I have seen things in user expectance test failed. When the client basically says the user says we can't use this, this isn't what we wanted. So you have to make sure it's what the user wanted that's testing also. Okay, but going on quickly, there's a new idea of test automation. Continuous testing as a fundamental part of continuous integration. So you create and execute tests as part of development. And we'll talk about test driven development briefly. Before I even, I should have mentioned this a while ago, but what do we mean by full stack test automation? By full stack we mean unit testing, functional testing and acceptance testing that's all automated. In other words, the whole process is automated. That's a full stack automation set. And starting off, we have acceptance test driven development. So the acceptance criteria is put into code in several different kind of tools. I'll give recommendations later. And run until the final application meets the acceptance criteria and passes. Okay, so the test, the acceptance test, which traditionally in the waterfall method was saved to the end, is actually run at the beginning. And development has to meet the criteria of the automated tests. And here, this is important rather than like a kind of tool set. Acceptance test driven development is more of a mentality, an approach to software development instead of just, you know, two specific tools and processes. What do we do? This is the role of testing. The role of testing is kind of elevated here. So acceptance tests are created first by QA and basically used as communication tools with developers. Tests are customer oriented from the user's point of view. Any development and test executions run integrated until the tests finally pass. Okay, this may not be new to anybody, but I want to start, you have to start with unit testing. The first level of testing, theoretically test every object in the code. Okay, and test driven development is you create the tests first, the unit tests are run first and then the code is written. An approach here, I hope everybody can see this. I'm not a PHP developer. This is the most advanced I've ever done with PHP development. But this is a simple and I hope correct. You can do your testing here if there's a bug, please let me know. But with this, basically we have a simple application that just returns hello and then adds two integers together. The point here is that this, the test part was written first and then the code added to make sure that everything runs. Okay, since I'm kind of running out of time, we go quickly. Now let's do test automation specifically for Drupal 8. We're finally getting around to Drupal 8. The cool thing about Drupal 8 is that Drupal 8 can create unit tests for you. You have to add and expand the kind of testing, but you can do it with the Drupal console, add controller to module with Drupal console. And there's an option, it'll even tell you, I'm sure a lot of you know what I'm talking about. It'll say, do you want to add a unit test class to this? And of course you say yes and it'll create the class. And PHP unit can be run, I think it's already automatically integrated with PHP unit and Drupal 8 are already run together. And you can use numerous tools. Our company does a lot of PHP unit tests running Jenkins daily. Okay, that is white box testing. Now for functional tests we do black box testing. So you basically examine what the system actually does from the end user's point of view. So input is repeatedly sent through the system using a number of different tools. Like I see here from Night Watch, Nightmare Caps for JS, Smoka. There are just more and more and more of these. So take your pick, whatever is good for you and what's good for the project. And end-to-end tests can also be run. Again, at the end we get to the acceptance test. So the acceptance test is finally when you can really say to management, to the client, that the test is ready for them to look at. You know, the application is ready for them to look at. Cucumber Be Hot has acceptance test automation, robot framework. Codeception has unit testing tools. And basically the tools test the developed software at a higher level. So at this point as opposed to the unit test and especially the functional test, for the acceptance test you don't really want bugs anymore. All the bugs should have been found during the unit testing and functional testing phase. So by the time you get here everything should pass. If things haven't passed then there's a problem. Okay? So somebody asked me, you know, who should do the testing? I say, you know, everybody, everybody can find problems. Developers and testers, anybody can find a problem all throughout the process. And like I said, always finding bugs is a good thing. Well, and often you have to get the whole project into the mindset that finding bugs is always good. And again, it's difficult to do because often people's mentality has to change more than anything. So I remember one time at Nokia, a project manager when we were really getting close to the finish time, to the release date. The project manager asked me, was there a successful test run? And I said yes. And he said, great, then we can release. And I said no, because in my opinion a successful test run meant bugs were found. So he got angry. That's fine. But that's fine because that's successful testing. To me it's like fishing. You know, no one goes fishing and they had a great successful time fishing if they didn't catch anything. And they showed that I've proven there are no more fish in that lake. So a different attitude. You know, successful fishing means you find fish. You catch fish. Same thing with successful testing means you find bugs. So who should do the testing? Really everybody. Everybody should find problems all the time because our bugs are ubiquitous. Functional test automation is for QA. There's a movement now just to have testers, to have QA doing unit testing. Because unit testing should be, is supposed to be. It's a great idea if everybody does unit testing, but very often unit testing's kind of slipped aside. So having QA doing unit testing is becoming more common. Functional testing QA should do that because you need the critical distance. You need to stand back. So I'm going to need to stand back. Acceptance testing is done with quality assurance. Yeah, with heavy involvement from management clients, developers. So everybody look for bugs all the time at all levels. And of course finding bugs is good. Find as many as possible all the time. So just to conclude briefly, testing should be planned early and started along with development. Keep in mind the critical distance. I think developers can be very good at developing test automation. But it shouldn't be your own code you're writing the test automation for. Assign a developer and think of it as your writing code that will find bugs. Like I said, it's easy test automation. It's easy development. All the features have been approved. There's no paperwork. The tools are easy to use. And like I said here, they're available for every stage of development. You have to find the one that's best for your own project and also best for your own mentality. Like I said, test automation should be regarded and planned as quickly and easy development project. And to end up, the main point of test automation is to find bugs and not just to confirm that the code works well. That's all I've got on test automation. So start automating. You'll find it's fun.


Hi everyone, it's MJ and welcome to the introductory video on something called the central limit theorem Now I remember when I was taught this for the first time I was like why is everyone getting so excited about this formula because the the textbook was like This is the most important thing of stats and I was like why I really really don't see the point of it Essentially what the central limit theorem is doing is it's giving the statistic that we created Something known as the sample mean it's giving it its own set of parameters and its own Distribution that distribution would be used and it would be become so famous They would actually get the name normal because it became the normal thing to do in statistics And like I said when I say this I was like what's the big point? But when you see the big picture of stats when you see the big picture of stats that the only way to optimize Processes and answer questions and all these various fields is if we have information about the parameters and the distributions of Our random variable that is generating data Well, what they've done is they've taken the sample mean and they've made it a random variable Or they've correctly identified as random variable and they've been able to figure out its parameters and its distributions Using the central limit theorem now like I said in the very first introductory video on descriptor stats This idea basically came around by using graphs the guy rolled a whole bunch of dice and or he flipped a bunch of coins and he saw the bell shape curve appearing it would take another 200 years 200 years for them to prove the central limit theorem using Maths now fortunately for us will fortunately most universities most actual courses Do not require the proof of the central limit theorem So instead what we're going to be doing is just explaining what it is how to use it how to get the most out of it But we will not be proving it because like I said it took 200 years and some of The most hardcore mathematicians out there to actually figure out the proof so Don't try and get bogged down with like oh where did this come from but rather focus on okay How can I use it and understand why it is so important to the whole subject of statistics? Anyway, thanks so much for watching and I'll see you in the course. Cheers