Hi, everyone. This is Overview and State of Lincority. So welcome. So I'm going to just start with a show of hands so I can do this. But who here has heard the word service mesh before? Should be everyone because I just said it. Who could explain what a service mesh is? OK, about half the people maybe. Who has used a service mesh before? More people somehow. Who's using a service mesh in production? That's still a good number. What about who's using Lincority in production? Still pretty good. I have to ask this to stroke my ego. Yeah, so speaking of my ego, my name is Alex. I am a Lincority maintainer. I've been working on Lincority since the beginning of Lincority. I'm very proud to be part of the project. Lincority is a very cool project. It's used by a lot of different organizations all over the world and has been for a long time. We have a very vibrant open source community. So if you ever pop into the Lincority Slack or go on to GitHub, you'll see lots of issues, lots of pull requests, lots of activity, people helping each other in Slack. It's really nice. We're a CNCF project. We are a graduated project. And we're very proud to be there. So what does Lincority do? So Lincority is a service mesh for those who said they were not able to explain what a service mesh is. A service mesh, in our case, or as we use the term, means that there is a sidecar proxy in every pod or in every pod that's part of the service mesh. And all network traffic for that pod that is either leaving the pod or coming in is redirected and intercepted by that proxy. And that proxy handles that traffic and is able to add a bunch of functionality there like observability so you can get things like golden metrics for request rates, success rate, latency, et cetera. You can see your service topology because you know who is calling who. You can get reliability features like retries and timeouts, load balancing, traffic shifting, AB deploys, latency aware load balancing, which is a really neat feature. So you can shift traffic automatically to replicas that are being faster and shift it away from replicas that are being slower. And then perhaps the most important thing, transparent MTLS between all services on by default. So this is the thing that people are usually most interested in or a lot of people kind of come to Linkerty or service mesh for first is they want MTLS and they don't want to work for it. They just want to install Linkerty and have it work, which is what we do. And of course you can do things like cert management and rotation and access policy, which I will talk more about in a little bit. And I meant to say this earlier, but actually the way I want to do this talk is I want to talk about what is new in Linkerty, what is coming up soon on the roadmap, but I want to get through all of that kind of as quickly as I can to leave a lot of time if possible for questions. Cause I really want this to be a little more interactive and to hear what you all want to know about Linkerty and hopefully answer that. So if we get to the end and there's no questions, that will be very awkward for me. Okay, so what's the kind of the philosophy behind Linkerty? Linkerty has gone through a couple of iterations. There was a previous version of Linkerty called Linkerty One, which was written on the JVM. And we learned a lot of things from that. It was very, very powerful, very, very configurable. And while that was really awesome, it was also very hard to use. And a lot of people who were trying to use it kind of had the experience of like, well, you know what we're trying to do. Why doesn't it just work? Why do I have to configure all of this stuff? And so we took a lot of those lessons into what we sometimes call Linkerty Two, or we've kind of dropped the two, we just call it Linkerty Now. And the idea is it should just work right out of the box for 99.9% of use cases. You should be able to just install it and it should do the right thing. And anything that needs user input or needs user configuration should kind of come after that. You shouldn't have that as an upfront barrier to getting started. The other big philosophy that we had for this project was for it to be really, really lightweight and really, really low resource utilization. So that's why we wrote a proxy from scratch. We're not using Envoy or any other kind of off-the-shelf proxy for Linkerty. We have a proxy called the Linkerty Two proxy. It's written in Rust and it's designed to be as lightweight and fast as possible. And operational simplicity has kind of been like one of the most important things from the beginning is that this should not only be easy to get started with and easy to install, but also easy to operate over time and easy to reason about and easy to know what's happening in your system without having to understand a lot of kind of black magic or weird things that are happening. So like I mentioned, we use a specially built micro proxy. It's very boring to anyone who operates it, which is the goal. It's called the Linkerty Two proxy. And it's something we're really proud of. It's kind of one of the most invisible parts of the service mesh because as an operator you should never have to worry about it. But it's got some very, very cool technology under the hood. It's written in Rust on some cutting edge libraries that we helped develop like Tokyo and Hyper-NH2 and Tower. And because it's written in Rust we get a lot of security benefits from that as well. We don't have to worry about certain classes of memory issues. But as this says, the philosophy is that the proxy should be in implementation detail. It's not something that we ever think a operator should have to worry about. And so this kind of leads into our philosophy on security. We want to have secure foundations. We want to be built on secure libraries in secure languages. And we want to leverage Kubernetes as much as possible and be Kubernetes native as much as possible. So that means for example, when we're doing MTLS all of the MTLS identities are bootstrapped from Kubernetes service accounts. And so that's kind of the primitive that we build everything on top of. And in order to be secure you really need to reduce the barriers to security because security features that nobody uses are not useful. So MTLS is on by default. There's nothing you need to do to configure it because we know you've got a service account. That's your credential to getting a certificate. Once you've got a certificate you can do MTLS. And so we have workload identity and all this stuff just kind of works without needing any special configuration. This is what people like to ask us about all the time is what's the difference between Linkerty and Istio and how do the two compare? I don't want to go through all of these points, especially because these two projects are both changing at rapid paces. So anything that's true here one day might not be true the next. But I think the biggest difference is just in philosophy in that the Linkerty project is really, really focused on operability and simplicity rather than trying to satisfy every use case under the sun. And I think that's what makes it easier to use and what makes people have more confidence in it and it's what means it can go to production faster. There's also a lot of performance benefits, I think, to using the Linkerty and the Linkerty Proxy. We've done some really interesting benchmarks which you can look up if you're interested. Okay, so what's new in the project over the past year or so? So Linkerty 2.11 was a really exciting release. I forget when this came out, but sometime in the last year. And this is when we first added server-side authorization. So we've had MTLS for a long time which has given us authentication. We know when one service calls another, we know who that is. They have an identity, that identity is bootstrapped from the service account. And so we know who is calling who. But for the first time in 2.11, we gave you the ability to restrict who you would accept requests from. So the service could say, I would only like to accept requests from this other service or I would only like to accept requests from this other subnet or some combination thereof. And so finally, there was fine-grain access control and you could start implementing those policies which a lot of people were asking for and are very, very useful. This took us a while to kind of figure out what model we wanted to use here. We wanted to do it in a way that was Kubernetes-native and felt natural to people who were in Kubernetes and didn't have to be a whole new system that people had to learn kind of on top of what they already knew. So we introduced a new resource type called server. This lets you define a specific port on your workload. And as soon as you have a server, then you can start to define authorizations to say here are the identities which are allowed to access this server. And that's all enforced on the server side, so it's very secure. And again, because we have the sidecar model where we have proxies inside the pod, each pod kind of becomes its own trust barrier and it can decide for itself what traffic it's deciding to accept and what it's not based on those policies. There were a bunch of other things in that release which were really exciting. Specifically, a GRPC retries was something that was a long-term coming. So we've had retries in Linkerd for a long time, but they've been very restricted in terms of what types of requests can be retried. So specifically, anything with a body, we were never able to retry before because we would have to buffer that body so that if that request eventually fails, we could retry that body so we could send it again. So that buffering was something we added in 2011 so that for GRPC requests in particular where there's always a body on the request, we could retry those. Up to a maximum payload, yeah, 64K. So we'll buffer a certain amount. And this is another philosophy about Linkerd and something that we get from working in Rust is we get to make very conscious decisions about how much data we're buffering to the proxy. We have fixed-size queues. We know that we can decide how much we want to buffer and how much we want to use things like back pressure to push stuff back and make sure that we're not growing our resource usage beyond what's acceptable. We also made a bunch of performance improvements, and we're always kind of having one eye on performance to make sure that we're not having anything run away. And a lot of other cool features, too. The other big thing that happened in 2011 is that we changed the control plane architecture a little bit in that we added a new piece of it called the policy controller. And the policy controller is very important for serving the policy API, which allows all that server-side policy access control that I just talked about. But what's exciting here is the policy was our first controller, which was written in Rust. So before this, all of the control plane was written in Go and the proxy was written in Rust. And so this was the first time we had Rust kind of entering the control plane side of things. And this, I think, is a very, very exciting development because we got to kind of try out what it was like to write a controller in Rust. Typically, this is written in Go. There's a lot of Go ecosystem around Kubernetes controllers. There's a lot of really good libraries for writing controllers in Go. But that ecosystem on the Rust side is really starting to develop now. And it was... I worked a bit on that policy controller and it was a joy to write, actually. I was dreading a little bit when I first got started because I'm like, oh, man, writing a controller in Rust is going to be a nightmare. But it was great. So I think those libraries have really matured a lot. And I'm excited to kind of, as we develop more things in the control plane, to do more and more of it in Rust. I think that's really, really exciting. Okay, so fast forward to 2.12, which is the most recent release of LinkerD. This kind of took the server-side authorization a step farther. So one of the big drawbacks with the server-side authorization that we had in 2.11 is that all the authorization, we said it was fine-grained, but it was fine-grained per server, which meant per port. So you could say, you know, this port has this policy, this port has this policy. These are the types of requests that it'll accept and here's who it'll accept it from. But what we really found is that we needed to get even more fine-grained than that and have per-route policy, which meant to take a look at the HTTP path or method and decide, you know, is this a liveness check? If so, it needs a different authorization policy than if this is, you know, scraping the metrics or if this is an application request or if this is something else. So people ran into a lot of problems specifically with liveness probes because those were coming from the Kublet. They were not authenticated. They were not part of the mesh. So in a lot of cases, we were rejecting them because people set up, you know, their servers and their authorization policies and those liveness probes were failing and then the application was failing because it was detected as down. So this kind of helped to clean that up a lot and meant that we can now do authorization per route. We can say this route, you know, these clients can talk to this route and these clients can talk to this route and it gives us a lot more control. So that's been a huge step forward. The other reason why this is really exciting is because when we were developing this feature, we needed some way for people to specify which routes, you know, were allowed and which routes were not. So we needed users to have some way to specify what is a route. And it turns out that similar work was already happening at the same time in the Gateway API where, you know, you also need to define what is a route. And this was a really good opportunity because we could use those types and we could kind of make sure that we were developing this in a direction that was compatible with what Kubernetes was doing and what the Gateway API was doing. And so that's what we did. We used the Gateway API type, the HTTP route type from the Gateway API to define HTTP routes and you can attach server policy onto those in Lincordies. And, you know, when talking to this server on this route, here's the authorization policy that you should use. And I think this sets us up in a good direction because right now there's ongoing work on the GAMA project which is a project to adapt the Gateway API for service measures in general. So this is obviously something that's of quite a bit of interest to us. And it means that we're kind of well set up to be compatible with that and we're very involved in that conversation. So the Gateway API is very cool if you have not checked it out. I'm doing a talk tomorrow about the Gateway API and specifically how Lincordy uses it. So if you're interested in hearing more about that, I will be talking about that tomorrow. But in the meantime, just know it's very, very cool. What else? Oh, yeah. And we also added kind of automatic support for health checks. So that means that even if you don't manually configure that these are the paths that you've defined as health checks, we will admit those automatically because we know what they are because they're in your spec, they're in your container spec. And we know those are coming from the Kubelet, so as long as they're coming from the right place, we don't require MTLS on them and that'll just work. So that's been a big quality of life improvement there. Okay, so what's coming up next in the future? So Lincordy 213 will be our next release. I don't know exactly when it's planned to come out, when it's ready. But the major focus for 213 is going to be client-side policy. So in 2.12 and 2.11, the major focus was on server-side policy, specifically admission policy. We wanted to say, you know, we're going to let these things in or we're going to deny them based on their identity. On 213, we really want to focus on client-side policy. And there's a few things, there's a lot of topics, there's a lot of things in there, but specifically we wanted to focus on header-based routing and circuit breaking in particular. These are two features that have been highly, highly requested. And so, you know, it's the natural time to kind of take what we learned doing server policy and move that over to the client-side. So again, we want to continue the path that we've gone on using the HTTP route type from the Gateway API to do this in a way that feels very Kubernetes-native and Kubernetes very natural to anybody who's running in Kubernetes. So for example, HTTP routes have these things called back-end or back-end refs, which are very useful for ingresses, because as an ingress, you want to say, okay, for this route, here's where I'm going to send this request to. In the same way, it's kind of also natural to use that for east-west traffic when saying, well, when I send a request route to this service, you know, actually I want to send it to this other back-end instead or I want to split it and send a portion of that traffic to this back-end instead or I want to split it based on a header and say, for this header I want to go here and this header I want to go here. So that's something we're working on right now that's very, very exciting. We've also had a lot of requests for circle-breaking. This is a kind of, this is an interesting one and a little bit of a nebulous one and a lot of requests for circle-breaking means something different by it. So we're never quite sure exactly what that means. But I think in general, there's this need to do, to specify load balancer policy. Load balancer policy encompasses a lot of things. So for LinkedIn right now, what we do is we do this load balancing algorithm called YUMMA, E-W-M-A, Exponentially Weighted Moving Average, which is a very, very cool algorithm that takes a look at historical latency data and uses that to weight how much traffic should go to each backend. So if you see some backends are performing very well, they'll get more traffic, other backends which are performing more poorly, they'll get less traffic and it will kind of automatically adjust over time as the performance of those backends changes over time. And it's really, really good at minimizing latency. So that's what we use. In 100% of cases we always use YUMMA and performance is great, but there's kind of this desire for some people to say, well, actually I want a little more input on how load balancing happens. I want to do, I want to have more control over when backends are in the pool or out of the pool, and this is kind of what people call circuit breaking to say, well, there's been a bunch of failures on this backend, maybe I want to kick that out of the load balancer pool for a while, let that backend recover and so there's a lot of surface area here for configuration to say, well, exactly how do you want load balancing to behave and so client policy is a really natural place for users to be able to specify that configuration and say, well, maybe we need different policies for different routes. Maybe this route is fundamentally, you know, behaves differently and it needs a different load balancer policy than this other one. Maybe we want circuit breaking over here, but we don't want it over here because the nature of those services is different. Now, if you are a LinkerD expert, you may recognize that some of this sounds kind of familiar from service profiles. So service profiles are something that's in LinkerD today and it's a way of specifying which routes are retriable and which routes have timeouts and you know, that's got a lot of overlap with what I just talked about being able to specify client policy because retries and timeouts are client policy. And so kind of because there's this overlap, we want to kind of start slowly to move away from service profiles for configuring these things and start moving towards something that feels more natural in Kubernetes, which is by doing things with HTTP routes and with the Gateway API. So this isn't going to be a hard cut over. We're going to kind of slowly start to deprecate things from service profiles and move them over to the new world of HTTP routes and Gateway API just because that feels a lot more Kubernetes-y. And so we'll kind of slowly migrate that functionality over kind of over time. And as I said before, we've got our eye on Gamma where we're very involved in those conversations and to the extent possible we want to be compatible with Gamma, we want to have all that server side and client side functionality be configured in a way that makes sense with the Gateway API. So if this sounds interesting we would love for you to get involved. All the development is open source, of course, on GitHub so you can kind of follow along. You can file issues. You can open PRs. If you are trying to run Linkerty and you run into any problems you can always hop into the Linkerty Slack slack.linkerty.io and there's always people, maintainers and other users who are there helping each other out and just being friendly and nice. We've got some mailing lists that are from the CNCF that we announced releases to and make other announcements to. There have been some security audits that we've done which are very interesting if you care to read security audits. And yeah, we would love to have everyone participate. If you are looking for a more kind of hands on way of learning about Linkerty there is a hands on service mesh academy. The next one is in November and that really gets you kind of hands on and teaches you right down to the nitty gritty the details about Linkerty that you might not be able to pick up on your own. So if that is of interest to you I highly recommend that you check it out. And if you are running Linkerty in production and you need a little bit of extra help or you want to alleviate some of that burden of running it Boyant offers a fully managed Linkerty so it will take care of things like automatic upgrades and certificate rotation and alerts and stuff like that which just takes some of the administrative burden off of you and makes it a little bit easier and gives you one less thing to worry about. So boyant.io slash demo if you are interested in getting a demo of that. Okay, so hopefully I went fast enough there to leave a lot of time for questions and I want to know what you want to know about Linkerty. So Istio is going to have something like a Proxeles mode using MPM mesh. Do you have any plans along those lines? Anything? Yeah, good question. Istio's got an ambient Proxeles mode. Is Linkerty ever going to have something like that? Probably not. So we are really tied to the sidecar model. We think it has a lot of advantages in terms of security and in terms of operability and understandability. The pod is a very natural security boundary and so when you do something with ambient where you take that proxy and you run it somewhere else and you have it kind of be multi-tenant and you lose a lot of those benefits and you've got one proxy serving multiple different pods. Those security boundaries get a little bit more muddled. You have keys from multiple different accounts potentially coexisting in that one proxy. So we don't see kind of any major advantages to that sidecar-less model that kind of outweigh the drawbacks. So we're probably in it with the sidecarper for at least the medium to long term. Yeah, that's a great point. Someone just pointed out that LinkerD1 had that architecture and that's true. LinkerD1 had a per node proxy and one of the lessons that we learned from that was that there's a lot of drawbacks to that and it's very difficult to do security correctly in that model and it's very difficult. It introduces a lot of complexity that you can drop if you go to this more isolated model of proxy per pod. Hi. We've been running LinkerD1 production since 2020 but we're on 2.9 and it's hard to upgrade. It's like a one-way upgrade and for production workloads it's very hard to guarantee that we can revert if there's a problem especially since you have to rotate everything to get the other recommendations but for us right now the plan is to safely upgrade to a new version is to have a separate cluster a separate cluster that's running the exact same workload, the same network but it's got a different LinkerD1 and then if something goes back we just switch over to the older cluster. Yeah, so the question is how do you upgrade in a way that you have confidence that you can roll back I hear that it has been an issue in the past that roll backs to a previous version of it very very very difficult we're trying to get better about that kind of going forward but it is historically a problem. My advice to you is if you're running into problems just try and engage with the LinkerD team directly we can try and help you sort out the specifics but going backwards doing it downgrade has not been something that has been a great experience in the past so I hear that. So obviously with the new server side policies you can enforce security within LinkerD is there a security reason to do both you know is it I know you're enforcing a proxy but is it you know a concern that we should apply it on both sides potentially if we have pods that we don't want anything talking to do you need to do it twice or is it one good enough? Is the question about whether you would also do kind of security in the application as well? No I mean on like the firewall level so you could do it on the on the LinkerD level and on the firewall level you know through the C&I type deal. I see I see. Yeah I mean you could it's kind of like a belt and suspenders type of approach they're slightly different things you know when LinkerD talks about security and MTLS what we're talking about is workload identity so we have these identities which are tied to certificates which are bootstrapped from service account tokens so you know we don't necessarily say that you know this request is you know coming from a certain place but rather it has this identity this cryptographic identity which represents this workload and so you know if you want another layer on top of that or below that that can potentially make sense as well it's kind of just a different it's a different layer and it's a different thing. For the cryptographic identity and the certificates how are you guys issuing that is it through an ACME do you link into like an ACME provider using CertManager or are you handling that entirely with the LinkerD? It's by default it's handled entirely by LinkerD we do integrate with CertManager so for example if you want automatic certificate rotation CertManager can do that and that works great. In the default case we generate all of that all those certificates inside of LinkerD and those are you know kind of bootstrapped up from the service account tokens but that trust chain is kind of all you know all there it's not connected to like a well known CA or anything like that. Okay so if you wanted to operate like your own ACME compliance CA and hook it into CertManager would you still be able to get the same like identity management rotation? Yep yep you can supply your own trust route your own CertManager and that'll all kind of get hung off of that. Thank you. Thank you for the presentation it was great so I'm a long-time SEO user but also a fan of LinkerD personally. One of the things that I was looking at is in terms of like day two operations in terms of visibility SEO for example makes it very easy to do something like Keali. Is there something in the community that's equivalent inside the LinkerD community or is there an opportunity is that something as a community we should like look at or in terms of viewing you know traffic routing inside the cluster? Yeah so a lot of that is kind of built into the LinkerD Viz extension you know if you use the LinkerD Viz extension you can get things like service maps and dashboards and so on. So a lot of the functionality that's in Keali is also kind of available through the LinkerD dashboard but kind of on top of that all of that data is in Prometheus and you can build you know any visualization you want on top of that. Two quick questions you mentioned that the control plane was down to three components but I counted five on the slide so are there some doubling up there? Let's take a look. Let's see whether I'm wrong or the diagram's wrong. So the destination and policy controllers they're still out here but they're in one, they're kind of bundled together in one pod. The public API doesn't exist anymore and that's three. So the slide is slightly wrong. Okay, yeah the slide's revealed because also I think your Twitter handle was wrong on there. Oh was it? I found you and I followed you anyway. The other one you mentioned briefly is something about back pressure. Does LinkerD provide a back pressure mechanism? Yes that's a great question. So for back pressure you know this is kind of the HDP back pressure mechanism so as kind of the proxy handles traffic it takes those bytes in and sends them out and as soon as it sends them out it kind of signals you know upstream that it's ready for more kind of using the natural connection windows of HDP. Hi. So I'm interested in LinkerD's talking about your authorization policies it's on a pod to pod kind of this workload authorization. Does LinkerD have a story around like user authorization between pods or accessing services or endpoints in pods or maybe further on the stack that a gateway wouldn't be able to necessarily block that traffic? Yeah good question no. So we've always kind of been focused on workload identity rather than user identity. I think that may change a little bit in the future as we start to take on more ingress functionality. I think that's a more natural place for that. But kind of for now all of the east west stuff is all workload off. Yeah sure I can take this one and then. Yeah the question was can you explain the difference between east west and north south traffic. North south generally refers to stuff coming in from the outside world to coming in through the ingress of the gateway and then east west is service to service within the cluster for one service in the cluster to another service also in the cluster. So can you explain to I guess work with something like open policy agent to have like data policies on service to service traffic? Yeah potentially I mean there aren't any kind of plans right now but open policy agent is something we've looked at in the past and it's very interesting and it's definitely potentially useful for a lot of stuff but we don't have anything concrete right now. Can you say anything about the communication between your data plane and control plane. So for example in Istio they use something called XDS because that's what Envoy exposes. But I guess I don't know can you say anything about what kind of protocol you use? Sure so the question was about how does the communication between the control plane and the data plane work. You know conceptually it's very similar to the XDS APIs from Envoy but it's a separate gRPC API so control plane each of the control plane components exposes some gRPC API and the proxies connect to the control plane to get that information. So conceptually very similar to XDS but a different thing. Okay I think that's time. Thank you everybody. I'll be hanging out if you want to ask me more questions.


What's going on everyone? Sam here with late sports cards ripping 22 bowman draft baseball super jumbo six box full case break number 18 Random team style. There's a look again at your random results As always you can find these on the website under the results tab as well as the link in chat She's to go on inception divisions coming up after this everybody. So thank you very much for Getting that sold out Henry bull. Yeah, Henry bolt would be solid Henry bolts the man do I like him a lot He's all backwards Just I did the wrong way. That was my fault Just for you. Yeah Yep, one to wouldn't surprise me the day. I'm having so far would not surprise me Upside down James Triantos for no reason very cool. Shout out that first Nick Bittison J Allen, Roger Carias for the Yankees back on track here base Looks like a base or refractor auto base base teal lava Joe lamp. Nice one there to at 199 for the Guardians Crawford first pay palette first Mason and win she won't go refractor Cole Phillips To 499 for the Braves nice one there ATL Kyle S picking that one up Cole Phillips Paper base Yeah, I saw that I saw that yeah, the personals don't go until after group breaks are done So I won't go till later tonight one between probably 1 1 30 a.m Eastern time Gavin cross place is haunted I'm convinced on that Robert Moore It's very awkward situation where like it's six 28 were the only ones who are ready. Yeah, I know usually like that Usually there's somebody here, right? Just a weird feeling. Yeah.  I'm not gonna lie when I'm sorting and I see this guy's name. I do remember Going to the Pirates on the base first auto nice one there Pittsburgh That's great We're like we're sorting like extras is they don't have like the Mets are the Yankees. I'm like, oh just Let's go Actually thankful her one of the one of the sticks one of the sticks actually came in handy You heard it here first ladies and gentlemen. I'll give Sam props One of the sticks did come in handy. That's about it. Yeah, that's fair I'll take one dude. One's better than nothing. Yeah, one's better than all of them being annoying at least one's annoying but helpful Yeah, there's tomorrow Johnson and Victor We're talking off those first jet the Met Drew Thorpe Luciano first as well or not first It's gonna tell me don't say that you give him power You know, it's just the one. This is the one Probably Lenin Sims true blue paper first for the diamond. That's the chattel.  I'm gonna chase the water first chase the water Willy Vasquez Colton cows are based first auto Gabriel Hughes going to the Rockies nice one there Colorado. Oh Dusty that's just a glove in there. Yeah, it's not scratch or anything It's like a glove strap of some sort You don't mind sorting them by color Like it takes so much time out of your day. Yeah, you have no idea. Please That's like a whole 10 seconds. Please listen to listen to the complaint department. Oh trash You're seeing the So random, but it's like Pac-Man Jones Steven Zobeck first talking about Terrell Pryor There's Jacob Mizorowski was it on the No, no, no, it was on like it is a while ago. There's both and they're still playing and they were like They're asking Pac-Man Jones like what do you think about? What do you think about Terrell Pryor?  He pulls a trash case like this is him right there I don't know. I think I see that look that up at some point just look up like Pac-Man Jones Terrell Pryor rant There's South Stewart to 199 Hey, what's up Higley happy birthday, dude. Happy birthday, Donnie. How are they Johnny? Hey Higley? What's up? I'm here today. Green Speckles is our Frito to 99 for the Orioles Adam Azure the rare currants Cermak son more bell refractor Deandre Smith to 499 for the mess So I'm there on the auto. I do yeah, I know I do live outside of Oh, we never see him again He just went loony down. He just went loony on us. I escaped the dungeon there Keep you in the walk away in the warehouse All right, you need to top load today base It's got two divisions left last time we checked in Inception that breaks right after this Gavin Cross The answer is a tide you both give up zero Sunday day. She are like the Kennedy and our Alcazar It's two divisions left guys get you five at teams in a full case of Bowman inception. We'll never have a dining cam Yeah, Sam will be disgusted Nice Ivan Melinda is the 250 on the paper for the or the purple purple paper for the Diamondbacks nice one there Chrome of some sort coming up. It looks like that is gonna be a Marcelo Meyer to 250 as well. Nice one there Drew Gilbert first some Paulino first of South Stewart and Teal lava auto is Jordan sprinkle 160 out of 199 nice one there. I Honestly, they're the best team in this Alvin. They've got Jackson Jackson holidays like the big chase So yes, both Baltimore is the best team in this for sure. I would say How you think Jordan likes his donuts? Sprinkle Dutch I'm not a Sam Whoever thought Sam would be somebody's role. All right That is the wrong decision right there Yeah, Judd fit Judd the stud Fabian Higley at what point in the year do you think you'll get done with the Matt Ryan? PC all depends on all depends on that one-on-one if it gets pulled when it gets pulled how much it gets pulled for Michael nor Brandon Barrera listing stuff on eBay. There you go. Let's go forest now, dude. I'm getting back into my eBay grind once I move into my new house I'm having a whole room dedicated to it all like gaming and and cards. Yes That is Marcelo Meyer 499 No one wants to watch you play for me, Sam. I hate to break it. Oh, I know that leave me That's a waste of people's time. It's Gabriel used to 250 Like man, if I want to be that bad, I just go and do it myself. I'm gonna watch somebody be that bad Say you got first of Kate Horton and base auto chase junk. Nice one there Femoons. It's up. Femoons. There you go. Tigers Femoons. Femoons. That's for his eBay name. Femoons. How clever. Femoons. Femoons. I can see a forest is a creative guy. Oh, yeah, or it's really Doug Beatt for that username Justin Voight first Bryson Mott's When by the video game when I was 15. I'm surprised. It's not something more like Cringy than that if you made it when you're 15 for us. I got I'll give you a props on that for sure I'll take you to get you both fired. There's Green Pedro Panetta to 99. Yeah, we're over on We're over on YouTube as well. Higley. We're not on tiktok after the whole Not allowed to do breaks on tiktok anytime. I see people doing breaks on tiktok. Now, I report on Jose Ramos Mini diamonds. What are those guys? Yep Like if we can't do it, you can't do it either Logan Tanner first first Blake Burkhalter and a Zack Nido that is a Nido Nido nice one there for the Angels shirt H a little bit of schmack on this.  So I wasn't here when they were back Get it Yeah, send it we'll send an empty box and wrapper with the angels. I apologize on that that Jerry Yeah, Jerry. Sorry, Jerry Halo's a little bit of damage on that Nido Nido. She could be worse true Alvin true Kubrick's er Yeah, it was me. I eat the glazed doughnut right before I open this pack. I Mean I mean if there was one here would be and for sure I probably got to a faster than the same. I don't play with doughnuts. Don't I don't either It's been all brawl here Jer Richie first Mar Johnson Brooks Lee Danny D'Andrea and a purple Alex McFarlane 30 out of 250 going to the Phillies. That's one there. That's Philadelphia Philadelphia prism spot elite spot Still two to go on inception breaking right after this. It is divisional style full case 16 boxes. So a shot at God 32 autos More than that maybe. Yeah, usually about 32 waters Victor Oscar Colas Mike you're a marrow first Henry Williams Those are Those golden goddess and inception are really cool. Yeah, they're fire. I agree with that. It's Clark Elliot Is to 499? We got a lot of shtick guys in there, too, which is good Lot of shtick guys in that one. I don't think I Blue Tanner Schoble to 150. Yeah, you have not newer in for my friend Sean McClane on hell Martinez refractor is trace Gonzalez 466 out of 499 nice one there for the Pirates Congrats Pittsburgh You have me saved for us.  I now know for us eBay So I can have a lot of fun with that So look at dollar off around like a $200. Oh, absolutely Chase the water first Couser Just Ithaca sports cards like my Instagram if you haven't already for us. Go make sure you have a minimum Yeah, I'm offer. We get that ready for it. All right auto cancel He really did buy a car for me for like a dollar.  I know I sent some I sent some Air apparent Mike you're a marrow green to 99 nice one there for the Red Sox So some offers first and Don Russ cars. I won't hear back First Nick bit of sin blue wave Trevor Martin to 150 for the rays nice one there Tampa Of course, I was saying if you haven't already make I'll make sure all your best offer listings have a minimum Offer for Sam offers a dollar. Yeah, I'm gonna start spamming you with dollar offers Then I'll just start making new accounts zero feedback accounts Every time you block me One's gonna be named for us, please notice me Please notice me.  No, I now I now hold all the power knowing for us eBay name The ball is in my proverbial court. What would be my account name or who? Yeah, my is I think of sports cards Tried to offer a dollar My name is I think of sports cards on everything like there is pretty much everything that YouTube Instagram What not well your branding's on point true I Have a little business cards out of my logo on it, too. Thank you. Shout out this the print for that one Who's a parker messic use the affiliate link It's just this right here franchise Then sports cards after it. I'm gonna have to ban myself for self-promotion. Oh, no There's a purple Anthony Volpe on the paper to 250 nice one there It's one thing whenever I'm giving like people my emails because I still use my I think of email over the phone I'm always like it to go it H a C a right. I have to spell out every single time. No, I want to college I want to get to college and then they're like Drew Thorpe you're in confidant and Jacob Miller at a 499 nice one there. Oh my god Yeah, not on a non first. Oh But you do on paper. Yeah, well, it's only a two box break. So you got to get them in my camp Got you franchise got you Class of 2021 baby at the college. Let's go roll bombs We're the bombers. What do you want us to be the Tigers? At least that's cool.  Good luck everybody some purple Purple said any Raphael to 250 you can't be purple Sean McLean to 250 there you go Dodgers nice one there Sean McLean very nice Yeah, I mean if you go in a certain Facebook group So I would say put in a bounty on the one-on-one Matt Ryan's probably a good idea So at least people know I don't offer one dollar on the brand and March card. That was pretty funny I'm I'm going to ham on the one dollar offers on on all of Forrest items Reggie Crawford Pick them as a rosky 1.5 million bounty on the Matt Ryan one of one Yeah, I've got like 2,000 list things or something like that I gotta bump that up. I have so much stuff. I need to list virtual compost to 150 There used to be a lot more used to be closer like 2,500 Dylan let's go Yep, Steven Zobeck base Kevin Parada nice base auto is coming out of here Rada and needle and a uh jump Very nice. Congrats on that There was this one time dude. I had a it was so random. I had like a Cooper cup spectra like 2019 like die cut number to like 50 for like $30 or something And some guy just kept like offering and offering and like messaging me He was like the last one went for 26 dot dot dot like 22 or whatever it was No, no, I just kept doing it and then he just kept like bugging me about it He would never put his offer up and he kept offering me He's like he's like I don't understand why you won't sell this to me And I'm like because I know someone's gonna bin it I know it and then like a couple days later someone bought it now So and then there was one time to Jackson Jackson holiday This was kind of like Messed up. I was like he kept sending me all the comps for it And I was like hey next time I'll call 911 if I want the comp police to come to my come to my door And that really set them off and then like a couple days later I uh, I sold it like for full price and I I sent him a screenshot of it. I'm like Here's your comps buddy. Here's your new comp Stop Justin. Thanks for the sub. Yeah, we have so many people that just annoy the But Jesus out of me Ivan Melendez Dylan Beavers and blue Jordan Sprinkle to 150 nice one there Sam trolls trolls Oh, yeah Yeah, I know you see like it was getting to the point where he was like He's like I can't believe you're not selling this man. It's like it's my car, dude I can do whatever I want with it right Right, exactly. It's so annoying. It's such a bad business tactics, dude.  I was just like, no There's samuels of all out of 499 Yeah, I know I'll pay when I'm ready those kind of people. Oh god Okay, actually since we're on the ebay talk is it wrong? Okay, let's say Pay for a card. There's a blue by the way. I missed this blue. You're in confidant 150 um You buy a card get the card it comes in God first another jase jung nice one there for the tigers on the first base Jase jung josh's little brother and there's like a crease in it that wasn't pictured It wasn't mentioned like and is it wrong to give that seller a negative feedback without Contacting yes, you kind of you gotta give them the you you have to like that's that's I won't say it's bad practice I mean everybody's a little bit different but I would contact them first and be like hey this came in damage like can we do a refund most people will Most people if you send them the picture and everything of how it was received most people will just be like yes We'll give you but if they one don't respond or two say no, then you give them I skip that stuff in the case when they get a feedback. Yeah, I would say always try to always try to contact them first Maybe just don't send the damage hurt. Yeah, but it might not be their fault. It might have been the males The way it was packed. I'm pretty sure it was this Like there was no damage to like the envelope. It was one of those like It's just like a plane. No, it was like a cardboard like I don't know what they're calling I know what you're talking about. It was like a tab to rip open. Donnie, what's your ebay? I'm gonna block you That's fine. Um But no, like it was it was in a car table and a penny sleeve no top loader. No nothing Yeah, big Then yeah, I mean I would still contact them and then if I'd give them like 48 hours and they don't respond Or they say no then I would negative them huge swanbin show I don't really care.  Exactly. Yeah, I would much rather like if someone ever does like if people contact me I'd much rather refund than then I'll get negative feedback Michael nor 2 4 99 I've had so many times where I've gotten neutral or negative and I've had to like I've had to like go to ebay to have it like removed or switched How does that even work?  Yeah. Yeah, I've got like almost 2k positive So it's not like a big deal at this point, but it's just annoying First Jacob Marcy chase my drop kenya huggins and dustin airs It's giving negative review for being a ravens fan fair What's up frank chase jung to 499 Uh for the tigers nice one there a lot of chase jung coming out of this chase jung case so far the show for show it's going to be a Green I believe yeah green and 99 Justin Campbell and chase the water for the guardians First William Kempner Eric Brown Henry Davis and the Evolpe true blue is ryan sermac 87 out of 150 going to the race nice one there in Tampa congrats.  I think there was a pager penata green And there was clark elliot like sky blue I think reinforced wares And nothing of like of note yet illegal and alvastka's first chase jung again a lot of chase jung man. Geez Guzman will medias Paper again, uh inception does break next definitely check that on out We want to kind of stay on this somewhat schedule we're on now Schedule's kind of been thrown out the window tonight Yeah bowman's good bowman's a lot of fun I mean like the firsts of like the big names go for a lot for sure Like the first autos first colored autos those are those are like In blue chip investments basically jet the met williams mood ring Farland first ryan ridder first gave the rincones first Samuel zavala and we've got purple drake bald wind going to the eight uh braves nice one there Atlanta Uh 164 out of 250 mood ring jet the met. Yeah mood rings are cool, man. I like mood rings They're clean Brooks Lee Probably dropping that like again guys two to go into visions breaking right after this marcello myer gold paper for the red sox Nice one there Teal lava coming up here. See what we got see what we got It's gonna be nice jackson holiday on the variation. Congrats on that Orioles. There you go. Alvin nice one there buddy on the photo variation Passiola first Scanzala zack nido and zardo teal lava alex bick farland going to the fillies 128 out of 199 Congrats on that fills Yeah, it's just a few more group rakes tonight with spots and section divisions next one We need to fill up coming up right after this At least I have it on Uh, they go after group breaks are over at night, uh tint Brenner Cox first I'm gonna say sox Brennan brayer like I know we're not gonna have a lot of time for personals tonight. I already know that We're probably not gonna finish till about after one um Tonight so we'll only be able to get to a few but uh should be able to get to most uh anything that doesn't go tonight We'll definitely go tomorrow morning. I mean tomorrow tomorrow night after group breaks It's winds auto. Let's see it michael They got a decent checklist They've been good the past couple uh bowmen. So that's quack true blue is alex mcfarland to 150 again oh and murphy More in cannon christian vicaro and base auto tyler schweitzer. Let's go into the white sox other schweitzer Base Oh, yeah pour a beer and turn on the world baseball classics. What we like to hear What we like to hear Hell yeah, dude I'm in on that for sure. Okay, two boxes to go everybody watch breaks. Absolutely Absolutely two to go and Yeah, there's enough time in between it trying to see It's all good Holiday legitimately does look like he's 15 It's a holiday in general. This looks like he's 15. He's married dude. He's 19. He's married Really? Yeah engaged at least Like nothing wrong with it. It's just great like for me being four years older than him like that's wild right Uh, yeah, you'll be first tonight clinton. Yeah, you'll be first tonight first of no shells James triantos like I'll make sure that we get yours done tonight for you dillon rey Or Bruin sends I think you gotta go world baseball classic pretty funny. Yeah, no problem clinton Sorry, it's been such a we just don't do personals on the main channel on sunday and monday Like sunday night and monday night since we're over on drip. So Um, a lot of times you order something on sunday. It won't break till tuesday. There's Nate Savino Uh to 250 But yeah, you'll go tonight for sure Frito jud the stud fabian nice one there for the orials. Congrats on that Bruins games are meaningless to the playoffs now pretty pretty much.  Oh, there it is. He's also in inception. I believe why is your green first? Robbie's smelling first green kenya huggins 52 out of 99 for the reds Nice one there harper with cincy Kenya huggins green Yeah, oh, yeah Cunha Kaden Wallace first manual rogerigas paper That is a sky blue paper to 499 averson artega giants Air apparent doing beavers Green mini diamond similes avala to 99 for the Padres Eson morville there's chariot and jared mckenzie nice one there on the first for the nationals base auto You're going to washington the nation's capital Noice ben joce Noice Yeah, the joice Purple kevin parada to uh, 250 paper Is joshua baez 275 for the cardinals Brady house and sterling tomsen going to the rocky's base auto a little bit of schmack on that We'll just wipe that off really quick little dust Lodge green Cole young first trish and beer lane Another base auto, you know what carl's doing his tuesday night. Oh, yeah World baseball class got one screen cocaine bear on the other person palm quests to uh, 199 paper Elite sports cards on the phone. Oh, yeah, watson michael kennedy first walter ford first and zack maxwell to 499 refractor auto for the reds Congrats against cincy I don't want to hear it Sick of you Sick of you More elites coming in elites very far close to sold out. I believe very far close to sold out Yeah, down to 11 down to 11 on that mosaic choice at six 20 on 10 bucks tuesday and two at inception So still just for group rocks group breaks, uh With spots tonight Yeah, dude Say if you give me those us hats Yeah, that kind of fire. I don't know. I don't love the world baseball classic hats Yeah, I would get a us one or a Dominican one What about a game war to a tony? I mean that'd be cool. I mean that's a completely different story And guys just two to go on bowman inception at random division style that is breaking right after this Division style. I'm not dropping that link when you're done. Yeah. Thank you It's uh, iven melendez. Nate savina jackson holiday refractor jackson joe Donnie's dropping you guys that link again just two to go Actually, we're down to one down just one to go Last swance the last spot mojo on some inception divisionals. You do click that link right there. There you go. Yeah last spot for inception, baby There we go. Thank you. Thank you took that spot. Let's see Just down to one Justin taking a few spots. That would be jacob. Uh g thank you jacob Appreciate you buddy See a lava jason sharia honey nut sharia to 199 first anthony hall Jason sharia again jake bennett first jash kozovich and brandon berrera. What's up, Jeremiah? How you doing buddy brandon berrera first for the blue jays Okay, sorry. We are a bit behind tonight The site really screwed us the site was down for like an hour so they could buy anything even if they wanted to Felt a couple breaks in the beginning of the shift as well.   Don't introduce any players around vaughn got no shoots stone beavers alan serda Jordan mauler refractor judd the stud fabian nice one there to 499 for the orials. Congrats, alvin I've been eating a lot of recently and it's it's bad because I make fun of forest all the time for it Landon sims No, no those are those i'm I just know for some like crazy Um, well, no force doesn't eat these a lot, but like he orders them at five guys grilled cheese. I've been making a lot of grilled cheeses lately. Yeah, there we go. le daylock roots to 150 I really go for a grilled cheese right now grilled cheeses are awesome. Oh, they're so good, dude There's like nothing bad.  It's a butter. I got there's willy vasquez put on skillet three year olds We are I don't care. I enjoy my grilled cheese. Yeah, I wouldn't care either. Walter ford first That is blue. Oh and murphy to 150 Oh and murphy I'm a i'm a i'm a butter guy. I I respect the the mayo because it crusts it really well, but um or crisps it really well I should say But uh, I just like the butter. It's just easy What christmas side Is it word? Yeah, there Put a little webster's need help on the baseball. Yeah, i'm a butter guy for sure It's like choice. Let's go. Justin's selling us out. Let's go, baby Whoo, you're gonna need help like who's good and everything just and I got you I got you first chanel simpson brannigan and cone and bergoya breaks whenever we get done with this Yeah, honestly random super easy to type out because it's just six names. So Be able to get right into it basically Yeah, I got you. I got you. No worries.  I can help you. Don't worry. It's all in the water first tanner showable First angel pins are kind of pre-lip to 4.99 of a jr richie to 75 for the braves first tray sweeney trio We got a redemption that is Uh class of 22 autograph gold refractor to mar johnson. Let's go last pack mojo for the pirates Pittsburgh is gonna be Anton H nice one there. Nice tomorrow. I'll be number 250. It'll be a color match as well and base Heck yeah, Anton. Let's go buddy Donnie's gonna get that one mag for it. Let's do a quick recap We'll be on to inception in just a minute here Christmas is canceled You're off to have your christmas dictated by if you pull something out of a bitterson brandon berrera Sterling thompson jared mackenzie judd fabian tyler schweitzer jace jung kevin parrata zack nito jace jung jack brannigan gabriel hughes refractors 4.99 judd fabian uh zack maxwell jacob miller trace gonzalez the andre smith colt phillips teal lava to 1.99 alex mcfarland jordan sprinkle blue to 150 oan murphy ryan sermac jordan sprinkle trevor martin green to 99 kenya huggins chase the lauder purples to 250 drake baldwin shon mclean alex mcfarland and mar johnson class of 22 autograph gold refractor parallel for pirates. That'll do it for the break guys Thanks again for the film next up inception


Modern explosives are very reliable, however, nothing is perfect. Occasionally when firing a blast and using explosives, a misfire may occur. Behind me you can see a stake that's painted green and it has a pink and black ribbon on it. That stake indicates an identified misfired hole. As required by the Mines Act in code, this misfire has been marked with a non-sparking material, i.e. a wooden stake, and then it's been barricaded by stakes around it at a distance of eight metres and that would be the stakes with the pink ribbon on them. Upon a misfire being identified, the blaster will notify the shift boss. The shift boss will then identify the misfire with the help of the blaster by placing the stakes that we've talked about and then the shift boss will then, for the information of oncoming shifters, will identify that information and record it in the shifter's logbook for a permanent record.


What's up guys? Welcome to Road to Riot. I'm your host Jeff and this is Learn to FPV. Learn to FPV is a series of videos aimed at the absolute beginner. So maybe you saw some guys out flying drones at a park or maybe you stumbled across some FPV videos on YouTube and it looks like something you really like to get into but you don't know where to start. You don't know how any of this stuff works. Well our goal with this series is to give you a clear and concise playlist that by the time you finish it you have a good understanding about all the different parts and pieces and components of flying a drone FPV and you have a clear idea of what your path into the hobby is going to be because FPV really is a hobby. It's not so much like a casual activity that you just pick up and you're doing in one day. So hopefully by the time you finish this you'll have all the knowledge that it takes. So here's what we're going to do. Every Friday we'll release three videos in this Learn to FPV series. So depending on when you stumble upon the series you'll either have at least three to watch or you can just binge watch the whole thing. And here's some of the topics that you can look forward to seeing. We're going to talk about how to get started. We'll cover all the different radios that are available. We'll do a video on each and every component that goes into a drone. We'll talk about the different goggles that are available and we'll talk about the different price points and features and which ones might be right for you. And along the way we'll also teach you about all the different terminology and acronyms that there are in FPV because FPV itself is an acronym. It stands for First Person View. But there's also VTX and RX and PDB and ESC and FC. So you learn about what all those are. We'll do an episode on what tools you're going to need once you if and when you do decide that you want to start building one of these. So definitely tune in to the next episode because that's what we're going to start talking about. Where do you get started? What's the what's the first purchases you should make? Which simulators you should look into getting? Should you go right into getting a micro right away? For you, maybe it makes sense to even go right into building a five inch drone with a GoPro on it. So tune in for that and this has been your introduction into the Learn to FPV series. I'm your host Jeff for Rotor Riot and thanks for watching.