Thank you everyone for coming in person and this is cool to see everyone together a lot of the talks in the Observability track have been virtual unfortunately. I hope it changes But I'm glad to get everyone together and and showing up and meeting and talking Today, I'm actually the titles a little misleading But this talk is going to be about Jaeger and we're going to dig into the Jaeger operator Which is a really cool piece of technology that's part of the project And then we're going to talk about some of the metrics work that's been going on in Jaeger The first part of the talk about the operator Joe Elliott actually put the slides together and he was unable to make it last minute He's one of the maintainers as well He's over at Grafana labs and he's the person responsible for tempo for those of you that are maybe using that He's a great engineer. Sorry. He's not with us today My name is Jonah Cowell. I'm the CTO at logs. I owe I do a lot of work on Jaeger open telemetry and open search Which is the new open source fork of elastic search And I'm happy to be here when I'm not working at the Computer or maybe playing a little video games. I spend a lot of time underwater It's been nice and COVID because you're very isolated that way So I do a lot of diving. That's my passion for the last several years and Explore a lot of cool places where I live in South Florida and all over the world so If you want to talk diving, that's definitely another thing besides observability that I like to talk about and My company is a SAS observability company. There are many out there. I can see many of you representing other ones We focus on an open source space platform and Jaeger is part of our platform So it's the same UI the same usability with a bunch of other stuff around it And Jaeger is a is a great CNCF project. It's been graduated for quite some time For those of you that are not familiar with Jaeger it's And you're maybe using open telemetry or looking at it the collector component of Jaeger Was actually forked to create the open telemetry collector And we're starting to bring some of that back into Jaeger and we're essentially going to just be consuming upstream collector and that's the plan so Jaeger is basically a storage format and a UI and a bunch of other pieces around it in order to scale it out But in general we Build things in a very different way. They're very Componentized it's designed to run on Kubernetes And this is something that uber created many years ago and open sourced donated to CNCF Yuri the gentleman who created Jaeger and uber has a great book on distributed tracing Many of you have probably read it. It's very helpful even though the examples are open tracing they're still very similar to open telemetry and Those that are not familiar I'll just give you a really quick rundown of what you're looking at here This is a trace and in the trace. There's a bunch of Different transactions that are occurring here So we can look at the different spans which are each of these little segments and how much time they're taking and Then we can look at the end-to-end trace. How much time that's taking are their errors Are there other things that are going on and you can drill down into these there are tags that are added that show You different information In the example here that my sequel call you can see the database query how long it took whether there were issues, so It's a really useful tool And it can take data in a lot of different ways and allow you to analyze The trace data it's very focused on debugging. So when you compare it to a p.m. Tools This is very much a tool that people use to debug problems or understand what's happening Not really monitoring as much and I'll talk about that on the second half of the presentation When we talk about metrics because that's really what it's going to make Yeager More of a monitoring tool and less of just a debugging tool like it is today So the operator is a really cool piece of technology That that has been evolving a lot over the last year Jp or jirasi depending on how well you know him is Is the gentleman responsible for this he was previously an engineer red hat He recently joined garfana labs And he did a lot of work on the operator does some really cool things and i'm going to show you how You can use this on your laptop to do Set up yeager and start using it And even how you can use the operator to scale out and operate kubernetes in a large distributed environment The operator is designed to do all of those things Here's a link to it To the docs which are also really good and comprehensive and explain everything in depth So a lot of work went into this And thanks to the folks at red hat who are big into the operator model That basically want everything to be deployed this way. I think it's the right type of Model to use with kubernetes. You've heard about it a lot this week. And I think it's It's really important for the ecosystem to adopt this way of Deploying and running things I'm definitely a fan So We're going to go through a bunch of different pieces. How do I basically do Deployments configuration scale out and even talk about agents and sampling And autoscaling so keep in mind that some of the things that we're going over here specific like the instrumentation libraries Open telemetry is going to be the standard yeager had its own libraries before but open telemetry is basically going to replace all of that Something that's currently being discussed A lot of people do use the yeager libraries and their applications And they're still supported We're just using hotel in the future similar to people that maybe used open tracing before Open tracing is being deprecated. There's nothing new going into it. All the work is an hotel But that doesn't mean that the hotel collector Will not accept open tracing data it does and it will continue to do so And this is the challenge with instrumentation is that as new things come Whether we decide to replace them or not we have to figure out what we do with that data in those formats. It's it's tricky So anyways to the operator Basically to Get up and running Cube cuddle create. This is essentially how you get a yeager system up and running So a couple things to keep in mind the logs are very useful when you're getting this up and running um, and also It will watch specific namespaces to deploy new New instances essentially If you leave it blank it will deploy on every namespace or you can specify certain namespaces as well So it's up to you depending on how you're deploying this if you're testing it In your test environment or on your laptop. Just leave it blank and it'll Deploy everywhere essentially So, uh crd, uh, you essentially define What you want to do with yeager and there are three strategies that are defined in the operator There's all in one production and streaming and i'm going to explain the difference between them And you specify the strategy uh in your resource definition and this tells the operator What to deploy configure setup and how to scale it So So the really basic way of deploying yeager on your desktop laptop, whatnot is basically a single binary um, so this includes, uh, the the application well So the single binary is the centerpiece the yeager single binary The other piece is around it. It needs a data store a place to store information And then data comes from your application Instrumented with the client and goes to a yeager agent The yeager agent is sometimes optional depending on how you're setting it up And then the single yeager binary includes everything that you need for the user interface For the data ingestion for the storage and then a database And i'll explain what the database is and such this is the really simple deployment the all in one version of that The second and you'll use this on your laptop if you want to test it out start playing around The second one is production Which includes everything except for the green box which says streaming and i'll explain streaming after And so what this means is now we're starting to deploy a collector And the collector allows us to scale out the way the data ingestion comes in So you can think of this as a way to Essentially support more yeager agents more infrastructure that is sending trace data And we're going to talk more about the back end database and about kafka and how those work in the production mode because there are options for those Uh yeager query is also a service that helps scale out the ui. So when you're running in production It's a microservice that's also deployed and managed The operator does work for all of this stuff basically to deploy it to scale it and to manage it It's very powerful and i'll show you some examples of how that works So today when you decide What you're going to run yeager on there are two options today in the operator One is elastic search and the other is kassandra The operator will handle deploying those and being able to scale them out. So it's actually quite comprehensive What the options are You can also point this at another cluster if let's say in your organization, you've got a big elastic search cluster You can just point it at a url instead of deploying that but the operator will deploy that as well So, uh, we do support open search, which is the apache 2 version of elastic search It's not in the operator yet. It would be trivial to add it We'll see right now red hat hasn't decided whether they want to Switch to open search just because they they do keep things apache 2 in their Code base. So we'll see what happens with that The other option is or the other piece is Is deploying kafka? kafka gives you the ability to deal with back pressure on the database So anyone that's running big elastic search clusters, you're already running kafka because there's essentially no other way to scale it well Uh, and so in the streaming strategy or configuration It will deploy kafka You can use various topics as well if you want to separate and manage the data effectively And this allows you to deal with Bursts of data coming in that maybe your back end can't deal with kafka will cue them The other thing that kafka can be used for is to do some stream Analysis and there's been some nice little experimental projects that are in one of our repos in the yager org Of people that have built kafka streams and spark streaming type of analytics on the trace data None of it's really well baked, but some of it came from uber and other companies that do that type of analysis We built something similar in kafka streams that does some of our streaming analysis We have an open sourced all of it, but we're we're going to do that soon It's definitely in the plan So kafka something that you're going to want to deal with if you're running a bigger cluster Or you have other use cases there But the operator will do that So to give you kind of an idea of how this works the nice thing about yager is that each of the components because it's all in go It's just command line arguments So the operator is basically passing in the right command line arguments for what you're trying to deploy So some examples here and we can we can specify a lot of this on the command line This basically is an example of us deploying Uh, you know, it it essentially does all the configuration and passes the command line arguments in For you by running the operator so that you don't have to deal with this all yourself Which is what happens when you run it on your own So it's definitely gives you a lot of options and makes it easily scalable in in a kubernetes environment and uh The other thing to note is that if you decide to pass in other command line parameters So in this case the example is There are there's blurg and blarg that are basically being specified in the crd here And you'll notice down at the bottom when the command line is run Unknown flag blur dot blarg it actually just passes all of those parameters in So if you feel like passing a different parameter in to one of the yager components The operator will just essentially run that in the command line So it gives you a lot of flexibility to do custom things On top of what the operator already supports So the crd just makes it really easy to manage the config and roll this out consistently Uh, it's definitely uh pretty powerful in terms of what you can do with it So the other thing to think about is the agents and in yager The agent is essentially something that the instrumentation talks to So in the open telemetry, uh world, it's It's essentially a collector In yager, we actually have two different things We have an agent and a collector in open telemetry the collector can be an agent or it can be a collector That was kind of part of the design of open telemetry was to have that same binary be flexible for both use cases So when you decide to deploy your agent as a sidecar in the operator What this means is that for every node that's running an application An agent is going to go there There's going to be centralized collector that the agents all talk to this is one option that people use Uh, and i'll show you the other options for for agent deployment that the Operator supports. So this is one way Uh, this way is kind of better because it's more segmented with each of the applications that you're deploying In uh in kubernetes The second way to do it is with a daemon set. This is another option where you have a single agent for multiple applications Now the challenge here is that you can overload the agent And you may have different teams deploying applications That would talk to a single agent and the config and and just managing that may be difficult depending on your configuration And how your teams work Um, and then those get sent onto a collector. So these are basically the options For agent strategy deployment that are in the operator The other interesting thing that yeager has which is almost an open telemetry I saw some actually commits go in this morning Is this idea of remote sampling uh in sampling is a big area of discussion in tracing and an open telemetry What remote sampling is is it's actually pretty unique It's something that they built at uber for their specific use cases around the volume of data that they were dealing with So today most of the sampling happens at the collector So the traces come in and the collector decides whether it's going to send those on to your back end The challenge is that all of that data is still going over your network And if your collector isn't really close to your infrastructure that could cause other contention or cost if you're running in the cloud With remote sampling the instrumentation library actually is able to read a file or get a signal To change its sampling strategy in real time And so because that's happening in the instrumentation You can eliminate the fact that the instrumentation is even going to send trace data or not And there's a lot of really great use cases for this. I'll give you a good hypothetical Let's say uh in general I want to get one percent of my trace data. So I'm I'm sampling But when there's a problem, I want to get 50% of my trace data so that I can debug better with remote sampling I can send a signal that says change your sampling strategy And then I can get more data temporarily. So this feature is really powerful. It's it's almost an open telemetry The challenge is that the libraries have to implement it also So we have to go in the go instrumentation and support remote sampling not just the collector So there's still work to do here So one of the and the other thing is with open telemetry is it does tail based sampling Which the jager agent only does head based sampling. So hotel is more sophisticated for sampling strategies Uh, here are some examples of uh of sampling strategies Using both using basically the probabilistic, which is the basic type of sampler And you can specify different types of sampling for each service Depending on what you want to capture and what you want to discard And you can put this all in the crd. It gets passed in To the rest of the jager deployment So it's really powerful in terms of Configuring everything together as a crd, which has a lot of benefits So the other thing that the operator supports is auto scaling and scaling the collectors and ingestors, which is really useful as well how many of the Collectors do I want to potentially scale to? and you can also Extend this on your own and maybe use a metric for auto scaling And I'll talk about the metrics that Jager supports because it exposes a lot of data and prometheus that you can scrape And then you can use that as part of your auto scaling as well So there's a lot of options here in the operator To to do the auto scaling for you Defined once again in the same crd. So it gives you one nice place to keep all of your config as code Which is really handy So I mentioned the storage You know that supported Kafka and elastic search And monitoring jager itself With prometheus is also easy. We expose a lot of metrics that you can easily scrape So a lot of folks are are doing that and it helps operationalize jager for sure So there's also a bunch of other pieces that the operator can do that I'm not going to dig into because they're even more advanced use cases But here's a few example examples of them in kassandra. It can create schemas There's a lot of index management and elastic search where jager will actually do the whole life cycle management of indices for you And then there's all kinds of other things that You know that this can do and of course open shift support That's the main reason that red hat contributed all the work into the operator Because they're big into that And there's lots of things that you can do with this operator as well. So it's It's worth checking out. It's worth using even if you're just starting to play with jager on your machine It's definitely a good way to do that and it helps You see the power of operators because I think that's the future and if you listen to the keynotes That's clearly kind of where the foundation is taking things. I think So the other pieces is the logs are very useful As I said, it exposes open metrics. You can scrape with prometheus or any other Open metrics compatible format And then and then you can also get traces off of jager, of course So Uh, I did want to spend a couple of minutes talking about metrics and this is really how we move jager from being a debugging tool To a monitoring tool Is really introducing and integrating metrics uh, so Most of you that have used an apm tool or or other products that call themselves that It's because they use traces and they also use metrics together And this allows you to do things like monitoring alerting Capacity planning other types of planning when I deploy something new How is it going to trend? What's going to happen in my environment? This is really the difference between Distributed tracing and monitoring tools like apm tools Um, so we built uh recently over the last several months A new capability we call atm or aggregated trace metrics And what this is is there's a couple of pieces to it One is an open telemetry. There's uh, uh, a span metrics processor And in this processor when traces come in the little diagram over to the right traces come in We then are able to look at those traces And derive metrics from the traces That then you you send to a any type of matrix back end So whether you're using prometheus or you're using a commercial tool Anything in open telemetry can take those metrics from that trace processor And then the traces continue on to your tracing back end So the most common use case is If I want to use all open source is i'm going to send my metrics to prometheus And i'm going to send my traces to jager as an example And uh, and so this allows us to create all kinds of metrics off of the trace data And i'll give you some examples and and show you what that what that does So in the configuration for open telemetry This is an example config We basically specify the histogram buckets that we want to create Inside of prometheus And uh, and we can define definitions. There's a bunch of examples in the code base The challenge is that it can create a lot of metrics depending on cardinality that you define Most commonly we do status code based so Okay versus errors versus You know redirects and other things like that and then you have all the histogram buckets and prometheus to do that Down at the bottom is an example of how you would use that together So using jager and prometheus together. This is basically a simple config Of the pipeline so how that's all set up in open telemetry And the code in github is down at the bottom as well. It's part of the collector So once I have this data, I can do all kinds of cool things Here's a screenshot from grafana showing the histogram buckets the performance of all my traces And uh, and we basically are calculating The request the request per second or the request time the latency the errors So it allows you to do a lot of different monitoring use cases and gives you real visibility into it We also added a view into jager to query these metrics and I'll show you that in a second And that supports anything that's prom ql compatible So in jager whatever supports prom ql You can point it there and it will query those metrics and bring them into the ui and I'll show you how that looks The community can add other things but We use m3 db in my organization and prometheus of course But it'll work fine with cortex or cortex based systems and of course Thanos timescale db whatever else is prom ql compatible If you listen to the talk yesterday about compatibility It does matter whether things support prom ql the right way So naturally it it does have to support the right type of query language for it to work But if someone wants to contribute a You know the ability for this to work with another Another metric system. That's fine. We'll definitely take any prs in the project And so we have a new this is actually a pending pr right now in jager ui As there's a new monitor tab in the ui And this allows you to visualize this data so You know latency response time error rates the trending of those And then some views this is kind of the first step. I think for jager Obviously would be nice if we Built alert manager visibility into jager and really created more monitoring capabilities Really to move jager from a just a distributed tracing system into more of a an operational monitoring tool and debugging tool So that's kind of What we put together, definitely check out the docs come visit us in slack And we're always posting blogs and if you have blogs or cool ideas that you want to post on our medium Just let us know. We're always looking for new content and ideas And I think that is about it. I'm open for questions here. I'll repeat them for those of you that are listening online And I will also bring up the slack and the online thing so that we can Make sure to include everyone. So if there's any questions, please Raise your hand And sure So the question was I talked about the scalability of jager Is there any questions about the scalability of the atm component that's inside open telemetry? So one of the challenges with with anything that's doing sampling or calculation is that you're going to get It's it's tricky because you're going to be somewhat limited based on where the traces are going So let's say you have 10 different collectors that are calculating metrics You're going to have 10 different sets of metrics in prometheus But if you roll those up, so let's say I put the collector name in the metric path I can then use it without the collector name And get the aggregate of that data So the idea and that's what's nice about prometheus is that you can aggregate data up a level from where you are And if you decide that maybe I don't want a service I mean, maybe I don't want a microservice level view and I want to move a level up and look at a Let's say a pod level view or a kubernetes You know construct you can use all different kinds of things in the metric path. So it gives you a lot of flexibility In terms of scalability, we haven't really posted numbers on it But we put a lot of metrics through it like To the point where it got prohibitively expensive and we actually tuned it down So it can definitely create a lot of metrics. I'm not really worried about that But so hopefully that answers it I'm going to take one online, which is can yeager work in a multi cluster environment? Uh, so yeah, definitely. I mean yeager is a microservice is architecture. It's scalable. There's no real issues around that If you have different storage back ends yeager doesn't work across separate clusters of elastic search or Cassandra, for example, so you should scale those out Which presents its own set of challenges because they're not the easiest things to scale out but um It does work well, uh, but it only supports basically one back end because of the way that the That the product really works today or the project really works today Um over there cool So i'm gonna try to rephrase the question and hopefully still get it. Uh Can you combine the remote sampling with other types of sampling? Is that kind of what you were getting at? An attribute sorry Yeah So you can build sampling and sorry i'm sorry for people online. I'm trying to to rephrase it, but uh You can you can combine different things in the sampling strategy so you can use tags you can use any type of part of the Transaction itself to create a sampling strategy and do sampling and filtering the challenge is with remote sampling is that We haven't implemented all the way in hotel But it will go that way because there are customers or sorry They're not customers there are users using the jager libraries that support that and they want that feature Including companies like uber that created it they they need it And they want to go to hotel so the only path they have forward is is for that to happen So it will be supported you will be able to combine them together But it might give you weird results depending on what your goals are Combining remote sampling and centralized sampling There was a a working group an hotel on sampling. It's Not that active anymore, but it's still an interesting topic for sure Let me take one for online Uh So, uh a talk from the speaker In the next session bartek asks, uh, I wonder does permissi does prometheus aggregator for trace data In hotel also populate exemplars. That's a really good question. The answer is no Uh, I don't believe that there's good exemplar support and open telemetry yet or maybe I just haven't seen it But if uh, if that's there, uh, that would definitely be an option for enhancement And exemplars for those of you that are not familiar a really powerful prometheus feature or open metrics feature. Sorry That allows you to specify an example trace or log with a metric And that allows you to move from a metric to an example of something that matches the metric So it gives you a lot of context when you're troubleshooting to use exemplars A really powerful thing for sure Um, I'll take another one for the live audience. I'm trying to go back and forth. Uh, sure Oh Sure So the question is does the operator Work with service mesh like istio and in that case Do you not want to use the agent? Uh So I've seen users Use the built in instrumentation for istio the challenges unless you instrument the code the traces are very They're not much better than logs put it that way And the issue is that the data being generated from service meshes It's not going to create an end-to-end transaction. You're just going to see what the service mesh is doing So you do need to instrument your code and if you and there's auto instrumentation If you don't want to make code changes for many languages And that's a good option But you do have to instrument your code and therefore you need a collector and an agent in the case of yeager So there's no way around it if you want meaningful traces like the example that I that I showed you And we've I've had End users at my company that have done that and they say why is the trace data so boring It's like the same as a log message and I said, well, you've got to instrument the code Or we're just going to see what the service mesh is doing So there's no shortcut unfortunately with service meshes and proxies and that kind of thing so Yeah, sure I'll take one online. I'm just kind of picking the top voted one Oh, that was the top voted one. So the next one down Uh, what's the expected memory or cpu footprint of running agents's sidecars So the cpu is going to depend on the throughput of what you're sending through the agent similar to the collector But the footprint on the memory side should be very small. It's a go binary It doesn't do much. It's actually not a super complex piece of technology at all Similarly, if you decide to use open telemetry in that way, um You can run a stripped down collector that doesn't have all the exporters and other things in there There's a custom builder for open telemetry that lets you build your own Distribution essentially it's really simple to use Uh, and then you can create a really small collector And it shouldn't be using much in terms of uh resources Beyond what you're sending through it, which is obviously the the processing power that's that's really required there um Another question live anyone And I know i'm kind of running out of time, but all right you can go again Yeah, sure So the question was that if you're running it across multiple regions and you have multiple elastic search clusters The thing I said it doesn't support we don't really query across them So you would have a single yeager ui instance for each Region and you can't really search across them So unfortunately the answer today is we don't support it. Uh, it could definitely be built But it would be pretty hard to federate those queries and make the ui work the right way Uh There are there is work going on in open search to to to do a multi cluster query It's actually was just released recently in open search And so you'll have some capabilities there, but it's uh It's not something that's supported in the yeager ui Someone could contribute it, but I would guess that's a pretty big feature to build Um And I don't really have a good recommendation around it My company we do something differently where we allow you to create Different sub accounts that that point to different clusters and indexes And we can search across those but we built a whole bunch of abstraction To make that happen. It's part of our platform Um, but it would be really hard to contribute that because it's It's uh, it changes the way that all the back end works basically Um, but if you want to contribute something like that, then you know by all means, I think it would be a cool feature Uh, there may already be an open issue on it, but Feel free to suggest it in the channel and if it's something that you're looking for So, uh, I mean, I'll keep going till someone cuts me off. I'm over though Well, I think bartek's talk is uh, is starting actually. There's a little bit of time I'll answer one more before I call it. Um So here's a good one because I like app decks, uh, can yeager. Sorry Okay, this is the last one Can yeager, uh plus atm generate app deck scores So app decks is an interesting way of trying to summarize user frustration or how well your application is performing It's not something that's supported, but it could easily be added to the to the uh, to the metrics processor that's there or you could Actually make a different A different one to do that. So it's a good idea. I think, uh, but not something that's supported today Um, and so I'm gonna wrap it up, but thanks for attending and it's good to see everyone again Uh and uh come and join us in the yeager channel Uh and appreciate everyone showing up. Thanks again


Do you feel that spiritual men are better in bed than somebody who's not Necessarily a spiritual guy who's maybe science-based What's going on everybody I am popping in to let you know that this video is sponsored by Squarespace from websites to online stores to marketing tools and analytics Squarespace is the all-in-one platform to build a powerful Beautiful online presence today and run that business you've been wanting to start So if you haven't checked them out go over to Squarespace comm slash shan booty and start playing around for free And when you're ready to launch just go to Squarespace comm slash shan booty and give that business a shot Now back to the video. What's going on? What up my god, dude? It's always it puts a smile on my face every time I see you, you know like you I was talking to Shan you know the other day when we went to Turks and Caicos and I had watched the season when I didn't go right? I had watched the season I was like, yo, this guy is cool like this guy's dope because it's Wild for me to say that because usually I'm so I'm like repelled from people who are super spiritual, you know, like there's a part of me That's like, oh, we probably wouldn't connect or there's a part of me That's like, oh, you know what like I'm not really into those things So we might not be able to get it get along but then when I was watching you on the show on too hot to handle I was like this guy's cool like this guy's dope. And so when we went out there the second time I was like telling her like I can't wait to meet really I'm super hyped to hang out with him and stuff and and She was like, yeah, he's like really cool And I thought it was crazy for her to say that because she's the same as me when it comes to that So I was like, oh, I already know we're gonna be cool. So yeah, it was just something that I thought of I have a question for you that I think This audience would would love to know And I could be barking up the wrong tree here, but Do you feel that spiritual men are better in bed than somebody who's not Necessarily a spiritual guy who's maybe science-based. Mmm. I Definitely have a bias towards this Spiritual man, but I wouldn't say like as a full-on term Spiritual men and like generalizing it I would say men who are aware and to work on themselves are better lovers in the bed Oh, yeah, like in that kind of way and if you call that spirituality, then that's what spirituality because for me It's like me knowing myself deeper.  Yeah, you know Or could you go selfish like I know myself so well, I only get off this way. We're only doing this Another buzzword it comes another thing. Yeah, it's like I feel like if we're gonna use your terminology are spiritual and better lovers Yeah, I would say yes. Yeah, I I agree with you I agree with you 1,000% because I was thinking about this the other day Because I knew you was coming over and I knew I ultimately wanted to talk to you about How to be a better lover in the bedroom hence this audience really mainly because I feel like they're so interested in sex Relationship and intimacy, so I wanted to bring in how do we talk about spirits or spiritual world in those veins, right and I was thinking to myself our spiritual men better at sex then Somebody who's not into that type of world, right and I instantly went to yes But then I was like oh wait, wait a minute Somebody who studies the anatomy and is very science-based and knows what spots to hit and knows where to go You know, would they be better? Maybe because they have more tools Then I thought to myself do I think that I'm a good lover and I would say yes I mean it might be conceded, but I think I think I am I think I'm a really good lover And I try to think what makes me a really good lover because I at the time don't consider myself a very spiritual guy and then I was thinking about all the things that made me good, you know I think about connection. I think about, you know Being present and doing things in the moment. I think about, you know Being able to be intuitive and and listening and and all those things all those phrases that I think of Sound very spirit-based. That's actually tantric. Yeah Yeah, exactly. So and I think about moves that I do that I think are you know Haymakers or should I say, you know, I used to do this thing where If I'm like in missionary like I'll take my hands like my my hands and I'll put them around shans like Forehead temple area and I'll grip her head and I'll look into her eyes And then in my mind as we're having sex. I'm thinking about like The center of my palms Sending every loving thing that I think about shan into her brain. Mm-hmm. If you're science-based That you wouldn't do that. Yeah, that's not something you would do, right? You know what I mean? And that and I was thinking myself like that's very spiritual. Yeah Maybe I am a spiritual guy.  You actually are Yeah, I think it's too with some and I we've we've chatted about this many times You know, yeah, and it's for me personally in my life where I'm at today I I have beautiful Experienced with people who are connected to their heart. Mm-hmm. Anybody who's connected to their heart to me is a spiritual person Yeah, so I feel you are even when we're on the island and I'm saying and like we had them mushroom chocolates Yeah, I'm saying like you went out to the ocean and swam all day. Yeah, you're connected Yeah, so you are that but that experience that you're talking about like that to me That is a spiritual experience because in society too with when it comes to men We're taught about penetrative sex. Yeah, and this is We start porn from a young age and we just see the Yeah, it's you know, very simple.  I have a couple friends who are in the industry and they say a lot of those positions Are for the camera only. Yeah, it's just so the best visual best visual But is it having like a beautiful euphoric intimate experience where they orgasm just from you you put in their hand in their head Yeah, absolutely not. Yeah, so interesting because yeah, like I think about some of my earliest earliest Experiences with sex was definitely derived from porn.  You looked like a painter you look like you were so focused on My body and you were so focused on Trying to learn it and figuring out what it likes and what it wanted to do that it didn't feel like The positions that we got into were rehearsed. It didn't feel like the times that we had sex was like a dance count It felt like you were in the moment in moving with me as like a dance and so for me. I think that spiritual men have Way better sex. I Firmly believe spiritual men make love in a different way. Yeah, and because those cues like those things It's like that like that's the foreplay. Yeah, like this is actually like the thing about like like Tantra and and when we're exploring It's there's no end goal. So let's say you being Picasso and I'm on being a painter It's like a painter really doesn't have like it doesn't have like a finished product in regards to their mind They just start and keep going until they get the feeling. Yeah that we're done Yeah, so when it comes to love making in sex to me, it's the same thing So what I teach my guys in Tantra when they're with a partner, it's that there's there's no end goal Like there's like men we like to tick boxes. Yeah, okay? Blow job. Yeah. Yeah. Yeah now this and then yeah, yeah So we're going into the space fully curious. Yeah open to the moment Yeah, and and even taking a step further even working with guys and I do this myself Yeah, it's there is a difference between orgasm and ejaculation and this is actually a big thing So most men just think biological ejaculation coming. Yeah, is Orgasm it is but you can also separate that based on practices where you can experience those orgasmic moments without releasing your fluid How does that work? I want to learn this So you you can orgasm without ejaculating and then it's possible. It takes work practices to get in that space So when we ejaculate as men, it's actually like a biological thing like we're releasing our muscles Or the best body are coming out of us to go in hopes of procreation. Yeah, so When it comes to Orgasm, it's like another feeling right when you're about to come. Yeah, that feeling that goes up your spine Yeah, yeah, yeah, yeah, that's the orgasm feeling. So do you stop that's the spot where you can keep Experiencing that feeling how over and over and over again when you're in the space with the lover How do you do this? How do you do this because I like that feeling so That's why I learned it so I mentioned this on the potty would yeah, and Shannon was like first time I ever experienced this feeling was when I was doing breath Work. Yeah, you know, I got to a moment of like minute 26 breathing Yeah And the next thing you know, I was just like my body was convulsing and then like I felt like I thought I literally Come to my pants and I touched myself and it was dry. What I was like Yeah, yeah, and so I was I was already intrigued by there Yeah, and that started my journey on on getting into these practices of being able to separate Ejaculation from orgasm and we can do it just by breath or getting deep into like breath work and let's say there's a practice called edging Yeah, oh, I'm an edger.  Yeah, you know what edging is. Yeah, I'm an edger. Oh, yeah I'm that's what I'm into like that's like my kink. I'm an edger. Yeah Do you do it alone as well? No, not so much but when I'm alone. It's a it's like kind of like a Utilitarian like I'm just kind of like getting in and getting out Yeah, yeah, I'm kind of like and I'm in I'm on a mission when I'm alone You know, but if I'm having sex like my preferred way of having sex is getting like I like when Shang gets me so close to coming Then stops. Yes. That's like my preferred and I like to do that over and over again Yeah, until it's actually time for me to release So this is exact you just six so what you just explained This is the practice you can do to literally experience more organ so like you know when you get to that space of like almost coming Yeah, in that moment right there you deep in your breath. Oh deep when your breath in your moment Are you able to still stroke though? Absolutely. Well depends on you as well because let's say it just feels so good You might go over the edge. Yeah, I'm too distracted. I can't breathe right now Yeah, but if you actually breathe it you expand that feeling and you prolong it Yeah, so a lot of times when I'm in that space with with a lover like I'm breathing and I start feeling that feeling I And it doesn't but what if see okay, I have so many questions So for me, bro when I get to that space like I have to completely stop or I'll go for that edge And so you speak you know and if I go like I just imagine myself Okay, let me just focus on breath, but like I'm an audio guy as well Yeah, so like if I'm hearing myself breathe or hear it Like I that will get me there too. So I I don't know if I could be this I don't know if I could do it Because I get like the audio gets me to yeah Yeah, yeah, I'm just like I don't know if I could do it Yeah, so that's why the edging on your own really helps because it actually it helps you be more in control of that situation So doing practices like with your perineum like actual like some male kegels Like we're actually like say like you're driving here and like you're at a red light Yeah, like literally you can have your you can start squeezing your perineum that muscle that's underneath your balls I can't reach area and you just squeezing it squeezing it gently like you're just doing these contractions Yeah, that strengthens the muscle down there because we use that when we hold So if you're about to come you squeeze that part.  Yeah, there's a kidney spot there I did you know it going to what you're saying right now. I did read that like men hold their This is a completely size side fact, but men hold their their stress in their feet Yeah, and women hold their stress in their hips So that I was I was on something there, huh? Yeah. Oh A lot of issues come down from from the foot actually Interesting and in regards to love making to what's important because let's say Shan knows you I've been an intimate space so many times She knows when to stop so you don't go over the edge. Yeah, you know why tell her Whoa But I would love to get to that space with her like where I don't even have to say And that's that's actually the tantric piece so like when it comes like tantra massage and other stuff It's like what yourself practicing you come together in the space She gets to know your impulses because let's say even before you got to say it She'd say she'll feel you throbbing in a way that she knows she recognizes. Yeah, because the edging practice alone Why is so important because let's say one is like soft flaccid penis 10 is like super hard You just ejaculated. Yeah. Yeah, so realistically like we want to be between like a six and a seven Okay on that scale to experience this orgasm thing that I'm talking about So it's like and you you it's arbitrary, but you know what's like a six or seven for you Yeah, yeah, you get to that space because I know what an eight feels like once I go to an eight There's no going back. Yeah Yeah, like I can't turn right like I'm here. Yeah, I'm right here right now.  Let me think of it.  Yes Yeah, do you practice that at all? I do practice semen retention. Yeah, how how Is there a healthy way to do it because I remember I thought about doing it, right? um, I Saw someone speaking about it and he was talking about it as a life force And like the protein and the actual nutrients that are in Semen and and why you would want to keep as much as that as possible And I remember being very intrigued because the way he was talking about it was like Oh that makes sense And I kind of started thinking about it and I was sort of looking up and doing research and then like I saw a stat that was like You're like 50 percent more likely to get a testicular cancer You like risk yourself up and I was like, oh I'm gonna keep coming Keep letting it out. Uh, I want my life force outside of me now But I don't know how true that fact actually was. Um, but yeah, that was what turned me away But now I am I've had a vasectomy. Yeah, so like am I like now unwilling or Unvoluntarily having semen retention happening, right?  Okay. Okay. It's just you know, you just have an empty cartridge I didn't know. Well, no, I still develop I still Like everything works the same basically what's What I got was like there's clamps On the tubes that the travels through you didn't get the sniff sniff. No, no, I ain't gonna have Yeah, yeah. Yeah. No, no. Well, not even that. I just I just wanted to still Have all my parts, you know So I got the one that was just like there's clamps. Um, and we'll do a full video on the vasectomy But there's clamps that essentially stop the semen from Coming through I still ejaculate, but there's just no swimmers in it. Amazing. Yeah You still have the same feeling and everything is going the same feeling everything yet. No, nothing has changed. There's just literally Where the the actual swimmers come through or he's like it's like blocked So Am I technology am I am I am I keeping my life for us and actually the doctor told me That back in the day Warriors would do this technique When they went to war Yeah, because they believed that it made them stronger. Wait, so seamer attention Well, no, they got the the clamps the clamps. Ah, yeah, and he said that they believed that um I don't know if it was clamps, but they got a vasectomy in some some capacity But they believed that going to war It would make them stronger because now they're not ejaculating the actual Yeah, well think about like like I don't know too much about it in depth But I I lived in In oklahoma for like five years when I went to university and like bull riding is a thing out there Oh, I've heard and I and I've also had friends who were bull riders and ball players They also said that at times they would put like clamps or like rubber bands or something equivalent around the bulls Yeah testicles before they opened the stable before you go Yeah, yeah, and that would like rattle him up. Yeah, I can see there's might be something to that. Yeah. Yeah, he's like Yeah, yeah, he's ready to go like anything Yeah, those cowboys up. Yeah, but it's like when it comes to what seamer attention I still feel like the same applies to you even if you got the clamp because you're still releasing the fluid Yeah, and that's the stuff that has the magic Yeah, and but also like I'm the same way too because I'm like I believe fully like if you don't use it You lose it. Yeah, so I'm not going to do a seamer attention for for months on end. Yeah There there's a big no-fap movement that happens and what's that? No f.a.p Um, and no fap is like something that guys do cold turkey when they just say I'm going to stop Um, ejaculate and they do it with a really like science-based aggressive kind of way. Yeah For me, I don't really get down with that for me. It's more of like I do it more in a graceful way So in Taoism Taoism tantra is amazing like because they were doing this thousands of years ago Actually had a full-on formula about like how to What what actual practice Taoism is not like it's not a religion. It's more of like a how-to Culture. Yeah, I really loved about that. You would love like a lot of their principles And they had this thing where it's like this scale in regards and it's it's also it's real But it's also arbitrary too. It's let's say like based on your age age rings. Let's say for me Um, I'm 35. Yeah, so it's like a 35 man to a 40 year old man You should ejaculate once every 14 days, you know like say if and for me Let's say it's between seven and 10 days now And when I do it and that gives my body enough time just to like regroup and recenter and come back But within that 10 days I can actually still have orgasm and still have sex just be clear and that I'm not going to ejaculate Because think about what's the running joke of culture with men.  She's ready to go to bed.  I'm ready to go do something. I'm ready to go work on something I'm ready to go create something and so I that was the other part of me that was like, I don't know if I Want to do the semen retention because like I I genuinely Get a burst of energy. Yeah after I after our orgasm But who knows maybe there's a there's a science in like if you wait And then you ejaculate at 14 days or whatever the recommended was that you get an extreme creativity You know, I don't know it's it's the in between that you feel the recharge humming then Like I always like to say it's like let's say like um when a woman's pregnant You know what is it month six or seven when she just has that banging glow all the time like that pregnancy? Yeah, yeah, yeah when when men when we're in this practice we get this glow within us Yeah, it's not just a look, but it's also a feeling. You know, and it's a discipline thing as well Um, but I would what you're explaining to to me. That's like that's that life force energy So when you hear guys talking spiritually about oh like sex and love and the life force energy That's actually it You know because like you took it from the bedroom straight to go create music create art And that's that god thing you're talking about like I don't know what it is because to me Creating art and sex is one in the same Listen, if you watched any videos on this channel before then, you know, we are huge fans of squarespace. Why well for one It's easy to use even for me who has no idea how to code with squarespace I get that custom look that looks stunning They also have really in-depth analytics where you can gain powerful insights about your site visitors and how they interact with Your content and they have so much more and I just want you to go see it for yourself So head over to squarespace.com for a free trial and when you're ready to lunch Go to squarespace.com slash shambudy to save 10 of your first purchase of a website or a domain


What's up guys take down here with another hockey card video for you guys if you guys have watched the artifacts ones I do apologize. I didn't get the greatest stuff in them. I got a lot of base Cards I open up to blaster boxes made two videos out of it. It was originally going to be four but I decided to place them together and I got 25 doubles so upper deck is giving me some a small care package of collectible cards So hopefully I'll get that soon. I wasn't asking for it, but they just offered it To make up for how many doubles and how many base I got It is but it is so I know I did say those were gonna be the last hockey cards. I purchased for the season until the fall when Tim Hortons comes back around but Dollar stores restocked. They have series one and series two packs. So I purchased three packs of series one and And three packs of series two. I hope to get some good stuff. Hopefully Connor McDavid You guys know I have a collection there I'd like to see some more ruckies some more Ottawa centers would be nice, but I'm gonna basically this video I'm gonna open up three of the series one See what I have and then in the next one are in the later video.  Let me open up the hockey cards and see what we have Really excited Hopefully I don't get too many doubles.  I'm happy of that card Boy am I happy with that card because it is my third double, but it's one of those cards You don't mind getting doubles and I do plan on selling my other ones later this year But I'm gonna share every card I get I'm just gonna try to do it faster Just because I appreciate every card that's in the pack So this is Alex Go one ski go long ski. I do butcher names and I do apologize. It's not it's not that I Really tried to do that Taylor Hall Leave that there. I don't know why there is a glare on my phone today we have Rick Nash, sorry. I was I was looking at the glare there. Try to speed it up I'll keep this one to last. I'm happy about that Jacob Markstrom, I Have Jonathan quick. I like that card That'll be a great addition to my collection. I got Jacob vorac and I got Brett peace I'm probably pronouncing that wrong and The third card I have of his this year. It's a young guns. It's Tyson Yoast or Joe's some people pronounce it one way some people pronounce the other so I'm just gonna say both But I know this card is valued at I think it's something like 12 dollars. Just maybe it's more now depending on how He is but let's get into the second pack. So that is a win in my my book Even though it's a double and I already have two of them It's a great card. So let's see what I get out of this pack. That's pretty good. I will take that All right, let's go Blake Como Tobias reader Ian Cole who the Ottawa centers had a trade for and then they traded him away So that was a pretty interesting trade with that one They did announce that they were gonna trade him before he could play but I wasn't really expecting it Jeff Petrie Nick Holden Brett peace. I think I just got his card a minute ago, but I don't care about these doubles Jason Zucker and then regular shining stars for Sydney Crosby So I count that as a win And I have one pack left. Let's get into it. I see a checklist in here Yep, a checklist. I already have but nonetheless Sweet, let's just get into it. I'll start off with the checklist. This is from 101 to 200 Golden Knights Checklists is on the cover Flurry right there. Flurry is great in my opinion Zach Echel, I'm butchering names. I do apologize. I'm trying to go really fast today Michael Matheson Michael Frolick Clark MacArthur, I Think I already have this one. I do believe I'm not a hundred percent sure David Savard Jill Thornton and Brandon Carlo So that pack was all base, but they're all pretty good base in my opinion So today Sydney Crosby shining stars and Tyson Yost or Jost however you want to pronounce it are my top two I already have three of these ones. So I will be selling them in the future See how that goes But yeah, this is my series one. I don't know if I'll get more in the future it depends on You know if they still have them in stock where I purchased them or if It depends on if I get any more anywhere else, but I'll leave this video here Hope you guys did enjoy if you did, please leave a like it actually helps me out more than you think and I will open up. You'll probably see this one in the future series two I'm gonna open up these ones next see what I get you guys won't see that for another Week or couple weeks, but anyways take care peace


There are a few basic models that are very helpful for thinking about system change. One of the most popular of these is what is called the iceberg model. The iceberg model tries to illustrate the various levels of abstraction to a situation or organization. From the observable events to underlying patterns that generate these, to the supporting structure and ultimately the mental models used by an organization. The iceberg model helps individuals and organizations to expand their perception of a situation, to see it within the context of the whole system and not limit themselves to looking at just a single activity or event. It is designed to help people to step back and identify the different patterns that the event is part of, the possible structures that might be causing it to occur, and finally the model that is creating those structures. An iceberg is used as an analogy to represent the underlying structures generating perceived events and issues. As it is known to have only 10% of its total mass above the water, while 90% of it is underwater. The expression tip of the iceberg is used to connote that what one can see is only a small part of a whole situation, i.e. there is much more below the surface and what it looks like may be surprising. Just like with an iceberg, a large percentage of what is going on in our world is hidden from view, and the iceberg model tries to make this explicit by depicting it as a series of layers that sit beneath the everyday phenomena observed. The iceberg model argues that events and patterns, which are observable, are caused by systemic structures and mental models, which are often hidden. A fundamental system's thinking concept is that different people in the same structure will produce similar results. That is to say, structure causes 80-90% of all issues, not so much the people. Thus, to understand behaviors, we must first identify and then understand the systemic structures and underlying mental models that cause them. The iceberg model typically identifies four basic levels to situations. Events, which represent the manifest components and actions observable to us. The patterns of behavior beneath this describe trends over time. System structure describes how the parts are interrelated to influence the patterns. Finally, the mental models that support everything else in the system through a set of beliefs, values, and assumptions shaping people's perception. The one-minute snapshot of a current affair that we might see in the evening news is an example of an event within the iceberg model. Above the waterline are the events. Events are markers in time where multiple variables are observed. They are the what's happened or what we saw. They are discrete activities or facts about the state of things in the system, like catching a fish. If we apply the iceberg model to global issues, we could say that at the tip, above the water, are events or things that we see or hear about happening in the world every day. That there is a new president in Italy or that the price of commodities is up. The events that we hear about in the news represent the iceberg tip. Most of the world spends its time at the event level. It is how we perceive the world while being occupied with our daily activities. Patterns are the changes and variables that occur over time. They are the trends that we perceive taking place over time. If we look just below the waterline, we often start to see patterns or the recurrence of events. This might be, for example, recurring oil spills or one's computer periodically breaking down. Patterns are important to identify because they indicate that an event is not an isolated incident. Patterns answer the questions, what's been happening or what's changing. When we make a statement like, it seems to be getting warmer in winter or the price of gas is going down. These are patterns that we are observing, a series of relationships between events. When we get to the pattern level, we can anticipate, plan and forecast. It allows us to adapt to problems so we can react more effectively to them. The structure supports, creates and influences the patterns we see in the events. Structures can be understood as the rules of the game. They can be written or unwritten. They can be physical and visible or invisible. They are rules, norms, policies, guidelines, power structures, distribution of resources, or informal ways of work that have been tactically or explicitly institutionalized. They answer the question, what might explain these patterns? It may not be easy to see the structure, but the patterns we can see tell us that the structure must be there. Structures are composed of cause and effect relationships. These are connections between patterns. For example, a farmer might say, if I increase the number of cows, I will get more milk. He is saying there is a connection between an increasing number of cows, a pattern, and an increasing amount of milk, another pattern. Or for example, the underlying structure of a problem such as recurring oil spills might be our dependence on fossil fuels. But if you look at the root cause of such spills, you can start to understand and address long-term, sustainable solutions, such as developing alternative energy sources that do not rely on oil shipment. The mental model used to perceive the world is ultimately what generates the structures, patterns, and events. Below the structures are the mental models. These define the thinking that creates the structures that then manifest themselves in the patterns of events. Mental models are people's deeply held assumptions and beliefs that ultimately drive behavior. There is typically not just one pattern or structure or mental model at play. There can be many. Mental models are the attitudes, beliefs, morals, expectations, values, or culture that allow structures to continue functioning as they are. These are the beliefs that we often learn subconsciously from our society or family and are likely unaware of. Mental models are ultimately what keep the structure doing what it does. They are the thoughts and processes of reasoning that need to exist to cause the structure to be the way it is. These ideas exist in the minds of the structure's stakeholders, the people who set up the structure or those that play a role in the way it operates. Mental models are typically difficult to identify and that they engender many assumptions that are never made explicit. An example of the iceberg model may be seen in one's own health. Catching a cold would be an event. Catching colds more often when we are tired is a pattern. The systemic structures or causes for getting tired might include lack of rest from excessive work, which might in turn be a product of a mental model surrounding our identity as a hardworking person. One tends to get caught up in the immediate event of suffering from a cold and typically forgets that it is part of a pattern of events that is caused by the underlying structures of our lifestyle and perception.