platform, not just for publishing, but for networked software. And this is the thing I remember from Andrew's talk. He had a slide. The slide had on it a UPS tracking Earl. And he just invited everyone to have a really good long look at that Earl and think about what it meant. He said, this is amazing. I kept saying that over and over. This is amazing. It's like every package on the web has its own homepage. And it wasn't just that the package had its own address on the web. It was that it named an instance of a business process. And the people who had access to that business process were UPS employees. They were also customers. But also, programs, machines had access to that process or to the data that was in it. So those of us who had started writing Pearl programs to scrape web data and repurpose it and reuse it, were also hitting that same kind of URL for different and complementary reasons. So as we all learned, URLs can point to all kinds of resources, right? Audio and video, documents of all kinds. But for a lot of us here in particular, it's the idea of pointing to text inside of a document. So words and sentences, cells and HTML tables. And this set of URL addressable resources has really two properties. It's infinite and it's interconnected. So 20 years later, we're still kind of figuring out what you can do in this infinite universe of interconnected web resources that you can manipulate with a few simple commands like get and post and delete. And when you're working in an infinitely large universe, it can seem kind of ungrateful to complain about the fact that it's too small. But actually, there is a much larger universe contained within that one. So let's sort of contemplate this URL and just think about what it really means. Well, I'll show you one view of what it means. A human being who follows that link is going to visit Roy Fielding's dissertation on web architecture and is going to scroll down to a selection of text inside of that document. And there, be able to assign tags, maybe have a discussion about that fragment of text. A program that accesses, well, not quite that URL, but a variant of it, is going to retrieve this resource. The URL that identifies that resource is not itself any kind of a standard, it's just a link that points to a web resources. But the resource itself is, since February of this year, a W3C standard. And the way I like to think about it is that the highlighted phrase in that document and every possible highlighted phrase has its own homepage on the web, a place where humans and machines can jointly focus attention. So if we think about the web we've known as a kind of a fabric woven together with links, the annotated web increases the thread count of that fabric. And so I've been working with my panelists here. I've had the privilege to spin out a series of applications that explore the implications of that idea.  Anita Bandrowski with SideCrunch, Beth Rudi with AAAS, and Marianne Martone with UCSD and Hypothesis, to talk about what these apps are doing for them now and where we hope to be able to take them. So the first one up is Science in the Classroom. This is, I guess only a few people were there yesterday, so I'll just repeat a few things, is a AAAAS project that annotates a collection of primary literature from the science family of journals. Annotations are done, I think, mainly by graduate students for the benefit of younger students to help them understand the methods and outcomes of scientific research. So here is one of those annotated papers. There's a widget called the learning lens that toggles layers of annotation on and off. Here I've selected the glossary layer and I've clicked on the word distal to reveal the annotation that's attached to it. If we look behind the scenes, Hypothesis was used to annotate the word distal, but learning lens predated Science in the Classroom's use of hypothesis, and Science in the Classroom team wanted to keep using learning lens to display the annotations. What they didn't want was the workflow that was behind it, which, as I understand it, involved an extremely laborious process of, I think, even manually inserting content into HTML pages. So the idea was, use Hypothesis to create the annotations, and then use JavaScript in the Science in the Classroom pages to retrieve the annotations and write them into those pages using the same format that had been previously applied by the, I guess, webmaster. So the pre-existing and unmodified learning lens JavaScript code could do what it did before, which is pick up the annotations, assign color-coded highlights based on tags, and show the annotations when you click on the highlights. What made this possible was a JavaScript library that helps with heavy lifting required to attach an annotation to its intended target in the document. That library is part of the Hypothesis client, but it's also available as a separate standalone component, which is what we're using here. It's a nice example of how an ecosystem of open-source components can enable interoperable annotation services. And I was also gonna give a shout out to the guy that wrote that library because he was here this morning, but I don't see Randall. There he is. Randall, thank you for that. Okay, so we heard also this morning a bit about Stefan Kendea's European Investigative Collaborations, and my call fields work with student fact-checking. So this is the app that I've worked on with Mike to help his students marshal evidence and make sense of the web. Now these investigations are written in a wiki, and also displayed in a wiki. This is one of those examples, which is an investigation that I did myself in order to test out the process that we were developing, which required me to gather a whole lot of supporting evidence before I could even begin to analyze the claim. So I used a hypothesis tag to collect those annotations, and you can see them in this hypothesis view. Now I can be very diligent and disciplined about using tags this way, but it's a lot to ask of students or really almost anyone. So we created a tool that knows about the set of investigations that are underway in the wiki and offers the names of those pages as selectable tags. So here I've selected a piece of evidence for the investigation. I'm going to annotate it, not by using hypothesis directly, but instead by using a function in a separate digital extension, that function uses the core anchoring libraries to create annotations in the same way that hypothesis does. But it leads the user through an interstitial page that asks which investigation the annotation belongs to and assigns a corresponding tag to the annotation that it creates. Back in the wiki, the page embeds the same hypothesis view that we've already seen as a related annotations widget that's pinned to that particular tag. I ended up with so much evidence for this investigation that I needed another way to organize it and try to make sense of it. So came up with another widget that we are calling the timeline. It gathers a subset of the annotations and displays them this way, annotations that have been tagged with dates. So to put something onto the timeline, I use another one of these right click helpers. Select a date on a page and use a function that says add selected thing to timeline. Choose the tag which targets where that thing is going to attach. This is what the annotation looks like in hypothesis. So it has a tag that's the date. Over in the wiki, the JavaScript that runs in that page organizes that stuff on the timeline. Now, it turns out that publication dates aren't always evident on web pages. So sometimes you have to do some digging to find them. Now, I think one of the key points here is that when a student does add a date to a web page in this way, they haven't just populated a timeline on a particular investigation page. They've upgraded the web in some small way because anyone who visits that page with either hypothesis or any annotation or client is gonna have the benefit of that work that was done by the student and will have an indication of what was the date on that page. So that's true for all of these annotations that the students are creating. They're using them in a particular context, but those annotations are generally available to be reused by others in a variety of ways. So the last and actually most popular feature that we've added to this toolkit is called footnotes. So once you've gathered all your raw material into the related annotations bucket and maybe organized some of it on the timeline, you wanna weave the most pertinent references into the analysis you're writing. So to do that, you find the annotation that you gathered in our annotation viewer here that's embedded. Use a copy to clipboard function to copy the what we call direct link and wrap it around some text in the article. And now when you refresh the page, here's what you get. So there's really two things happening here. The link on the word posted is a straight up hypothesis direct link. So it does what a direct link does. It takes you to the page, scrolls you to the context, highlights the annotation and opens up and displays whatever is related to that annotation in the sidebar. But if you have 15 of these footnotes in a page, it can be kind of tedious to open them up into 15 tabs. So the other piece of this is that the link here, the in this case, superscript one is pointing just down into the page here. So there's a section in the page now that does what Ted Nelson would call transclude. And what Nate Angel for some reason hates hearing me say, the word transclude, but it's what it does. It transcludes the footnotes into the page. So now you have all of the context from those separate annotations that were marked up and directed at the page available directly within the page. And one last point about this kit and this is just an experiment so far but students really don't like the writing tools that are available in these open source wikis. And they're not wrong about that. They're really rough around the edges and hard to use. So we've been wondering if we can enable students to use Google Docs, launch out into it as the editor that they use and bring the results back into this page that is displaying the results of the investigation. And it looks like that's going to be possible and even it looks as though we'll be able to convey by way of these hypothesis direct links we'll be able to convey the footnotes still into the article, right? Cause we can just look in the export from Google Docs and find them in transclude the annotations. So it looks promising but we don't really know how this is going to work out but I will say that my colleague, Maryann Martone here, who both uses hypothesis to gather raw material for the research papers that she writes and often writes them in Google Docs is really hopeful for the outcome of this experiment because she would really love to be able to flow annotations through her writing tool and into published footnotes. So we'll see if we can make that happen. And that is the segue to a thing that we've worked on. Anita and Maryann both have worked on with me and Tom Gillespie who's here, a project called Cybot. So Anita in particular is someone who is, I would say, working to increase the thread count in the fabric of scientific literature. So when neuroscientists write up the methods used in their experiments, the ingredients often include highly specific well, for example, antibodies. That's the dominant kind of thing that we're talking about here. These are the ingredients of the scientific experiment and if you want to reproduce that experiment, you want to know exactly what ingredients were used. So these things have colloquial names and they have even vendor catalog numbers but those aren't unique identifiers. So the neuroscience information framework or NIF, where Maryann and Anita both work, has defined a namespace called RRID which stands for Research Resource Identifier. And they've built a registry for these RRIDs and they've convinced a growing number of scientific authors and journals to mention RRIDs in the text of articles. So here's an article with RRIDs in it. Now they're just written directly into the text, you literally write RRID colon and the identifier. And that's a very carefully chosen design because it turns out that the only real permanent artifact in the scientific record is this text. And it's also a searchable archive. So they want the stuff to be in the text of the papers but these are identifiers and they need to be correct. So if you're talking about polyclonal antibody, the idea is you look it up in the registry, you capture its ID, you write it into the text, and if it's not in the registry, you go and add it to the registry and make Anita very happy when you do that. So the first phase of this project, SciBot, was about validating these RRIDs because they're just text typed in by authors and so was the identifier spelled correctly? Did it actually point to a registry entry that resolves and brings back the record that you expected? So to find out, we built this tool called SciBot that automatically annotates occurrences of RRIDs. So here, Anita is about to click on a bookmarklet, labeled RRID, and what it's going to do is send the text of this article to a little backend service. That thing is going to scan the text, do some simple expression matching to find our RRIDs, look the RRIDs up in the registry, and then using the hypothesis API, programmatically create annotations in the paper that anchor to the instance of the RRID and when clicked in hypothesis, open up the sidebar and display in the sidebar the registry information that came back if it was found. And so here we see that the hypothesis real-time API has notified us that this backend service has done its work and there are three new annotations on the article and here they are, right? So now we have hypothesis links on these RRIDs. Now, that's just the first step, right? And kind of the key point here is that we're in this zone of partnership now between humans and machines. So some of these things might be misspelled or missing. In this case, here's one that was missing, right? So vglut2 should have been in the registry and it wasn't. So now that information has been added, not directly to the paper, but made available to a reader of the paper because it's been added in the annotation layer. So, you know, pretty much every automated process needs human creation and exception handling and that's what this hybrid of automatic entity recognition and interactive human creation gives you. These corrections are now available to train a next-gen entity recognizer so that iterating through that kind of feedback loop, we're gonna be able to, I hope, mine the implicit data that's in the scientific record and make it explicit. Here's the hypothesis dashboard for one of the SciBot curators. The Tag Cloud gives you a pretty good sense of how this process has been unfolding so far. And now, publishers have started to link to RRIDs as well. So here, this is a PubMed article and there's a link on the RRID Zerk ZL1. If you follow that link from PubMed, you'll land here in what NIF calls the SciCrunch registry and you'll see that there's a list of other publications that use this resource. So that's kind of what we do in the web that has existed for the last 20-some years, is we point to documents. And of course, now we can do better. So the main purpose of RRIDs, really, is to say, if I'm using Zerk ZL1, which happens to be a particular strain of zebrafish, I wanna know who else has experience with that tool, as they call it. And not just the experience that was reported in the paper, but what's been added to the paper in the experiences that have been reported in the annotation layer. So one of the ways that we could do that, we've already seen, we could do that footnote transclusion thing. I mean, I think it would be cool if publishers did that. But there's lots of other ways to skin the cat. So here is just a little tool. So you have a piece of text that is selected and it says, find other uses of this RRID. And all it's going to do is link to hypothesis query for that tag. And there are all the other instances where it's been tagged. And if we open one of those up and click on the direct link, you go to the page and you go to the context where the researcher actually used that thing. So the last piece of this, and then we'll get into a discussion about all of this, is gonna bring this full circle back to Andrew Shillman, who I mentioned at the beginning. And Andrew now works as a patent attorney. And we reconnected recently. And he said, there's this tool that I use in my work. It's called a claim chart. And what a claim chart is for a patent lawyer is a two column table where column one is a set of selections from the patent. And in particular, it identifies the claims in the patent, right? And they literally call them claim one, claim two. And in the second column of the table, there are statements in other documents that bear on the claims. And so as you can imagine, in a legal tradition, there's a really strong need to be able to bring these things together and reason about them, right? Does this statement in the other document support or the claim that's being made in the patent, right? And nowadays people build these documents laboriously in Word or however they do it. And so Andrew said, you know, it seems to me that maybe annotation would be a way that we could do this better. And I guess if there's anything I've learned about annotation in a couple of years that hypothesis is if somebody says, can you do X with annotation? The answer should always be, I don't know. Seems like you could. Let's try it and find out. So this is an annotation powered claim chart that we've come up with. It's just sort of a first iteration of this. But this is the layout. The daggers in the top left of each cell are hypothesis direct links. The one in column one, right? Those are enumerating the claims. So that's going to take you to the patent and to the particular claim that's being asserted. There's a hypothesis annotation on that. The second one is going to take you to another document where another statement has been selected that relates to the first statement. And the toolkit does it this way. It says, when I select the claim, I tell it I'm adding a selection as a claim. I go through a process of identifying the claim. In the other case, I tell the toolkit I'm adding it as being related to a claim. And here, we bring these two contexts together in a single view, right? So now I don't just have to remember or revisit the tab that had a patent in it with the annotations about the claims, right? Because I can see it's not just claim one. It's, oh yes, claim one, a monoclonal antibody. I'm now associating the sentence. It is a fragment of the monoclonal antibody from another page with this one. So once you've identified the claims in this way, they're available as targets of annotations in other documents and it's easy to connect the two statements. So the last time I read Vannevar Bush's famous essay, As We May Sank, this is the quote that really struck me. He runs through an encyclopedia, finds an interesting article, leaves it projected. Elsewhere in history, he finds another pertinent item and ties the two together, right? Ties the two together. So when statements in documents become addressable resources on the web, we can start to weave them together in I think exactly the way that Vannevar Bush imagined. So with that, everyone with whom I have collaborated on the things that I've just discussed is here with me and I would just like to hear from them about what's working, what this has enabled, what's broken and where they think this can go next and why. I'm Beth.  There was a lot of copying and pasting. I won't talk too much about the workflow because I don't wanna mess up my talk for tomorrow which is gonna be invigorating and wonderful. But essentially we went from having a Drupal 7 widget and doing a lot of copy pasting and having it kind of hard code things in HTML. Now we've got a much more automated system. There have definitely been some bumps on the road which I think is inevitable when you kind of have a custom extension and you're working on something together to try to figure out the best way to make it work. I know that for us, the most important thing is to have something that's reliable. So the less the number of steps in the process of getting from the contributors annotations to pulling it in through our learning lens is kind of the number one thing for us because if there's so many moving parts and there's like one thing that goes wrong, then basically you just have a research paper that's reposted online with no extra additional information. I could just keep talking but I'll stop now. Anybody else? So for us, one of the coolest things that I really like to do and I don't know why but it's just really satisfying. It's probably an OCD thing. But I actually really like to open up a paper and run SciBot and have it actually come back with the entity. I don't know why, that makes me so happy but it really, really makes me happy. When it doesn't come back with annotations then I email Tom and he has to restart the server. So that's a problem. We're working on that. But we have already, first of all, I believe that as of the last time I saw Dan's talk, I think SciBot has the most annotations of any annotator which I find very satisfying. Out of that million annotations, we own a significant chunk of those. It's great. The second piece of, so there's a lot of good news, right? But we've definitely found some really interesting things about how publishers do things on the back end of the webpages that they have that we don't love as much as SciBot running properly. So we can certainly, any publisher in the room, if I grab you and start screaming at your face, I'm sorry, it's just a deep frustration. But the kinds of things that would make our lives much easier would be to figure out which version of an article, because an article is just, it's a web artifact but there might be different copies of it like strewn around the web. And if I have several curators actually working on something, two of them might run into the same document. And we don't know about each other until hypothesis starts coming back and going, hey, you've already annotated this. Oh, well that's no good. So there are like little technical things that I think we really need to start thinking about addressing now. Because articles are supposed to be these preserved artifacts that we as a society have really said these things are valuable, we want to save them forever, but we also need to have like the copy of record. And that's something that I think is a general problem because as soon as you don't know that information, annotations break. So actually one thing I'll jump in here and say is that, and this is a thread I've heard from, I think probably all of you, but in particular, so Mike, I remember you said at one point that when you reformatted the textbook, it was two days of reformatting and copying and pasting. Your process was copying and pasting.   So much as Nate dislikes the word transclusion, what that really says is if we can, in the same way that we give addresses to web documents, we can give addresses to statements in web documents that are reliable and persistent, then we don't have to copy and paste things. We can refer to things and we can transglute things and it's just there's less breakage, there's less stupid. So another thing that really attracted me to this is we've heard a lot about semantics and in the neuroscience information framework which you mentioned, since the early days, we've been trying on the semantics of neuroscience. Neuroscience is an extremely hard domain to characterize because if you saw the announcement in 2014 about the US Brain Initiative, it's saying we still don't know how many cell types there are in the brain or even if the idea of a cell type has any validity and if so what? Because we're on the forefront. And so at various times people have come through and said we need to develop these formal knowledge models and I'm like we need to develop enough of a shared semantic that's computable so that we can reasonably make assertions that someone says I think that this is what this means but it's really in the usage of these things and the data that you determine whether these assertions have any validity or not. Is this a good concept, is it not? And the idea that you can sort of formally structure knowledge or a paper from the get go I think is just false.  Different statements in the paper can be interpreted in different ways. So what I liked about Hypothesis was that it was a lightweight linking layer over these things and not built into it because the weight of the things you have to say about something even very simple to fully characterize it is enormous and this lets us use this hybrid between what computers can do and what humans can do. We supply some structured knowledge. Yes, sometimes it's very easy for us to look at a string and say gene. Other times it's very difficult for us to look at this and say anything because we don't know what the nature of these things are. And I had a very interesting experience, our group built a semantic wiki for neuroscience concepts a long time ago called Neurolex and Neurolex was a very useful thing. It was the semantic media wiki but it let you link pages of course and concepts of relationships rather than just a hyperlink. So you could say this neuron used this type of neurotransmitter, this neuron was here. It was very powerful. It was a really powerful tool for teaching people about why when you have a URI and you have a concept that's machine readable you can do a lot of things with it. But at one point we created a template to ask neuroscientists to fill out information about these neuron cell types. We had 40 worldwide experts come in and do this. First, these are some of the smartest people you're ever gonna know. They could not use a wiki, right? So it was a real barrier for them to use a wiki because that's not their expertise. They could put very fine electrodes into neurons and they could record things. They could do things in a lab that were artistic but the wiki was not worth their time and it flummoxed them. But when I was analyzing at one point, right? Because basically the knowledge that came out was a triple. There was the subject, there was the predicate and the verb. I noticed that some things were really easy for scientists to think about as a triple. So neuron in brain region X, very simple. They knew that knowledge. But as you got deeper and deeper into the characteristics of neurons, they, everything turned into a red link, right? Basically there were no completed triples and when you looked, you saw that the scientists reverted to natural language to try to capture the nuances of what they were trying to say. So there were some pieces where they could very easily turn this into a formal knowledge structure. There were others where you could see, it was, they were incapable in that construct to be able to say what it is they wanted to say. So they reverted to the power of language, right? That they could then say but sometimes or maybe. And you could actually watch this evolution and it was a very fascinating thing. So when I saw hypothesis and I saw the ability to be able to link across the documents without this rigid formality but allow the expression, right, the caveats, the notes, the things that were bothering people or thought about it. You've now narrowed down the fact that I don't have to digest an entire paper and an entire paper and draw links. Somebody's already done that for me. But they've been able to express in a very natural and easy way what they thought this relationship was. And if another person came in, they'd likely give you something else and somebody else might give you something else and over time that may change. But it showed you that there really is no sort of universal curation. This idea to make these very rigid structured things works okay but you need this flexibility. You need the interface between someone who has that deep domain knowledge and the things that they're referencing. Then the computers now instead of operating again on everything, you've narrowed down a subset and probably can use NLP or other things to make it so that this re-churcher never has to write a triple, right? Because if you ask some of my colleagues, I remember I was gonna write a paper once. Do I have to write in triples? Is that what I'm being asked to do? And you can't do it. So I find the opportunity to create these dynamic, evolving linking layers that allow this partnership between humans and machines to develop to the next level without overly imposing on the people who understand these things the necessity to learn how to write mark down or mark up or any other sort of language, right? That's an imposition and it takes me out of the things that I know into trying to tear my hair out to sort of figure out how to use this tool. That is why I think this lightweight connecting layer on top of is what I like to say. I like the increased thread count because that's what it does. And maybe we're going to, you know, to Mike's world be leading students to a place where, I mean, citation in the way you think about it, right? You three in the world of science. It is a highly specialized and in a way elite activity, right? What you're trying to do is get students to cite things in a more, I don't know, informal way, right? But to inculcate that habit of thinking in that practice. Yeah, so, you know, from a person that teaches students is wiki or anything like that, it's hard and the reason why it's hard for students is things like wiki try to train students to use really structured data. And someone once asked Ted Nelson, you know, what the downfall of the web was and his answer was simple, fonts, right? It was fonts that killed the web, you know, very Ted Nelson-esque, but it's true. I mean, what's happened is that we've kind of devolved from the web as a really semantic phenomenon to a WYSIWYG phenomenon and that's the world people live in. So how do we, how do we get, you know, how do we overlay semantic information in a way that WYSIWYG doesn't wipe out? And that's a big question, right? Because if we could do that, then maybe we could work happily in some of these WYSIWYG interfaces without just completely, you know, zapping all our data every time that we reformat it. So the thing that excites me in that way about, you know, hypothesis and the URLs is here's something, instead of taking just an HTTP link, right, and then, you know, pulling a quote and adding that quote in or whatever, you know, you're able to take this hypothesis link which will link to a specific anchor point in that document and may also be able to pull other information that's been added to that document about date or subject or, you know, specific IDs or things like that. And that can carry that around and as long as that link, right, doesn't get, doesn't get nixed as that document moves from place to place, that information doesn't disappear because someone decided to, you know, select all and like, you know, change it to Calibri, you know, which is the place that we are now, right? So I think that's the exciting thing is teaching students to use this, reclaim these URLs as something that has, that expresses meaning, right? And lay them, you know, lay them into a document and then the document generates the footnotes, right? Yeah, no, that's a, thank you for bringing that point and beating it to death. But no, if the annotations break because of, you know, changing to Calibri then we're kind of nowhere. Although I can't say we're nowhere because we still have on the back end all of those annotations stay on the back end, which is great, you just can't see them anymore. And that's the thing that we really have to fight against. Especially, again, in the scientific literature where you're really trying to annotate an artifact that's gonna be there for 100 years. And so if you can do that, that would be a really big step in making sure that you actually preserve the annotation layer on top of this, you know, 100 year artifact, right? So the annotations can't break after a year if your artifact is meant to last 100 years. So we need to figure that out. It's not, it's something that we can figure out, right? It's not that difficult, but it is something that we're gonna have to address as a community. I think that that was something also as soon as we started, as soon as I started doing this, this longevity, right? That things that my colleagues immediately asked for, if they were going to invest time in this, this was not ephemera, right? This was not something that you started a little conversation and it was a tweet that sort of went on, right? These are now data and these are things that you need to preserve. So immediately, one of the first things we asked was we need to be able to export our annotations. We saw Pundit had that, right? And we wanna export them and we wanna reform them, right? Because these are now serving as data for something else or something else that we're going to be able to do with it. So we want to be able to manipulate it, but we also want to make sure that my explorations over the last two years with Hypothesis represents my corpus of scientific work. I used to keep these in reference managers, I used to keep them someplace else. I need to be sure that I can preserve that in a form where I can go back to it. Because it often takes two years to complete a study and two years to write a paper. So it does have to have some permanence, right? And then you also, again, we started to see with the push towards activity pages, this constant stream a la Twitter was not a useful way for us to gather these, right? That there were multiple annotations that were attached to a URL, even in science, as Anita says, the URL is not sufficient because that article exists in five different places at five different URLs. It's the DOI or some other object, right? That says I'm actually attaching these annotations to some third category, not the individual instances itself that needs to sink across. So I think that it starts to sort of point out that I always like to say for myself, if a tool is useful, it's not just because I work for Hypothesis, I will use it all the time. It becomes an essential part of what I do. But I don't want to invest in it if I think that this is going to go away, right? I want to make sure that I would have access to it and that I can use it, which is why I think the open standard was so important. But we did touch a little bit on the kind of referencing and I know I got one of my favorite lines from John is, some people annotate not just because they like to annotate, but they're actually trying to do something else, right? That they're annotating during the course of something else. And this is something that I think is a really important thing in science. And we talked about the fact that the footnotes were great, but the APA style doesn't call for a footnote, right? It calls for a formal reference, a formal citation. And right now, that still involves a whole lot of copying and pasting and all kinds of torturous paths through different tools. But we ought to be cognizant of the fact that if we want annotation to become a regular part of this that you need to understand the end goals, right? The claim chart is what he needs. He's gonna use annotation to get his claim chart. That's what he needs, right? I think that we cannot overestimate. So I mean, I think maybe you told me an estimate at some point of what percentage of the NIH budget is spent on reformatting and copying and pasting, right? And it's non-trivial. So, and that's true in every domain, right? So again, I mean, just that, just it's such a simple basic property of annotation, but just the fact that you can refer to and move around resources that are canonically addressable, right? At the level of a word, a sentence, a paragraph, right? In the same way that you talk about documents as a whole is just an insane efficiency boost across almost every line of business that I can think of, right? I mean, it's just a baseline, better way to do things. That's what I just was thinking while you were talking. So basically my signs in the classroom is the same article that is available on a different webpage and also available in PDF form across who knows how many users being able to annotate it in our space and then somehow have that also be able to be plastered over the science version would make it doubly useful. But I don't know how that would even be possible. Well, it is possible, especially in an automated way. It often works except when it doesn't. Yeah, exactly. It absolutely is possible. So we were thinking we would open it up to conversation and we're actually gonna try a slightly new thing with the questions. So we're gonna, at Esther Dyson's suggestion, my lovely assistant, Christoph, is going to act as a mic stand. And we are gonna invite people who wanna ask questions to come up to our living human mic stand and ask the questions there. It's a Christoph stand. It's not a mic stand, it's a Christoph stand. That's right. Christoph actually. We're gonna call Mike. Hello? Hello. There we go. Without organizing annotations, not just storing them in a single centralized or a hypothesis database, but having multiple databases, you either exchange annotations or somehow be able to search across repositories of annotations. Is that work that still needs to be done or how do you imagine it going forward? Oh, that's absolutely central to the vision for hypothesis, right? Is that it is an implementation of a set of standards. And that there, this will only succeed if there is an ecosystem of interoperable annotation services and clients and a standard way to exchange annotations among them. And I mean, we heard this morning about exactly that, right? This is what the W3C have done actually is to say, this is how we will agree to talk about what an annotation looks like. This is how we will agree to talk about exchanging them among systems. Absolutely. That's fundamental. One more, I also noticed that there's no copyright other than releasing to the public domain when I annotate using the Chrome extension for hypothesis. Is that something that also, I imagine some people might want to have a slightly more restrictive. In hypothesis, and that's just our policy, right? But in hypothesis, the policy is that a public annotation is licensed to CC0. Got it. Hi, I'm speaking. Another voice from LibraryLand. I know we've been in Twitter conversation about handling annotations as some kind of an event, a scholarly event. But I have to say, first of all, that from the library world, we're just suffering from the fatigue, the extreme need to treat all these new forms of scholarship as first class objects. And while in principle, we're your first, you know, acroite. We're so deeply supportive of the idea, but we're also underwater financially. And so we're already struggling to treat software, data sets, and all those other objects that are part of a new 21st century scholarly ecosystem. There's no question that annotations deserve that treatment. And we've talked about, you know, if you issued a DOI and they get registered as a cross-ref event, then they're very easily trackable through any system. And that probably really, the infrastructure isn't as hard in that model. But again, it's who the heck pays for this. You know, we keep looking to the commons to pay for this. And you know, I work with some other folks here on research data alliance efforts, force 11 efforts to try and find a sustainable path to handling, curating, and really treating all this other stuff besides the paper as first class objects. It's not that we don't all share that value and really want to make it happen, but it's a completely unfunded mandate. And I just don't know. And libraries just are not the backyard people can keep pointing to as magically being able to do it. I mean, we seriously need help. Another reason to get rid of stupid as many places as we can, because the more time and effort we spend on things that are unproductive, the less we have to actually devote to things that now do need our attention.   And I'm like, I don't. I have to work through the user interface. And that means awful, repetitive, cutting, pasting, hair pulling, jumping back and forth between incompatible document formats, all kinds of stuff that you have to do. And it's technically not necessary, right? Practically you're never gonna get rid of all of it. But I think because of these unfunded mandates, we can't be spending time on this anymore, right? We have to be able to turn our attention to something else. And I think the time is really to do that is now. I also, just as an aside, you know, I don't think every annotation needs to be preserved. What I like about the direct link about the, you know, is when do I decide that this thing does need to be preserved? When does it not? You know, when do I invest extra, and when do I not? We'll never get that 100% correct, but that's what libraries do, right? They decide what are the culturally important things, or what are the things that we do need to invest in. The other stuff, maybe it'll get carried forward because of many copies, maybe it won't. But you know, society won't collapse if we don't carry everything forward. The brain doesn't carry everything forward. You know, we manage. So Marianne, did you develop the getting rid of stupid in science when you were working on that APA paper? Yeah, okay. Yeah, that's what I thought. Anita, was there anything you wanna say about the possibility of business models around? Yeah, oh no, no, no. I'm not sure about that, but I mean, there are certainly a lot of business models where there's cost savings that can be realized. But no, the reformatting of references is one of those things where all researchers just need to stop because the really funny part of that is the typesetters pull out everything anyway and redo it. And the fact that we're all not just putting in PMIDs into the reference list I think is just idiotic. Thank you. So a few super quick interactive questions. So you guys are big annotation people and obviously some of you at least read a lot of papers. Do you print out the papers and take annotations on the papers or do you do it on the computer? So I would say one of the most profound changes over the last two years with hypothesis is my reading habits have completely changed from printing them out and scribbling in the margins or to downloading PDFs or even uploading them into reference managers to using my reading on the web and tags and not even necessarily explicit tags as the way that I interact with the literature because I find web-based annotations so useful beyond anything else that I use. So it actually did flip me over because I used to hate reading online but now I would rather read online because I get this advantage. Can we get a hypothesis chant? Hypothesis, no, it's just me, sorry. Do you guys still print stuff out? Do you use it on the computer? What tools? Me? Yeah. I feel like I don't read anymore, sad but it's true. I usually, I'm using it to actually write the annotations on the paper that I'm reading so I do almost everything web-based. I rarely print anything out and write in the margins. I can't read my own handwriting anyway, to be totally honest. No, I've stopped killing trees. I think hypothesis for that. And, go, what? So do I print things out and read? Is that the, or? Did you print things out and annotate is the important question? Or how do you take notes? Like, I print things out and then I type my notes in a text document. Yeah, so I'm kind of, right now I'm kind of a one note fanatic and I like having clippings and copies of things because things disappear and that's of course the big issue, right? So one note allows me to take a snip of that page and keep it but yeah, I don't write things out. I generally use that. I think hypothesis is a piece of that. It's just the only reason why I end up defaulting to one note is I've just been burned too many times by things disappearing. I should say interestingly, just to your point, the only things I print out and scribble on by hand are when I am writing something. So the only way that I can review a draft and quickly interact with it, flip back and forth, I can't do that electronically. I don't see it in the same way. So the one thing I do print out is anything that I am writing and that is where I do my editing. Cool, okay then the second quick question is how many people, maybe in the whole room, including you guys, keep lists of quotes or ideas? And I'd like to ask the speakers, what tools do you use it? Do you do it on real notebook? Do you do it on a computer? What software, if so? That's my hypothesis quote tag. Okay.  It's okay. Okay, we still love you. So I tag things and I've been doing that for a very long time. I was one of the original biggest fans of I think called Delicious, probably first social book marketing service. And I think I still failed to fully explain to most people how important a change that was. But the example that I often give is like this. And you'll see this all the time now. Someone will say, can you give me a list of things? You know, whatever it would be, movies or whatever it is. I want a list of things. So someone will open up a document and make a list of things and send you the document. So they've sent you a list. What I prefer to do is put that list onto a tag and send you the link to the tag, which means I have sent you not the answer to a question, but a way that you can answer the question every time you visit a URL and get a possibly different and better answer, right? And that cognitive shift is still, after all this time, I think not really appreciated by an awful lot of people. Awesome. And just the last thing is, so I take it you use OneNote also for that? For what? Yeah, I use OneNote or Wiki. I'm kind of a wiki fanatic. The big revelation for me in terms of keeping notes was to, instead of breaking notes out by document, to actually decompose documents into ideas in the document and have multiple separate notes from a document that then could be combined and slowly become, be expanded into something that's capturing an idea among many documents. So one of the problems with a lot of tools that we see out there is, and hypothesis is an exception to this, is they treat the document as something you wanna respond to the document rather than try to extract an idea that is bigger than the document and start combining that with other ideas, right? To me that's been one of the big revelations about really reaction to documents is the way that we react to whole documents is kind of really constraining the possibilities of the synergistic possibilities of the web. So you do use OneNote then to keep lists of ideas and quotes and stuff? Okay, awesome. So just asking as a citizen this time, you guys are working in fields of science and education and we've heard from journalists and their scholarship and publishing. I'm curious, this idea of the annotation layer operating as a kind of highway over which information can travel that's sort of above the document layer and sort of has an existence outside the document layer so documents can come and go and the highway can remain and new things can travel on it. What other fields do you imagine being radically or could be radically transformed by this kind of transport layer in practice beyond education and beyond science? Have you thought about that kind of question or maybe we all should and just think about what other kinds of human practices might be able to be effective? What else is there besides science? Sorry, I know. And education. So I have an answer to that that's a little techno utopian for 2017. But initially when the web came out a lot of people conceptualize this as a browser goes and it reads pages that are designed for a web browser and the web browser displays the pages. That was kind of the model that people had but very quickly people kind of built around the edges of that and started understanding, well we're delivering HTML to the browser across this set of protocols and we can do a variety of things that this is not designed for. And so in 1994 you suddenly can order a Pizza Hut pizza. I mean this is true, 1994, check it out. Through the web, right? And how does that happen? Well there's a form that goes to a thing that produces a fax that goes to the Pizza Hut. Fax, I know, web and fax. It was there for like one year I think there was an overlap. So I think that's the interesting thing about this is you can think about things like hypothesis or genius as a product and I think that that product just like web browsers had to develop that product has to get much more polished than it is and much more user friendly and much more intuitive. But co-developing with that you have to see this set of protocols, this addressing space and I think the real future if we grab it is by those people that, you know, the same people that were kind of the pearl hackers in 1994, 95 that said, you know, wow, you can build a store with this, you know? It doesn't just have to be a document. I think there's a set of applications out there that we can't imagine but that we have to really create the developer community that can patch together quick and kind of messy solutions to things so that we can explore that space and eventually get to some of the more polished stuff. So the answer is I think it could be like John says. I mean, the answer to can annotation do that is who knows but let's try and that's how we get there. I actually give a different answer to that which is there's a field that already has been transformed by this that we all take for granted and we probably shouldn't and that's software development. So I mean, when it comes to living in the information world programmers have always been living in the future relative to the rest of the population because it was always the case that the work process and the work product were digital and networked almost before anything else was. So it is completely taken for granted on GitHub in that work environment that I with my colleagues can point to a line of code in a revision of a document and we can have conversation about that particular point in time and that particular location in the code and the precision and accuracy of that method of collaboration but let's just say without that the software that we know now would not be possible and I think that the people who live and work in that environment have so internalized that that they take it for granted and also don't fully recognize the degree to which people in most other lines of business are not supported by that level of tooling and sophistication and that we need to kind of, we will be bringing everyone up to the same level. Hi, I'm Joshua Choi, medical student at St. Louis University. So I just wanted to make a comment from my own experience, starting from the mention of Nirolex actually, I found it quite useful during my research on basal ganglia, so thank you for that. But I also was quite inspired by your mentioning of the trouble you had getting normal people like world famous neurologists to input structured data. Yes, in my experience there's something very similar when it comes to physicians having to input patient data. We have a lot of problems when it comes to that and we're inputting a ton of data from friends, family, the patients themselves, labs and it's super underutilized because it's all scattered together and we're not able to really comment on them or point to specific places in order to express and document our clinical judgment and reasoning. So I'm hoping, like there are a lot of EHR or electronic health record systems today that try to get us to input structured data, like here's every single symptom that they mentioned positive and negative. Here's every single examination finding that we have. But all that misses the point if I still can't point to a specific place on a graph of their glucose during some admission and point out this is why such and such or this is why I think they have this diagnosis or not. So I'm hoping that one day annotation technology can help save lives frankly by helping physicians make less mistakes and be more efficient and document and express and communicate their clinical judgment together by using annotations and annotating raw data so to speak and to annotate each other on that, all auditable and such. There's something, it might fit in the strange liminal boundary between structured data that humans usually can't do at least normal people like the neurologists and people wanting to input natural language. Oh, I could go on and on about physician notes and the kind of copying and pasting they do. I'm hoping some day annotations can help with that. So I'll tell you my one story which it still I think is relevant to that. So electronic health records and human language I think is a big thing. The many things attracted me to annotation but one of them was that it is the capacity to create an interoperable knowledge layer where as things pass through different stages which they almost always do by the time you go from one place to the next there's valuable knowledge, valuable comments and things that get put on there but they're lost, right? Because every time you switch over from one system to the next whatever comments or anything or there often go away or even when they're in the same system that's exactly right. So if you could look very closely at my hand you would see a long scar going down my fingers and that was a very unfortunate interaction with an automatic nail clipper in my cat. Okay, she raked my hand and ripped it to shreds. I went to the emergency room because by the evening I couldn't actually use my hand and cat scratches are dangerous. And the woman's, first of all the electronic health record she has to turn around with her back to me and sit there and try to type in and she's looking for animal scratch, animal scratch, cat scratch, can't find it. She's like, eh, animal bite. So she put it in as an animal bite so I'm incorrectly coded as an animal bite because I have a cat scratch. And I said that's how people get frustrated. That would have taken her five seconds to say she was scratched by her cat, okay. And that's why I mean there is this interaction between sort of deep structure and then the flexibility that language actually has. But to me again when you actually look you can see that some things lend itself very well. So my name, my social security number, I can structure that and the more we deviate from that the worse life gets because there are some things where it's fairly easy to identify and you wanna structure it. But then the further out you get, the harder it is for people to express this type of knowledge the more time it takes, the more frustration. This is something else that I think John has really appreciated and certainly developers in my laboratory that when people are using these tools in real life contexts, okay, as opposed to some sort of idealized development, they are using them under pressure, they are using them because they need to get from A to B and the more barriers that are put between that the more likely they are to code you as a right animal bite even though this was not an animal bite. I actually had a friend who was a bioinformatician and she said they pretty much assume that there's a 20% error rate in most of the data that they get. Part of that is there's 40 different ways to measure blood pressure. They know that nobody actually records how they measure blood pressure and they're gonna have to put something down because this is a required field so they'll put something down but they ignore it, right, it's a lie. And I think that this is really, this is underappreciated that when you use these tools under pressure, under duress, under deadline, every extra click becomes a frustration, right, every time you need to copy and paste becomes a frustration so what you end up doing, right, is whatever it takes for you to get your job done and that's something else I think we always have to keep in mind when we design these, when we design them for this very narrow purpose, we think that they can be used in these contexts but in the field they fail utterly. Yes, it is. In that they're both machine readable, in that they can analyze the relationships between comments and between what different people say and what they're talking about but it's also lends itself very well to natural language in that the content itself of the annotations might be written in natural language in a cat scratch, right, or even if they were forced to code it as animal bite maybe it would be nice if everyone else who saw it from the non saw a comment on it that said, actually it's a cat scratch. Hi, we talk about interactions with ourselves and our work and a software machine and with hypothesis and other collaboration machines and we collaborate with other people through these machines. So human, machine, human. I'm wondering, have these annotation projects change the human-human interactions? Again, you're using human, machine, human types of tools and how has that changed the human-human connections? Douglas Engelbar would talk about there are two sides to any augmentation setting. One would be the human system, the other would be the technical system and so I'm trying to ask a human system question. How has the human system been changing? Thank you. I can give you one example from really, probably the dominant example right now. A lot of the use of hypothesis is happening in the classroom right now and the interaction between teachers and students and among students all focused again on particular passages and texts, right, has been a compelling thing in particular higher ed, right? And so, and Jeremy Dean here will tell you for hours about the kinds of models that people are developing and there are lots of different ones, right? But for example, a teacher can pre-annotate a document, a class reading with a set of things for students to respond to, right? And then one model might be, I want the students to respond to me, one model might be I want to actually have the students converse with one another. All this stuff is happening and again, it's happening in a way where it's not just, it's not just tell me what you think about this book or this chapter, right? It's tell me what you think about this paragraph, but it's happening in that context, directly in that context, literally in the document, right? And so that's my best example. Whenever we had people co-annotate, which actually ends up making better annotations overall, they used to have to pass a PDF back and forth and then comment on each other's comments. And I just recently co-annotated a paper with a group of authors and it was seamless because we could just kind of talk to each other in the comments within hypothesis and if we were all working on it at the same time, we could have a kind of collaborative effort and we're not even in the same state. So I can only imagine how we have a lot of students that are also team annotating papers in class. So that lets them interact both human-human and with the machine in the middle. I don't know if it's a different answer for you guys because you have a little bit of an automated system, but. So I mean, I would say human-human interactions, it actually has changed the way that I now communicate with, for example, my lab members when I want to communicate something to them. I often do it with an annotation now, right? So it's basically this is what I'm talking about, this is where I'm talking about it.  So I'm using it as a messenger system, but without me having to copy and paste the URLs and the thing I'm talking about, I basically launch it and say, can you take care of this? It was also interesting because I was sitting on a review panel where it was fairly intensely neuroscience centered and I was asked to essentially fact-check a set of computational models for the things in the papers that they were claiming that they were getting their parameters. And I actually got annoyed that I didn't have direct links because I had to spend anordinate amount of time pouring through these papers to try to figure out exactly what they were talking about. And I said, we really ought to allow this type of activity if you don't give me something more than just I reference this paper. So I find both as a messaging system, it's just a lot easier rather than even composing an email. It's like, here's a subject line, add this to whatever, that it's changed my modes of communication. Good, thanks everyone and thank you guys for playing along with my crazy experiments. Thank you.


Rent control is bad for renters, but good for politicians. By Lee Friday, an audio Mises Wire, narrated by Michael Stagg. Ontario's ever-changing rent control policies prove that politicians are just as committed to flip-flopping, as the Minnesota Vikings are to not winning the Super Bowl. Rent control as a means of buying votes. Ontario's modern history of rent control legislation began during the 1975 election campaign when it was actively promoted by the New Democratic Party, or NDP. This was the stagflation era, and the NDP conveniently ignored Canadian monetary policy as a major contributing factor to price inflation, which was 7.8% in 1973, 11% in 1974, and 10.7% in 1975, including higher rents, preferring instead to talk about horror stories of individuals and bad landlords who imposed exorbitant rent increases. However, as William Watson wrote in the financial post, what protection do renters have against unscrupulous landlords, other landlords, and lots of them? That is, of course, if other landlords are not dissuaded from entering the market because the government forbids them from charging market prices. Flip-flop, the NDP finally conceded this point, sort of, when, in 1992, they tried to encourage the building of more rental units by offering a five-year rent control exemption on new units. The exemption later became permanent. Well, temporarily permanent as we shall see. While acknowledging this basic economic lesson, the NDP nevertheless continued playing politics by removing rent control only on new units while maintaining it for current tenants in exchange for their votes, despite the economic consequences. As Henry Haslett wrote, quote, builders or owners of pre-existing apartment houses finding themselves with restricted profits or perhaps even losses on their old apartments will have little or no capital to put into new construction. In addition, they or those with capital from other sources may fear that the government may at any time find an excuse for imposing rent controls even on the new buildings, and it often does, end quote. Sure enough, in 2017, Ontario's Liberal government imposed rent control on the newer buildings. Flip-flop, the NDP supported the policy. Not to be outdone by the NDP's multiple flip-flops, during the 2018 Ontario election campaign, the Progressive Conservative Parties, or PCPs, soon to be premier Doug Ford said, when it comes to rent control, we're going to maintain the status quo. Flip-flop number one. A few months later, the PCPs majority government deviated from the status quo by exempting new construction from rent control. Flip-flop number two. The PCPs planning to introduce legislation to prohibit rent increases as opposed to limiting rent increases as per the status quo for the vast majority of families in 2021. The economics of rent control. In contrast to the world of politics, economic principles are timeless. Principles are not subject to flip-flopping. As economist Thomas Sowell wrote, quote, a century ago, virtually any economist could have explained why preventing housing from being built would lead to higher rents, and why rent control would further widen the gap between the amount of housing supplied and the amount demanded, end quote. And as Haslitt wrote, quote, the rent control laws among their other effects create ill-feeling between landlords who are forced to take minimum returns or even losses and tenants who resent the landlord's failure to make adequate repairs, end quote. Government laws are supposed to promote conflict resolution, not create conflict. In an unhampered market, landlords are forced to satisfy tenants and lose them to other landlords. But when the government intervenes in the market, competition is discouraged and supply is restricted, which means landlords do not need to satisfy their tenants. If a tenant moves away from a poorly maintained rental unit, the landlord can quickly fill the vacancy due to, A, the shortage of other housing options for tenants, and B, the high demand for rent-controlled units. How rent control destroys choice in housing. Thus, government intervention arbitrarily restricts the supply of housing, whereas competition, if the market is allowed to function, guarantees a sufficient supply to meet the demand and the best possible price for consumers, the tenants. It is ironic that this basic economic principle is easily observed, falling rents with tenants in control, the direct result of the government's economically destructive pandemic policies. Entrepreneurs, unlike politicians, have skin in the game. If they do not build the right type of accommodation in the right location, they will not attract tenants, and they will lose money. In contrast, bleeding-hard politicians profess genuine concern for tenants, but they always stop short of investing their own money in the construction of rental units at what they consider to be affordable prices. Moreover, they never admit to their own culpability for an insufficient supply of housing or their own role as bad landlords. Government policies are usually the product of politicians' desire to portray themselves as saviors of the people. Therefore, timeless economic principles which promote social and economic well-being always take a backseat to the propaganda of vote-seeking politicians. But that's what we get when we allow economic activities to be directed by people with political skills instead of people with business skills. For more content like this, visit Mises.org.


This video will talk about simplifying radicals. When we simplify radicals, you kind of first have to think about squaring. So if we have 5 squared, that's equal to 25, and if we have negative 5 squared, that's supposed to be equal to 25 as well. But when you take the square root then, it's kind of doing it squaring backwards. You're going to unsquare 25 in this case. So we would take the square root of 25, and we take the square root of 25 and we get 5. If we had the negative square root of 25, it would also be 5. The first one we use is called the principal root. If you're going to take the square root of something, you're usually going to give the principal root. The second one is called the negative root. If you have a negative in front, then we're taking the negative root. So let's look at several examples here, and we'll start here with these. The square root of 64. So I'm really saying, what squared is equal to 64? When I do that, I would have, we could say the 8 squared is 64. So then we could say, this is the same thing as the square root of 8 squared, and we all know that the square root cancels each other out, and we're just left with 8. So if I look at the next one, I want the opposite of the square root of something squared being 16. So what squared is going to give me 16? That would be 4 squared is equal to 16. So I want the square root of 4 squared, which is the same thing as just 4, because the square and the square root undo each other. And finally, now we have one that's got a fraction underneath of it. But you can just simplify the fraction. You can think of this as the square root of 9 over the square root of 25. And if you take that, the square root of 9 would be 3 without a radical, and the square root of 25 would be 5 without a radical. So we have 3 fifths. All right, let's move on to cube roots. When we talk about cube roots, we need to just find out something times itself that, three times, that gives us our number. So if we have two times itself, three times, we get 8. So the cube root of 8 is really the cube root of 2 cubed or 2. And now, watch, when you have a cube root, we can have a negative number times itself three times and still gives us a negative. So this is actually wrong. It should say negative 2 cubed would be negative 8. And the cube root of negative 8 would be negative 2. So if I have a negative underneath my radical, that tells me that my answer is going to be equal to a negative number. And I think negative 3 times negative 3 times negative 3. This gives me, these two give me positive 9 times negative 3, which is negative 27. So the cube root of negative 27 is negative 3. Now this time, I really want the opposite of the cube root of something cubed that gives me 125, and that would be 5 cubed. So the cube and the cube root cancel each other out. So I still have the negative out front, and I have the 5. So it would be negative 5. And finally, the cube root of 64, what times itself three times? So an accidently to the square root, we want to know the cube root of what cubed would give us 64, and that's going to be 4 cubed. So in here, we would say 4 cubed, and the cube root, and the cube cancels each other out, so the cube root of 64 is 4. Now of course, we could have always done these with our calculator. But we wanted to make sure that you got the concept of how they work. But now, if we go back to the calculator, let me get my calculator all cleared up here. If I wanted to do a square root, the keystrokes would be the second, and then the x squared, above that you see a square root. So the square root of, and let's do the 25 that we began this problem with. So the square root of 25, and then close my parentheses, press Enter, and I find out that sure enough it's 5. And if we want to do a cube root, we have to do one extra step. We have to go under Math, and then you see here at 4, it says cube root. So we would say, we would net number 4, and that gives me this cube root. And now I get to put my number in, so let's do the 64 that we just ended with. And if I do the cube root of 64, sure enough, it's 4. And just to show you the other two, practice the cube root, because that one's a little bit different. The negative, and then the cube root under Math, option 4. The negative cube root of 125, I should get negative 5, and sure enough, we do. And then finally, the cube root, go back to Math, number 4. And we want to put in our negative 27, close the parentheses, and we find out that we get negative 3. So you could do this with a calculator. But if we want you to show work, you would want to show that you were taking the cube root of something cubed, or the square root of something squared.


What's up everybody? Jason here for jasperyscasebrakes.com. Last filler here guys We're giving away the last nine spots in the Cajona's break With this little packed filler of 2021 optic hobby. So again guys, we'll do the break, randomize customer names Teams, distribute the hits out of the pack. It's only four cards, but you never know or I might get adjacent to being a sautograph in here and then We'll randomize the customer names again Customers in the top nine get spots in the Cajona's break, which is our last one and we'll do that next So here we go dice roll it roll 4048 the hard way one two three four five six seven eight Carl down to james six seven eight Guardians out of the red socks All right, so there you go. No trades though. I was about to say riffra I wonder I didn't know what they did turn into the Taj Mahal because I remember the last time we were in The Atlantic City was like 2016 The Taj Mahal was like literally about to close and those people striking it don't go in there and blah blah And uh, I was just like I was wondering what they turned that into so they turned it into a hard rock now And yeah, Carl, you know, I mean, honestly, their sketchy plays parts in everywhere especially like in vegas too but I don't remember one of the first times we went there me and nick and Boss man and Joe and all this we we needed to go to like riotator or Or some pharmacy store. I don't remember what it was. I think it was a riotator or CVS And it was really close to us, right? I say I was within walking distance. So we decided to go and it's like We made a left then another right and then I just felt like we were holding another entire city Like it was just crazy and then uh, I just remember we walked to CVS. We got our stuff and then we're just like I don't know if we want to walk back. So I think we ended up like getting a Uber to like the pier or the The one of the casinos and then we just kind of stayed there Because there's like a direct street like literally I forget what street it is But like when you get out of the nationals the hotels that are right there It's just one direct street that takes you right to like Caesars. I think it's in between Caesars you pass by like the the The uh, the hospital I think on your left and it just goes straight down there that street's nice because all the new outlets in there are really nice But yeah, if you go left or right, then that's where it can be a little A little sketchy It's just like anywhere else.  So People's that had to stick around Cantermaida And max mara, huh? There you go.  So appreciate you guys Coming up next is the big cojones


At what point will people wake up and realize that the information they've been fed their whole lives in regards to diet and nutrition is completely wrong? Is it the second or third miscarriage, yet a mother still follows the wisdom and guidance of her doctor? When, just dozens of years ago, mothers were popping out 10-15 kids like it was nothing? Is it that everyone watching this video has likely been personally affected by someone with degenerative disease? Is it autism rates, skyrocketing, babies dying of cancer? Apparently, none of this is enough. So, I'm led to believe that we're never going to realize the importance of the nutrient qualities of animal foods and how plant foods were really only ever eaten out of necessity. If you put any wild animal or plant food in front of a baby, they will always choose the animal food first. People listen to the USDA Dietary Guidelines, the government, on health and nutrition, and look where that has gotten us. We are the unhealthiest country in the world. And now with this meat tax, all this vegan propaganda, people are looking at it like the next best thing. And it's really unfortunate. We're going to take a look at freely the banana girl and see how she justifies losing her period on a vegan diet. This really goes to show you that people will justify anything in the name of their beliefs, even if it's as simple, as black and white, as nature telling you, there's not enough nutrition in your environment to sustain a child. Welcome to another episode. So today's topic is menstruation, monthly's period, whatever you like to call it. So I think I have a lot of experience on this because I've had my period on a sad diet, on a raw vegan diet, on a vegan diet, and I also lost my period on a raw vegan diet. So when I first came to 100% raw food diet, raw vegan diet, that was back in 2007, January. And as soon as I came on to lifestyle, like within the first month, I lost my period. It was gone. And I was like, yes, get out of here. I don't want to see you ever again. Don't come back now here. That's how I was because I was just so excited to get rid of it because I'm coming from this past of heavy period, pain, discomfort, depression associated with my menstrual flow because I'm eating animal products and I'm eating junk food and everything like that. So I was very, very happy.  So was it that that brought my period back? Well, it's hard to say because at the same time, I actually got with Harley during Ryder and that can also affect your hormonal levels a lot. So I'm not 100% sure why it came back, but it came back and I went back onto 100% raw vegan and it came back lightly. So initially it was heavy from the high fat and then it went in light and light as in about half a cup of menstrual cup of blood each day for a couple of days. And then the third day was basically gone. So I was only having period for like three days. If anyone knows what unit of measurement a menstrual cup is, feel free to let me know in the comments. And that's how it was for years and years and years. And it was great. I didn't know when I was coming because it was so, you know, painless when I was there. I hardly even knew I had it. It was fantastic. So rewind back to, you know, why I lost my period in the first place. I think because I was coming from taking a contraceptive pill for seven years every day for seven years. So my hormonal levels were quite crazy. So what I feel is that my period, when I took out the meat and dairy and the junk food, my body finally had the energy, the vitality to start cleaning house, to start balancing out my hormones. And a lot of people are like, oh, but that's unhealthy. No, no, you need your period. What's going on? You know, that's terrible. But is it? Well, a lot of people don't know. And all I can go on is my instincts and my feeling at the time that it felt good. It felt Hey, you heard it here first, guys. Losing your period on a vegan diet is detox. And I'm not a destructive person.  You know, I like to say that these vegans are misguided and they just need a little bit of information in regards to nutrient density of animal foods, looking at the other side of the coin. If that little bit of information is not enough, unfortunately, a lot of them are just so, there's just so, so closed-minded, so arrogant, so in denial, so brainwashed that it doesn't really matter. You pretty much have to leave them to their own devices, let their health suffer, and hope that at one point in the next years or whatever that, you know, they kind of wake up, so to speak. And it's really unfortunate. And almost everyone experiences this in their life to some degree. You know, everyone makes mistakes when they're younger and realizes them when they're older. And the lack of open-mindedness, self-awareness, and objectiveness is something that everyone suffers from. There are many people that follow a carnivore diet, many prominent people in the carnivore diet community that are very well known suffer from this. Almost every single professional in any field, regardless of how successful they are, suffers from some closed-mindedness, some sort of, you know, almost like in a pride sense. They don't really want to either explore new things or get rid of old information. I mean, the craziest thing to me is, you know, what does it take? You know, the reason I showed you this clip of her is to show you how unintelligent people can be and how impossible it is. It really is. Thank you guys for watching. If you guys would like to support me, please just subscribe and share the video. If you guys would like to reach out to me for one-on-one consultations, personal evaluations in regards to your complete diet and lifestyle in order to optimize your health through nutrient density, water, exercise, as well as sun exposure, you can reach out to me on the website below or email me frankatifano at gmail.com. All that information is in the description. Please let me know what videos you guys would like to see in the near future, and I will be doing a live stream tomorrow, so you boys better free up your schedule, because Frankie here is answering questions for free, as usual, every Saturday.


Hey, this is Brett, and this 2017 Ram 2500 Megacab Short Box Laramie with the Ram Box's stock number 13615Z. I am here at Summit Automotive in Fond du Lac, Wisconsin, you're new and used heavy duty truck and Ram headquarters. This 2017 Ram 2500 has the 6.7 liter Cummins diesel engine. It's paired up with the 6-speed 68 RFE automatic transmission. This truck has been fully-safetyed and inspected by our service shop, has a fresh oil and filter change. All the fluids have been checked and topped off, and it is 100% ready to go. Probably one of the cleanest 2017's we have on our lot. And I'm going to go all the way around in this video, inside, underneath, start it up and take a look under the hood to give you the most accurate representation possible of the truck. The white clear coat is the color and I shoot all my videos in 4K, so if you have HD capabilities on your computer, tablet, smartphone, or television, I recommend turning them on because it is your best way to check out the quality condition options and cleanliness of the truck before sitting in person. Going down the driver's side box here, box is in really nice shape. The Ram Box cover is in nice condition as well. Cab and doors all look fantastic on this truck. And the paint is very glossy and reflective, looks really good, driver's side front fenders in great shape. And if you like the video, you can subscribe to my YouTube channel, which is youtube.com slash Summit Auto. Click the bell notifications and you'll get updates on the videos I do each and every day here at Summit Automotive, as well as having access to one of the largest catalogs of vehicle walk-arounds on YouTube. This one comes with the 20-inch painted alloy wheels with the chrome inserts and it has Michelin LTX AT tires. These are LT275 65R20s and I would say they have close to 70 to 80% of the tread left on them, very good tread left on those tires. Frame and underbody is exceptionally clean. This is a clean title history, clean car facts out of North Carolina. You can see the bolts are even like perfect. Get the projector lamp headlamps, LED running lights, factory fog lights, and the front bumper parking sensors are in great shape as well. Get the tow hooks there, the chrome trim grille, and the hood is in fantastic condition. I didn't see any dents or dings on there. It looks really great and it does come with the cab lights up top. Passenger side front fender, very nice and clean as well. And the passenger side front wheel is in nice condition too. Nice to go down this side of this 2017 Ram 2500. Take note of how clean that body is, how reflective and mirror-like that paint is. I take these HD videos so if you are far away or even if you're close by and you just cannot make the trip down but you're still interested in purchasing the vehicle, you can see the truck, hear the truck, and have confidence in the vehicle that you're looking at. Before you even get here, so when you do get here there's absolutely no surprises. You can make a smart and informed buying decision from wherever you're at. If this video helps you make that buying decision, let your salesman know that you saw the video that it was helpful, and that Brett sent you. Back wheel is in excellent shape as well, and the back tires have just about as much tread as the front tires. Once again, look how clean that frame and underbody is. This is like a brand new truck, and really nice all the way underneath has all the remaining factory exhaust. Like I said, you will not find one of probably the cleanest 2017 we have in our lot, and you won't find too many as nice as this one. Comes with the nice factory chrome step bars, you get the ram box here, which is a really nice feature. Get the lights in there, locks as well. Coming around to the back, rear bumper is in great shape, no dents or dings in there. It does have the backup parking sensors, full towing package, which includes a receiver hitch 4 pin and 7 pin wiring, and the tailgate is in very nice condition as well. It does have a locking tailgate, and it comes with a back flip fold up tonneau cover. You get the bed extender slash cargo organizer, and you get LED bed lights back here. This one does have a gooseneck hitch in it, and you also get 7 pin wiring back here. That spring and bed liner goes on to the tailgate, which is nice as well, and that shuts nice and solidly. And for full disclosure, this back wheel just as nice as the rest. Now I will disclose that there is just a little bit of warping on this fender flare on the inside, which happens from excess diesel fuel getting on these plastic fender flares. That's a very common thing. It's more noticeable on white trucks because it kind of turns it yellow. You get the heated fold up tow mirrors with built in directional signals. They fold up like so. They fold in like that.  No rips or tears on the seats. They are in fantastic condition. You get the Laramie embossed into the backrest. It smells very clean inside this truck. Memory driver seat with lumbar, and you get the, I think they're weather techs, and there's a factory set of Ram ones underneath. They look like weather techs. Some headlamps, power pedals, power windows, locks and mirrors, and these mirrors do power fold in. I always like showing both sides, so let you know that both sides are working properly. Take a quick look at the back seats. They are just as clean as the front seats. No rips or tears back here. It does have the latch child safety system for any child car seats you may have. Power sliding rear window. These back seats are heated on the outboard side, and you get the weather tech floor mat back here as well as that carpeted floor mat. I think it's a prerequisite. If you get a mega cab, you have to buy weather tech floor mats. See them in just about every mega cab I've ever seen. Has the heated seat buttons right there, and these seats fold down two different ways. First way, the whole backrest and seat go down to give you a nice flat floor all the way to the back of the cab, which is great if you've got pets, put both sides down. They've got a huge place to lay, or even if you need to take a nap back here, you can do that. The other way that these seats go down is just the backrest goes down, then you get a nice confined storage area back there, and a higher load floor right here. And child safety locks on the back doors as well. Inside and bottoms of the doors all look fantastic on this truck. Like I said, probably one of the cleanest trucks I've ever seen. There are the powerful up mirrors go. You can see that this one has, you get the Laramie animation going there. This one has 37,450 miles on it. You get the digital speedometer compass, or I'm sorry, outside temp, time, range to empty, gain, and you can change those to read whatever you want. You can put the compass up there if you want as well. Comes with the heated leather wrapped steering wheel. It's an excellent shape, cruise controls on the right, Bluetooth and information center controls on the left, audio controls on the back of the steering wheel comes with the six speed automatic transmission, 68 RFE with the optional tap shift. This one does have the Alpine premium sound system. And you get the factory navigation system on here. This is the 8.4 3C radio. There's highway 41. So you can see that is working nicely and FM and serious XM radio capabilities, heated and cooled seat buttons as well as heated steering wheel button backup cam and cargo cam here. I'll show you how those work. There's the backup cam. There is the cargo cam. If you didn't have the tonneau on there, you could see what's going on in the bed. And then you have all your different nav and climate and apps on here.  You get the speakers in the ceiling part of that Alpine premium sound. This one comes with the power sunroof, map lights, homelink buttons for your garage door security systems and lighting systems, power sign, rear window button and 911 and assist buttons in the mirror. I will show you the tire and loading information real quick before we start it up. There's the tire and loading and then here is the VIN sticker. All right, let's start it up. Take a look under the hood. Lights are right up. No check engine lights or anything like that. I would personally like to thank you for checking out the video today and hopefully from this HD video you've been able to verify the quality, condition, options and of course cleanliness of this truck all the way around inside and out, all the lights are working nicely. Under the hood we have the 6.7 liter Cummins diesel engine engine based very clean runs very smooth. Once again this truck has been fully safe and inspected by a service shop has a fresh oil and filter change all the fluids have been checked and topped off and it is 100% ready to go.  There's the emissions sticker and I would highly recommend this truck from a quality and condition standpoint. I'd ship this one to California, New York, Florida, Texas, wherever whoever is going to get this truck is going to love it and to see more pictures of this truck in one of our other 550 new and used cars, trucks, SUVs, minivans, wranglers, halftones, three quarter tons, one tons, you may want to go to that website there at summitauto.com. Full pictures and descriptions of every single vehicle all at summitauto.com. If you'd like to check out more HD videos you can go to youtube.com slash summitauto. Click the bell notifications to get updates on the videos I do each and every day as well as access to one of the largest catalogs of vehicle walk-arounds on YouTube. In fact in a second you will see a link to subscribe to my YouTube channel on the upper left. A link to more Ram 2500 truck videos like this one on the upper right. Go to this vehicle on our website and more will be left in a link to one of our latest YouTube videos. In the lower right click those check us out. We're super excited to help you with this Ultra Clean 2017 Ram 2500 Mega Cab Short Box Laramie Ram Box in bright white clear coat. Thanks again for checking out the video. Remember to like, subscribe, and share on the YouTube channel. I really appreciate it. Thanks again.