Okay, welcome everyone. We'll go ahead and get started. Welcome to the first hopefully of a series regular the occurring series of All Q&A's for registered reports, of course the publishing model where peer review occurs before results are known and Results are published regardless of outcome with us today. I'm David Miller from the Center for Open Science and Chris Chamber Professor of neuroscience at Cardiff University and chair of the registered reports committee Chris, can you give a little explanation of why we're doing this and then why are we doing this very good? So welcome everybody. This is some this is like registered reports for registered reports nerds So well over the last six years. I've given perhaps 200 talks on registered reports and one of the Common features that most of those talks has been there's never enough time for Q&A at the end And it goes on one particular talk, you know, the Q&A lasted for 90 minutes after After the presentation. So we what we thought we do what we thought we would try Is a format dedicated to like the Q&A session of a talk and that means I won't be giving any Introduction to registered reports themselves This is for people who are already familiar with the format and indeed if you go to the The COS website or my talks page on the OSF you can find plenty of slides introducing the format But instead today we thought we would as I say focus on Q&A and in preparation For this webinar we sourced questions from from you from the community Some of them came from Twitter. Some of them. I think we mailed directly to David And we're going to work through them one by one and you know talk about the issues surrounding them And as David says this is all recorded so you can come back to this later And you know if you missed anything and also the slides will be going up online So I think that's enough for a very brief intro to why we're doing this as I say it's for this is for the nurse This is for the people who are in the process. Maybe they're thinking about Launching registered reports at their journal. Maybe they're thinking about a registered report. They're writing. They're in the middle of the process now I'm always happy to get really specific questions like no reviewer one asked for this. How do I do? How do I do this in a registered report? I've edited I was looked at the numbers today. I've edited 196 registered reports so far across seven journals in the last six years. I've seen most Variants of the process and things that can you know the challenges the opportunities things that go right things that go wrong So without further ado, I Suggest we move on to the questions and just to say if you have a question during the webinar Jump in ask it. I think David's going to be watching the bar on the side here so we can We can catch those questions as they come up and we'll be keeping a close eye on that so that we can track that as we go along So to our first question Which I think this one is from a journal editor who is thinking of implementing registered reports And they're asking from the editors point of view. How do you manage? a registered report with OJS, so that's the I think open journal system Which is an open source peer review Manuscript handling system or other stock peer review management platform is the second step a separate submission How do you count time from submission to decision slash? Publishing now the answer to this is it really depends. There's lots of different ways of doing this when we when we launched registered reports back in 2013 at Cortex, which is an Elsevier journal. We kind of jury-rigged it so that Basically we didn't change anything about the workflow. We simply added some new Guidelines on the website which created a new article type Which was the same workflow as a regular research article But had different instructions to reviewers different template letters to decision letters to authors And what we did is and actually we still do this is That we Process that stage one submission as a regular manuscript and when it gets to the point of In-principle acceptance we actually reject it which might sound weird But we technically we rejected on the system of course we tell the authors that they have their IPA So everything's tickety-boo on that front but we actually reject it technically on the system and then what the authors do is they come back At stage two and they select stage two registered report from the drop-down list And so the idea there is there's two separate workflows one for stage one and one for stage two and The publisher at that time was quite keen on this because they were reluctant to incorporate the time that the authors took to actually do the research i.e. between IPA and stage two submission within their publication times because they felt that that would actually make registered reports look extremely slow and would Skiw all of the various statistics that they use as KPIs I don't really care about those issues, but you know, this is what publishers care about so you have to work with them so in that case as I say we had two different workflows and In terms of counting the time from submission to decision It's simply a matter of doing that within each of those workflows as you would do for a regular article Now that's how Elsevier do it. At least that's how they do it for Cortex there are other ways to so At Royal Society Open Science, for example, we use scholar one and for scholar one There's a more integrated workflow where there's one Pipeline for the entire stage one stage two process that's preferable if you have that facility within your Management platform because it's just it's just better to have it in one order trail It makes inviting the reviewers back easier because you don't have to like search for them again on the system They're just there waiting for you. There's little time savers. It's just better. It's a more. It's just a better trail And I prefer that so that's the better way of doing it, but really It's it's even though the the structure of the review process is very different from Regular peer review in the sense that you have these two stages You have different letters. You have different criteria and so on you can shoe horn it into the into the old way into the old Management platform if you need to and because all these management platforms seem to have been designed in like 1989 and never updated since then They're so antiquated that it can be often quite challenging to to go into them and try you know Implementing revisions and innovations and they break very easily So you may decide as an editor that it's easier just to work with the system You've got get registered reports up and running and in the meantime, perhaps work on perfecting a more integrated work flow and these next series came from a From one single lab and their colleagues, so some of them will be pretty similar. What's the average? Rough range or an estimate time taken for a stage one register report to go from submission to give them the first round of reviews back Yes, it's a good question. I don't get this one very often I often get the one where how long is it before I get my final decision How long before I get my first round of reviews? So I was looking up some statistics before before joining today and it's It's a little bit tricky to tell because when you submit to a journal It doesn't always go to the editor immediately Sometimes there's a there's a buffer period in between where it goes through the journal admin to check it for very basic stuff And so it's not always obvious to the editor how long that process is taken so it usually takes about a week So if we factor that in if we allow a week for it to go through some kind of pre-editorial Smoke test as you know, does this does this pass muster at a very very basic level and Then if the at many journals there's an additional kind of editorial triage stage where the editor looks at the manuscript in relation to the stage one criteria and says Does this sufficiently me each of the stage one review criteria that it's not going to catch fire when I send it out for in-depth reviews So if it's close enough to meeting those criteria, the editor will probably push it through to review if it's falling Significantly short in any one of those areas like for example insufficient methodological detail insufficient linking between Hypotheses and analysis plan that's this kind of thing when these when when there's not enough in those areas of the criteria It often gets desk rejected So the fastest you can get a response back is often the one that I send at least half the time when a registered report comes in And I see that it's not gonna it's not gonna do well in peer review until the issues XYZ are addressed So what I do there is I typically desk reject that within about a week And I ask for the authors to make various revisions in order for it to proceed further to in-depth review So that process overall can take one to two weeks to get past that desk stage if you go into in-depth review I ask reviewers to turn around registered reports at least at the journals. I had it for for within 14 days Never takes 14 days. What's rare usually takes longer. It takes time to find reviewers It takes time for reviewers to accept review requests And then when they do accept this, they're often delayed and so on so It I would say the average once you go into in-depth review is probably about four weeks Maybe five to get your first set of reviews back allow some time for editors to look at it and make a decision And you're probably looking at I'd say in total if you went smoothly through the process And you read the guidelines very carefully and you avoid the obvious pitfalls So my top 10 tips for how to avoid getting desk rejected if you follow those closely You're looking probably at about five Five weeks or so five to six weeks for your first set of reviews back on average at the journals I had it for now. It's not always that quick at other journals. I know some journals are slower Some journals like to get more reviews in they just had different journals have their different Process to this and I don't know all of the information at all the journals. I added seven Soon to be six journals out of 208 So there's a lot that I don't cover But typically allow yourself about a month to a month and a half to go through that process The fastest I've ever had was a few days when the reviewers just were like lightning speed And I was able to process that one and feel really good about myself and the slowest one I've had was 12 weeks and that was because of reviewers being very slow Saying they'll review asking for delays not being contactable having to find other reviewers and so So it can take there is a range there, but you probably fall on average within that range about one one to one What's the most time-consuming thing that can be asked for the reviews in that first round of review I think the most time-consuming Request or requirement is pilot data. So this can happen where the reviewers are not convinced about the feasibility of the of the protocol for some reason or maybe they're not convinced that the rationale is all in place They may not be convinced that positive controls or manipulation checks have been sufficiently established There are various weak points which can be addressed often by doing preliminary studies And and that can be the most time-consuming thing because obviously the authors then have a choice They can either you know try somewhere else or abandon doing a registered portal together Or they can go away and actually do the preliminary studies and that can take as long as it takes them to do Aside from that if those issues all check out And often, you know, we get submissions where authors come in with pilot data already So they've already addressed those issues before they come to us The next I suppose most time-consuming element would be just addressing all of those criteria You know so linkages between hypotheses analysis sampling plan making sure it's a really really clear one of my Top recommendations for authors is that you always include a table in your stage one registered report Which includes your hypothesis stated in terms of specific variables your your sampling plan your analysis plan and your contingent interpretation depending on different outcomes of that test and Make sure it's all a really clear chain because that can that can avoid a lot of unnecessary Discussion about what's unclear, you know, I read the reviewers often say I don't Understand clearly the link between this hypothesis and this set of analyses And I think authors if they come in without having thought those things through they can go away and realize that in their own mind They weren't even clear and that can Elongate the process longer than it needs to be So just making sure again It comes back to those top 10 tips that are in my in my guide try and really nail those those issues Make sure you've absolutely tick them off And then if you've got your pilot data if you need it all in place and all of the other elements are there It should be relatively quick another similar question but Average and rough range of time taken for a stage one registered report to go from revisions to getting it accepted That's usually pretty quick So if you get to the revision stage of a registered report You've you're almost certain to get IPA eventually I think at least of the journals I edit for I shouldn't I shouldn't say that too general because there are as I say 190 something journals where I don't edit but for those that I edit for you you're pretty good chance of getting in because You've you've already achieved most of the criteria to even get to that point So There's two ways this can happen Sometimes a revision comes in and it's so good and I don't need to send it back to the reviewers And you get an acceptance within days and sometimes hours So more often than not though when there's major revisions it does have to go back to the reviewers and it's a bit quicker than the first round usually because they don't have to Read the whole thing again There's a very high acceptance rate because the reviewers are already when I say acceptance rate I mean acceptance of the invitation to review Because the reviewers have seen it already and they're invested in the process I would say typically you're looking at about three to four weeks For you know from from the time that we submit When you add all of that up you're looking at around three months to go through the entire stage one process and added to that you're going to be Taking into account the time you take so we as an author you're gonna have to go away and think about issues So add that as well make sure you factor that into your timeline. I typically Ask authors to consider a four month window as being representative of the process And that gets through one of their questions It wasn't specifically submitted but one of the frequently asked questions that we hear also a lot is just how much time Is this going to delay my project? Getting started because oftentimes one is a year to get started and this does by design take more Review and focus and evaluation right up front For very good reasons, but that is some of the take-home message Remember also you say that time comes back to you in the end It's like it's like putting money in the bank because when you get to the end of when you get your IPA You know, you know, you're not going to get pretty much No, you're not going to get rejected at stage two So you're in a really strong position to get that research published quickly So you're investing time up front But you're really getting it back at the end because you're not going to have to go from one journal to the next to the next Is there data available in the length of time to go through this process in general by journal or by a subfield? So some of the things here This data doesn't exist in any Organized form at the moment. It's mostly me talking And a shield works with Daniel Larkin's in Eindhoven has data on this For cortex that I sent her and she's analyzing it at the moment and There I suspect are more such studies in the pipeline Looking at how long it takes and then once that data is out there. We can start carving it up into, you know Genres specialties journals and so on and actually think this is really important information because one of the key Deciding factors for an author as to where they submit could very well be how fast is this journal? And I think journals should be transparent about that process as much as possible One of the challenges I should say from an editorial point of view is it is it's quite tricky to actually calculate these times again? Because the manuscript handling software was all designed in the 90s It dumps you out this really uninformative statistics was an editor Which doesn't caption really the information you want at the granularity that you want So we often find ourselves having to do this stuff manually, which is not good and very time-consuming I think which is one reason this data isn't more available But I hope it will become more available The as I say that the overall time frame you should allow is in the order of Three to four months to go through the entire stage one process. We don't know Really how that differs by journal or subfield yet If designing an intervention study, there's no data collected during the intervention only before and after it How specified does that intervention itself need to be? This is a good question And it's interesting because this is actually a lot of registered reports fall into this category You know, it's quite common that I think that there'll be no data collected during the intervention if it's an independent variable It's just something that is done to somebody or to you know to an animal or to whatever and then you measure before and after This is typical experimental design and so, you know the answer is it needs to be fully specified because it's crucial that every element of a registered report is reproducible and That's kind of one of the fundamental principles of registered reports You know in general and I would argue that should be the case for all publishing But the thing that you learn as an editor as a reviewer as an author within the world of registered reports is that to properly assess a Stage one manuscript under all the criteria that we assess them by You really need to have that level of detail in there and so I would always recommend Having more information rather than that So if you're not sure whether it should go in put it in if you think it really disrupts the flow of the manuscript to have All that detail put it in supplementary information, but still put it in Big one right here, but they're describing Two phase project phase two is suitable for the registered report, but the measure employed will be will depend on which measures In phase one a separate study Our significant predictors of performance in order to submit the phase two as a registered report and still be within the timeline of the grant We would need to submit at stage one at a point in which we know what potential matter measures will use And we know the criteria for determining which measures will include But we don't yet have that phase one data to determine which one is which Would you be able to list the potential measures that we will include and state exactly how we will determine which to include and why? The short answer is yes So in this situation you could do what we call like a contingent design Where you would say you would actually submit the registered report now and you would say Step one Which you could build into the protocol or you know for stage one review or you could You could have a separate and it's not part of the actual protocol But it's something separate like separately pre-registered. Maybe it's already underway, which is fine But you could build into that that process into that phase two protocol which forms the core of the registered report You have options. So there's presumably a finite number of measures That will go into phase two and you'll have in your mind You must have already a series of decisions that you're going to make in the future about if this then I will do that if this Then I'll do that but if this I will then I'll do that and so if you can operationalize it with that level of granularity Then the best approach is simply to build that a decision tree into your registered report and then When you get your IPA you can just follow the follow the tree and and see what happens and when you come back With your phase two data, you will have completed one path in that in that tree So it's very doable. We don't get a lot of submissions that propose that kind of thing. Usually they Usually they have a more formulated and hardwired sort of protocol But there's absolutely nothing stopping you from doing it indeed where we tend to see this more often is with analysis plans Where someone will say depending on the distribution of the data, we might do this type of analysis or might do that type of analysis It tends to you send us tend to see that kind of Contingency built more into the analysis side, but it's just as doable at the design stage provided Your phase one is Sufficiently developed that you know in you know what you're going to be putting into that contingency So you need to have some kind of bedrock underneath it which will now enable you to to build that contingency table And I think the reviewers will have to be able to see that that's being done in a very rigorous way and just convince that skeptical reviewer that That decision is not going to be made in any sort of biased way That's right. And you know one of the things the reviewers might do is start critiquing the phase one element So you it's it's almost advantageous in this situation to to to submit Phase one and phase two together as one registered report and revise them all at the same time So that you can get your phase one element approved and you can update that As you're also updating your contingency to do them all together in a way because if you do that You avoid the problem of having started your phase one and there's no turning back now some reviewer says fatal flaw the contingency that you've Put in place doesn't make any sense the this therefore must be rejected That would be a situation where an editor would be left in a position where they might have to just outright reject because there's now an element of the design Which is fundamentally unrevisable All right This one is kind of a talking about scientific culture and and how we disseminate and publish surprising findings What's the ideal vision for balancing a breaking news finding that deserves lots of attention? But by the very nature are less likely to be confirmed in later studies a very exploratory preliminary findings The current system encourages hyping of those findings and one manifestation of that is high-impact factor journals But if that is a to be diminished How will we attract attention to those potentially important findings that deserve lots of attention in the research community? Is it simply a matter of resetting our expectations? I think it is and I This this touches on a lot of issues about incentives and newsworthiness journal rank There's a lot of issues to unpack in this question I think and because of that as you know, you're going to find a lot of views on this And there's no reason why my view should hold any particular way. However One thing I will say first of all registered reports do not eliminate journal rank journal rank will always be there So long as there are journals because that's human nature If we eliminate journals, of course we eliminate journal rank, but as long as we have journals So people will find some journals more prestigious than others prestigious something that's baked into the academic culture at the moment But I do also think that resetting expectations is important here about what Justifies a piece of scientific research for newsworthiness in the first place at the moment Newsworthiness at least in the vision of this question and more generally as well is thought to be Demonstrated based on outcomes so you meet some minimum standard in terms of methodology and question get an amazing outcome and it's newsworthy and Registered reports shake this up really because they say at the core really what makes piece of research valuable important high quality newsworthy even Is when you might get an amazing finding but you can also show that it's not the product of reporting bias We don't take it that into account enough in my opinion in my opinion it You know what we need to reset expectations about is how newsworthy a finding ought to be when it's proven Or at least Suspected to be the product of reporting bias and I would suggest that in those situations It shouldn't be that newsworthy at one point in the talk I gave in London on Open science for controversial research I presented this kind of pyramid this hierarchy of evidence that I think makes sense in that context where you know typical sort of status quo research is really rarely what particularly in controversial field is in my opinion rarely Deserving of newsworthiness what's deserving of the newsworthy label is really when it's when it's Replicated when it's meta analyzed when it's shown to be reliable and demonstrable That said, you know, I can say what should happen till the cows come home. It's not going to be the case I think we have to accept that newsworthiness is still going to be a factor some outcomes will always generate more news than others The best thing we can do with registered reports is treat all such papers the same at the level of the journal The scientific record is not the newspaper. I think one of the mistakes that we We allow in science is Conflating the scientific record with with new with news reporting They are different and I think registered reports help to separate those two worlds and finally the thing I would say is that registered reports are not designed for the purely explore Blurratory science that often leads to findings that generate a huge amount of impact. I found this amazing unexpected thing I wasn't I didn't even you know, I wasn't didn't even have a study going or I just saw something That type of research is always going to be there. It's always important It's always valuable and it will always be newsworthy The question is how much weight you put in it until it's being verified and that's the balancing act Rebalancing I suppose of science that registered reports trying to establish I know cortex and a few others are specifically labeling or inviting submissions to authors Just specifically label exploratory results with you know, very little expectation about replicability, but but specifically designed for completely unanticipated findings We have a format cortex as David says called exploratory reports, which is the kind of yin to the registered reports Yang So this format is all about Generating hypotheses from data and it's not about there's no pre-registration as we discourage inferential statistics really of any kind Although, you know all this can report me if they want but we we we try to steer authors away from making conclusions about what they think is real And more about using the data to generate questions that can be answered in future studies using You know the hypothesis sort of methods so completing that deductive cycle. I also think this Question speaks to the Potential strength of preprints authors reviewers even journal Journalists often preface Findings report in a preprint with a this has not yet been peer reviewed taking that peer review as kind of the gold standard of scientific credibility And it would be great to hijack that skepticism a little bit with You know unconfirmed findings or unregistered findings Can be you know quickly and easily disseminated via preprints waiting for the higher level of rigor and evidence Provided by that the full register report format Yes, I think so and I think you know Certainly tagging articles as to whether they've been replicated Yeah, so I'll I'll have to go in there Going backwards through the scientific record and saying has this result been replicated and then badging that maybe onto previous papers Would be a really neat thing Unfortunately, I keep coming back to this You know the way journals work the way the scientific record is accumulated is again stuck in the 1990s Where you know you get this fixed PDF record, which is very difficult to update So we need to really think about the future of publishing the future of communicating science if we're going to develop those kinds of innovations This is a paraphrased from a series of tweet questions Relation in question they submitted a register report in the first review reviewers requested a manipulation check Fair enough. If you don't know that's just a way to demonstrate that the Proposed manipulation had the intended effect or that I was done in a competent manner Now the second round of review Interestingly reviewers are asking for a pre-specified plan as to what we will do if the manipulation checks don't pan out Finding this harder question obviously Then it seemed that first I mean if manipulation check is don't work out You have to pretty much go home, right? There's not much point running the main analyses if you believe they didn't even successfully manipulate the thing you were trying to manipulate So I guess I'm thinking you have to be a middle way Perhaps a plan can be if manipulation check fails We'll still run some planned analyses, but purely for exploratory reasons. It will not consider results supporting our theories What else do you have here? This is a good question. This is one that comes up a lot actually with registered reports because Manipulation checks positive controls in clinical research is referred to as intervention fidelity Hmm These are the only aspect of the results that could theoretically lead to a rejection at stage two So that actually happens, but it's possible that if a study was run in such a way That the authors couldn't show that the intervention was even applied properly or that there was some you know Something failed in a in an inner an outcome neutral check In such a way that the study was almost pointless then that could in theory leads a stage to rejection now in reality You got to ask yourself as an author what a reviewer what a reviewer is trying to get hold of when they ask you to report manipulation checks And when they ask you for contingencies about what you will do when they don't work out They're actually throwing you a life line Because remember that failure of a manipulation check at stage two can result in rejection So if you're in a position where you're able to say what you'll do You're also therefore in a world where that's the failure of that check won't lead to rejection Because otherwise they might they might say nothing you go ahead and run the study your manipulation check fails and get bounced Which is theoretically possible So what I suggest doing in this situation is always having think of it like a layered insurance policy your manipulation check is your highest Level insurance policy, that's the one where if that passes you're absolutely rock solid because your intervention whatever it is Has been shown to have the necessary fidelity was applied in such a way that the hypotheses that you that you propose are testable But if it fails all is not lost what you want to then have is another layer below that of insurance Which is how if my manipulation check failed how would I convince a skeptical reviewer that I ran my study to a high quality? So, you know if I was giving some kind of drug to one group and placebo to the other and My manipulation check on you know some known effect of that drug didn't pan out How would I convince a reviewer that actually gave the drugs to the correct groups in the correct dose? Etc. So think about how you would actually demonstrate that you know in some studies we get That might consist of demonstrating that signal-to-noise ratio in an EEG study is within a specified margin And or you know some other demonstration of lack of flaw ceiling effects. So think of it like a see a lay a series of layered Checks where the lowest level one We the one that if that doesn't pan out You're not sure if if the study was run at a level that you're satisfied that you want to publish anyway and We have never had a case in all my editing of the lowest level check not panning out What we have had and is very interesting is a couple of cases where manipulation checks have failed But the low-level checks have passed and what that tends to suggest is that the thing that you think is real That your manipulation check is tapping into may not be as real as you think it is So it could be that the the reality check that your manipulation check relies on is in fact Not as reliable as you thought and that that can happen because you know We work in a field where there's a lot of unreliable research. We don't have key benchmarks in every area that we can always push against So it's not disaster to have a manipulation check fail, but ask yourself how Reliable in your heart of hearts. Do you believe that manipulation check to be how much do you believe that particular result? Will pan out if the study is wrong correctly if you have if you suspect bias in the literature, which has shown That particular effect before or there's some other reason why you think it might be unreliable again build in the lower level insurance And if you do that then you can that can be your outcome neutral check that Determines or could determine whether your manuscript passes stage one and then later stage two review This is the last one that was Pre-submitted and we've got at least four questions in the queue that have been submitted through our question and answer format So do you think there is a risk of predatory or sub optimal register report journals? And if yes, how could these be policed and there's two possible ways to do this not honoring the in principle acceptance or Giving a poor stage one peer review. So let's answer that in two stages. First of all predatory journals I can't stop predatory journals. Can you David? I don't know Yeah, but it's a good predatory journals You know, they're like they're just a thing and I think we have to just avoid them because to be honest with you They're so easy to spot really most of the time that it should be straightforward to avoid them one of their very basic things that we do to We haven't encountered this situation yet, but if a predatory journal an obvious predatory journal Like one of those ones that says greetings to the day what are emails you if one of those started offering registered reports We would probably not add it to the COS list or at least if we did we would flag it in some way as potentially predatory We would do something to keep you informed So every journal that's on that list at the Center for Open Science COS.io forward slash are every one of those journals We believe is not predatory So that's actually if you just go by that guide That's a fairly easy filter that you can apply in addition to your own judgment I think most scholars who have got past a certain level in their career Know how to avoid predatory journals. The second one is a little bit more tricky suboptimal our journals This is a this is something that we This is this is a greater risk. So this is where the journal itself is respectable But it's just not doing a good job editing registered reports. It's either it's you know when when When we came up with this format six years ago I was very careful to make sure that the policy was quite detailed because I knew that it would probably be Cannibalized by a lot of other journals And so if you build all that detail in at ground zero then it that will be propagated across the area And so you will see a lot of the journals that offer registered reports use the text from our original policy That's good. If they follow the policy if they follow that policy then it should be fairly consistent across the board But they may not follow the policy that is always possible that editors will not honor an IPA or they will reject a manuscript at stage one for bad reasons or at stage two for bad reasons or that they will You know, there's one journal that comes to mind which has an implicit policy of Always rejecting stage one manuscripts that require any revisions whatsoever Which just seems bonkers to me in the whole purpose of registered reports is to is to Improve you eliminate bias but also improve the designs as you know through reviews So what's the point of going through that process and then just bouncing them if they're not perfect? Technically that's within the rules a journal can do that because it can decide at stage one It can reject on those criteria. It doesn't have to ask for it It doesn't have to allow authors to revise but I would say that suboptimal So the best way of monitoring all of this is for the community to tell us when it happens We have some very very early stage plans for a website where Researchers could rate journals based on their registered report experience Where they could leave specific feedback about what they liked and didn't like about the review process at that journal Maybe they could even talk about how long the process took you could gather various information from the community And then you could create a league table You create some competition between the journals and all of a sudden you've got a marketplace And then I think things will become more transparent and then we can address Some of those suboptimal elements more transparently in the other hand whilst we've got that sort of stick And there's maybe carrot in this hand I think we need to be training editors better in how to do this kind of editing and in a way that's depressing just for me Editing a registered report is really just editing a regular paper in two stages So if you can't do a registered report, I'm not quite sure how you're able to edit a paper with results So that's that's a little frightening to me However that it also must be accepted that there are some you some some unique challenges in editing registered reports Which some editors are not familiar with like maybe some of the statistical requirements, you know Maybe some of the deeper thinking about theory and rationale Maybe they're not used to doing that Maybe they're just used to going straight to the results section and making judgments on that basis So we need better training materials registers This is also something that we're in the process of developing and that could include, you know vignettes and possible even accreditation That an editor could get to show that they've passed some kind of test or a series of tests for properly editing registered reports But all of those things together and I think you can create an environment where you've got some control over the non-predatory yet suboptimal practices that are almost inevitable Almost inevitably going to going to happen because as this thing scales up it goes out of my control I only edit as I say seven journals It's going to go out of my control and it's going to be something that the community needs to start monitoring And I'd say for both of those Information is key Information gathering is key So if you see something going on if you feel like an IPA wasn't honored We are happy to advise and see what's possible for either of those situations Yeah, you know, I get a lot of email like this, you know, I probably get At least an email every week or two from someone. It's not always complaining about a bad experience But it's often, you know, like I've I've got this situation I don't know what to do this reviewers ask me to do this xyz What's your advice on this and so I do a lot of that sort of stuff through back channels But so I think it'd be nice actually if more of that sort of Dialogue was public because then everyone can learn from it and it can become a knowledge base So I would encourage you to share your registered reports experiences as publicly as you're able to do even if to some anonymous Way as much as you can because then others will learn and you'll also learn from from their experiences We have four submitted questions right now on the the chat We have time for plenty of them if you have others anyone listening feel free to submit some more But let me go down the list where we have Please can you give guidelines on searching the literature to find pre-registered studies? Chris and I can well, okay, so if you mean registered reports then There's There's one way you can you can find them is to go to the zodoro database And I'm sure David will post a link to that. Yeah in response So there's a the center for open science curates a database of stage two registered reports that have been published Which is not comprehensive and it is manually updated. So you can't rely on it as being the definitive guide But it's got a lot and it's And it's growing all the time So that's good. So that's one place you can go to find them You can also just set up a google scholar alert for the word registered report or registered reports You'll get a lot of false positives You know people talking about registered reports more and more people talk about them in their articles But you will also pick up the ones that are called registered reports um And the other if you if you also mean stage one registered reports rather than the completed Um, you know full stage two articles You can go to the osf registries page and i'm sure david can post a link to that as well Where you can filter for registered report protocols that have been Accepted at stage one. This is a really good resource. I send my students to this and on the master's course that I teach I I send the students that too because it it um Shows you what an accepted stage one submission really looks like which is terrible I think it really useful and a little bit more useful than a completed stage two article Because the stage two article of course also includes the results and discussion And there can be minor changes to the front end, but to really get a grip on what it takes to get a stage one manuscript Um Accepted it's really good to look at the accepted stage ones that are out there And as I say you can find that on the osf register And there are links to all of those on the registered report website and I'll send that out right now also cos.do slash rr It will send links to all of these too to all attendees right Chris you mentioned including a table detailing the links between the hypothesis the analysis and the possible interpretations Are there any good examples of that that we can look for? Um, there are so there are some published examples of that I couldn't think of any particular study to mind because my brain doesn't work that well But there's there are there are examples out there that have done this and you'll see more of them coming through because It's something I regularly ask authors for now And so most submissions that I edit actually end up with this in it But of course there's a delay, you know between that going through the pipeline and being coming out the other end Um That said you don't really need an example of this. So think about it logically. So you've got question And that there might be a research question here and then next to that the hypotheses You know list them one by one, maybe one each road and then The analysis plan now, maybe you've got multiple analyses for each hypothesis Which is okay in which case what combination? Of tests will give you what outcome then you might have your power analysis your sampling plan for that specific test Always make sure that your sampling plan is linked to the exact test that will test your hypothesis It's a big mistake people often make in a registered report having that too fluffy Make sure that's there and then contingent interpretation at the end What will different outcomes mean it's you can map this out on a whiteboard. It's it's one of those things that I would encourage everyone to do really whether or not you're doing a registered report or not It's just a good process to go through. I think when you're designing an experiment But you will find examples in the literature. We can probably dig some up after this webinar, but you know Fundamentally is also an element of logic to that yeah, there's a One of the big points is simple clarity using the same Basic words the variable names that are used in the analyses as closely as possible in their hypotheses just to avoid ambiguity there You know, you can always have two columns. I've seen this also where um You have one column which is the kind of prose description of the hypothesis and the next one linked to that that cell next one along will be the The opera operationalization of that hypothesis in terms of specific variables in an equation essentially And that's really nice because then you've got an equation then that links to an analysis Then that links to a sampling plan then that links to an interpretation so if you can build that chain of Very specific granularity with such precision that you can just throw data into this and then answer comes out the other end That's kind of what you're looking for All right, this question. What is the usual journal policy about news or media coverage of the study before stage two acceptance? Are you familiar with any of those before stage two acceptance? So this is interesting So this is when presumably the question here is about um Preprints this is about pre so this is this essentially falls into the world of a standard pre print whereas results exist So it's obviously potentially newsworthy But the the stage two hasn't been accepted. So let's assume you have published your stage two manuscript as a pre print Which you can always do At least in our field I think virtually every journal and indeed every registry report adopting journal That I know of is pre print friendly So you could always submit your stage two manuscript as a pre print and indeed you can do it all the way through So there's just to go off piece for a second I mean there are some researchers who just put their that ben jones does this he puts his stage one protocol up And he keeps revising it and it's basically stage two and you can just track it through version control all the way through to the end um, it's this I the same it'll be the same policy for media coverage and embargoes for that For a stage two registry report as which will apply to a regular research article that journal the journals embargo policy if they have one Will not discriminate between registry reports and regular articles So for example, if you publish a registry report in nature human behavior You're welcome to publish a pre print if um, you get You probably want to talk I would talk some of the more high impact journals might be a bit twitchy So I would talk to the editor about potential news Exposure that you want to generate before acceptance just to be sure that uh, that's not going to violate their embargo policy more generally Because that could endanger acceptance in a very strange way. I don't think it's ever happened, but you know, it could happen but you know Basically treat it like a regular article look at the journals embargo policy All right a couple of questions about Registry reports and grants and timelines Do you know of any cases where a grant was submitted without a register report in mind? But once awarded the applicants realized that it would be ideal for an rr But the timeline of the grant doesn't accommodate doing it Do you know of anyone who has gone back to the funding body to ask who extend the life? Of the grant and the associated costs And of giving a rationale about the benefits of Assuming that they were convincing about that That's a follow-up question, but yeah start there That's what a great question. No is the answer It's a really good it's one of those situations when you put all of those contingencies together the answer is no I've heard of different parts of that being placed, you know, I've had I've got a grant myself which I've submitted which Wasn't going to be a registered report, but ended up being one There's also cases I know of where people want to do registered reports, but the timeline doesn't quite work for them I what I don't know of is a situation where that anyone's gone back to a funding agency to say can I have some more money It's usually quite difficult to do that ever My experience like you tend to have cash limited grants and going back to a fund and saying hey Please may I have some more rules? So like all of the twist doesn't tend to really work That said you never know till you ask and some of these funders Particularly the smaller ones that may be more flexible and not so bogged down in pages and pages of policies and procedures They might they might be open to that I think this is what this question highlights for me is that the importance of registered reports funding model themselves Because they solve all of these problems You know if you can if you could submit your stage one registered report to a journal and to a funder at the same time You can tie all of these processes together and get rid of all of this risk of things running at the time and you know different stage one processes not Not being compatible and so on And this is something that Marcus Monafo and me and others are working on at the moment But in the meantime, I if you if you're in a situation where This is a scenario you're facing I'd be very interested to hear more about that because it's possible that with our collective influence of the c os and and Being involved in registered reports that we could always Approach a funder as some kind of team and say You should consider at a very general level This a particular change to your policy which would enable more flexibility For researchers to do registered reports that there's always scope to change policies We're actually anywhere if you've got a good enough case for it And the follow-up question, uh, you just answered it. You know how How could grants or registered reports go together better? And that's exactly where the editorial review and the potential funding review can rely on the same set of expert reviewers and If accepted by both you get the decision that the the work will be funded and published regardless of outcome Simultaneously So anonymous attendee at 3 47 p.m. Nailed that so that is absolutely right and that that is why we created the registered reports funding model So if you go to the c os.io forward slash rr and you go to the four funders tab I think it's called the four funders tab. Yes, it is You will find a list of the current registered report funders or funding models that are available It's a very short list at the moment in very specific fields but it's worth having a look just at the You know The style of it and I think we need more of these and that's something we're certainly looking at Understanding more and promoting and if I could pass on this to sort of an anecdote or series of anecdotes anecdote data There's a lot of enthusiasm by the research funded community about registration in general and registered reports in particular and they very much want to encourage the process and our working to Dot their eyes and cross their t's so But if they were to receive a question I want to add this process to the workflow List a couple of the benefits that they many of them are quite familiar with it But but having quite figured out the way to require it or to to make it more of a common thing That I very much expect that those types of questions would be well received Absolutely always asking for more money is tough, but always ask I totally agree always ask because If lots of people ask for a thing they take they start paying attention and sometimes if you know, they get one question And you know, it can lead to a change in policy a change of thinking That it's possible to change almost any element of this With time and you know with pressure So yes, definitely. All right chris. What are your experiences with reservations of journal editors? And society officials towards adopting the register report format for their journals Any insights as to how to best preempt these and win over the skeptics? Wow, this is a whole another one-hour webinar. Let's go right That's a good question. I mean active very this is a question. I get a lot from from editors actually who who Encounter barriers within their own editorial boards or they get blocked higher up So they might be on an editorial board and they want to do register reports They might even be a chief editor, but then they go to some publications committee Of essentially academic bureaucrats who then say no, we don't like it or they don't even you don't even know why they don't like it they just say no and Why so why why do journals say no? I have somewhere a bingo board on this I think we should add it if we if we've got a website for this for these slides Let's put my bingo board up. There's all kinds of reasons I've had from editors and societies over the years of why they don't want to do registered reports They will perhaps I think a lot of them are fallacious So they might say well registered reports don't fit all of the research in our field Therefore, we're not going to offer them as an option for anyone within our field Which is really a bit disingenuous because no article type at any journal ever suits everybody in the field All of the time. So, you know to limit an article type on that basis is pretty pretty illogical I think perhaps the greatest objection you I've come across is really just various forms of Publication bias. So essentially particularly higher impact journals Get their brands in large part by selecting what gets published based on the results and the Obviously the core of the registered reports model is that it takes away the power of the editor To say which results they prefer to publish over others which results are worthy of my prestigious journal And that power if you are if you are a journal whose reputation relies on publication bias And whose impact factor perhaps relies on publication bias You'll be less disposed perhaps toward offering this format then if you're a journal editor who actually tries their best to select what gets published based on quality And looks at results because of course regular articles always have them But tries to make the best judgment scientifically and those sorts of journal editors tend to be much more open to the idea Now the other thing is that a lot of editors don't like admitting That publication bias is the reason why they They are resistant to registered reports because they know that that's an unpopular opinion and I might talk about it so what they often do is they they they Kind of use smoke and mirrors and you get a whole lot of bullshit like our computer system can't handle it or our editors are too busy You know, I'm not the only editor who's come across these These issues there's some wonderful blog posts that have been written by editors of other journals who go to their chief editors and say Um, would you like to do registered reports? I'll do all the work I'll do all of this and they get a know for reasons that are very obviously publication bias, but Are not phrased in such a way How do we pre-empt these and win the skeptics over? Well, you know step one Show as much as possible that that the impact of a registered report Is is so great that you don't need results to go out to to go a certain way in order for Them to do well within the journal and we actually have the first evidence from citations. For example, that that's the case so Work by lily hummer and colleagues at the co s. I don't know if you're even on that page David you might be So they've got a no, I'm not not. It's um, it's your colleagues over there which have shown that That registered reports are cited Comparably to regular articles Or even possibly slightly higher within the journals which they appear Which is the best evidence you can give to a fussy journal editor who cares about their impact factor and is worried That accepting a whole lot of papers with quite possibly negative results will Lead to them publishing a whole lot of boring studies that nobody will read That doesn't seem to be the case based on what we know so far. And in fact, if you go to our uh, the co s web page in amongst the faqs you can find a Uh a two page pitch to editors which addresses these questions head on Yeah, and I think it gets to one other thing The proposal of a registered report is essentially asking the journal saying this research question is so important that it Deserves to be addressed regardless of outcome and that's kind of a high hurdle to to get over um, so The type of work being submitted here is not Boring Work that we all know the answers to already it's it's to questions that there are really burning questions So um, you know at least in the past couple of years there It hasn't been a tsunami of boring boring work. It's been the pressing research that deserves a You know the register report treatment and it's often high high risk research, you know Well, it's interesting back in the early days when we launched this format people thought well The only types of articles you get submitted to register reports are really really really incremental research or replications You know because that's the only time maybe that people would be prepared to go down this road In fact, you get everything So I get a lot of submissions of people proposing quite out there hypotheses and the reason it makes perfect sense if um If you're if you've got a really important question, but a really Severe test a high risk hypothesis Which could turn out null, but if it doesn't well, it could be really interesting You know if it's if it's supported that I could have major implications that can get through the registered reports process fine As long as the question is important enough and the method is robust enough So we get a lot of submissions like that the testing risky predictions What would be very interesting to know is whether the predictions in registered reports are fundamentally more or less Risky than in regular articles and that's a meta scientific question that I know some people are currently Studying get on that everyone. All right. We are just about at a time. I will conclude this first hopefully in a series a webinar of all q&a for entry reports a success and Be on the lookout for information coming your way if you register for the webinar We'll send you links to slides and a couple of resources mentioned throughout this Chris, thank you as always for your time and everyone. Thank you for logging on. Thanks for joining us


Alright, I got this question twice, so thank you for giving me money twice, I appreciate it. I was going to get to this question anyway. I'm fascinated by religious people's neutral or even negative view of money. Can you please discuss this? I've read Dan Coney's speech at least a dozen times and it's beautiful. Yes, it is amazingly beautiful. To really understand religious people's negative view of money, I mean partially, Dan Coney explains it, but I would also encourage you to read an essay I wrote on usury, on the history of usury, it's in my book, the moral case of finance, but also if you look online, I think there's a free copy of at least a version of it that you can find, or there might be a free copy, I'm not sure, I think it's free. So just put usury, you're on book. We're going to the history of money lending, and I show how to a large extent people's attitudes with bankers and money was determined by certain stuff that was said in the Old Testament. I certainly think that it had to do, it's not irrelevant to Jesus though, it's the money changes out of the temple, it's not an accident that God tells the Jews that charging interest is a mortal sin, at least charging interest from people who are your brothers, is a mortal sin, it's not an accident that Dante places money lenders in the seventh rung of hell, I think it's the seventh, and that by the way with a bag of money around their neck dragging them towards a fire, pulling them down towards a fire, but essentially I would say this, money and seeking money as a reward for productivity is fundamentally egoistic. It's fundamental, I mean you're striving towards attaining money in order to satisfy your needs, to satisfy your material needs, and in seeking pleasure in life, you're going after money because you're going after life, money is one way to do that, money is an essential way to do that, you can't survive without some money. Money is a measure of success, a success of what? Success of actually achieving your values, values for what? Values for life, whose life?  So money is a reflection of egoism, it's a fraction to some extent, and this comes out in the money speech, it's a reflection of your individual pursuit of your values, so it doesn't surprise me that a philosophy that rejects, that embraces altruism, embraces the idea you should live for others, embraces the idea that your life is nothing if it's not in service of other people, that sacrifice, self-sacrifice is the most noblest thing you can do. It is not a surprise to me that a philosophy like that, a religion like that, would hate money, would reject money, would view money as the root of all evil, or at the very best view money as, you know, just bland, nothing, amor. I mean money represents your time, your energy, your effort in achieving your values, values that are materially tradable, that are tradable, that's what money reflects, it's the value of the values you've created, and that's very egoistic, that's very selfish, and the Christian morality rejects all of that, and of course making money off of money is the most selfish thing you can do, and therefore the most evil of all the things you can do. All right, please. To a money maker, as well as to an artist, work is not a painful duty, or a necessary evil, but a way of life. To him, productive activity is the essence, the meaning, and the enjoyment of existence. It is the state of being alive. Arthur Vining Davis had created alcohol by the extraordinary range of his vision. He was a true builder, and in order to feel alive, he had to remain a builder to his last moment. That long-range vision is characteristic of all the great money makers. It was characteristic of J.P. Morgan, who made his fortune by his ability to judge which industries held the potential of future growth, and to finance, as well as organize their integration into industrial giants. United States Steel is one of his monuments, as well as the monument of Andrew Carnegie, whose company was the central property of that merger, and who had started in life as a steel worker. The money maker's ability to defy established customs, to stand alone against storms of criticism and predictions of failure, was eloquently demonstrated by Henry Ford. Ford was a revolutionary innovator both in technology and in economics. He was the first man to discover the financial advantages of mass production, the first to use an assembly line, the first to refute in practice the theory of class warfare by offering his workers an unsolicited raise in wages higher than any union scale at the time, which he did not for an altruistic purpose, but for the honorably rational purpose of attracting the able kind of labor and obtaining a higher production efficiency.


It's a tight versus a bill, two more, no showing up again. Allen gets away looking in trouble firing in its intercept. Not it, because that's Eddie George, y'all. Order tonight, huh? I love it. It's old. Love it. Hyped up. It should be. Yeah. It's another week. Another week. All right, let's do this. Nothing's behind us. Good to see you. Yeah, we'll talk about it. We'll talk about it. Do you have a good week other than the game? Man, I had an incredible week. I was in LA, San Diego over the weekend, watched the games out there. Got back late, Monday morning, and just trying to figure out where I am on the planet. So I've been in San Diego, Baltimore, DC, Columbus, Nashville. World travel. We're traveling the world, man. Big star of this guy. Well, thank you for being here with us. It's good to see you again. All right, let's do what we do. Let's kick off this show and let's get going. So let's do four downs with Eddie and let's talk about this bill's game. Ouch. All right, well, look, look, look. Yes, lost. I get it. Good things to, good things to point out. Number one, the mayor of Murfreesboro, Kevin Byer, continues to impress. He's a stellar athlete. Round of applause for Kevin, y'all, because we have star athletes on this team, leaders on this team.  I mean, look at Landry applying the pressure there. Oliver Field, five tackles.  Oh, man, well, a couple years back, prime time, Deion Sandus is, well, who is? Just a fan byer. Just a fan, right? Now he's, he's my early case. He's making an early case for defensive player of the year. Wow. And he's doing it with his play. Granted, right now, the record doesn't represent that. He needs some more help in that area.  He's showing that he's worth the money. And then some, he's emerged as a leader on this football team. And the defense has been playing, well, all season long. Yeah, absolutely. Giving them some big plays, they have a big, Bimba don't break type of philosophy, but they get the job done. Yeah, he had a huge pass breakup, too, that kept us back in the game, late in the game. I mean, the defense is definitely playing, playing lights out, as you see right there. All right, so thank you, Kevin, for that good play and the rest of the defense as well. Moving on to second down. Henry continues to run a great game. Henry is solid once again, 78 yards, had the touchdown, had another touchdown that got called back, unfortunately. Yeah, oh, that's painful to watch. But man, he's continuing to do it. He's picking up where he left off last year. Exactly, since week 14, he leads the NFL and rushers since week 14, number one overall. And the thing I'm impressed with him is that he knows, the defense is know he's going to get the football. And he's responding to that. His runs after contact have been amazing. I mean, he's getting four or five yards after contact. And when the guys of his size and his stats should look out, I mean, he's running hard in between the tackles and posing his will. Now, it just has to come together for this offense in terms of fast protection. We're going to get to that in a little bit. But he's a bright spot in the offense. And I think he's just continue to get the football to get them into a flow.  We talked about this was all of the news. Your talk with him was very inspired. You talked to a lot of football players. And did you see it in his eyes that he was really understanding what you were saying about imposing his will? Because that's something you say a lot. Well, we've re-talked before, but this is over the phone. And he was quiet. And usually when you're quiet, you're absorbing what's being said. He didn't give any excuses of why he wasn't running well or what was going on. He said, listen, I need you to be frank and really be brutally honest with me. And I did just that. And he's just been playing extremely well. He's been running like his hair is on fire. And he's a phenomenal back. And when he gets to the second level, he causes damage. And he can outrun anybody on the football field. We've got to get him to the second level. We do. But it's fun to watch him late in the game, too, because he is so punishing with those runs. Third down, you mentioned it, the past protection, something. That's the elephant in the room. OK. OK, look, Marriota is going to go only as far as the offensive line allows him to. We saw what happens when he gets disrupted. Jacksonville, they got to him with nine times. In the losses, he's been out of rhythm because he's not being protected. They've got to find a way to be more consistent up front. Atlanta kept upright. All things working. Well, my point is that it's complementary football. Complimentary football. Sure, sure. So it all starts up front. But with this being Taylor's first game back, working in tandem with Roger. I think it has a lot to do with him. And Buffalo's got a good defense. I mean, they're real. Look what they did to the Patriots the week prior. My point exactly. Yeah, and Marcus, let's not act like the Buffalo builds of old. Now, these boys can play some ball on defense now. It's true. There's some grown men out there. I don't even want to see them myself. I'm a big boy. But they can't get after it. So you've got to give them what credit is due. But we had opportunities to put the nail in the coffin and that was the difference between a good mediocre team and a great one that's pursuing a championship. That's true. We're not quite there yet. That's true. We had lots of opportunities. It was a good game in so many spaces, but not the right spaces and too many missed opportunities. We'll have one more down this way. Moving on to fourth down. Thank you. Well, part of the new look of the team, Mr. Cody Parky has joined the team. We've got a new kicker. Yes. And for those of you like, OK, so what's the story on Cody Parky? Let me tell you something about Cody Parky here. Cody Parky, he is number 20th on the list in his percentages. Do you realize this? 20th on the list. Do you know who's 50th on that list? Sebastian Janikowski. Adam Vinitieri is 16th on the list of percentages. Yeah. So I mean, the man, he can kick field goals. He kicks a career average of 83.9%. So and you know, sometimes a fresh start is always great. A new environment, new team and the fact that he's hungry. The kicker is a lot like golf. It's based off of your confidence. If you can get your confidence up and you got the support behind you and you've reeled off the numbers, he can be a very valuable asset. Now, when you miss a couple like my man lost last week and your confidence goes down. Sure. You don't have the confidence to kick it through the uprights. So hopefully he'll come in. And I think Mike Ray will be very patient and give him every opportunity to be the guy and really resurrect his career. Well, here's the deal. We're two and three. OK. We're two and three. I see a resilient team. I see lots of talent. Yeah. I'm excited for this game coming up. Yeah, I think we all are. Yeah, we've got to get to it. We will talk about that game in a little bit.  With that, we go to break with our Geico Fast 15. Stick around. Titan's going to be right back. It's trouble firing and it's in. Coming with pressure. It's trouble. Alan, die! You have Henry on the left. Well, that is George. Back with you. It is halftime here on the show. And I'll take a break from the X's and O's. Eddie, we're going to go deep on this. OK, I love the segment. All right, so I got a question for you. We're going to do a little rock and heart place.  Bill Spant.  Alone? Alone, alone. I can't stand people that will know. Like, I'm a loner by heart and by nature anyway. I am the same way. Yes, that's an easy one. Yeah, all right, all right. Well, we ask the same of our Titan's players. And you might be surprised what they pick. Here is Rock in a Hard Place presented by Snickers. I'd rather be surrounded by annoying people. I know a lot of annoying people, but I can just tell them, like, chill out. I can't be alone for the rest of my life. Annoying people. Yeah, I can't be alone. Can I just be with my wife for the rest of my life? That'd be nice. That's the goal. That was just some steep, steep.   I'd rather be alone. Annoying people is annoying, so. I'll be surrounded by people. I'm a people person, so I can teach annoying people some things and get them on game a little bit. Can I just be honest here? I guess I could be surrounded by annoying people, because I have four kids, and I love them to death, but they get a little bit annoying from time to time. I think my wife will agree to that, too. I'm used to it. I had my birthday recently. I went to the movies by myself, and I was so excited. I mean, I love my family, but all of it. Logan said something was interesting. He can teach them to not be annoying. Oh, okay, I didn't know it was part of it. I thought they were just annoying forever. That's how we set it up. Logan, you're not allowed to teach people. Yeah, you can't teach them. All right, so guys, listen, you watch the game, you watch the game in the seats, you watch the game at home. We're all armchair quarterbacks, unless you played the game. Have you ever just wanted to call the shot? Well, now you can, thanks to our app, our Titans app presented by Fandall Titans Pickle, and this is very cool. I don't know if you've played it yet. We give away prizes. You basically, you're picking the outcome of each drive. It's touchdown, field goal, and you know, yeah, you can play, so you can jet. Now, I know the app you're finding out already. Titans app, and you play Titans Pickle. It's very cool. So do it this Sunday when we go get that win in Denver.  We got prizes by the end of the season, and apparently you're playing against Eddie now. So good luck to you. All right, speaking of the game, come up that we're gonna get that W. We're gonna talk about it on the other side. So do stick around. We've got more Titans Blitz on the other side. Go ahead and download that app. We'll do some time. Everybody farm bureau health plans. Back with Eddie George. Let's talk about this game. It's a two minute warning. We got a big game coming up as we talked about before the commercial break up. Going up in Denver. Gotta get the ship right. Gotta get back to three and three. Shit, ship? Ship. Well, either way it's right. Ship right. Either way is your own point, right? That's true. That's not the thing. Who's that time of his whole day? He's not wrong. You've got to get it right. This is right if you're alley. First key, establish that run game. Yes. Yeah, gotta get that going. Must control the clock in this game. Listen, they did a nice job last week. Denver Broncos defense did a nice job last week of containing Melvin Gordon, held him to what, 31 yards on 12 carries.   Really, you look at the Broncos record, but one and four, they're better than one and four. They are. Very good team. Flacco can play extremely well, but they've got to be able to establish the run with Derek Henry, making a point of emphasis.  Yeah. We're making a point to get him going and build off of that. So I think they should make a statement by saying, hey, we're going Roger, Roger back this game, Derek and his feet off of you and run play action off of you. And you said something too. When teams know that's what you're going to do and you do it. Oh. It, you know. It kills your confidence. The defense. Yeah. I mean, you take the heart from the defense. It's like, man, we cannot stop this, no matter what we do. Yeah. We can block them. We can get off blocks and tackle them. We can't catch them. And they'll just quit. You will ask what you want. You want to impose your will and make them quit. Well, on the other side of that, we got to stop their run game. Which is very good. Phillip Lindsay is a dynamic back. Yeah. He's quick, he's strong for a small size.  He's a guy in water bug that squirts around, makes big plays, and he's a tough guy. You know, you look out at the statue with Roy Steemann. Out of Oregon, runs hard. So it was a dynamic duel between those guys. And 191 rushing yards. Yeah, between the two of them. But our defense is good enough, I believe, to stifle them and put the game in Flacco's hands. And that's the best chance you have at slowing down this Denver Bronco office because they're making plays all over the field. But they're one and four for a reason to have it yet to really find a way to finish games. They did it last week. But we got to nullify all of that this week by really getting at the Flacco, making it uncomfortable. The third key, and this is all about, these are defensive games. We play these tight games, but we have to keep Vaughn Miller in check. Linebacker Bradley Chubb out with a torn ACL out for the season. Unfortunately, yeah. So Miller is their key threat there on defense. And he lines up all over the field. Yeah, Vaughn has always been a problem. Since he's been in the league as a rookie, nasty off the edge, plays the run really well. And we're going to have to find ways to neutralize him. He can be a force. And given our problems on the offensive line, it's going to be a point of emphasis to protect this guy, run at him, wear him out, and find ways not to be in third and long situations and be effective with moving the change. When you were playing, you always know who's on the other side of the ball. But a guy like that, even if you're not chipping or not taking the ball, you just always have to know. Listen, it behooves you to know exactly where 58 is lining up at all times. Because he's a problem. Whether he's over the tight end, inside, outside as a linebacker, you never know, he's a disruptive force. That you gotta, like guys that you know, Junior Sayal, know where he's at. Know where Ray Lewis is. Know where Lawrence Taylor is at all times. He fits that same move. And finally, and real quick, just the final point. We gotta get up off the mat and keep fighting. Well, success. What do you say to the guys? Listen, the only way you get to success is through failure. And we learned from last week, we build off for some of the great things last week and just continue to move forward. The season is still young, so there are a lot of games to be played, but we have a great foundation, a great nucleus to build off of. We get it done with a win in Denver. So, yes, we'll be there. Why do you think we are playing better on the road? Is it harder at home sometimes? You know what, it can be. You would think pressure is your advantage, but is there pressure? But the pressure of winning in front of your own fans can be that way. But when you're on the road, it's us that, us against the world mentality, you know, it's a worker men's type of environment where it's a road game, like this is all business as usual. Let's go out here, take care of business and get back home. I think we'll get it done. I like our chances. We're gonna get it done? We're gonna get it done? Guys, stick around. We've got more Titans Blitz on the other side. We'll be right back. We're here on the show, Eddie, a little overtime for you. Eddie Chan. They love you, man. Wendy's hot take of the week. Listen, the Titans partnered with the Jimmy and Rosalind Carter work project and Habitat for Humanity of Greater Nashville this week is very cool. The rookies went out to build affordable homes and for low-income families, you can see there they weren't swinging any hammers right now because they got to, you know, so they had those hands, exactly, right? But they were there showing their support, helping serve the meals and helping out. It's so huge to be a part of the community like that. And in rookies, especially, coming into the professional football players now the keys of the kingdom given to them, it's good to see that stuff. Yes, and that's what rookies are for. You can't trust them on the field. So you send them out of the community and have them do the grunt work. But it's always good to have the Titans organization to be a part of the community and the efforts that are going on and to be involved and entrenched in what's going on. Yeah, well, and especially, I mean, this is a great project. I think it's 20 homes in a week they're putting together. Do you remember back, you know, when you were coming into the league opportunities like this, what it meant for you? How did it shape you as a football player, as a man? I mean, these are young men. Well, again, football in short is just a platform. It's a way for you to give back and to help others. I mean, we are role models. We are influencers. We are people that can, athletes are people that can affect change. And when we can go out on our spare time to give to the community, show that we're interested in helping them build homes or raise awareness for cancer or whatever it is, you want to do that. You know, it really allows you to be in a giving spirit and operate out of an excellent spirit, which you'll be blessed in return. So it's why not. Available for motivational speaking. Oh, it's true, man. Couldn't have said it better myself. Thank you. All right, well, guys, listen. Game coming up, right? I don't know where you're watching it at home. Well, maybe you want to check this out. We've got a game day hangout series happening, Brewhouse South in Franklin. Titans at Broncos October 13th, 325 is the kickoff. You might want to get there a little bit earlier, but come hang out with some fellow Titans fans. I know you like the comfort of your home, but this is a good hang. So Brewhouse South. Beer, half price, right? What? Now you might see Eddie there. He's enjoyed it so much. I'm on a beer, drinking, but at price, anything? I'm near. I'm hanging out with Eddie tonight. Guys, thank you so much for being here. We're going to bring home this win, right? Yes! All right, so check that out. Remember, Titans, pick them. Part of the Titans app presented by Fandil. You got to take advantage of that. Win some prizes all year long, whether you're playing at home or you're playing here in the stadium. Thank you guys for watching Titans Blitz. We will see you next week with that W. Thank you, Eddie, for being here.


A horse with a speed of light, a cloud of dust, and a hotty-hio silver! The Lone Ranger! General Mills, makers of Cheerios, the Oat cereal that's ready to eat, Betty Crocker mixes, and Wheaties, the breakfast of champions, present by special recording, The Lone Ranger! Say, isn't there something pretty wonderful about the delicate flavor of fresh roasted peanuts? Doesn't it make you hungry just thinking about it? Well now, you can enjoy this all-time flavor favorite in a brand new Betty Crocker cake mix. It's called Peanut Delight, and it really is a delight. It's the first cake mix ever made with butter from fresh roasted peanuts. What's more, into this mix, Betty Crocker has put the same fine ingredients you choose yourself, including famous softer silk cake flour and pure vegetable shortening. First of all, new Peanut Delight cake mix is made with real peanut butter. That gives the cake its wonderful, delicate flavor of fresh roasted peanuts. Mmm, it sounds too good to miss, so try it. It's more fun than a circus, and more delicious than you can imagine. Next time Mom goes shopping, ask her to please get the new Betty Crocker cake mix, Peanut Delight. With his faithful Indian companion Tonto, the daring and resourceful mask writer of the plains let the fight for law and order in the early western United States. Nowhere in the pages of history can one find a greater champion of justice. Return with us now to those thrilling days of yesteryear. From out of the past come the thundering hoofbeats of the great horse Silver. The lone ranger rides again. Come on silly, let's go big fella. Are you silly? After the lone ranger and Tonto captured an outlaw named Hans Albert, the mask man's Indian friend took the prisoner to jail in Casper City. As soon as he saw the hand bill describing the outlaw, Sheriff Tom Cherry put hands behind bars. Then he returned to his desk and compared the serial numbers of the paper money Tonto gave him with a long list on another hand bill. Hans Albert have that money in saddlebag when we capture him this morning. Oh God, every bill I've looked at so far is on the list. We think all money on list there, Sheriff. If you're right, this accounts for $5,000 of a stolen cat. I hope we could find the rest. Well, maybe Luke Moody and gang have rest of money. That's scum. Color named Hans work with gang. That's true, we might be able to make him talk. He'll already talk. He'll draw map and tell mask friend and Tonto where find Luke and gang. What mask friend are you talking about? Mask friend called Lone Ranger. The Lone Ranger? Ah, him on way to hide out now. Well, you mean to say you know the Lone Ranger? Ah, me, no long time. You said your name was Tonto. That's right. Now, me, me, no, Sheriff. Hold on. What's your hurry? Let me go after Lone Ranger. If you wait for a few minutes, I'll get a posse and go with you. Well, me wait. Good, good.  Fifteen minutes later, Sheriff Cherry left deputies to guard the prisoner in jail. While he and five picked possemen rode out of town with Tonto. How much of a stark does the Lone Ranger have on us? About four hours, Sheriff. We'll have to ride hard to catch up with him before he reaches the hideout. How far is the hideout? Lone Ranger, show me map. You take one day to get there. Spare your horses, boys. As soon as we join the masked man, the better I like it. Get him in there. Come on, get him. Shortly after noon the next day, Luke Moody and the two men with him stood in front of the well-concealed shack in the Dakota Hills. The outlaws named Rome and Webb listened for the sound of approaching hoop beats, while Luke Moody threw a half-smoked cigarette to the ground, grinding the tobacco into the rock-screwed soil with a heavy foot. We muttered. Hands should be back here by this time. Hey, listen. Well, Ryder's coming this way. Maybe it's Hans. Hans had come from the east. That Ryder's coming from town. It's Muley. Bringing supplies from town. He's traveling fast. Yeah, too fast. Whoa, whoa, whoa, whoa, whoa, whoa. Stay there. What's the idea of traveling so fast, Muley? A pace like that could kill a horse. I was in a hurry to get here, boys. What's wrong? Someone in town recognize it? No, no. No one in town knows me, Luke. They shouldn't. You're the only one of us who hasn't been written up in any handbills. I've got good news. A web. Take the saddle off my black while I go inside and tell Luke and Rome about it. All right, Muley. After I bought the supplies we needed, Luke, I stopped in the cafe in town. That's no surprise. A soldier was there asking the barkeep to let him buy on credit. Nothing new about that, Muley. I know. But when the barkeep turned him down, the soldier said he'd have plenty of cash to pay what he owes on Thursday. What happens then? He and all the soldiers in this part of the country collect the wages due to them for the last six months. How do you know? I bought the soldiers some drinks and started asking questions. He told me all about the payroll. Hey, a payroll would be worth going after. You've gone right. Hey, is that coffee hot? Yeah. Well, I'll get a cup. How is the payroll being sent to the forts? Well, on the express car of the Northern Pacific. Well, that means a train robbery. Shooting our way into an express car won't be easy. We'll not have to rob the train to get it, Luke. All right. The payroll will be unloaded at the finally station. The army will pick it up there tomorrow afternoon and take care of getting it to the forts and the territory. The soldiers in Fort Abraham will get it there after tomorrow. How will the army move it? In a wagon with grub and ammunition. Well, then all we have to do is stop the wagon. There's the right room. There's only one trouble. Robbing the army is a lot different from any other kind of holdup. Federal agents will be on our trail. Yeah. For a share of the payroll, I'd risk a tangle with federal men. We'll not tangle with them if we can help it. I figured we'd come back here after the robbery and hide out, Luke. No one will be able to find us. No, no. That's out, Muley. When we get the payroll, we'll keep going. We're going away. Across the Badlands to the Canadian border. There isn't a lawman alive who could track us through the Badlands. You know how to get through them? Sure. I've heard of fellas that got lost in the Badlands and died there. We'll not die there, Rome. I know the way through them, too. Well, in that case, it's all settled. By this time tomorrow night, we'll have the army payroll. At 3 o'clock for next afternoon, Tato, Sheriff Cherry and the posseman drew rain outside the upload hideout. They dismounted and looked around. On the place that's deserted, John. Maybe the lone rangers already captured the gang. the gang know him not capture gang well how do you know and you look at tracks for riders left here a long time ago here book with the silver alone rangers horse not right in here about our goal leave indian sign here and ground do pebbles arrange like that mean something fine mean lone ranger want me following will you be able to follow us tracks from here me follow and let's go hit the saddle boy we'll continue our lone ranger adventure in just a moment sheriff sam is a boy of ten he busts right in the robbers den and gets his man because he knows real shaped like little letter O's and those O's stand for oats the good grain Cheerios is made from every delicious spoonful of Cheerios and milk is real muscle building food each spoonful contains vitamins minerals and proteins your body needs yes those good things in a Cheerios breakfast do good things for your body help you have healthy nerves good red blood strong bones and muscles you can see that Cheerios is made to give you real go power so make sure you have a Cheerios breakfast every day then you'll hear people say he's feeling his now to continue to avoid being seen and recognized in piney station where they were known criminals Luke Webb and Rome had waited on the outskirts of town while Muley rode on at three o'clock he joined his friends what about him Muley six soldiers put the payroll in a covered wagon and left town they're heading west we'll go after him Luke and his men followed the wagon tracks for several miles then the outlaw leaders signal to hold boys the wagon tracks are heading for dead man's cancer yeah you're right those soldiers are jug heads to go through there we're lucky they don't know anybody there's a shortcut through the hills and by taking it we'll reach the canyon ahead of them I will wait on the rim for that wagon getting a payroll will be as easy as falling off a cliff get up when the outlaws who reign on the canyon rim they saw a dust cloud in the distance Muley studied it for a moment then said it's a wagon Luke with rifles ready Luke and his men concealed themselves until the wagon entered the canyon then get him boys before the surprise soldiers could return the fire four of them were seriously wounded as the other two sought cover Luke brought them down that does it boys they're all down let's ride to the canyon for and get the payroll Luke Moody was in the lead when the gang entered the canyon leaving his horse at ground hitch he walked toward the wagon when suddenly a wounded soldier fired the shot that struck him Luke went down but as he fell his gun roared the soldier dropped to the ground while you collect their guns I'll see how bad Luke after disarming the wounded soldiers web and Rome smashed the lock on the chest containing the payroll they put the money into their saddlebags and joined Muley at Luke's side you'll not be able to travel boys you gotta get me to a doctor no no no take it easy Luke I saw bones as in Pines station I'll die I'll die if I don't get help but he's unconscious good leave him there but but he planned to hold up it was his idea to clear out of the country you know how to get through the badlands Muley well yes well ride through them just as we planned we've got the payroll I hit the saddle Muley all right half an hour later the lone ranger drew rain on the canyon room a few minutes later he entered the canyon two of the disarmed soldiers had sufficiently recovered from their wounds to help their comrades when they saw the mask man a corporal came toward him oh you said a big fella I do all I can to help you corporal your mask I'm no outlaw outlaw or not we need your help is anyone dead no the rest of her fellas are badly hurt so that outlaw bandage the wounds of two men put them in the wagon well I hope you take care of the rest tell me about the ambush right by the time the last of the wounded soldiers have been cared for and placed inside the wagon the lone ranger knew the details of the ambush he knelt beside Luke Moody you know that's Mr. yes I've been looking for him for some time who is he Luke Moody badly hurt I hope he dies Muley Rome web your friends are gone Luke gone yes you you mean they left me here left me to die you'll not die your mask you're a law dodger too you're wrong there's no need to lie to me mister take it easy well I bandage your wounds I wish you'd been traveling with me instead of the coyotes who left me here but I'll get square with them you know the way through the badlands yes why Muley web and Rome are heading that way with the Army payroll you go after them you you might be able to take them by surprise I'll go after them good gun them all in the payrolls yours but before you kill them tell them I sent you I want them to know that they they can't get away with double cross and Luke Moody they get lost consciousness I've done all I can for him the doctor in town will have to remove that bullet we'll we'll take him to town in the wagon and turn him over to the share I'll go after his pals thanks for helping this mister I'm glad I was near when you needed help corporal an Indian friend of mine named Toto was following me if you meet him tell him I'm heading for the badlands all right he catches up with those cooks he'll have the army payroll with odds of three to one you'll have a hard time getting it too bad he's not law he's different from any old rude I ever met you'd make a fine soldier yeah come on but I'll drive the wagon back to town right after riding hard for several hours Muley Rome and web reach the bad land for a moment Muley looked from the familiar landmarks to the darkening November sky I don't like the looks of those clouds boys I've been watching them too nearly storms blowing up and might be a bad one this time of year might need children before we're through the badlands well there's only one place I know of to find it but we'll have to ride harder reaches all right then come on get up one of the worst storms in the history of Dakota territory swept across the badlands that night in the beginning it was a fine rain then as the temperature dropped rapidly the rain changed to sweet and icy pallets of driven snow that stabbed like sharpened nails Muley and the two men will follow him walk their way grimly towards shelter how much farther do we have to go Muley oh 10 15 minutes on her bring us the chimney rock there a camera there just a free-sided rock formation with a lot of overhang and rocks that'll shield us from the storm but I'd settle for a hole in the ground if I could find one boy so it is to live here I miscalculated we've already reached chimney rock come on here the outlaws dismothered under an overhang at the base of a steep cliff huge rocks on both sides shielded them from the wind and storm Muley took a stubble candle from the saddlebag and lit it for a moment the flame flickered then burned brightly this is as good as being in a cave a lot of travelers must use this place for shelter there's some wood some cow folks might have left it there are there ranches in the badlands yeah sometimes riders come this way looking for straight stock a bunch of blights to him for leaving wood I'll get a fire going how long you figure the storm will last well there's no tellin web sometimes it's sudden other times the last couple of days just have to wait it out later that night the storm began to subside but the roaring wind was loud enough to drown the sound of Silver's hooves at the mighty silver brought the lone ranger close to chimney rock the mask man saw the outlaws camp fire he drew rain the thinning snow revealed three men in the fire life the lone ranger dismounted and guided silver to a giant boulder leaving the stallion in its meager shelter he advanced on foot he stopped and dropped with a cover of a big rock a short distance from the outlaws with a gun in each hand he shouted web newly rolled your comment on your gun the startled gang snatched guns from their holsters but before they could fire the masked man's colts blaze newly staggered and fell with a bullet in the arm as web dropped his gun and collapsed with a wounded shoulder for a moment Rome's pistol wavered uncertainly as he tried to see through the darkness beyond the fire you're a perfect target stop a bullet not a chance of your gun a silver bullet shattered Rome's gun as the outlaw looked around for another weapon the lone ranger called raise your hand break your arms you've been I won't fight a man. I can't see. I give up. What about your pals? They hurt too bad to make any more trouble. It's a crime. Auto! He brings Carol from Cossie from Casper City. We met the soldiers you helped. They told us you were heading for the bad land. Just in time Sheriff. The last of Luke Moody's gang are there beside the fire. Take care of them boys. Put handcuffs on them and then bandage their wounds. Right. Don't try a fast move you scouts. You're all covered. They stole an army payroll, Sheriff. It's in their saddlebags. The soldiers driving the wagon back to Piney Station told us about the ambush. Sheriff sent one deputy back to Piney Station with them to watch Luke Moody. Even though he was wounded I didn't want to take any chances with him. Good for you, Sheriff. Corporal Davis told us how you helped him and his buddies. He must have been. Yes. Him plenty surprised to learn you not outlaw. I told him I wasn't running from the law. Now he knows for sure you weren't. A storm almost ended. Yes, Tunnel. The sheriff and his men will have no trouble taking the prisoners back to town. Aren't you riding with us, mister? No, Sheriff. But before we leave I want to tell you I promised Hans Albert I'd let the law know he helped capture the gang. I'll remember that. Good. Adios, Sheriff. Adios. Goodbye, Tunnel and thanks. That all right. Maybe we meet again sometime. I hope it's soon. So long and good luck. Everything under control, boys? Full capture all handcuffs. As soon as Pete finishes bandaging their wounds we'll be ready to travel, Sheriff. Good. Who shot me? Who opened fire on us? You mean you don't know? We never got a look at the critter. Too bad you crooks missed your chance to see the Lone Ranger. Righted feature of the Lone Ranger Incorporated is produced by Trendall Campbell Muir Incorporated. The part of the Lone Ranger is played by Bracebeamer, your announcer Fred Foy. Listen to the Lone Ranger brought to you by