Thanks. And then we are going to have an introduction to the template from Gjeldjorn and Olmo who are representing the team that developed this template. So I will turn it over to Gjeldjorn to introduce himself and then Olmo, Mark and myself. We'll just go around real quick. Okay. I'm Gjeldjorn Peters or everybody mostly calls me Gj. It's great that you make the effort to try to pronounce my name but most people can't even in the Netherlands so most people stick to Gj. And I'm an associate professor of methodology and statistics or M&T as we say in Dutch at the Open University of the Netherlands in the psychology faculty. And my original field was behavior change where we work quite post-positivistically basically using whichever methods we need to solve real world problems. And partly because of this I've done a lot of systematic reviews and of course as pre-registration becomes more common I've been wanting to pre-register those. And that didn't always work out for our projects. So that's kind of where this started and why I'm involved. That's great. Thank you, Olmo. Yeah. My name is Olmo van Anakker and I'm just finishing up my PhD at the Meta Research Center at Gjeldjorn University in the Netherlands as well. And my PhD is about pre-registration so it's nicely linked to what we've done today. And I'm basically assessing effectiveness of pre-registration in psychology or post-science. So that's my main topic. And I just finished, I just started a new job actually as well at the Quest Center in Berlin. So it's my third day so I'm now on a work retreat actually. So yeah, cutting time. That's awesome. That's congratulations. I didn't realize that. That's wonderful. All right. Good deal. Do we have Mark as well from COS? Yeah. Hi. I'm here. I am the real Mark. I don't know about some of you guys but Zoom is giving us attitude this morning and it's made you guys some of me. So apparently we're going to take over the world. Anyways. Hi. I am Mark Call. I'm the product owner for other staff registries and we're here for the Center for Open Science. All right. Awesome. And I am Katie Corker from Grand Valley State University in Michigan. I'm associate professor of psychology and I'm also doing some work with COS involving community engagement. And I also happen to be involved as a contributor on this template. So I certainly did not do as heavy a lift as the project leaders here that are presenting. But I helped a little bit. So it's exciting to see the template moving forward and getting integrated into OSF. And we're excited to introduce it to you today. So I will just, in case we had a couple more people join, I'll just say the agenda will be in the chat for you. There's a place to submit questions during the presentation so that we can sort of gather those up for the Q&A portion later. And if you'd like, you can also sign in on the agenda so that we can, you know, see everyone that attended and you can also see and learn a little bit about the others who are on the call so that we can all get to know each other a little bit better. All right. So I will turn it over to you all. I'll go with that. And that and almost to introduce the template. Excellent. So I'm going to be doing it together a little bit already when we prepared all my reminded me of some things that could be worth while telling. So basically, he'll just put in I'll start a bit with where it started. And then we'll move on a bit. Let's see. Excellent. So this is a big group of people that was involved in creating it. Apart from KJ, I also saw Amy briefly. So I and Richard. And there are a lot more people that you can see on this list that I'm not all going to name because you probably read them right now. So this project started out of well frustration is a big word. But basically, I was working with a PhD student who did a systematic review about sports because they can. I'm sorry, a bachelor thesis student because they can kind of choose their own topics. And it was about red cards and yellow cards. It wasn't a military, military analyst project was just a systematic review. And he couldn't preregister it anywhere. So then I started looking for ways that this was possible to pre-register it outside of Prospero somewhere because they only take half related research and they don't take scoping reviews out of. And as you can see, it didn't get too much interaction because I'm not very popular, but fortunately, this was retreated by somebody who was considerably more popular. And then there were some responses and some links where I also met Nicky, who you see at the bottom here. So quite early, you see that we were discussing doing this at the open science framework because of course the open science framework had a number of these templates. And this would be, you know, great to have because then everybody can just be registered systematic reviews there. So we're thinking about maybe starting one, but that that specific account of the open science framework. And this was like four years ago wasn't super hyperactive. So we didn't really get so much response. But at some point, Nicky had the, for some reason, drew Brian's attention and then he got us in touch with Matthew Spitzer, if pronounced it correctly, from the center of open science. And then we basically started thinking about it. How can we do this? And that's kind of how we got the ball rolling. Nicky was a veterinarian who also had problems posting on a large sparrow. And that already opened up the, because I always think from psychology, you know, it's like apparently there are also other sciences, but from my perspective, it's just psychology. So we have qualitative, we have quantitative, we have systematic reviews, but that's kind of it. Apparently it turns out there's a whole world out there with people working radically differently. And that's kind of one of the things we try to do here to make something that everybody can use. So we got together this team, partly also through Twitter and through people we knew, we didn't do some like general call through societies, but we, yeah, use more of a snowball approach. And then we started working on the form based on earlier forms that existed, like, for example, the Prisma guidelines. Within the team already, there were some differences on opinion, which is good, of course, if you want to make something general inclusive on, for example, the role of pre-registration. Alma, you alluded to this earlier. Do you remember specifically what we discussed? I mean, I know some, I know at least one point where I differ with at least Daniel Larkin and some other people as to the role of pre-registration. Yeah. So some people were wondering, hey, why do you need to register a systematic review? Because you're not collecting primary data. And so at least my point of view is that whenever you are going to draw a statistical instance, or maybe even a scientific general instance, then it's good to register your design, which involves systematic reviews, which can be systematic and objective, but they still have room for research or biases and in all kinds of collections, for example, in collections of studies, especially if you already familiar with the literature. And to, let's say, present these biases, I think pre-registration has a big role to play because you're logging everything beforehand where all the decisions are made. So that was my main reason for going into this project. Yeah. And as somebody who does a PhD in pre-registration, they're probably one of the most knowledgeable people on the whole topic in this group. Yeah. So basically we started integrating these items, looking at also our own experience and what we did. We had, for example, also some librarians, like Amy, for example. So we did have these different expertise and like we have research or perspectives, librarian perspective, et cetera. And then through some rounds and discussions, we worked on the form and tried to streamline it a bit to have the same types of items within every section and stuff like that. And then in the end, the form resulted. As a kind of context, it might be good to emphasize the kind of, yeah, the vision or the aims of the form. So the idea was to not make it specific to any discipline. So ideally, even people who do a systematic review of case law, for example, in some country or multiple countries, could use this. That's, of course, a bit harder because then you have to realize that not all the sources that people extract information from are always articles. So it could be more general, also reports or other things. And also ideally it wasn't specific to any review type. I assume everybody here has looked at the form. At the end you see there are quite some fields that are kind of specific to meta-analyses, like to quantitative synthesis. But we did try to formulate everything such that it could also apply to, for example, qualitative synthesis as much as possible. The consequence of this was also that there were no obligatory items because there's always, you can always think of some type of review where something wouldn't necessarily make sense. So instead of that, the approach was much more to list some items that we consider extra-elevant. They achieved a little gold, they got a little, achieved a real gold star by their great performance. These items got a gold star. But they wouldn't actually be obligatory. So that's, I think, kind of a brief introduction as to the context and the vision aims. Omo, is there any other important stuff? Yeah, maybe we can shortly mention the force we used for addressing the item. So if I recall correctly, we used the Prisma statement as a source at the Society for the Improvement of Psychological Science We also came together in a conference, I think it's called, to draft a template for meta-analysis. And there's also some people in the group who drafted registration form for systematic reviews in animal research. And it's also quite a different perspective. And there's multiple four and quite a big group that designed the template to compete for non-preventive research, systematic reviews in that area. So we basically gathered items for all these small sources, we bundled them together, and we thought, hey, what are the overlaps? What are the things we need to add? And this, we were like, in the process, we arrived eventually at this template Perfect. Katie, was that kind of what you had in mind? Yeah, absolutely. Yeah, no, I think one of the things I'm reminded of, yeah, is how many different perspectives we brought to the table already in developing the form. And we're continuing to solicit that input from people from all different kinds of backgrounds at this point. I think one of the things that we're really eager to do as we deploy the template more broadly in OSF is to make sure that it's in a good position for people from all different kinds of fields and backgrounds. So that's where the community feedback will be so important to make sure that we get at least a good version 1.0 up and then it can be iterated later as necessary, but hopefully we can get a very solid version up for the first draft. So it is, the form itself is linked in the agenda. And I think our next plan is to actually go through the form itself and give a little bit of an intro overview to it. And then we'll move on to the time for Q&A. And I'm monitoring the questions so far, so far, no questions, but please do feel free to drop those in as we're talking so that we have something to start from when we discuss in a little bit. So we'll turn it back to you. Oh, sorry, I thought Mark was going to do this bit, but we can do it too. I think, yeah, we, I misremembered who was going to do it. So if you're all right, that would be okay if we walk through Adobe part of it, if that's all right. Sure. And I went ahead and put in the link in the chat so anyone can look at both on their own screen, but also, John, if you want to share and welcome through it. Yeah. Oh, I think I might need to allow some more. One second. Perfect. So just to pollute the conversation for everyone, these are mockups to kind of show exactly how they will reflect what it looked like within the OSF registration system. When you go through them, everything on the left-hand side and the next button in the back buttons will be clickable. Everything else is not. It's just enough to be able to provide context about the content of the questions, how we can improve them, revise them, etc. Yes. So it starts with the metadata that's pretty similar to most pre-registration forms, so it has a title and has a description to give some metadata about this specific registration. You can add a license, you can add subjects. I think these will be familiar to pretty much everybody. The landing page has an explanation about the form. One of these things here is that it links to more specialized forms because it is such a general purpose inclusive form. If you do a meta-analysis, using a dedicated meta-analysis form might have more benefits. As already indicated, it can help prevent biases by learning you to specific things that you have to take into account for meta-analysis that are quite niche in the broader landscape of reviews and therefore are not in the general inclusive form. And it allows you to document more accurately. So ironically, even though this is a pretty big form, and you know we worked hard on it, we think it works very well. The idea is that ideally if there is a more specialized one, it can be beneficial to use that instead. So these are the instructions to use. And then we get to the actual form. If I'm going too fast, by the way, please just let me know because I've had a whole day and I'm pretty well caffeinated by now. One of the things you'll notice here is that type of review stages, current review stage are all just open text fields. And we had quite a lot of discussions about this actually in the team. There's a lot of benefits to using categories, to using closed questions because then the answers become machine readable. So it's easy to create overviews of the forms and you make them more searchable. But on the other hand, that requires an exhaustive and mutually exclusive set of categories to exist. And we couldn't actually find any that we were really sure, for example, even types of review, that didn't differ per discipline or per field. So that's why actually all the fields are just open text fields. So you start off with specifying type of review in whichever words are commenting your discipline. Then you list the stages that you distinguish within your review and the stage that you're in at the moment. Then the envisioned start date and end date because in my experience at least those are rough guidelines generally. Then more background information, primary research questions and potentially secondary research questions where the idea is that your primary research questions are mostly what shape the design. And the secondary research questions are things that you can also answer, but that have less influence on your decisions. Then if you have any hypotheses or expectations, if you don't do confirmatory research, for example, you can list them here. And then you describe the variables that you aim to extract from the studies. So the main variables will generally be outcomes, for example, or predictors, or sorry, dependent variables. And then you will have independent variables like interventions that you're looking at for treatments. If you look at RCTs, for example. Then you can list some additional variables. And then you describe the software that you will use for the review. That's one of their goals here is to make sure that you remember citing those and so in the end. And so that it's easy clear to people if they want to use resources from your review, whether they can, depending on whether they have required licenses, for example, or if they don't have licenses, whether they are familiar with the software. Then funding, conflicts of interest, and overlapping partnerships. That's one that was new for me when we started this. Sometimes you do a review because you are quite involved in the field. And then you might end up in a somewhat awkward situation that like one third of the studies was co-authored by you. And then it's good to have a plan for how you deal with this situation. So you can describe it here. This is a search strategy. Fortunately, under our science framework, you can save your drought halfway. This one has only been saved 11 days ago, as you can see here. But of course, in real life, we'll save them more frequently. Then you list the databases you search. I assume that everybody here is pretty much familiar with how systematic reviews work. So you probably know the difference between databases and interfaces. If not the interfaces are the service, the website you usually use to access the data from behind them. Whether you cover any great literature, the inclusion and exclusion criteria that you use, and then the query strings that you will enter into the databases through the interfaces. Then the procedure you will use to validate the search. Ideally, usually, you'll already have some target articles that you know you will want to include. So you can, for example, use these to identify queries. Then any additional search strategies you use in addition to just searching databases. How you plan to contact authors, what you do when you contacted authors, whether you are planning to report on this or not. And if so, what you will report. How long lived you think your search will be, how long do you think it will be solid. Of course, if there's imagine that there's like a pandemic that starts, then the expiration date might be a bit shorter than if it's a topic that's relatively stable, like I imagine something in history or archaeology. Then you can justify your search strategy and then you can add any additional miscellaneous details. These last two are in every section from now on, so that you can always justify why you made the choices the way you made them and provide any additional details. Then we move on to the screening. You can describe the stages that you use for the screening. Sometimes you do everything in one go, sometimes you try to do something quick the first round and then you go more comprehensively later on. Whether you blind or mask any of the fields, for example you might not want the screeners to be influenced by the journal because if it's a procedure journal they might be more inclined to include or whatever. The exclusion criteria you use during the screening, because you can really include because there's not an inclusion criteria that can trump an exclusion criterion so basically you just exclude during screening and the literal screener instructions ideally. There you can also upload a file because often of course there are Word documents or PDFs with instructions about what exactly they should do. Then how you will look at the reliability of the screening, you usually use multiple screeners and then you usually really start screening when you're happy with the reliability which means the screener instructions are clear enough that people can work with them. How you deal with inconsistency with disagreements between streamers, when one person says that something should be included and the other person says that obviously it should be excluded. And oh yeah, whether you include all the sources sometimes you may only want to look at a number of the sources like the articles for example that are included and if that's the case then how you will choose them and how you will determine your sample size and finally the procedure how you justify the procedure for the screening. Also here you can explain how you plan to manage the data and share the data because ideally of course if people weren't already planning to this will prompt them to realize ah of course I want to share all this openly and then they can explain that here. Then we finally have our hits so we can start extracting then start with listing all the entities you want to extract like author names or effect sizes or variable names whatever else and for like legal cases for case law it could be whether somebody was what's the word well whether they had to go to prison or whatever then the stages in which you will extract that can also be similar to screening you might if you expect that you will get a lot of sources that you want to extract from you might want to try to do something efficiently at first and then do it more comprehensively later on again the instructions for the extractors that's probably even more important than the instructions for the screeners because those entities you extract determine your data and the quality of the data so it's important that everybody agrees and ideally the others that are not in your team can also extract with similar results then any blinding slash masking of extractors for example you might want people to extract do not know what your research questions or hypotheses are again how you look at reliability and again how you reconcile if there is a disagreement between extractors then the justification for your why you extract the way you want to extract again how you share your results for example the forms with extracted data and any additional details and then we can finally start with the synthesis part with any data transformations you want to do for example for quantitative research you quite often will want to convert all the effect sizes to one metric for example Pearson correlations or for qualitative research you might want to standardize the kinds of results that you extract from results from articles like cluster them so that it's easier to synthesize them later on how you deal with missing data even after converting others stuff is just not there or can't be found anymore how you validate the data you found because after all after you extracted there might still be some errors just like the empirical research so ideally you have some procedure to look at this how you look at the quality of studies for example risk of bias assessment and then finally how you plan to synthesize if you do more confirmatory research or if you have some calculations and you are planning to draw certain conclusions about something then it helps to clarify how you will come to these conclusions in an early stage so you can explain that here again you can mask or blind person who does the synthesis or you can have multiple synthesis of course and then you can still mask or blind if you have multiple people who do the analysis for example in parallel you can do the analysis for example for example if you are looking at reliability and again you may want to have procedure for reconciling any differences between unless you are doing like a many meta-analysis study if that hasn't been done yet maybe we should start after this how you look at publication bias how you do sensitivity analysis and finally again justification, data management how you recognize this probably at the end you basically see your results you can review before you finally submit it so that's the form in its current state and now of course we are very much looking forward to all the suggestions and questions to improve it into a better first Thank you so much TJ that was really great I'm reminded you know just looking at the level of detail and the length and so on I think every supervisor who suggests that their PhD student do a systematic review for their research project should be forced to just review the form first of all to remember all of the different steps that go into it before beginning so we do have a couple of questions that have come through and I will more coming in this is great I think I'll start with one about mandatory mandatory versus optional items so we have actually been discussing this recently about sort of our philosophy or approach to whether or not all of these many items should be required so do one or both of you want to talk a little bit about our thoughts on that and maybe we could also have some other input from folks to react to what you're saying Homo Shalaya will correct me if I'm wrong yes so I think for OSF we decided on no obligatory items basically because that was a technical issue so maybe Martin talk about that more well I think there was actually there needs to be at least some obligatory items because they have to have things like the metadata fields with contributors and so on like those have to be there so if we have no obligatory items at all then it creates a situation where someone could register their review and have almost nothing in it either completely empty or almost empty so a concern is that if all items are optional to make the form maximally flexible then we worry about yeah in complete entries so I think actually what we had landed on last time was that maybe we would do the opposite which was to make the form maximally flexible and then it forces the user, the person completing the form to at least indicate not applicable or something in response to every question so go ahead G.J. exactly what almost said was exactly what I also explained in the presentation the plan was to have nothing obligatory that's why we had the gold stars for the things that we thought were important but not mandatory but yeah it's right it's a bit lame if people are able to enter completely empty registrations and then making everything obligatory kind of solves them because of course you can always say this doesn't matter and an added benefit is that you then have an explicit statement from the authors as a result of their reflection on that item and that I think also helps well maybe it's too optimistic to think it directly helps to prevent bias but at least from a meta scientific point of view it helps you see how people consider these things and where they have a more comprehensive explanation or where they just say N.A. or whatever where we also had with that was that it might be too burdensome to fill out the form so with every item so of course you can say just N.A. two letters that's easy but maybe that's something that the audience can also provide feedback on so there were a lot of items that you saw and if they're also they're all mandatory now so is that too much or do you agree with our reasoning that this way of going about it makes sense from a scientific extent? Yeah that's perfect so I would invite anyone who would like to speak up please do so or you can respond in the chat as well if we've got too many people to all talk at once very curious if anyone wants to speak on that yeah Alexandra? I think I just beat Matt there so I'm speaking with my prosperity for animals on the issue that we have sometimes is that people because our items most of them are mandatory the issue that we have is that some review authors just copy paste the guidance so I think I posted in the in the Google forms if there was some way that OSF would support semi-automated data validation to just check but it's either not blank, NA like none or whatever because yeah that is a manual process for us to check it for animals at the moment. Thank you yeah that's super useful Matt did you still want to chime in? Yeah that was my question yeah I guess my concern is like someone could put a lot of effort into a pre-registration and then they can claim they pre-regist their study fairly and then someone else can put minimal effort and also make the same claim so I sort of feel that needs to be a few more mandatory items especially if it's not being irreviewed. Yeah so the way it's now is that everything's mandatory right so that's in the concern that Alma just voiced was that maybe people will just maybe well the concern was that it is too burdensome of course that would translate and fear is that people just don't use it because it has like 65 items so it's quite a lot the point is that as I said it's supposed to be inclusive right so you have a form that's created to be useful for people regardless of whether they do a review of government reports about city planning or case law regarding I don't know people breaking into houses or whatever those law people do or just normal topic in psychology like for example the determinants of energy-relevant behavior and ideally it can work for all of them so because of this it's framed quite generally but there are some items there for example data transformations that will just not apply maybe to case law or it might but in that field people might not do it yet you know because these things change over time and then of course not applicable would be an acceptable answer but they would be facing all these questions so this is I think one of the harder issues to solve in the objective yeah I agree it needs to be a balance and I had to use the OSF pre-register something and not all of the fields were applicable but I guess at least if you make the mandatory and then they can put NA it sort of gives the impression that the defaults should be to try and you know put something in Alexander for example but that might also be because Prospero does have more narrow use case so you do have clear ideas about what should be there which you can't have with a general form because you suggested kind of the opposite but this allowed people from saying this does not apply to me or NA so there is a kind of tension I mean I would say that ideally if people have a health related systematic review they would use Prospero because that's more that again some really interesting tensions here then between sort of being inclusive comprehensive rather and being more narrow or more user friendly potentially so folks have thoughts on that you can continue to add them to the chat or to put them in the feedback form Ricardo Yeah I think that like at the journal we are looking at a lot of re-registrations and so on I mean you always need to look at how people use the pre-registrations anyway so I'm not too concerned about the fact that people might say that all we pre-register these with this template is a bunch of NAs because I mean you could also answer everything elaborately and so on it might still be very, very poorly worded and everything like that so the pre-registration is only saying that it's a way to assess the transparency throughout the process so people are going to try and game that and I don't think we can avoid that by forcing people to use it so Evan sorry Evan you're muted Thanks As I look at this I'm thinking about the difference between what I think of as a registration and a protocol in this context and in other contexts and one of the things that I think is great about trial registries and medicine where a lot of this kind of kicked off is that they have structured data elements that are searchable and ensure that I can go into a database and find all of the trials that have been done about something I'm interested in and that means that you have a minimum set of items that have to be entered in a certain way the WHO has a minimum data set that trial registers around the world are working from and there's a little bit of free text in things like clinicaltrials.gov but there's not a whole lot of free text in those or they're short in structured fields and what I see here are larger text boxes that correspond to in some cases very major sections of a protocol and so this to me looks less like what I would consider registration in some ways and more like what I would think of as a you know structured outline for a protocol so I think there's that tension and if I were to design something for registration I would probably strip it down and have structured elements rather than so much free text and if I were developing a protocol I might go in a different way as well so I see the guidance in the document here and then I'm comparing it with Prisma 2020 and there's actually much more detail in Prisma 2020 for many of these items than there is in this document so if I were thinking of this as a registration I think it's a bit too much thinking of this as a protocol I actually think the guidance might not be sufficient to write a Prisman compliant protocol or a protocol that complies with other reporting guidelines yeah that is great feedback and it's definitely something we discussed among the team do you want to react to that either of you anybody yeah I can basically this is indeed one of the tensions and it also relates to the role you think pre-registrations or registrations have I more and more think they don't necessarily are valuable because of an epistemological role but also because of a meta-scientific purpose and I think Evan that means that I would be exactly indeed in between a protocol or like a bare-bones registration but I think that people can differ quite strongly I mean there are people who think that they mostly have an epistemological role and they mostly come into their strength value whatever for like confirmatory research because it helps you to evaluate the strength of claims that's a very different perspective and would create a very different focus on this form they would also say for example that for qualitative studies pre-registration doesn't have much added value and I think that they're also there so I think this is very much a function of where you fall on that spectrum which means that we can go anyway with form kind of it's just yeah I think I can just add from a sort of technical or meta-meta point of view I don't know how we want to label this this is something we're thinking a lot about at COS generally is just sort of the role of human readable versus machine readable or findable objects so thinking about you know data repositories you know there's many examples across different fields of data repositories that have elaborate metadata schemes that enable findability of you know data down to the to the variable level in other fields you know these kinds of ontology systems of categorizing whatever metadata taxonomies are less developed and we're I'm seeing a parallel issue here that you could have these fields be designed to be sort of findable searchable machine readable etc versus what we have designed which is something that's more just human readable and not perhaps not as future proof in terms of being able to have these other functions that some other registries do already currently have so that's a really interesting point that I think generalizes beyond just this particular issue to sort of a bigger issue in general being able to find and search information among these repositories Ricard. Yeah I think Evan's point there about protocols is very important and I think that part of the way how to solve this is is I mean because I agree that this is a bit of a hybrid and it's also how how pre-registration is used a lot in psychology in particular as some something in between the registration of a protocol often but I think that on the landing page what is needed is explaining that in areas where there's a tradition of writing full protocols and register them hopefully or publishing them that is preferable much in the same way preferable to use prepare and so on and I think this again this is like a fallback procedure for areas that do not yet have those kind of things and I also think that it's super important that this doesn't you know out-compete such such endeavors I mean if we could come to a stage where we have full protocol registrations like in register report format for example in psychology systematic reviews that is of course preferable and that is of course preferable in you know law or any other field as well but we are so far away from there in many areas but we are yeah. I'm going to pull out another question there's quite a few to choose from in here so I'm going to try to pick one that goes in a slightly different direction person asks what was the rationale for including the option to indicate that the review is already completed when filling in the form that's also a really cool question it also relates to on how you see preregistration registration if you approach this as being mostly about transparency it can still be useful for people to want to do this at a later stage I mean of course if everything is done and it's published and you're not going to do anything anymore I think don't think it's going to be super useful but I think for a long time there are useful stages when it's useful to take a snapshot of your plans and your ideas at that moment and then I mean in theory you could complete this form in a few moments you could do it like actually a PhD student of mine completed it beforehand said in the preregistration form that she would review her methods after she'd done like a pilot of 100 studies and then registered again that allows you to see how these things change and once we have enough critical miles that can be super useful of course to improve our procedures so but that's my perspective and this is also I think something again like where people differ I mean not everybody thinks that registration after the pre-stage is still useful so I think it's a super super interesting question Yeah there was another question you brought up pilot testing that was related to pilots I think that's a useful one to bring in would it be appropriate to add a section to the form about weather and if so how a given stage of the review process would be piloted and how adjustments would be made so I think I could imagine sort of two solutions to this one would be adding additional fields that would address piloting and perhaps there are it's already covered under some of these fields sort of implicitly or it could be using the updating function within the OSF would be a nice way so you would have a sort of versioned version of the of the protocol right a pilot phase and then a second stage when you actually proceed to the main review I wonder if anyone speakers or any others have thoughts or reactions to that idea The problem I see with updating registrations all the time is that also these updates can be reviewed so currently as it is there isn't really account at all for checking registrations versus the final product it was just actual work for the review as well and if you have a sequence of 6 or 8 or 10 secret reviews or registrations that might even add to the burden so maybe the OSF update function can help make the process more structured and also more easy for reviewers then to actually review the differences but that is something we need to take into account Yeah the questions about the interface with peer review are really interesting to me actually and it's not something I've thought about in the context of this particular form I mean I'm finding myself more and more as I'm doing peer reviews of course if someone includes a registration or review the registration along with whatever else they've sent and you know different reviewers differ in their approach to this but I wonder we could think about how how it might be challenging to use this form in the process of review because it is so lengthy like I wonder if if there are improvements we could make along that line or if anyone has thoughts about the usefulness of forms like this within the peer review process I don't know if we have folks from other backgrounds outside the social sciences on the call but we don't have really a Cochrane like body and psychology for example there's the Campbell which takes some psychology relevant work but there is not like a sort of centralized organization that's doing peer review of basic social science research one sort of hole in this space that I've often wondered about in a form like this could have sort of a natural fit with with that kind of peer reviewing activity so if anyone has any experience with bodies like this or is from fields outside of social science I'd be curious to hear about reviewing protocols and or registrations within the context of this field I'll look for another question while we're if anyone speaks up while I'm doing that in the meantime while you're looking I saw a question in the chat from Heather if finality that actually also relates to an earlier question that whether or if finality is a main goal of the template then then we will need categories then we do need like ontologies and searchable stuff I do think that this is for at least psychology and I don't know about other fields but for psychology this I think will be important but also challenging because it's quite hard even for the methods to create ontologies and standardize those I tried with Wolfgang for a while to create a package he has this ES calc function in metaphor to create a package to extract basically all the conversion functions so that it would be accessible to other packages as well easily and then we also ended up with you need some kind of systematic API just for the conversion functions and that was just already super complicated and then the pandemic started and then the project kind of stuff but I think this is I mean I think we all agree that you have machine readability and human readability and ideally you have both but to achieve machine readability here is really really hard I think so if anybody has a solution for that that would be great yeah this is where my mind is at a lot nowadays is thinking about this problem and I feel like there's so much more that I have to learn in this area but so I'm constantly looking for for folks that know about this stuff so if that's you I'd love to hear from you so I have I think this is actually maybe a question for Mark best suited someone is asking in what format can you download the input so maybe you could talk a little bit about what if any API capabilities there are for registrations in OSF Mark don't know if I would cover all that within six minutes yeah essentially the probably the best way to download all those inputs is going through the API I can give you guys a link to how you can start your API one thing about our API is that only does public registrations it does not include any that are private or embargoed but I'll be happy to send that document along it doesn't much better than what I can do as a little high level yeah that's perfect we could certainly maybe we need to follow up just just on that topic alone I think people folks would find that interesting it's the API is more powerful than we all realize and it's quite interesting once you get into it all right so we we just have a couple minutes left I think I will do just one more question which is when will the template go live and our further developments or adjustments planned after that so we're going to take a look at what we're going to do in the next week to kind of our general process which is we were currently developing a process for templates like this to be incorporated into OSF so that process is going to be iterated through 2023 so if you are actively working in this area or other areas on related registration projects have those templates considered for consideration in OSF so this template's already moved past that stage right it's been selected and it's been now it's being piloted we are planning a phase of a few weeks to months somewhere in that region to continue to gather more feedback from the community at this piloting stage before we officially launch it so I expect some time within maybe early first quarter 2023 or there abouts that this will be sort of live and functional in the meantime the template itself is in the pre-print which is linked in the agenda and you know folks can of course begin using it at any time in its old static form it's also I have an R package pre-recker which allows you or pre-reader basically pre-reader pre-register with an R exactly but all our case because otherwise you have to type that R anyway and that's created to allow anybody to specify pre-registration forms that are not on OSF but that you can then use in that R package to create our markdown templates or to fill out using the console and this one is pre-loaded there as well so if you want to use it you can create an R markdown template to PDF for example and then upload as a file using the OSF generic form yeah so it could be an open end of registration or a general an attachment to a general registration at this point but yeah it will soon be available once we have the final version for further adjustments and developments really any of these forms are opened editing at any time but of course they quickly become sort of incorporated into the broader infrastructure of OSF so we don't push changes lightly but you can always email mark or anyone the OSF help as well is another good place if you have suggestions or input for feedback on any of the templates that are up and that feedback gets reviewed and potentially then incorporated it as we push changes so this will then be in the sort of same corpus another thing that we're planning for 2023 is reviewing the existing templates that we have and then aligning them to potentially make an incremental step towards this idea of making metascientific research and searchability findability and so on easier across templates so if all registration forms for example use the same labeling and scheme for primary research question then it becomes much easier to look across different forms for how that field is completed or filled in or what have you so it's a relatively large project but that's on the agenda of sort of trying to sync up the existing forms that are already there I see Evan has his hand up so go ahead please Evan I'm not sure we can do this in one minute I'll send you a note okay great does anyone else have any last thoughts or any questions before we disband I really appreciate all of your attending and I hope you'll share this back with others in your community and we hope this will become a really useful addition to OSF and we're excited to share this work with all of you so thank you G.J. and Olmo and Mark as well for joining us and I hope everyone has a great day and thank you for you and Mark for organizing this I think this is super useful with all the feedback I hope we got through the form now as well so thank you and thank Olmo for actually joining us from Berlin are you in Berlin now? you are there already right? yeah wonderful enjoy bye everyone


All right, welcome. Here we are talking to probably nobody or Just the folks who can put show up on YouTube It's the first day of recovery Mondays and new series that I'm gonna do today We're gonna go over why you are not broken Why you are not broken. You are not ill. You're not beyond repair. You're not beyond hope You're not unfixable. You're not ill. We're gonna talk about all those things So I know that in the live stream It's going to be a much smaller audience because at the time of this stream Facebook is down Instagram is down and I believe even Twitter is having some sort of string problems. I'm told I don't know So we'll make do with what we have if I have to redo it later Maybe I'll do it for those folks, but at a minimum we can have a little bit of a conversation I see 10 people So good pop in when you guys show up on YouTube welcome YouTube You're the only ones today because I can't stream to Facebook and I cannot post to Instagram just yet because of the outage But just give me a hello. Let me know where you're coming from and we'll get into this I've been trying to keep these a little bit Shorter and yet they still wind up 20 25 minutes So I am going to try and keep this one a bit shorter, right? And yes, I will save it that's true I'll save it and then I will post it to to Facebook later on so their loss, but I'm glad you guys are here There's 11 of you here on YouTube. Thanks for coming by I appreciate it Bethany says during the apocalypse. Yes, the great social media apocalypse of 2021 So let's talk about this. Why are you not broken one of the most common fears that come along me? And look these anxiety problems that we talked about all time. We're just loaded with fears, right? There's nothing but fears fears of your own body fears your own thoughts fears of your heartbeat and your breath and intrusive thoughts and scary thoughts But one of the most common fears that we don't talk about it's very meta in a way is fear of the disorder itself And fear of the idea that you can't get better like you are broken You are damaged you are ill and that it will not get better But that's not true. That's actually not true So and I want to talk about that now So if you're worried that you're not going to get better or that you're definitely broken or there or you're mentally ill or your Damage or something like that, then I am absolutely talking to you today Why are you not broken and ill first of all? Sometimes this is a bit controversial, but I'm gonna say it anyway. I Tend to not look at anxiety as a mental illness Now some people really get angry when I do that and I'm not sure exactly why if you would like to think of this as Some sort of mental illness or disease then by all means you are welcome to do that I don't happen to share that view, but that's my opinion. You can disagree with me for like Here's why I say that and here's why I say you're not really broken You've simply learned to be afraid of things that you actually don't have to be afraid of now Don't let me tell you that these things are not scary or worthy of fear They are like these things that you experience are very scary And they're very uncomfortable and they seem like you should be afraid of them And they kind of seem like you should begin to restrict your life and work around these things to try and make them not happen Right. So if you are plagued with all the body sensations and the panic and the anxiety and the panic attacks And the thoughts that are scary and intrusive and you can't stop them It would make sense that you would try to get away from those things and stop them from happening And try to prevent all that and make it all go away. So I do get that. I really do However, that does not necessarily mean that you have an illness or that you are broken or that you're doing something wrong Or that this is your fault. None of it is your fault So how did you how did you get here and really and truly like this is all out of chapter one of the anxious truth Which is the book that you see in the corner here. So that's the book that I wrote last year This is my that's my recovery guide Uh and why are you not broken like because you have simply experienced some scary things that your body has thrown at you But they are natural and they are normal humans think sometimes those thoughts get a little sticky and loud Humans have bodily reactions to fear Sometimes those bodily reactions get exaggerated and they happen when they're not appropriate Humans have threat detection and response systems and sometimes those get activated when they're not supposed to So these are all very natural things and they're normal things Just triggered at the wrong times or you may be in a situation in your life where maybe your resilience is a Little bit low and you're a bit maybe you're under the gun in terms of stress And therefore some thoughts might get a little stickier on you than they do at other times in your life So that's why these are not necessarily in my view in my view These are not illnesses because illness implies Something has happened to you that is beyond your control that you can do nothing about Unless some external force is introduced that will cure it or make it go away Then that's simply not the way this works. And it's not only my opinion This is we have just tremendous tremendous mountains of real world evidence in many many cases From all around the world for many many decades that tell us that these types of problems are treated very effectively With cognitive behavioral therapies and their variants CBT acd act dbt metacognitive therapy like these things work really well in these cases And those wouldn't really work if you are broken or had some sort of actual illness in the traditional sense of the word So that's why I say that you are not broken You have learned and understandably so to be afraid of certain things that your mind and body are doing However, you don't necessarily have to be afraid of them and the way out is to unlearn that fear response, right? So you have to learn through experience that you don't necessarily have to be afraid of those things Even though they are absolutely scary and uncomfortable. I will validate that all the time They are scary and uncomfortable and doing this makes it really difficult, right? Because you're actually going against what some people, you know survival instincts air quote So it makes it really hard to do but it doesn't make it impossible And these things do not mean that you are broken and again, none of this is your fault All of us sort of experience these things almost all human beings experience these things from time to time But for some reason for some of us they become a little stickier So many many people have panic attacks at least once or twice in their life But not all of them develop panic disorder people develop panic disorder and don't develop agoraphobia Why is that I don't know nobody knows that's kind of the zillion dollar question, right? But the bottom line is that what you're experiencing is not a horrible illness or an incurable disease You don't need somebody or something to be introduced to cure this. There's no defect going on You've learned to be afraid of certain things and there is a way out of that And millions upon millions of people have done this and actually found the way out of that over many many decades, right? So this is not new. I'm not making this up. This isn't my own special system or method or anything like that This is just science. This is what we know to be true based on a very very large population sample across Multiple cultures all over the world for a very long period of time So while you may be incredibly afraid and incredibly uncomfortable and feel like You are broken or damaged or that there's no way to fix you The reason it's first of all, it's understandable because these things really are very impactful in our lives It's a hundred percent understandable why you would feel that way But the error in that judgment starts to be when you think well, I have to try to stop it from happening Right. So part of the reason that people think that they are broken or damaged is because they can't seem to fix it Right. So part of it is that they can't seem to fix it But the problem is the definition of fix So when I say that we have a very large sample and a very large data set that tells us that people can get out of These problems they get out of the problems when they stop trying to fix it in the sense of make it go away So when you are trying to fix it figure it out If I could figure out my triggers if I could figure out what I have to avoid If I could just stop these things from happening if I could stop my heart from beating so quickly If I could stop having that thought about harming my child or if I could stop having that thought about this Or I could stop ruminating so much or I could stop having that short of breath feeling If I could stop all these things from happening that I'll be fixed And when you can't do that because it's really really hard or almost impossible to do to address it that way By trying to stop it all instantaneously Then you will logically come to the conclusion that you are broken And then nothing is working. So I'm sure a fair number of you watching whether you're live or watching on a replay would probably say Well, I feel like I'm broken because I've tried everything and nothing works But you have to understand that it's not your fault that nothing worked Nothing was going to work because you were trying to address the problem by pointing at the wrong target Like that's really really important to understand and I my heart goes out to you because I understand how you might feel And you might think that you are absolutely 100 broken and cannot be fixed. You're damaged. You're ill I have a mental illness because every time you try to manage Your anxiety or you try to control it or you try to stop it and you can't you fail at any consistent level It would definitely lead you to believe that there's something seriously wrong with you and you would start to lose some hope So I get that so the message today really is we hit the 10 minute mark and then I'll see if I take a couple of questions From the audience here, which again, thanks you guys for coming by but uh, yeah, if you This this is why it leads people to believe that you are broken But the reason why you are not broken is that there is actually a way A path to get out of the corner that you're stuck in right now It's just generally not the way that you would want right because it's an uncomfortable way. It's a difficult way It's a very counter-intuitive way Then in many instances as we do these recovery mondays, we're going to do these every monday, right? And we're going to take lessons right out of that book the anxious truth We're going to go right out of that and I'll give you samples as we go But we're going to talk about Why all the things that you've tried and the advice that you've been given has not worked for you So leading you to believe that you are somehow specially broken or worse than everybody else So when I say broken, I would also say a lot of people kind of think like Oh, this is clearly because I'm worse than everybody else. This can't work for me. I'm worse So that's a very very very common feeling too, but The path out is just not the one that you want. It might not be the one that you were looking for It's not the most comfortable one. It's very counter-intuitive. It doesn't seem like common sense So there have been many times in the social media community when I've run across somebody who is maybe new to the podcast Or hasn't hasn't seen me before and they'll hear me say things like you have to learn to willfully Like josh Fletcher says willfully tolerate anxiety or I'll say you have to surrender to it And some people will hear that for the first time you get really angry with me very angry Like you clearly have never experienced this. You don't know what it's like You don't know what it feels like and that doesn't make me angry. I understand that they want to disagree with me they think that I don't understand they think that I've never felt it because I would say something like that and The idea that the way out is so counter-intuitive and so opposite from what you want And so difficult because it you have to be willing to be intentionally afraid and uncomfortable Is what leads people to believe well, I don't want to do that. I don't want to accept that solution So therefore I I stay in the conclusion that I'm broken, but you're not I promise you're not I feel you but you're not broken Okay, so about 11 minutes. I'm going to try and wrap it up in 15 minutes or less So let's see if we have any comments From youtube. Thank you youtube Um, I don't spend a lot of time on youtube, but I'm glad that we're changing that So let's see what we have here and by the way, I will put up and yes, I'm going to do this because that's the way it goes But if you are interested, you do not have this book the anxious truth And you are not sure what to do like you're lost you're confused I literally started the book with those words your lost confused afraid And and don't know where to turn and directionless then. Oh, why did I do that? It blanks the screen? I forgot to turn off my app that that does that Um, okay, so if you're not really sure where to start This is all new to you and you're thinking I've tried everything nothing works How do and you want to ask those individual questions? How to overcome shortness of breath? How to overcome heartbeat how to overcome dpdr? I would strongly suggest you either listen to all my podcasts Those are 100 free or go and pick up a copy of that book Because all of these concepts that I talk about are laid out in that book in very great detail I spent a long time writing that book and it's incredibly detailed So let's see here. Um I feel a crashing feeling in the afternoons, which causes odd sadness at times. So I see I'll put these up here Um, I see two things. You guys can't see each other's comments. So I'll I'll just kind of call them out Um, so I see two things. I feel a crashing feeling Um, okay, that's a feeling. So you feel a certain way which causes odd sadness Okay So you are changing that what happens is you you're the way you feel changes and your emotions kick in And you may feel a little bit of a sadness or a low mood. The issue here is not necessarily that right? I mean unless and I'm missing something and you're suffering from clinical depression Which I'm guessing you are not because you didn't say that But it is 100 normal for us to change the way we feel involuntarily many many times throughout the day I'm in a good mood. I'm in a bad mood. I'm happy. I'm sad. I'm neutral I'm nothing like that changes all day long all day long We react to external stimuli and our mood changes and our state changes our physical feelings change All of those things happen. The problem here is that when you say, well, I feel a certain way I don't like feeling that way and then I start to feel sad and I begin to analyze why I feel sad And I'm afraid to feel sad and what does that mean? Does it mean I'm depressed? Is something wrong with me? That's the problem. The problem here is your reaction to this, which is the basis of all of this stuff Okay, see so it makes me question whether there's anxiety or something else and triggers anxiety So trying to figure out what this is because you're unwilling to simply accept that like well Maybe you will know what it is, you know, if you have a fight with your partner and that makes you upset Well, that would be a very clear thing like I am really upset because I had a big argument with my partner Or I'm really upset because I got I got let go for my job today. Like, okay, that would be obvious But when your mood changes and you feel like, oh, no, I have to know why to be safe From my mood and my feelings and you can't identify that Then yes, you will interpret that as the mood change itself and the emotion itself becomes the danger So instead of saying like, oh, yeah, the problem here is the big fight that I have with my partner You can't find the problem and you are afraid of that change in state So you will say that the problem is the change in state itself And that's very circular right and it feeds the next episode and again leads people to believe that they are broken So let's see here Put this up on the screen here. Maybe be easier for everybody Let's know what you feel changed about yourself when you gain recovering through panic disorder I like to hope that going through it might make me a stronger person in life easier. Okay Well, I mean the book that I'm writing now, which will be out next year Sometimes it's called lesson from the panic zone lessons from the panic zone That is all about the lessons that I learned as part of this process. And yes In retrospect, there were many silver linings silver linings and I did not get the old version of me back I got a better version of me back. So we could talk it. We'll talk about that But that is a very common experience many people who go to the other side of this will look back and say Oh, yeah, like I learned so much and I'm actually a better person now because of it It doesn't make it any easier now because you're really suffering and I understand you're under the gun and you're feeling like there's no way out But on the other side of that you may find as is very common I and many others have found this like oh that experience actually was was a net plus for me in the end But again, I posted about this on social last week Do not let anybody tell you that there's a silver lining to how you're feeling right now because right now you can't see that So none of this toxic positivity like this is going to make you stronger You'll see that after but for now I understand you're struggling What changed for me to be honest with you was I literally said I would prefer to just die Then to continue to live like this Skipping things skipping out on my family events not being there for my daughters Not paying attention to my business not being engaged with my family I didn't want to do that anymore So I was I was backing away from everything because of this fear and anxiety was telling me that I was in danger all the time I basically decided the discomfort of being Isolated and disengaged and feeling like I was failing at everything that discomfort was way worse than the temporary discomfort of enduring a panic attack because panic attack would be really uncomfortable for You know 10 15 20 minutes if it was undulating and came in waves maybe throughout the days I'd feel sort of spikes of that But then when I would retreat and run back home or refuse to do something or cancel something or miss out on a business opportunity The discomfort on an emotional level of that that just piled up and piled up and got deeper and deeper Was way worse than the panic. So for me, I decided Pick your discomfort I will choose to be temporarily uncomfortable in anxiety and panic as opposed to permanently uncomfortable because I'm stuck on my sofa That's what changed for me in a big way Um, so let's see here. Oh, I see this is a follow-up on the first thing. Yes I'm focused on some deep fear of depression again. So it's not the fact that you are Experiencing a change in mood. It's that you are seeing your mood itself not as a natural variation that humans have But as a sign of something bigger Uh, and that's another thing that leads people to think that they are broken Because we somehow think that the anxious feelings and sensations or the thoughts that we have Are more than sensations and thoughts. We think that they are omens or indicators or predictors And they are not and they are not but that would lead you to believe like something is really wrong here Because I feel like something is wrong And when you can't put your finger on it then it leads you to believe that like i'm never going to figure this out And if I can't figure it out then it means i'm stuck and i'm broken and I can't be fixed But the reality of this is we get better when we actually stop trying to figure it out I know very paradoxical, but it is what it is What's the connection between anxiety and lightheadedness so I'm not actually going to answer that but i'm going to put it up on the screen Why because in the beginning and you may be new in this journey. This is a good question, right? So this is the difference between assurance like productive assurance, which we would call teaching or learning Like part of a job of somebody like me is to provide that psycho education and help you to learn like teach you right But once you've heard the answer to this once twice three ten times and you've asked a million people Why you get lightheaded and people tell you what's an anxiety symptom? So my short answer to this is it is an anxiety symptom, right? It's very very very common to the point where we have Common phrases in the english language like my I was reeling r e e l i n g the room was spinning I thought I would pass out This is not things that just people with anxiety say like these are very common things that normal air quotes Normal people say when they get bad news or they get really excited or they're in danger Like oh my god, the room was spinning you've heard people say that So this is just the way the human body reacts to that to those type of stimuli The problem comes when you do not accept that explanation or you that's not the one you want because it doesn't give you certainty And it doesn't make it go away. So you just keep coming back and asking again and again and again That's the issue. That's unproductive reassurance And one of the reasons why people think that they are broken while they are not Is because they don't understand that that sort of pattern of trying to fix it that way by asking those questions about specific symptoms Again and again trying to seek 100 certainty and reassurance That's the wrong path out and it makes you feel like you can't get better Because it's not working for you asking those questions isn't working, right? So let's see here. Um I have been unbroken. Let's see what jim has to say a couple more minutes here I thought I was going to do 15. I ain't going to do 15. I just don't have the ability it appears This is good. We just have 22 people. I'm glad you guys are here. I've been unbroken for quite a while Excellent. However, I worry about the crack in the healing that will lead to broken. Ah, okay That is a like a confidence and recovery problem, right? So if you've been working this this thing for a while Then those repeated experiences and this a little bit more of an advanced topic for those of you who are Further along the line in recovery So as you have repeated experiences surrendering to anxiety and willfully tolerating it floating Accepting whichever terminology you like as you get better and better at that and you learn experientially like oh, I can handle this I can handle being afraid. I can handle being uncomfortable I can handle having disturbing or uncomfortable thoughts and just kind of floating through them and navigating through them I can handle all those things you start to build a sense of competence Like I can handle this I can handle this So first is the courage right did this a couple of weeks of the three C's courage is what makes you start doing that Going from like oh, I need my lavender oil in a pill to stop it from happening To I will let it happen and try my best to navigate through it That's courage when you do it enough times you discover. Oh, I can do that That's competence, which is Jim probably where you are And then when you continually have that experience and you vary it across multiple contexts So you keep having that experience in the supermarket home alone at a wedding on a long drive Whatever at work giving a speech whatever giving a presentation at school taking a test Whatever you keep having those experiences in multiple contexts Then you start to build Confidence which is confidence says that there's no crack that's going to lead to broken Because this is a wide and deep recovery that is portable across multiple contexts and durable So you just have to keep going and recognize that the the thought that you might have a crack in your recovery That will bring you back to broken is just a thought Just it's not a predictor that that will happen. All right So let's see you Okay, so Nanette says I always feel uh unhelpful because I've been agoraphobic for 16 years It's okay Nanette. I know many many people who have suffered for a very long time with these things It's it's not pleasant, right? It's not it's not good and it makes you think that You can never be fixed. I did a podcast episode on this if you go to the anxious truth dot com It's one of the you there's a search bar and uh, there's a search tool and the episode is called you can recover No matter how long you've been Suffering something like that. Uh, it's probably back in the last six or eight months But I did an episode on that it doesn't matter I mean it does matter because it's 16 years of your life and I feel for you But um, it doesn't mean you're unfixable. I promise Uh, let's see red dog Good name. Um I think that's it. We run out of comments here. It's a great book says mark. Thank you. That's this book here I assume mark you're talking about. Um Yes, thank you So I like to think that it is a very helpful book So if you don't have that book you can go to the anxious truth dot com slash recovery guide all the ways to get it Are there is unkindle paperback through all kinds of places and audiobook. So you're you're welcome to it. Um Let's see My son. Oh, this is always heartbreaking. I'll take one or two more and then I really do have to really have to uh wrap it up Um, let's see your san diego johnny's here No, no, no bought an audio form excellent. Let's see here. I'm really worried about shallow breathing It really upsets me. Okay. Well, a lot of people are afraid of shallow breathing. It's very it's one of the most common things I did a podcast episode on that if you go to the anxious truth dot com Hit the search tool and search for breathing and breath You'll see that I did an episode entitled breathing and breath centered anxiety Feeling like you cannot breathe is not the same as not being able to breathe So I will send you to that podcast episode and avail yourself of it. There's a lot of good information in that It will address what you're talking about Fear of dying says chris peterson. I literally just did an episode not too long ago again Go to the anxious truth dot com hit the search tool at the top of the the website and search for death And dying and you will see a podcast episode. I did on the my my fear of dying and how that resolved for me This is good. So tanya I'm this always heartbreaking when somebody talks about their their kids and you know what tanya I appreciate that you are like concerned and certainly advocating for your son My son has been having a lot of anxiety when in school. Should I approach it the same as we do here I again, this is gonna sound like working record. I did a podcast episode about six or eight months ago with dr Jackie Bogdanov. She I'm instagram connections with her. She is child behavior doc on instagram But if you go to my website and search for child children family, you will see that episode the short answer According to dr. Jackie is yes, generally speaking the same exact rules apply You have to remember though depending how old your child is We may need to give them more help and and present these concepts in an an accessible form that they will be able to understand Given their level of maturity and their their mental development, right? So it's one thing to explain this these concepts to a 17 year old or a 13 year old Very different in explaining them to a six year old right or a five year old So dr. Jackie talked about that but yes, generally speaking the same rules apply and a lot of it has to do with Also as a parent the way we model this and the way we react to their anxiety So dr. Jackie talked about it was really good episode. Just check it out Um, I'll do one more and then I'm wrapping it up. I promise during your recovery with their times So you couldn't go through with an exposure or left during okay? This is a total broken record here I did a podcast episode called what do you do when you fail or what do we do when we fail? So again, go to the anxious truth.com use the search bar And and you will find that generally speaking were there times that I did not do an exposure No, I don't think that there were times and then look there was a while ago So I could be wrong here, but nothing is sticking in my head in terms of a time when I bailed on an exposure There were twice when I was sick like I had the flu and I was really sick Uh for about four or five days.  I I should not have done that Um, there was no reason for me to do that But I missed some stuff when I was I had a nasty flu for about a week that that went to I remember But I didn't ever not do my exposures There were times when I did exit them early and what I learned from those experiences Is if I just went home and left it and ended it that way, it was worse So what I learned was I would Go back home if I did that and I would get myself together and I'd go back out and do it again And the second time for me was always much more of a success And that was a valuable experience the the act of bailing getting myself together and going back into it and having a more Positive outcome the positive outcome by the way was not I wasn't anxious It was that I moved through that the anxiety that was really helpful So yes, if you fail because you say bail for instance going back out and doing it again after your regroup is a good idea But I did a podcast episode and I called what do we do when we fail? all right, um So let's see here the the breathing question so many gen the how bad can hyperventilating get in a real in a nutshell if you were high if I just started If I just did that for the next 45 seconds You'd probably see me fall off the frame because I would probably pass out And then once I passed out my body would begin to breathe normally again. So how bad is hyperventilating? Nobody ever died from hyperventilating Um, it's it's again that that thing where now you feel like you can't breathe So you start panting and trying to fill your lungs all the way Just go to check that podcast episode breath and breath centric anxiety. You'll see Um, okay guys, that's about it. Thank you. Bestie. You're very welcome. I'm glad you think that I rock So, uh, that's it. That's it for this one. We did okay 22 people even though half of the social media universe is out today I appreciate you guys coming by We are going I'll put this back up on the screen if you want to copy that book This is what we're going to do every monday. We're going to do another lesson out of the anxious truth There are many many lessons. So this series is going to go on for quite a while So next monday at the same time on youtube and facebook and then I will post it to my instagram my IG tv afterwards Whenever instagram gets stacked together again today. Thank you all for coming by I appreciate it. And uh, if you have comments and questions, keep them coming I will do my best to try to answer them. And uh, yeah, see you guys next week. Thanks for coming by. Hope it was helpful


Hey guys, it's Nate, A.K. The Foot Accountant. Welcome back to the channel. What is coming next inside of FIFA 22 Ultimate Team? That's gonna be the question we're gonna try to answer today. Look at a lot of things related to ones to watch ending because today is the final day of ones to watch and at 6 p.m. U.K. time, all these cards go out of packs, the objectives go away and a lot of the SBCs expire as well. So I wanna talk about what could be happening after today in terms of content, in terms of the ones to watch promo. Will they put teams one and two back into packs? Will they do a new promo this Friday? What's gonna be happening? I wanna talk through that. And of course talk about this market as well and Team of the Week 4 that is gonna be coming into the game today. Team of the Week 4 is looking like one of the most OP and best team of the weeks. Not that we have just seen this year in FIFA, right? It's only the fourth week of Team of the Week, but like ever, this Team of the Week could be absolutely phenomenal today on Wednesday. So I wanna talk about that and there's a lot of market movements to watch out for with that Team of the Week today. Ones to watch cards, that could be included. And of course with content yesterday on Tuesday, being so confusing, if you guys of course were aware we did have a draft your squad SBC which this SBC costs more than it is to actually buy a draft entry. So basically you're paying more for a draft token than you are to just go pay 15,000 coins to get into a draft, it's confusing, right? I think everybody was just shocked by the squad yesterday and how much it cost it. But anyways, that content did not move the market yesterday so a lot of stuff is still very, very high. And I think it could drop today. So I wanna talk about all that in this video. First things first, if you're new around here make sure to thumbs up and of course subscribe if you are new. Now let's get into it, right? Today, Wednesday, Team of the Week day. Let's start off by looking at the Team of the Week prediction because we might have an absolutely incredible Team of the Week today, right? This is the foot head predictions by Patrick the Goat, right? Mbappe, Mane, Márez, Robertson, Sancho, DePai, DePaul, Mele, AKA the mailman as we call him on stream. Gavardi Olskard is what a lot of people have been saying is gonna be very, very overpowered if he gets an inform. Take a look at this item, Leipzig center back, 90 pace, Kailor Navas, Ferran Torres, there's tons of great cards that could be in this week's Team of the Week. Now of course, since it's from international break, right? International break, international games, EA has never done dynamic images for these Team of the Week players that are on international break. So unfortunately, we probably won't see dynamics for these players that played for their countries this last week and a half or so. We're probably just gonna have their normal, you know, their normal gold card face shot, but if they do juice up this team and the Team of the Week looks like this, that would be absolutely incredible. Now you can see here that we have three ones to watch items that are in this prediction. DePaul, DePai, and Sancho, also Hakimi is getting shouted for a potential Team of the Week. Subbitzer is being shouted for a potential Team of the Week. There are tons of ones to watch cards today that are involved in potentially being in this Team of the Week. So of course, we will find out at 6 p.m. UK unless EA drops it early for some reason, we will find out at 6 p.m. UK who is in the Team of the Week. Now there's a lot of people that have invested in cards like this DePai, like the Sancho. And all I'm gonna say is, I would just be careful with these. Right again, it's never guaranteed for them to be in Team of the Week if DePai or Sancho or one of these cards does not end up getting in that their wants to watch item has gone up in price. Like DePaul, even 27,000 coins after he was, I believe, earlier this week, down at like 20k, right? Even lower than this, I believe he was, 16k before he scored some goals on the weekend. Now he's up 10, 11,000 coins per card. If you've got some of these wants to watch cards, it's either you're taking a gamble today and you're hoping that they rise after they get a Team of the Week or you're selling into the hype as they've risen up a lot already from that performance they had that could potentially get them a Team of the Week item. So again, we will see how many wants to watch as EA puts in. Are they gonna do Mbappe? Are they gonna do Teo Hernandez? Are they gonna put Sadio Mane in? Is Mar is gonna get, I mean, seriously, this Team of the Week and the performances that we saw this last week from these players. I mean, the Team of the Week this week could be insane. So we'll see what EA does. And now again, watch those wants to watch items, whether it's in Team 1 or Team 2. Keep an eye on Hakimi, right? He's up 100,000 coins. If he does not get into the Team of the Week, you'll probably see a bit of a drop off on his card, right? Again, we're thinking the same thing as DePaul and with Sancho and with DePie. So keep a close eye on those today because that's gonna be a very big point of interest today on the market. Now also speaking about today on the market, yesterday, if we take a look back, was another very, very quiet day. If we take a look at the market index on the live graph, yesterday the market really didn't move. Now we're down a little bit this evening, just kind of a normal evening drop off, but a lot of cards stayed the same price or even went a little bit higher during the day yesterday because the content yesterday was really nothing very important to this game, to be honest to the market. So you saw a lot of stuff stay the same price or even go a little bit higher.  The last week we called it, we knew it was gonna be happening again. See this drop off from Tuesday to Wednesday last week, 82 points on the index down to 73. Now one thing we don't have this week is a confirmed promo for Friday. And I think what we're gonna learn today around 6 PM might influence the market a little bit. 6 PM UK that is the content drop. Usually on Wednesdays, we see the market drop off because people are anticipating the supply of division rivals rewards, right? People are anticipating that supply. The packs are gonna be opened and they sell cards. We've seen it the past two weeks as we head into rivals rewards. So again, you think about cards that could be dropping today. Think about all your metas and you think about, just at what point we are in this game right now where all these cards are up at prices that are so much higher than they were. And the reason why they're up in price is because people have gotten rewards, they've gotten coins and they're going out and they're building teams, buying players and using these cards in their teams and they're paying coins for them, right? They're buying them and that's rising them up in price because there's more demand for these players since there's more coins after rewards. Now, people know that rewards are coming again and then they're hoping that's gonna supply the market so they're gonna be probably selling that stuff off this afternoon on Thursday and I think what we might see this afternoon, just like we've seen in the past couple of weeks, is you're gonna start to see the market drop off in that later day time period, afternoon into the evening, UK time, leading into the content drop even and especially after the content drop. People will start to think about rewards, division rivals rewards and what they're gonna be getting from that and the pack supply and I do think you will see some prices drop off on this game so just be ready for that, be aware of that if you wanted to take the coins on some players that are in your team, I think it's not a terrible time to do that because if there is a promo on Friday, I do think you will see more panic selling because that promo will probably be something different than ones to watch and we're gonna talk about that again in a second as well. So watch off for panic selling later on in the day today. Besides the team of the week content-wise today, I'm really not expecting much. I wouldn't expect anything really ones to watch related since this promo is basically ending today for ones to watch stuff. Now we'll still have Boa Diwan and Wynaldum available in here but I believe the 78 plus SBC is going away of course with the ones to watch promo ending, your objectives are going away and it's like a clear stop for OTW. So I really wouldn't expect another ones to watch SBC today. If we get some sort of SBC today, maybe we've already had a flashback this week. I'm still thinking that Player of the Month, Erling Holland is gonna come pretty soon or Player of the Month and Cuckoo. The voting for that is done. So we should see a POTM Bundesliga very soon. That might be today, might be tomorrow, might even be Friday. We'll have to see when that is released but that should be pretty soon. So again, let's start to talk about what could be happening after today though, right? There's a lot of scenarios. There's a lot of things that we can look at because some people are saying that the ones to watch cards are going to be back in packs both teams, teams one and teams two. Now I don't think there's tons of people that think that but just once again, I wanna show you that it is not confirmed by EA Sports that teams one and team two will be in packs today. That is not confirmed. The thing that is confirmed with ones to watch team one and two is that if you're still holding your guaranteed ones to watch pack, that is what is only confirmed today. You can only pack a team one or team two player. So I've saved my ones to watch pack. I have not opened it yet. I'm gonna be opening that pack today because I should be able to pack cards from team one or from team two. So I'm opening that today. Now again, here it says for pack release, cards in packs, October 13th is the cut off date. So I'm not expecting to see ones to watch team one or team two or both of them in packs today. Now EA can do whatever they want and we don't have information about this. That's why there's such a big question mark around what could be happening. But let me let you in on some insight about what happened one year ago on this very day of Wednesday. And this is what happened. Last year on this very day, we had the rule breakers loading screen dropped on a Wednesday around the content time after ones to watch had ended. Last year, ones to watch and FIFA 21 ended on Wednesday, October 21st. And on that same day, we had this brand spanking new loading screen on a new promo that we thought was ultimate screen. But obviously it was rule breakers and it was something different. So one thing we are watching out for today is our first panic screen, panic loading screen kind of telling us what promo might be on Friday if there is going to be a promo. Now the calendar works out a little bit different this year because last year they went into this rule breakers promo on the 23rd of October and once to watch ended on the 16th, or sorry, it ended on the 21st of October and it started on the 16th. So we're kind of a week early this year, right? If they want to run the rule breakers promo kind of like ultimate screen, right? Maybe they'll do ultimate screen again this year. So it just, we have to kind of also realize that we're like a week early compared to last year. So if there is going to be a Halloween or an ultimate screen based promo, they might not start it just yet and we might actually have a week where maybe they do put once to watch cards back in packs or maybe there is no promo but I just can't see them doing that, right? I really feel most strongly that if EA were to do something today it would be a loading screen for a promo on Friday. I honestly think that we are getting something on Friday. We'll just have to see what EA sports is going to have planned and what they want to do with this game. But that is the other potential that we could see today and I guess the other option is we might not see anything, right? We might not see a loading screen today. They don't usually do loading screens for the promos at the same time every year, every single day, like they don't time it to where a rule breakers loading screen is going to be dropped on Wednesday this year just so it's the same as last year. It's not always the same, right? But be on the lookout for a loading screen. If you don't know what we mean by loading screens, basically when you log in to FIFA, the screen that it shows you right now, the ones to watch cards, if you see something different there that is what we call a loading screen and that will 100% today cause panic selling, right? Especially with rewards coming and people knowing that a new promo is going to be dropping with new cards, they're going to be going out and selling items because they're going to want to get ready and they're going to be like preparing basically for what that promo would be on Friday, right? And we'd expect that to drop on Friday. So watch out for a loading screen today, watch out for that new team of the week and watch out for some panic selling to be completely honest. I'm looking forward to today on the market because these card prices have risen up so much in this past week. Whether it's a card that's, you know, gold card might be going out of packs because of the team of week potential, like Sadio Mane being 200 and what is he? Like 275,254? Yo, that was just literally a 20K undercut. I will take that. What? All right, well, let me check Sadio Mane again to actually show you his price. But Sadio Mane is a 275,000 coin card. I'm gonna go listen to mine up real quick after this, GGs. And his card was like 230,000 coins earlier this week. So huge rises. I do think you'll start to see some people sell off because so many people I've bought and if there is a loading screen or if there obviously is a panic for rewards, I do think that you will see some of these prices dip off in this game. So I'm gonna take my nice little, what is that, like seven, eight K profit right there after tax, not bad, we move. But anyways, that's the video for today boys, right? We're watching for team of the week. There's gonna be a lot of market movements with Ones to Watch items. So if you're risking it with a Ones to Watch Sadio, if you're risking it with a Ones to Watch DePie or any of these cards, just be very careful because I do think that if a card does not get in to Ones to Watch, compiled with the panic selling that could be today, and if there's a loading screen and if they don't get a team of the week, there might be a buy time for some of these Ones to Watches. You know, if they don't go back in packs, if they do go back in packs, that's a whole nother scenario. I'm not expecting that, but who knows? It could happen. So big question marks around today.  Hopefully that does help. I do think one thing's for certain, you will see prices dip off after the content drop today regardless of what it is as people get prepared for that rewards timeframe with division rivals. So that's the video for today boys, whether it's Scream, whether it's the Rule Breakers promo, Ones to Watch back in packs, we're gonna be covering all today live on the Twitch stream. Make sure you hit that link down in the description, twitch.tv slash the foot accountant. If you enjoyed this video, smash your thumbs up on it, comment down below if you have questions and subscribe if you're new. It's been Nate, The Foot Accountant. I will catch you guys later. Peace out.