Hello, I'm Shane Also, the Community Engagement Assistant at ELIFE, and it's my pleasure to welcome you to September's ECR Wednesday webinar. This series aims to give early career researchers a platform to discuss issues important to you and your research career. You can now follow us on Twitter at ELIFE Community and with the hashtag ECR Wednesday. The session is being recorded and we'll make it available on YouTube in the near future. Now it's my pleasure to invite Alok Varma, a graduate student at the National Centre for Biological Sciences, India, and member of the ELIFE Early Career Advisory Group to introduce today's session and our panelists. Thank you Shane. Hello everyone. Thank you for joining us today for the ECR Wednesday webinar on the science of science using meta research to make your research more transparent and reproducible. I'm Alok Varma, a member of the ELIFE Early Career Advisory Group, and I'll be your moderator for today's webinar. Let me begin by telling you a bit about ELIFE and its Early Career Advisory Group. ELIFE is a nonprofit organization that's operating a platform to improve all aspects of research communication by encouraging and recognizing the most responsible behaviors in research. The role of the Early Career Advisory Group is to influence and support ELIFE's work and to catalyze broad reform in the evaluation and communication of science and in particular to represent the needs of researchers at early stages in their careers. To foster a research culture that's healthy for science and for scientists. So the ECAG champions many different initiatives to achieve this goal and the ECR Wednesday webinar series is one such a brainchild of the ECAG. Today our webinar panelists will explore ways that you can use meta research or the science of science to make your own research more transparent, rigorous and reproducible. So let me start with a little housekeeping. During the webinar, please be respectful, honest, inclusive, accommodating, appreciative, and even open to learning from everyone else. Please do not attack the mean, disrupt, harass, or threaten anyone or encourage such behavior in any way. We reserve the right to ask anyone to leave and or deny future access to subsequent webinars. And if you feel uncomfortable or welcome on any of these webinars, please contact ELIFE safety team via ELIFE safety team at the protonmail.com, which is on your screen. Okay, so as Shane mentioned the session is being recorded and will be made available online at a future date so keep your eyes open for that. And if you need any help please send a chat message directly to Shane also via the chat box there. Okay, so we have three speakers today each of whom will give a presentation lasting approximately 10 minutes. Following these presentations will be a Q&A session. If you want to ask a question at any point during the webinar, you can do so by typing in your question into Zoom's chat box, or you can tweet us, we are at the rate elive community, and use the hashtag ECR Wednesday. I would read out your name and your question at the end of the Q&A session that happens after all the presentations are done. Okay, so with that out of the way, I'd like to now welcome our three speakers. The first panelist is Tracy Weiss Kerber. She's a meta researcher at the BIH Quest Center for Responsible Research in Berlin, and a former member of ELIFE's ECAC. Tracy, we now invite you to share your screen. Okay, thank you, Alak. Hopefully everyone should now be able to see slides, and they should be advancing soon. So, yeah, today we're talking about meta research and how we can use meta research to improve science, and I have the challenging task of explaining to you all of meta research in 10 minutes. I'll also talk a little bit about how I got started in meta research, and give you a few ideas about some ways that you might be able to use meta research to make your research more transparent, rigorous, and reproducible. So our first question for today, obviously, is what is meta research? Well, meta research is essentially the science of science or research on research, the research process and research enterprise itself. So when we do meta research, we apply the scientific method to study science itself. And this is a very powerful tool that can help us to improve science by identifying problems with the reporting with the analysis and with the conduct of scientific research. So meta research can also help us by developing targeted solutions. If we're examining the scientific literature or other aspects of science and identifying specific problems, how common they are and what effects they have, that can also lead very directly to allowing us to solve those problems. And meta research doesn't just apply to evaluating scientific publications or preprints. It can also be used to evaluate other aspects of the hiring process or the scientific process. So that might include factors like hiring and promotion practices, funding agency practices or policies, educational programs and journal or institutional policies. So I'll show you a few quick examples of some different types of meta research studies. The first one is a study that was published in Plas Biology and the authors have looked at a very large number of clinical trials to determine how well they were reported in accordance with various elements of the consort guidelines. So our authors addressing things like blinding, randomization or inclusion and exclusion criteria. And the authors find that while the quality of reporting is improving over time, many papers are still missing essential information. So there's also an urgent need for us to continue interventions to improve reporting. This is the second example looking at an intervention to actually improve reporting this time for animal studies. And so here the authors conducted a randomized control trial where authors who submitted animal studies to PLAS-1 were either required to submit the arrive guidelines checklist along with their manuscript or they were not. And there were no other interventions along with that. And the authors found that unfortunately just asking authors to complete a checklist during the process of submitting their manuscript didn't really lead to improvements in reporting. Meta research, as I mentioned, doesn't always have to focus on scientific papers. And so this is a paper where we looked at statistics education practices. And here we found that while most papers almost all in fact 97% of papers published in top physiology journals were using statistics. And statistics training wasn't necessarily required to get a PhD in physiology or related disciplines. So two thirds of statistics programs are physiology PhD programs required to be a statistics course for students who were participating. Whereas the remaining third were split between offering statistics as a recommended elective, simply an elective, or having no statistics component for their programs. One of the important things to keep in mind is that meta research is not meta analysis, because most both terms involved the word meta people often get confused between them. And so I just want to emphasize that these are rather different things. When we do meta analysis we start by performing a systematic review and that helps us to identify all studies that have addressed a particular research question. And then in the meta analysis we combine the results of all of the studies addressing of that particular question in order to assess the size and the direction of the effect based on the literature as a whole, instead of looking at individual studies themselves. So again, this is quite a different process from the process that we go through for science of science studies. There are some commonalities between meta research and meta analysis. So when we're thinking about meta research that looks at a body of literature, as opposed to other aspects of the scientific system. Then meta research and meta analysis share the commonality of the, of the fact that both are looking at a body of literature instead of just single individual research articles. So meta research also borrows a lot of methodology from systematic review and meta analysis. However, sometimes meta researchers review other types of records beyond publications like funding agency or journal policies, course requirements, tenure and promotion criteria, or other factors. And while most meta research studies don't involve meta analysis, there are exceptions depending on your research question. For example, if you're looking at whether blinding studies produce larger effects on a particular outcome, you might need to perform a meta analysis to get the answer to that question. So why did I start doing meta research. I became involved in meta research because I was concerned about the problem in my field. I studied preeclampsia and well women develop preeclampsia and very similar symptoms at the end of pregnancy they often get problems, fetal problems and placental problems and different pathways when each in each of those. So for any biomarker we look at we expect it to be perfectly abnormal in some women with preeclampsia and very abnormal in others. This was a problem because we often present data in bar graphs. So I started off addressing this problem with some of my colleagues by looking at bar graph use in the physiology literature and examining the problems with the use of bar graphs and how often authors were doing this. And we published this meta research paper and plus biology in 2015 and since that's time it has contributed to policy changes in a variety of journals encouraging authors to replace bar graphs with more informative graphics. So the important question for today is how can you use meta research to help you improve your science. And there are a number of different ways you can do this. The first thing that you can do is find meta research onto topics that are relevant to your research studies and your methodologies. There are a lot of studies available on topics like open data or adherence to reporting guidelines statistical problems pseudo replication or things like planning and randomization, as well as many other topics related to scientific publications. And if you start to read data and information from meta research studies, these studies often tell you how you can recognize problems and fix those problems in your own research. And they can also be valuable in explaining to others why it's important to adopt better practices so you can have discussions about these papers with your colleagues and your friends. If you're not sure where to start with finding meta research papers that are potentially relevant to you, then we published a recent editorial that contains a variety of different examples of meta research papers. And the editorial is available open access and you can see box one for a variety of studies that will help you identify common problems and explore solutions. So here are just a couple of examples. The first study looks at the problem of power, statistical power, and the authors present data illustrating that underpowered studies are very common. They then go into detail examining the stuff problems that under sour studies create, and they explain why low power is an issue, even when you don't find a significant difference between groups. So here's an example of a meta research study that might be relevant to you. And there are several studies like this, but the authors examined blinded versus unblinded studies and they found that blinded studies generally find or unblinded studies generally find larger effects. This means it's important to use blinding whenever possible at all stages of the experiment. And depending on your reporting guideline, you may need to report blinding for status like for participants, caregivers, outcome assessors or data analysts. This is another study looking at the effects of attrition in experimental research on cancer and stroke, and the authors find that seven to 8% of animal studies are excluding with animals without explanation. And that about two thirds of papers lack the information needed to determine whether animals were excluded. And this is a problem because we are excluding animals in a biased way, especially in small sample size studies that increases the risk of spurious findings. A solution for this problem is to use flow charts to report all excluded animals, as well as the reasons why observations were excluded, which allows your reader to assess the risk of bias. Another way that you can use meta research to improve your own research is to find or start a reproducibility journal club. And these journal clubs are a grassroots initiative that make it easy to start your own club journal club that discusses meta research studies, as well as findings from other studies that are relevant to ways that you can improve your research. And so the movement that has started with psychology, it's now expanded to many different institutions and countries and is also beginning to expand to other disciplines. And so these groups can be a great place to meet like minded people who are also interested in meta research and science improvement, and engaging in critical discussions about some of the solutions for improving science and the strengths and weaknesses of those solutions, and how we can all make our science more transparent, rigorous and reproducible. All right, thank you very much. Thank you Tracy. It's a very nice overview of what's going on with meta research. Up next is Yulia Felling. Yulia is a research fellow in the hospital sick children program cell biology in Toronto, and was a participant of the meta research team of the 2019-20 cohort of the Elife Community Ambassadors Program. And she talked to you about that today. So Yulia, it's all yours. Thank you very much for your nice introduction. I will talk today about the lessons learned from the Elife Ambassador Met research team. And in the 2018-2019 year, the group of early career researchers were participating in the initiative led by the Elife Community Ambassadors. And we decided to create the meta research project. And this study was led by the Tracy and in her method of learning by doing. We decided to investigate and to clarify how to create clear and informative image based figure for scientific publication. So in order to create this study, we started with a definition of our research question and objectives. This research question and objectives should be well defined, clear, logical, feasible, interesting, novel, and feasible. And in order to define so we need to follow several steps. First, we need to define our problem that a lot of people while reading scientific papers are known to go first to the figures and read them. And therefore, it's important that figures are accessible to the broad audience. And for example, figures from the papers outside of the one immediate area of expertise are often difficult to interpret and making science opportunity to communicate much more harder. So after we defined our problem, we decided to investigate and validate our data with a preliminary research. And many researchers discussed fraudulent image manipulation and technical specification of the image acquisition, however, data how legible and interpretable images are missing. So, a lot of recent evidence suggests recently that it's important to include methodological data about the image acquisition in the papers and its information often missing. Next step was to formulate our research question and our research question was exactly how good the quality of the reporting and accessibility of the image based figure among the papers published in the top journals. And the factors that we decided to assess included, for example, the representation of the scale bars explanation of the symbols and labor clear and accurate in set markings, and transparent reporting of the object of the species and the issue that has to be shown for example in the legend or figure in order for the reader to interpret the data correctly. We also examined whether images and labels are accessible to the readers with the color blindness and other problems. So, once we defined our research question we needed to state our sampling frame, and it has to be clear rationale for the sampling frame and it has to be appropriate size. So, we decided to choose all the original research articles published in the April of 2018 in the top 15 journals for the original research in three different categories. Physiology, plant science and cell biologists, and we decided on those top journals, 15 top journals according to the impact factor from the year 2016. The sample frame was ready. We needed to screen the journals and eliminate those that didn't publish original research, for example, review journals. After the journals was ready, the PubMed search for the all needed articles was being done in a defined time period in 2018. And all these articles has to be also screened additionally for the full length original research papers and to make sure that they have all the images that area of our interest and the continuous data and all the articles was reviewed by the two different abstractors. After we decided with our number of our papers, we created our abstraction protocol in order to easily to convert all the context of the paper to the review and all the figures were reviewed by the two different abstractors and in both main paper and supplementary files. Before the we make sure that the training was done to the all the abstractors and the abstractors completed the 25 article training to ensure that all responses was similar before starting the data abstraction. During the abstraction to independent reviewers would blindly screen one paper and primary and secondary outcomes will be obstructed for each article and then later on disagreement would be resolved by the concept. After the all the obstruction was done any additional level of our reproducibility so to say was that we did the quality of our assessment and data extraction. So, this way that 10% of all the articles from the different field were verified additionally to the one quality assessment structure, who did it in all the field and in order to synchronize all the people taking the place in this study. So a few to put in our results in the context that was important for us to also represent the images in order to illustrate what we was abstracting for. For example, we was looking for the missing or inappropriate information on the scale bars, and if you can see from this example images. How could a no scale bar or scale bar that plenty in the background is could be represented in the paper. And according to our data, almost 50% of the journals in the physiology. We had the no scale bar information or partial information in the on the size of the images represented it's a little bit better in the cell biology field and in the plant science, it's up to the 70% had almost partial information on the scale images. So, for example, from the for in our study we also wanted, not only to show the problem, but also suggest the solution and educate people how they can make it better. So, for example, in any case how the scale bar could be represented in the different ways that could be visible and readable for the people. For example, in our paper and research where we did the analysis for the misplaced or poorly marked insets insets are often important part of the images in the scientific papers and often one could see that they are only placed or marked incorrectly, which is making very difficult for the people to find where exactly the paper are showing it. And it's important also to show in a visible way for the reader that were exactly the insets finding and here on the right side you can find the examples of it how you can represent. For example, talking for the results that in the case of the poorly marked insets. There are almost 30% of the papers and the physiology did not market correctly and in the plant science, it's even more in the case of the description of the insets. Also important sometimes to explain what are you doing in your legends that the people are following you. So it was up to 50% in each fields that those insets was not clearly described. Also in our paper abstracted for the different categories also and recommend for the image blind color blind people or other things that you can read from the our paper. So putting in the context paper that met all good practice criteria according to our analysis in the physiology it was 16% cell biology 12 and the new plant science, it was only 2% and such image representation affects clearly the science ability to interpret, and to build upon another scientist's work. So just putting all the knowledge that I learned from the E-Life Ambassador team and the MIT research project, I realized that there are also problems in my field. So for example, in the case of the, I did my PhD on the in microbiology on the aspergillus fumigatus and what this was noticeable that all the PhD students or early career researchers are discussing that often in the papers that background lineage of the aspergillus fumigatus is not mentioned or mentioned incorrectly. For example, it's clearly once you're doing meta research on such topic you can put the number to the problem and communicate such problem much more clearly to the audience. For example, almost 20% of the papers published on the aspergillus fumigatus had never mentioned it background lineage of this function, which is making the results of this paper in a top reputable and useless for the community in the future. So, with all this, I would like to thank you for your attention and if you want to read more about our meta research paper, you can do so under this link and you can contact me on the Twitter. Thank you. Thank you, Julia. It was nice to hear about this project wishes. It's quite nice to assess images and something that we do all the time. So our final panelist is clever neighbors, he's part of the coordinating team of the resilient reproducibility initiative. So clever, please go ahead and share your screen and over to you. So. Well, first of all, thank you for an invitation. I work as I mentioned with the Brazilian reproducibility initiative. So, the context of the initiative is that a lot of matter research actually came about in response to a perception of the reproducibility crisis in the last decade or two decades. A lot of initiatives came from it, like many mentioned already in the previous talks, and one kind of effort that became kind of common was the reproducibility initiatives. Let's get a lot of published results and try to replicate them, try to repeat the experiments and compare the results. And the Brazilian reproducibility initiative is one such a replication effort. We're actually focused on country so we tried to, we tried to reproduce 60 experiments from Brazilian reproducibility from Brazilian biomedical research and to estimate the reproducibility of Brazilian biomedical science. So, much of what I did in the last, this started in 2018 so much of what I did in the last few years was trying to reproduce experiments by other people. Of course, we, I'm part of the coordinating team, we actually don't do the experiments, but we coordinate the labs to do and we work on the protocols and we try to get everything working. So, this is the workflow, the plan for the initiative so we had to figure out what methods were common in Brazilian papers and then we had to find Brazilian authors who were willing and had the expertise to reproduce such papers using such methods. And then we got to a selection of those 60 experiments I mentioned. I actually want to focus, this is a lot of, this previous steps is a lot of research like Tracy mentioned method resurgent or you did that you're looking at papers and trying to extract information from there. But I want to focus on this last part which is what's happening now that we're defining the protocols and actually doing the experiments to do the data analysis and publish the results later. And here I think is what most people who don't do method research can take lessons from method research. So I'm framing this in terms of what if, what if I could go back in time and change the way we publish the way we do science to make my life easier as I was doing this. So, and I think some lessons can be derived from there. I'll mention protocols, data and documentation. So, the first step for us, once we had the experiments we wanted to reproduce we had to to get each one and and take a stretch a protocol from there right a step by step. A step that could be followed by by the replicating labs. So we decided to do that without contacting the authors, mostly for pragmatic reasons, of course the authors have information that is not on the paper, but this would take a long time and previous experiences showed us that this would, most authors would not respond. So we decided to skip this step at this point and go only by what the information, by information that is available on the paper. So we had to get some method section that is usually written in some freestyle right depends on the journal and on the author. And we had to convert this into a protocol that looks at this is an actual protocol from our initiative. It looks kind of like this right. You have the steps that were described in the method section but we tried to structure it in chronological step by step order. And we also had a lot of information that was not present in the original article. So we had to ask these questions to the people who were doing the replications right, and this is essentially about reporting right so what's the thing that would change here is that would have people reporting all this information that is actually essential if you want to do the experiment you have to decide what you're going to do. And if it's not informed in the original article you have to guess or to, of course, an informed guess you are also a scientist but this is not in the original article. And what we use for this and this is the lesson I take is that thankfully there are lots of guidelines right they started in clinical research but now they exist for for many kinds of experimental designs and even for specific techniques. So for PCR, which is one of the methods we're replicating. There's this Mickey guidelines, which is essentially a list a checklist of things that you should mention when you report your PCR experiment to make sure that all the important information is there if someone attempts to reproduce it. So, and this was the basis for the questions we asked, you know, we asked the things that are in the checklist, but we're not in the original article. The second thing I want to mention is the data. So we needed the data, and we needed the data from from the original reports, the original experiments for two steps. Mainly, first, when we are doing the protocols we needed to define a sample size. How large will be this experiment when we attempt to replication and the sample size was that simple size calculation was based on on the original effect size that the original experiment reported. And we needed to calculate this effect size. We know how large is the effect in the original so that we can choose an appropriate sample size. This process was really let me mention first that the second parts of the data analysis in the end if you're doing a replication you want to compare somehow the results from your replications to the original one if you want to evaluate the published literature. And to do this comparison we also need the data we're actually running a math analysis that Tracy mentioned in her talk, and we're comparing we're doing a math analysis of our applications and comparing that to the original. And well to do that I need to know the original value. And the process to get the data when the data is not reported in a structured format is actually very tedious and then, you know, in precise because we have to get the picture and the graph where the data was reported. And we have to actually essentially count pixels of course the software does that for you but you're essentially counting pixels and doing an estimation here. Based on the axis and you just mark this on the software while here's 100 here's three and the software estimates for you what's the value of this point and what's the value of the error bars. Depending on the resolution of the images and then tying this to what you did was just saying this might be like two or three pixels and you're trying to get an estimate from there. So this is very imprecise and very laborious. And what we are doing and what I wish people would have done if I were to to to go back in time is to to report data in a structured format so we're actually having spreadsheets where people are going to this is actually an example of one of our replication experiments where you report exactly the value that comes to the raw data that comes from the machine that you're using this case it's a spectrophotometer. So it measures an optical density and this is what we wanted to have would be much easier to do and it's really easy to share structured data nowadays with many repositories that you can see below. The last thing is contacting the authors we're doing this now just to see if the way we change the protocols is actually the way the authors would have done and now we don't have the pressure of time so we can do that in tranquility. So, so this really depends if we're going to ask the authors like the information that was not in the article, if we're going to ask them well how did you do this, that you did not report. It's really depends on whether the documentation in the on their own labs is actually done in an organized way. So maybe they have this information in a laboratory notebook that is like lost in some file drawer, or maybe they are using some of those this platforms that actually facilitate this work of managing lab and managing protocols. And depending on how easy it is to get this information, it will be easy or hard for them to share this information with us. And this really depends on data management right if this is, you don't need to use one of those platforms but if you have to have a system so you can find some information about an experiment that they haven't long time ago. And of course the last thing is is the authors have to be open to collaboration right they can just see our request for information and say I don't care. And this really blocks any further effort, but they have to be willing to collaborate and then a lot of those things I mentioned before like using reporting guidelines or using a platform to organize your data or to share your data in a structured format. And all of that is false to me under the umbrella of open as to collaborate because you're really making it easier for people to build upon your work. It's not just direct replications that we are attempting here is just if someone wants you to follow up on something you did. It's easier for them if you already put all this information and have the results there. And my last point is that this is not just for others and sometimes this is missing in and people think about adopting those open science of mental research derived insights that the likely beneficiaries you in the future because you know, a month from now, when you discuss with your advisor and decide to change the experiment you have to look back at your old protocol. And it's really good for you if you can can find it easily and if it's really structured and if your data is there in a way that you can really easily reply to the data or something because reviewer to ask. So this is what I tried to keep in mind when when trying to measure the cost benefit. So this is my message. Thank you. Thank you clever yeah this initiative sounds like a lot of work. Important work though, and I really look forward to seeing the results of this initiative. Once it's out. So with that I'd like to thank all of our speakers for their for their talks and will now proceed to the Q&A section of the webinar. Thanks for the questions we've received so far and please continue to post questions. We have in the chat box it's still open so if you'd like to ask there you can go ahead you can also tweet to us at the daily life community using the hashtag ECR Wednesday. So let me start off with a question from one of the panelists I'm sorry I'm not sure how exactly to pronounce the name so I'm not going to do that. One of our panelists wanted to ask Tracy, if she has received hostile or negative attitude from scientists representing the status quo during her first publication for example that regards that that was about bar graphs. And if if if so, how did how did you manage it. So, Tracy that's for you. And so I would say that's a problem that we were very concerned about while we were doing the study because bar graphs are really standard of practice, we did a follow up study in 2018 where we found that amongst papers that had a data figure in peripheral and cardiovascular disease journals, almost 50% of them had a bar graph and it was the most common type of visualization ever that people are using so we did a lot of work to really prevent that and we did that by sharing drafts of the paper with a variety of colleagues and getting their feedback on the paper and revising and adjusting things before it was ever submitted. Once it went through to publication, I think the fact that we had data really helped us with the statistical reviewers in particular lots of people have written papers on this topic, but the fact that we could show that 85 or 86% of papers in our sample had bar graphs for continuous data meant that it was clearly still a problem and one that urgently needed to be addressed. I think that many people who saw the paper felt that way as well and then the visualizations in the paper made a very powerful arguments that resonated with people. So I think, yeah, we took more of a preventive approach and then once the paper was out the response was extremely positive. It circulated very heavily on Twitter the paper was viewed more than 100,000 times in the first month that it was published most of what came to us was positive. I'm sure there are people who didn't like it. Maybe they just didn't talk to me. Thank you so much. So I have a question for you, Leah. So one of the things that we tend to do perhaps as meta research I mean as any researcher is we tend to highlight things that were perhaps done badly or that need improvement. But are there examples of things that you've come across that that you think have been done well and something that we might like to encourage. So Leah, that's a question for you. Yeah, so repository is and nowadays is a lot of positive changes happening and for example that the repository and backup of the original results of the experiment is very admirable and helpful. You know, and it's something that is, I wish would happen more often and the people who starting to do it it's extremely helpful also for the interpreting the data, and also, it's nice that it's happening. Clearly that there are wish that it would happen more often. And also I'm trying to adjust my own research to this guidelines of the reproducibility. But for those people who is already doing it and publishing it's extremely nice and admirable. So you think the future is bright and not. Yes. That's why nice to kill. Okay, I have a question for clever as well. So, so I think that this reproducibility initiative that's being done in Brazil right now is, you know it's a lot of intensive work but is it is other other reproducibility initiatives that have been taken undertaken around the world and if yes, what have they shown or what lessons have we learned from from them. Yes, I think, well, the first initiatives of this kind were in psychology. So those will probably everyone here is aware of them but the audience might not but there's the revolution the replication project psychology. There are the many labs projects there. Well, they have three editions already going into four, I think, and those are in psychology in biomedical sciences I'm only aware of the reproducibility project cancer biology which should be finished. Well, if it hasn't been published yet it should be should be releasing their results very soon. As far as I'm aware, ours was the first on to take the country as the level of analysis and to try to look at the reproducibility of the science produced in a country. But, well, there are indeed many, many replication projects that came before and we actually borrowed a lot of the structure and we learned a lot from them actually talking to the people who coordinate and those. And, well, at least you learn a lot, even if the results is not very informative in the end, you learn a lot about what I just talked about that how to reproduce papers and how easy these papers and what we could change just to make this easier right and it's just adding to what you asked to do I'm very forgiving when I see a bad paper because a lot of a lot of these is very hard and laborious to do, you know, open science is not something that is just well I'm deciding now that I'm adopting every possible practice they're recommended. It takes a lot of work and much more work that people are used to. So it takes time and a lot of learning about reproducibility I think it's learning how to make it easy for people to reproduce so that the incentive doesn't need to be that high for people to attempt to reproduce. So I think all the learning is in the process, not necessarily in the number that that's going to come out in the end. Yeah, thanks actually that's quite nice. I wanted to know. I think we were talking about this sometime back that there was a study to that try to reproduce experiments in cancer. So could you like talk a little bit about what's happened since then and what you think about that and the major challenges that they have they faced, for instance, in trying to reproduce key experiments on that land the landmark papers of cancer. Yeah, this, well, they, their challenges are different. So if you're going to read the reports from their experiments, they're trying to reproduce the whole paper. Right. So this is a design choice we made very early that we're reproducing one experiment from one paper. So this is a very simple experiment and usually they're not like they're not changed in that the first experiments not really dependent on the second is not really dependent on the first. So in the reproducibility project cancer biology, they did have a lot of problems if they couldn't establish the model. So if you have a biological model that it's very cutting edge and you can't establish that. The question of replication becomes really hard to interpret right because what do you do now is it a failed replication because you couldn't even establish the model, but you couldn't really try the experiment because the experiment depending on having that model for you to test. So they did. They also had much more advanced and expensive techniques. So the problems they faced were as far as I'm aware much more in that line. And our problems are more about our experiments are really simple. And our problems are more, it should be easy to reproduce our experiments we selected, and it could be made easier by the things I talked about. But our problems seem to be more and more per se. Yeah, I see. Thanks. So I have another question which is for Tracy. So how long does it usually take to plan and execute a meta research study and can anyone do meta research, or would you encourage everyone just, you know, do meta research. So how long it takes depends a lot on the particular study. And it also depends on the size of your team. It's important to adapt the scope of the project to be something that your team can do. So one of the challenging things about meta research is there are a relatively small number of meta researchers right now, and it is very hard to find training in meta research, I would really encourage people who are seeing a problem in their field that they think meta research might be helpful in exploring to reach out to someone who has meta research experience. It's like, you know, if you're an epidemiologist by training you wouldn't go running into a lab and that was in biochemistry and plan to write design and publish a paper in two months when you've never picked up a pipette before it's kind of the same thing with meta research it has its own skills and methodologies, and toolkit that it really takes time to develop and learn and understand and working with someone who knows some of those things and particularly the relevant to the question that you want to address can be very, very helpful in making sure that you have a sound study design, and that you will ultimately get the type of information that you want to know from your study. And then I think if you're doing a systematic review type, it's really important to remember that. Sorry, go ahead. No, sorry, it's important to remember that. It's important to remember that most stages involve two independent reviewers and so depending on the type of your study that you're doing. These aren't necessarily studies that you can do on your own you need to have, you know, more than one person involved in working together. Yeah, it takes a village to do science anyway. Yeah, I think that's a good point. Vinod has a question to the panelists which is do meta research projects benefit from pre registration. And I think maybe Tracy you could take this question. I think they certainly can and many are pre registered we often don't register ours because they are often more exploratory in nature we may be looking at issues that other have others haven't addressed before. And yeah, we don't necessarily have everything finalized in terms of exactly how we're going to be able to look at the question. So, yeah, but there are other groups particularly groups that do a lot of work with trials that do pre register their studies and there are also some systematic review groups that use pre registration and it's definitely something that I would encourage people to to consider if it's appropriate for their study type and study design. I see. Thanks, I think may have has a has a couple of questions actually so it's similar to the first question which is, how has, how is the response of journals to meta research articles and their suggestions so if you outline a suggestion or policy change. There are some questions that have actively made changes that you've suggested, based on meta research articles that have been published. And I guess anyone could pick this question but maybe Tracy is the most experienced to answer this. I can start and then others may have other experiences to share. So we have seen journals actively changing policies based on our work on data visualization to encourage authors to replace bar graphs and continuous data with more informative There's a big difference between changing policy and having that policy actually implemented and enforced and I think it's. That's something that's much more difficult to journal for journals to achieve so one of the approaches we've been pursuing now is to develop automated screening tools to make it easier to detect some of these things. And so I coordinated group that has people who have all kinds of automated tools. And we've pulled those into a common pipeline that we've been using to screen pre prints throughout the pandemic and post information results from those tools, public make public reports available through a website called hypothesis, which is a web annotation tool and those reports are also tweeted out via side score reports on Twitter. In terms of the response to journals, I think it's very, it's complicated so there are many journals that don't consider meta research to be research and aren't willing to publish these papers there are a couple of publishers like Plast Biology and Elife that have really embraced meta research and I've just recently started guest editing a new collection for clinical science as well to make it easier to get this information out into journals that other scientists are reading I think it's important that we are publishing these studies alongside normal science to send the message that this is important for, you know, every scientist to know about and to be aware of. And it's not something that should be hidden away in journals that only meta scientists read because the goal is really to change and evolve how science is conducted. And that requires having an ongoing dialogue with scientists that goes both ways about both problems and solutions and how can we implement better practices in a way that works for everyone. Thanks, I think that was quite a comprehensive answer. But maybe I can also say that there are certain journals which have been open to adopting, you know, having checklists for example for statistical reporting or to improve, you know, I think that the spring journals, for example, have also implemented the fact that you shouldn't publish bar graphs with error bars. So I think that there is, there is some adoption of these policies from the journal's end but perhaps it's not as widespread yet as one would hope. So I hope that answers your question. I guess. Yeah, if I could just follow up quickly. Checklists are very popular right now. I mentioned that one of the things about meta researchers we can use it to look at solutions unfortunately the meta research on checklists is not as inspiring as we wish it should be. I also showed the meta research study on the arrive checklist at the beginning we're just randomizing authors to complete the checklist didn't really have any effect on quality of reporting. And there are other meta research studies that also raise questions about the value of just publishing an editorial or changing a policy or posting a checklist. I think that there is some impact, but it's not nearly as much as we would like it to be and we still have a long way to go so I think checklists without enforcement aren't unfortunately going to be the major solution to our problems. Okay, so I'm going to ask a quick question to Julia first. I want to know, given that before starting off the life ambassadors program. You know, you had no prior experience in doing meta research so what was your experience like was it was it a daunting task was it scary to try and, you know, do this project and you know how do you think you fed when you were when you were doing Yes, on the beginning when you understand all the amount of the work that should be done and put in the paper in order to continue and to gather all the data. It's a little bit daunting, especially as an early career researcher working in the vet lab, you have to devote your time and split it, but actually it's this experience helped me to educate myself and to see and to more critically my own field and to be more reproducible and create also better image qualities and after seeing and able. to abstract the data, much more faster from the papers so even though that a lot of things for the early career researchers in the science and don't team, they are also tend to pay in the payback very well, so I would encourage any early career researcher at least to start interesting this topic and clearly the good supervision and guidance from someone who is already done it on the initial steps are very important in order not to get lost. Thanks so much. I have a question for clever, which is, do you have any recommendation on adopting fair that is the findable accessible interoperable and reusable compliance research data management plans for nationwide programs, such as the Brazilian reproducibility network. Yes, my recommendation. Yes, please do. We did. So, so I think the largest the project that the most you benefit from, from making your data management, very clear and have a plan. So we do, we do try to be very open and adopt all the recommendations that just said so we're using the checklist and we are pre registering every protocol, the protocols, well, the protocols are in public yet, but they will be after the experiments are done. And you can see much of the method research we did before as set up for the initiative is already available and everything is an OSF. I can share the link later but yeah, you should this is we hope that this makes it easier for someone who later once or even ourselves, if we want to do a second initiative and try to reproduce a lot of experiments that we can learn from from our previous one, the data is there and it's usable and interoperable and usable. The data will be all structured and we're trying to follow our recommendations. Okay, thanks. I have a question from that which is, is there a tool that authors can use before submitting that paper to ensure that it's more accessible in terms of reproducibility and, you know, it reports reports all the methods and stuff very well. Maybe maybe clever you could answer that is there something that authors can use now to try and check whether whether people is doing well. Tracy's the expert and very familiar with those tubes right. Yeah, I think the first thing that you should do is look for a reporting guideline for the type of study you're conducting so if you're doing human studies go to the equator network website. And they have things like console for clinical trials the stroke guidelines for observational studies Prisma for systematic reviews. And the guidelines is good for animal studies. There are also some options for in vitro studies although equator 10 is not to list those. The second thing that you can do is go to, there's an automated screening tools called size score which checks transparency for certain markers and so I believe if you sign in with an organ ID you can screen five or 10 papers per year for free. We'd also like to learn more. We published a correspondence in nature medicine in January on our screening pipeline and I'll tweet out a link to that afterwards from my Twitter account. But that describes more about what the various tools in our pipeline look for. And once you know what we're looking for it's pretty easy to tell like if your paper has a limitation section or other things. Thanks, Tracy with that question that brings us that question brings us to the end of this time. We see our Wednesday webinar. Thank you to all the participants as well as all you attend these. We really hope you learned something new and enjoyed yourself. We really appreciate your participation and we'll be happy to hear your thoughts and feedback about the event. I posted in a message. In the chat. That's an email ID to which you can send in feedback so please contact us at events at the rate be life sciences.org. If you'd like to ask follow up questions to any of our panelists or provide us feedback. So we also encourage you to post about this event on social media that that you may use, ensuring that you use the hashtag ECR Wednesday and tag at the rate be life community this is mostly Twitter. Wednesday is a series of webinars so it's not just this one and we keep having one almost every month. The entire the past editions of this webinar are available online, please go to Eli's website and check them out. We'll announce the next edition of ECR Wednesday very soon so keep your eyes open for that and hoping to see you then until then take care stay safe and thank you so much.


Hello there, it's Sandy Almok and today I'm going to be making an inked card. I'm going to use some new ink that I just purchased, an unboxed set for you, and I'll get out a glass pen and use some other supplies along with a stamp set from MFT. And it's called Wild Poppies, and I'll be making this gorgeous card. I'm making a blue poppy card because our blue poppy event at the local Road to Dinner Garden is apparently canceled already this year. It's not till May, but they've already said they don't think they're going to host it. So bummer on that. I'm hoping maybe they'll still be open that I can go see the blue poppies when they bloom myself because they come out every May. But I'm going to use this brand new bottle of ink that I just bought called Kanpeki Hiroshizuku that is made by Pilot. And I love inks because the bottles themselves are just so gorgeous that I just keep buying bottles of ink even though I'll never use all of this ink. So here I am using it on a card. So I'm hoping I can come up with some more techniques that I can use for cards at least and not just use them for my sketching. So I've stamped with some no-line ink onto watercolor paper because I want the lines to just barely be there because it's going to look like a hand-drawn card when I'm done. And I've covered it with water first, just a nice good very very wet layer of water. And I put the ink onto the tape because with ink it really sets in. Like if you put a blob of ink you're going to get a blob shape. It is not like watercolor it's not going to lift as easily that sort of thing. And I wanted to get an almost smooth background. It's a little challenging with inks because they aren't made to do smooth backgrounds necessarily. And I put the ink down the sides of the tape so I could just pull it in with the brush and just go back and forth in different directions. This works pretty well overall. It was not perfectly even but by the time I got all this part done it actually did work out pretty well. You might try this with other inks. You could try this kind of background with reinkers as well if you wanted to get a smooth background because sometimes those reinkers will act the same kind of ways as these bottles of ink. And this brush is really good for that because it's a nice wide one. Very smooth the way it goes on and I could just paint back and forth until I'm satisfied with what I'm getting here. I wanted it thin enough that I could see the ink drawing or the ink stamp underneath because I'm going to just draw over top of it. But I wanted to have all this ink color down here first because ink has a very special property. At least some inks do and this one did. I tested it out real quick so that I could make sure that it would do what I was hoping it would do. There are a number of inks that have properties to them. And you may remember I did a video last year I think it was using bleach with some inks because I took a class online from Nick Stewart who does amazing things with inks and was very excited to find a bunch of the inks that I have in my collection react in some kind of a way with bleach. Some of them change color completely. Some of them just disappear. They go to white. There's lots of different effects that they can have but it's kind of interesting to play around with something like a bleach and see what it can do. So I wanted to get this thing really dry before moving on to this step. So I've got some bleach in a little jar and I'm using the glass pen which these are really cheap over on like Amazon. You can get them at lots of different places. They're like ten bucks or something depending on how fancy you want the handle. And it basically picks up the bleach and I'm drawing in some highlight areas on this. I wasn't sure whether this was going to do what I wanted it to do overall. I knew it was going to lift up and make some white lines and you could basically go over this and just make the whole thing look as though it was drawn in a white type of ink except it's not raised at all. It's bleached out of the ink color that's there. But I just put some in the highlight areas and wasn't really worrying too much about oh my goodness where's my light source. I just wanted some on the tips of some of the flowers on the tips of some of the leaves and when you leave the bleach on there if you leave it on a really long time it'll just keep eating away at things and it'll keep expanding. So every once in a while I dab it off with a Kleenex just to lift that excess so that it wouldn't keep lifting things. I dried it and I thought I dried it really well but apparently I did not dry it well enough because one of the things that happened when I started going back in now to do the line work with the actual ink was that when I touched the ink to the places where the bleach was I guess that dries more slowly maybe than the watery areas would have dried because what it did was suck in extra of the ink color and most of the white ended up going away as this wore on as I continued with the drawing but what it did which was very cool was to give me some areas that were very very very dark blue because in any of those spots where it was on top of the bleach or touching the bleach the color went really dark because it sucked more I guess probably out of the nib of the pen I'm not really sure what it was doing. I began to get worried that I had ruined this at this point because I was instead of having a consistent line I had this line that got really thick and globby in some places and nice and thin in others but I kept going because that's how I work when I am working on a piece of paper I'm not going to give up until the piece of paper has nothing left to teach me and I decided to get out a brush and see what would happen if I started using some water and a little bit of ink to start to paint in some of the flowers and just portions of them not every single petal that kind of thing using thinned down ink I didn't want to use straight out of the bottle all that much because I wasn't sure if it was going to go on really heavy the way that those dark lines did and I also had to be careful not to put my wet brush into the bottle because I didn't want to water down the ink by adding water to it from the brush so it's kind of a dance trying to put some ink and a little bit of water into the cap that I could work from instead of messing with the bottle itself and at this point I'm not even following the lines of the stamp all that much anymore because I can't really see all that much I'm so distracted by seeing everything else so the stamp lines have kind of disappeared visually and I can just add in whatever leaves I feel like adding in. This is one of those places where my sketching students could just have fun and go crazy adding in little extra bits here and there to complete the whole bouquet of flowers and that sort of thing so I'm trying to balance out dark areas light areas that kind of thing and it was really cool I was very excited with how this was coming out and the kind of things that I could now do with inks that I wasn't really thinking I could do before they're a little challenging to paint with they're not like watercolor watercolor can lift and it has a different way of moving than inks will move so there's different kinds of techniques you'd need to apply if you're going to use inks. Well then I decided I wanted some of that white back so I completely dried all of the painted blue ink and started going back in with my glass pen and the bleach again I got a little dollop in the corner in the upper left over by the bottle kind of dripped out there but I didn't worry about it because I was going to trim this down to put it on the card anyway so it was going to fall outside of that area and then I added some dimensional adhesive underneath this panel and left a little of the card stock showing on the left and then a little more on the right and then just added a sentiment on top of all of that and I think it came out really pretty it made me not as wistful about my blue poppies and maybe I'll have to paint from photos of blue poppies this year instead of going to see them live myself I don't know I'm gonna go see if I can do that in May I've marked it on my calendar so I don't forget so thanks so much for visiting with me today I'll see you again soon with another video take care bye


Greetings, my name is Todd Chappell from the New York College of Podiatric Medicine. Welcome to this video overview for our original study entitled Morphometry of the Fibular Collateral Ligament, an atomic study with comprehensive review of the literature that was published in the journal, Clinical Anatomy. This study was done in collaboration with scientists from the New York College of Podiatric Medicine, Children's Hospital of Alabama at Birmingham, St. George's University School of Medicine in Grenada and NeuroMed Lab in Staten Island, New York. The aim of our study was to identify the morphology of the Fibular Collateral Ligament of the knee, also called the lateral-collateral ligament. There is no consensus in the literature related to morphology, bone attachments, and variations of the Fibular Collateral Ligament. Tears of the Fibular Collateral Ligament are underdiagnosed in practice. Our data are relevant to orthopedic surgeons, physiatrists, family physicians, physical therapists, and any clinician treating knee injuries, which are very common in practice. Knowledge of ligamentous morphology is very important when surgical repairing ruptures of the Fibular Collateral Ligament. We know that chronic injuries lead to knee instability, which underscores the importance of diagnosing ligament injury of the posterior lateral corner of the knee. Surgical repairs of the anterior cruciate ligament and posterior cruciate ligament in the presence of a missed Fibular Collateral Ligament injury lead to the premature and sometimes aggressive development of traumatic osteoarthritis. Seventy knees from formal and fixed adult cadavers with a mean age at death of 77 years were dissected at a digital caliper used to measure Fibular Collateral Ligament length with distance from proximal attachment to articular surface and distance from distal attachment to articular surface. The main length and width of all Fibular Collateral Ligaments was 48 and 4 mm, respectively. The main proximal and distal attachments to articular surface of all Fibular Collateral Ligaments was 22 and 25 mm, respectively. We found a direct relationship between the proximal and distal attachment distances to articular surface distances. We found the ligament row 0.527 with a p-value of 0.002 and this association was independent of age and sex. Two Fibular Collateral Ligament variations were found. A bifurcate ligament with two distal bands and a trifurcate ligament with three distal bands, all of which attached to the Fibular Head. Based on our literature search, we found 10 published category studies on the morphology of the Fibular Collateral Ligament representing a total of 176 ligaments. This review revealed that only 20% of category Fibular Collateral Ligament morphology studies reported variations similar to the ones we found in our study. Further, there was variability in the reported location of the Fibular Collateral Ligament proximal attachment. When combining our data with these studies, 48% of Fibular Collateral Ligaments were reported to attach directly to the apex of the lateral epicondyle, approximately 5% to a fovea posterior to the lateral epicondyle and the remaining 47% posterior and proximal to the lateral epicondyle. A recent study was published on the existence of an anterolateral ligament of the knee distinct from the Fibular Collateral Ligament. Like the anterolateral ligament, the proximal fibers of our bifurcate and trifurcate variants were blended together, so perhaps the anterolateral ligament is a variant of the Fibular Collateral Ligament. However, unlike our variants, the distal anterolateral ligament consistently attached to the tibia. We found no evidence of the anterolateral ligament in any of our specimens. Clearly, more research needs to be done in this area. Our anatomic study is one of the largest conducted to date and highlights Fibular Collateral Ligament morphology and variations and may provide insight into its age-related changes. Our data may help surgeons and clinicians provide more effective and evidence-based care for patients with knee injuries. We invite you to download and read our paper in the Journal of Clinical Anatomy and we thank the persons who donated their bodies for medical education and research.


When used for display vision applications, traditional cameras suffer from issues related with flicker and it can be very distracting for drivers. With its patented pixel architecture, the VG6768 ST's automotive CMOS sensor is immune to a wide LED frequency range, including traffic signs, car lights and other LED lights making it very safe for drivers. With traditional automotive sensors, the front and back lights of vehicles generate flicker. But with advanced ST sensor technology, the image is clear and stable so ensuring the driver's safety. The high dynamic range feature of ST sensors enables the viewer to see details as shown here in the highlighted areas as well as in the shadows. It prevents the sun's glare from interfering with the camera and enables it to reproduce the image very accurately. The ST sensor removes flicker from LED advertisements and road signs whereas we see flicker with traditional automotive sensors. The ST imaging sensor also works perfectly even in low light environments like tunnels. On top of which, the outstanding image rendering capability of ST sensors maintain a clear and bright image output and prevent ghost or artifact images even at high speeds. These automotive camera chipset solutions are now available at ST Microelectronics.


One of the great things about the Linux command line is there is a lot of good help information, help documentation available for you right at the command line. But many new to Linux users especially find this kind of confusing. For one thing, there are multiple help kind of commands available for you at the command line to get documentation for various programs and you know they all differ slightly from one another and many new to Linux users kind of find it weird that we have so many of these help functions available for us at the command line. Why do we need both man pages and info pages for example? Well today we're going to discuss some of this. So let me switch over to my desktop. I'm going to go ahead and launch a terminal and I'll zoom way in. So probably the most common command that you're going to run at the command line to get help information is man. So you can run a man on LS for example. If you're not sure about all the flags and options available for you using the LS command, that's the standard list command that's part of the GNU core utils. And you can read through the man page. The man page is called man page because it's a manual. It's a manual page essentially. And what you could do by default man pages open using the less command less is also part of the GNU core utils. That's why it defaults to less as your man page reader. You can see I've got some fancy syntax highlighting because I've switched my man page reader from using less. It's actually using Neo Vim as the man page reader to get out of a man page. Just hit Q to quit. People often ask me about my man pages. How do I get that fancy colorful man pages? Again, it's because I'm using Neo Vim. Let me show you. If I do a vim.bashrc somewhere in here, I have export man pager. So you have this variable man pager all caps. That is the man page reader. By default, it is set to less, the less command. You can see I'm using in vim, Neo Vim, and then plus man with a capital M exclamation point. You set that. And now anytime you do man, let's do a man on man. Now it's actually Neo Vim. So J and K go up and down. If I do a capital G, it goes to the N, GG goes to the top, 10G goes to the 10th line, etc. All your vim commands Q to quit. Now the good thing with man pages is virtually every single program that you will install on your Linux system will also have an accompanying man page that gets installed, meaning practically everything has a man page. So when people online, you go to a Linux support form or chat room and people tell you to read the manual, right? They're telling you to read the man page for the particular program that you're asking about, right? So if you didn't know about the CP command, the copy command, you could man CP, for example. And when I say everything has a man page, you're going to have tens of thousands of man pages probably on your system. The way man works, if I do a man on man again, is your man pages are divided up into several sections. You can see you have section numbers one through nine here. You can see a section one, which is one of the largest groups. That's all your executable programs or shell commands. So for example, if I do that man on LS again, you can see LS, this is the man page for LS and you can see parentheses one. So it is belonging to section one of your man pages if I go back to man man. And you can see section two is all the system calls. These are functions provided by the kernel. Section three are the library calls for special files usually found in slash dev, etc. You have section six, which is games, seven is miscellaneous. A lot of the man pages that you're typically going to be searching for, they typically are going to be in section one. Sometimes they'll be in section three. I'm usually don't find man pages in the other sections that I'm I'm constantly searching for at least for my personal use. And one of the good things about man pages is because everything practically has a man page. It can always be your go to for help documentation. A matter of fact, most Linux distribution, I wouldn't say most, but a lot of the large Linux distributions historically have pushed people to write man pages. They want all the programs in their repository of software to have a man page accompanying it. So where things can get confusing for new users is other than man pages. You also have info pages. If I do info LS, this is the info page for LS. You know, that's again, I got a lot of the same kind of information, a lot of flags and options and things like that. Let me cue to get out of that. If I just run info without an argument, this is the top page of the info. You can think of it almost like a book. You know, he's got table of contents. Pretty much everything found in info can be found from the top level down. You've got links. It's really like hyperlinks, like you're following web links. For example, if I wanted to read about Dear Ed, which is the file manager inside Emacs, there's info page for that. And if I wanted to, I could go down and there's more links here that I could find a file at point. I could read that page. And how you navigate this is actually you have to use the Emacs key bindings, which are the same key bindings you typically use inside your bash shell for most users. So next is in P is previous. So if I go in for next, that's the next node, essentially the next page in the book. If I do P previous, previous nodes or the previous page in the book, I can keep going back. If I want to go up and down by lines, you can use the arrow keys, but you can also use the standard Emacs bindings of control in for next and control P for previous. So next and previous lines in that case, Q to quit out of the info. Now, this is where things kind of get a little weird. Why do we have both man pages and info pages? Well, they're not really the same thing. The info pages were started by the GNU project info is a GNU project. The GNU project started in the 1980s. They were working on the GNU operating system. They, you know, created the GNU Emacs GNU bash, all the GNU core utils, et cetera, that eventually became part of the GNU slash Linux operating system and they had their own help pages, the info pages that were created in the 1980s. So it really predates Linux itself, the operating system we know now. So info is quite old. Also info is written using the tech info formatting using it almost resembles hyperlinks HTML. It's a very similar kind of syntax, even though the info pages were actually created before the worldwide web was ever a thing. Well before almost a decade before the web and the GNU info pages naturally originally were built mainly for documenting the GNU programs. For example, like the core utils. So the info page on CP, for example, or the info page on the bash shell, which is a very nice read essentially a book with links, lots of chapters. So if you're interested at all in bash scripting and learning more about the bash, you know, reading the info page on bash would be a good place to start. So naturally the question becomes if info is a thing and has been a thing for going back 40 years, going back really, you know, like the mid 1980s, why aren't info pages the standard on Linux? Why are man pages the standard? Well, there's actually a good reason for this. As old as info pages are, man pages are actually a little older, actually quite a bit older. Man pages date back all the way to the 1970s, dating back to the old Unix operating systems. The very first man page was actually written in 1971, if you can believe it. So we're going back decades and decades. So man pages have always been a thing and essentially man pages just became the de facto standard at some point for pretty much all Unix like operating systems. That said, if you want good help documentation on anything GNU related, and especially I mentioned info bash, I would also say info EMAX is also great documentation. It's very lengthy, considerable documentation about EMAX. You can also info EMAX inside EMAX itself. If I actually launch EMAX into a meta X info, there is a info within EMAX itself. And I've got information about all of the EMAX related programs that I have installed, including the ones that were built into EMAX and then the ones that have the red asterisks, that is EMAX programs, third party programs. I installed myself, they get info pages, I guess added to the info database after I installed them. So that's kind of neat. Now many non GNU programs also have info pages. If I did an info on PC man FM, for example, PC man FM has an info page, but it's really just the man page, right? It's an exact copy of the man page as kind of, I guess, essentially you can think of it as a straight clone of the man page. And you will find a lot of non GNU programs that do just that, they have a man page and an info page, but really the info page is essentially the man page. So there's no hyperlinking, they're not really taking advantage of the cool features with info. So while man and info provide you really in-depth documentation about something, sometimes you just want really quick, brief documentation on something, and that is where the dash dash help flag comes in. So for example, if I did an LS space dash dash help, instead of a massive man page, all I get are the flags and options for LS. Actually, in this case, I get the exa dash dash help because LS in my case is a list to the exa command. So let me actually do CP dash dash help, something that isn't aliased, and that is the help information for CP. Again, once again, I get the flags and options and kind of like man, everything has a man page. Almost everything will have a dash dash help option as well. For example, if I do man dash dash help, there's all the flags that I could have used with the man command. Now, one thing that I do need to mention, because again, new to Linux users sometimes get confused by this is this dash dash help flag. When people talking about getting help information at the command line, some people get that confused. In the bash shell, there is actually help. You can just run the command help. And this is not the same thing. Help inside the bash shell, just the command help. It lists all the built in commands within the bash shell itself. It is bash specific. So that's not the same thing as tacking on the dash dash help flag on a command. Now, everything I've talked about this for, man, info, the dash dash help flag, and the help command inside the bash shell, they're all pretty much standard commands that are going to be available for you on practically any GNU slash Linux operating system. Those commands are always there, but I do want to show you one interesting help kind of program that's not pre-installed on any GNU slash Linux system, but I think it probably should be because I think it's fantastic. And I've shown this on camera many times in my videos, but I'm talking about the TLDR command. So if I do TLDR with no arguments, you get the TLDR help information. That's exactly the same as doing TLDR dash dash help. But TLDR, you give it a argument such as TLDR LS for the LS command. And what you get instead of a lengthy manual page or info book or something that's going to take a long time to read because LS does have a lot of flags and options available for you. What TLDR is, it's the Cliff's Notes version of a command, right? Basically it gives you like 10 of the most common ways to use that particular command. So here we've got about eight ways to use the LS command, some of the most common flags and options people tend to use with the LS command if I up arrow and do a TLDR on CP for the copy command. You can see there are various examples on how to use the copy command. And where TLDR really shines is when you're searching for help information on something that is really complicated like the GNU find command, the find man page is massive because find has a ton of flags and options. And sometimes I'm not looking for something that's really obscure, I'm looking for some of the most common ways to use the find command and I don't wanna have to read this massive document to find those really common ways to use the find command. So that's where something like TLDR comes in handy. So if I do TLDR on find, these are the most common ways people probably use the find command. And if I had to do a man on find, well, good luck finding that information in this ridiculously long novel and I'm not even probably 5% of the way through this thing yet just scrolling down with my mouse. It'll scroll, I could scroll for the next 10 minutes probably, it's a huge man page. Let me cue and quit out of that man page. So there you have it, several different ways to get help documentation right there at the command line for your various programs on your GNU slash Linux system. So you have man pages essentially for almost every single program on the system. Man pages typically probably need to be the first place you go, info is great if it's a GNU related program and actually a lot of your software on your GNU slash Linux system is GNU software. All of the GNU core utils which is a lot of your command line utilities, those are part of the GNU core utils. So info pages on that stuff, great. Info on bash is great. Info on Emacs is great. And then you'd have the dash dash help flag for an abbreviated kind of list, right? Instead of all the documentation you're just getting the flags and options listed for the most part. And then finally you have TLDR which is great. You get, you know, six to 10 of the most common ways to use that particular command that you're asking about. Now before I go, I need to thank a few special people. I need to thank the producers of this episode. Daniel Gabe, James Matt, Paul, Royal West, Armored Dragon commander, angry George Lee, Methos, Nate, Erion, Paul, peace archimador, realities were less, red prophet, Roland, Solastri, Tools Devler, Wargent 2 and Ubuntu, and Willie, these guys. My highest tiered patrons over on Patreon without these guys. This little episode about man and info and dash dash help it wouldn't have been possible. The show's also brought to you by each and every one of these fine ladies and gentlemen. All these names you're seeing on the screen right now. These are all my supporters over on Patreon. I don't have any corporate sponsors. I'm sponsored by you guys, the community. If you like my work, wanna see more videos about free and open source software like man and info. Subscribe to DistroTube over on Patreon. Peace guys. And you can also just read the arch wiki.


Going on everyone Sam here with late sports cards ripping 23 tops inception baseball hobby 16 box full case break number 23 pick your team style names and teams Andrew H with the Dodgers Brad P at White Sox Nationals Brett S twins Brian L Reds chase eye with the Braves David G Blue Jays Doug R Cubs Guardians Eric a Brewers Marlins And Pirates Everett K with the Tigers and Cardinals Jeffrey R diamond bags Glen K Rangers Howie W Giants Jason C Orioles John C Angels Jordan N Rockies Joshua B. Padres Jungman K athletics Nick a Mets Quinta E with the Royals Ron S Phillies Ryan B you with the Red Sox Ryan B R Yankee Scott T raise Shane C Astros and Tim T with the Mariners Yeah, no, I could see him going to the Jays for sure. Absolutely dog with the Guardians in 33 and 34 Jason C picking up the Blue Jays in 33 and John C with the Dodgers in 34.  Just forgot about video games Wish the Jags got show hey my phone is at 33. Sounds good. Jayce. Oh, I was what I want to tell Vaughn Vaughn You want to hear that the triple auto I bought on eBay for $30. I Guess I could just show you I guess let me I'm gonna show you guys the the card I bought on eBay $30 I couldn't freaking believe it dude No, it's $20 dude. I got this card for $20 I'm so in on this bro. Look at this thing Triple auto of no Sean Moreno beanie Wells and LaShawn McCoy To 50 all on car bro. That's pretty yeah, dude bunch of legends Georgia legend pit legend in Ohio State legend Bova did play leg of fortnight all night That's why I was playing all day and all night. I don't think bro took a break from leg of fortnight Literally just eat and yeah, I was back on like within an hour Thank you Torkelson read it to 75 l to vey and James Altman rookie Hell yeah, dude, it's a fire card man Adley Ruchman and Jason Alexander to 50 for it the good old brewers Tim T with the Braves in 34 and John C with the Dodgers in 33 move down to in 33 now We're not at a lot of spots left on 33 guys deleted museum this morning for to go for to go on number 33 everyone For to go on number 33 at museum Rec flight to London is about to arrive and a kidding. I'm telling you time is Our soul. Yeah, there you go Riley green Green Riley green Irish spring green green green Francisco Lindor to 99 and Joey one like that. Yeah, Alvarez, India Strasburg and Josh Smith aka J smooth to 125 Yeah, I think the Yankees are like all in on Yamamoto now. That's what I'm doing. Yeah, I believe so Me too, no, I'm happy with that Me pitching man They can't just be Garrett. We can't just get like one win every five games Tenor baby Jaurim Carnation and Cole Regans Riley green and Josh Smith again to 299 this time Chris are with the commanders in 45 Danny, let's go Danny with a spot in two and three a masterwork. Let's go Daniel. You do need Yamamoto I agree Milan. We do need them So buckle up true Suki M picking up the Marlins in 34. Thank you, buddy Johnny a with the twins in 34 Man, we got a lot of spots rolling in here now everybody spots are flying We got plenty of time to fill up some masterwork everyone as well story Ruiz Both as a trader. How's both a trader? Morel and Mark Vientos the 249 What do I do I do I was saying you like that for you're technically a raised fan, right? Yes, like you're not a big.  I would argue that Jake's a trader by being jumbo Diaz And Yuri de los Santos to 99 nice one there pirates Thank you Chris picking up the commanders in both certifies now, so under 20 to go in both certifies Zambrake and next Justin Steele Yordon 2150 and Yan Yurkin out. Yeah And I'm not Toronto Blue Jays Frank Thomas Res Hunter Green gold signatures six to 25 nice one Reds Congrats on that one. I love Whenever Sean's breaking or Sean's top-loading we go in and start trolling So funny like Luzas you have nothing better to do really Unreal Simeon Woods Richardson Bryce Durand their stone Garrett to 125 Nice one there for the Dbecks and leave on Soto one of one Nike swoosh RPA for the angels.  Let's go John Good stuff John one of one on the Levon Soto Nike swoosh RP. I'll get that into a mag Celtics back in 2016. Oh, man. I remember that dude. I Remember that one Masataka Yoshida in the city connect and a blind address as a pirate you 99 so his regular auto He is a ray his RPA. He is a pirate interesting Sounds good. Got you tops Boston, okay, see in Golden State. Oh the pain no one Gorman Green Gabby Moreno to 99 Jordan Walker and von Grissom again to 75 a lot of von Grissom out of this But not the worst thing in the world. Do not mind that at all or I do love I do love Wednesdays when Sean goes It's a preacher I told Kyle he likes he wakes up Wednesday morning There no, yeah, dude, honestly Salvy purple gray rod to 150 It's when they're just like no, but I will think about some of the stuff He says at like random times and start laughing. Oh my god. He made the wrong card Such Josh Chisel Nick Lodolo to 125 such a It's a red card on Matt right straight up Mac in the wrong card Good thing they're magnetic. Haha, true What is Cuban put that 3.5 billion after selling the stake the map just goes to Bofa or Bank of America make deposit probably honestly though orange Z-Kill Duranda 50 and Hunter Brown J rod and to 149 the over baguaro Grats on that one there pirates. I think I do need some sort of substance some sort of abused substance Gabriel picking up the Rangers in like everything in the Met Wow Gabriel with a bunch of Bowman draft spots Thank you as always buddy appreciate it Uh for to go still cubs tigers brew crew and pirates on museum and then the second museum d-backs red sox cubs Reds Rockies tigers asher's brewers yanks pirates rays rangers and Lujays He mag the wrong card jumbo I don't know. Are you talking about it's right here He originally mag the wrong there, but now it's now. It's good now there. I'm no Crash into a wall He saw that we were all dancing he started dancing with us So we're all throwing up emotes so he ran over and started emoting do Peter Lonzo Aaron Nola and Yuri Perez Robles McCutcheon and Cal Stephenson to 299 for the ace grads Oakland No, they would not they would not know melch only only base only base Only base rest ring Juan Soto to 150 and Oscar Colas and Max Meyer 299 nice one there Marlins congrats Miami very nice Dan picking up the Dolphins in certified Tyler with the pirates in 33. We are now down to three teams left three to go everybody in the next break Three at Tog ooh Three at Tog oh everyone get a redemption. So we got an extra hit in here Oswaldo Cabrera rookie at red to 75 Trevor story and gray rod stone Garrett That is gonna be base rookie an emerging star autograph of Matt McClane nice one there for the Reds grads sincey Cincinnati at Reds with that one and then jumbo RPA to 99 is Nick Prado For the Royals Prado Otto She know about Prado Otto Yes, nice seeing McClane stuff in this nice seeing that McClane roof the autos and such another redemption So to another bonus hit out the Richmond green and Ever Julian that is Gabby Morena Mike trout Kate Cavali. We've got a can and Smith and jigba Nice one there for the Pirates. I was gonna say I've only pulled two total McClane autos All right, see what we got here Bofa inception autograph patch guard of Kodai Senga nice one there for the Mets again first Senga I've seen out of this I believe as well So that'll work and grads Mets very very very solid grads on that hopefully not super long cam Thank You Doug pick up the Tigers in both Museum Breaks drew with the blue jays in 34. So thank you guys appreciate y'all You gotta get masterwork filled on up here. Everybody at Star Wars masterwork first one is in fact sold out Last box Brian Bale green Patrick Bailey green and Miguel Amaya Thank You Dan picking up the Giants in 46 appreciate you Dan down with some certified spots Leave on Soto and bone nailer 31 of 99 for the Guardians. Congrats on that Very nice very nice It's not bad actually Milan 160 and buybacks, it's not terrible at all All right, let's do a quick recap errone here everybody. We've got cannon Smith and jikba Cal Stevenson a Josh Smith Mark Vientos Nicoladola Stone Garrett Josh Smith Max Meyer Yeri de los Santos von Grissom Jason Alexander Hunter Green to 25 More autos we had the Matt McClane Redemption Kodai Senga redemption a Leo from Aguero bone nailer Nick Prado Blimey dress and then this really awesome leave on Soto one-of-one RPA That'll do it for the break everybody. Thanks again for the fill up next is museum. Let's fill it up