of the greatest movies ever made and it's about by the way what we're talking about autofocus is about bob crane a really good guy yeah well yeah it had to find good yeah who i believe got poisoned by hollywood oh yeah rent autofocus bob crane was the star of hogan's heroes i love hogan's heroes you know why hogan's heroes is great the lighting i'm serious well that yeah but it's well went i never saw oh it's awesome you'd love it hogan's heroes it's the greatest is one of as a great show and i attribute it great writing great acting but there is texture and a kind of you're right an authenticity to the lighting you're that makes it believable you're actually a right yeah it's cinematic it's a really well done anyway bob crane became very successful and then uh it wasn't during the 60 he was a victim of the 60s fame and money and turned to became obsessed with pornography and autofocus is the cautionary tale of what happens when you can have as much vagina as you possibly want and what what he had so much vagina much of a good thing too much of a good he had so much vagina in his face that he turned to pornography it's like the reverse of what land swiss and i you know it's like we watch so much no vaginas yeah he went from vagina to pornography yeah no yeah i know i know a little bit about it so anyway greg caneer great actor autofocus rented great movie love in the age of trump let me ask you about slump busters have you heard of this term slump busters like a copper bag is that like a carpet bag no i've never heard of slump more like a carpet muncher oh no i don't know what that meant i think i knew what you meant okay if you haven't been having sex for a while oh okay you want to put numbers on the board by going after a woman or a man who is easy oh and you want to put an end to your cold streak the idea is to get some confidence get that glow it's like hitting a home run of t-ball it's like a hitting a home run off a triple a pitcher gives you this feeling that you can do it again so have you ever had a slump buster have you ever been somebody slump buster probably are you using that person uh can a man feel used can a man feel like he's a slump buster do women need slump busters i think well as you described it that's why i went on because like to me i can't unless it's just because i don't know yeah i think a man could totally be a slump buster like given how it's how you um presented it if some to me it takes we've all like flirted with people for our own ego but to actually like go further in my opinion and be like i really don't like i'm not even really like attracted to you at all you know it just seems really i don't know contrived i don't know i'm wrong necessary bad and moral using somebody i just don't know this is different yeah let me know it isn't about moral see i don't even think that i could i'm trying to like maybe i'm just i can't fake i don't know like i it just seems weird to me that like truly that's all it's about it's like i i need to put you know what i mean like i don't need to put women don't need to put that you i'm not oh i needed to put believe me i've had sex just to put numbers on the board so i guess i have but i don't i didn't because i'm the virgin for 25 years so after what i was like no this is whatever this is i'm never gonna see this person again but i don't want to i don't want to like end up in heaven with like how many people you sleep well you know yeah anyway but let me ask you but i don't consider it like i didn't do it out of like sympathy for them or like ew they're beneath me like to me the term yeah buster sounds like i'm doing this so i feel better about myself because look at this loser yeah i so to me that's the part of it that's a little land squeeze physiologically okay physiology is what it's like mentally your body okay your body uh while you're making love okay you're not feeling like you're conquering something but afterwards when you pay her the money oh see this is an apologize to the pimp no like i have worked hard yeah yeah after after the sex it feels like a conquest for men i thought during it felt like a conquest that's rape no i don't mean like that i mean like i thought that was part of just even how we're built like no no i was talking about what's going on in the control that's interesting i i more thought i don't well show braz i'm sorry what were i'm more i guess maybe i even just thought because like of how we're built like anatomically i always more thought like is that the right word yeah okay like during it it was more like of a conquest for you like how i did a little table rock thing you know like you're chair rocking the show um yeah well that's interesting because i never thought about it that way that like after you're like hey like i even thought it was during you're like hey you know i don't know that to me that sounds i i'm 58 so i i need an emotional connection oh no you can have an emotional connection and still feel that the way i think though i just don't think having sex like i don't i don't remember i don't think i guess i there's a vial go ahead there is a violence that like well i mean before i i'm listening it's volatile it's not like i think again i'm going to quote people because sure so like i remember this was i was this is before i ever had sex but i remember like reading some um i'm a big marty feldman fan and it was some quote for him where he's like you know why marty feldman you know i go from young frankis nine wow yeah go ahead he's yeah you know who he is right of course yeah i love him he's like one of my comedy heroes this is my father yeah i was gonna say that yeah anyway i wish i got his looks that's i know well i kind of do too no i'm just gonna do it but uh there was some no but there was not my father no i know he's not hello feldman is so anyway next topic but anyway so he had he had a quote that was like something you know violence is in society and he's like you know making love and making war or both violent activities and i remember i was kind of like thinking about it like hmm but then like i finally had sex and i was kind of like i get it from the perspective of violent as in it's volatile not violent as in like it's shooting someone but violent like chemicals are you know volatile and explode you know like i feel that way like it's it's yeah i mean it's i you know but i don't i just i i can't i have daughters i i don't see sex as i i know that there was a little i don't know i think i know what you're getting at because i i even joke about this in my like i that was part of like i had a hard time like i feel like when i particularly like when i first started having sex like that because i'm one like i'm 511 like i'm not used as a woman like feeling vulnerable like physically at all really like i walk or like i don't feel like oh this person's gonna you know i'm kind of like yeah i'm told like i don't really feeling posed upon let's say but like it was your father i thought i thought when you said you were 511 i thought you were like a chain of knockoff stores like 711 it was actually 711 like this really yep i was so would you like a slurp so i said to my mom would i would you like a slurp anyway i uh so i i think that that's something that i've even still i think been trying to like rectify within myself this feeling of like almost like vulnerability or like submissiveness but at the same time like you're willingly like it feels good you know i'm trying to say it's like this this vulnerability that you feel with someone um so i get what you're saying but i think those two things can exist at the same time you know what i mean like i think if you you know yeah i think they they can have this stuff do you know about i vow i don't know that either martin buber i don't know a lot of stuff worshiping you find god in other people okay i've heard that right i've heard that so i think sex is a form of worshiping god so i've heard that yeah so when i perform kind of lingus i'm really yeah i'm going down your god i'm going down on god that is become god no no i'm going down yeah i'm god i'm i'm licking god what is the interesting i always thought about i just lost every single listener oh i think well by the way if your earphones just burst into flames when i say i'm performing kind of lingus i'm god no that i will agree i'm gonna agree with you on this though uh a little bit because i always find it fascinating um you know people believe in god people don't believe in god some people aren't sure if there's a god whatever you want to call it but there is a weird thing when people have sex that they yell oh god yeah like regardless mm-hmm of their of their maybe religion or their you know it's um and when you say god you mean help police somebody call the police that's i'm sorry i'm sorry i just i can't help myself the um but it yes that's why i masturbate all the time there you go that's a fascinating thing though that people like whether you watch movies or people yell it regardless of like the like the you know right the most um uh unreligious person will yell that in the moment be and so it's a weird is there some kind of connection to an actual whatever to uh to another world uh a god or you know universe of spiritual whatever and i remember even the other thing like you know i remember this is maybe embarrassing that but i remember like looking this up like what i had started to have sex because in french what is it like le petit moir i was like you're like die when you come yeah so like to me it's like okay so what is it like it's a little death like when you come you die that's what i say yeah so like it's kind of that's what i meant more about wrapping my head around this idea of like you're like enjoying it but at the same time like you're so like vulnerable to this other person that you're dead you know i mean it's like yeah anyway i just wrote look what i wrote aw aw as i go writing it says little yeah little death i got little death i wrote little death kid it says little de and i was just in the middle of writing a to make a note this is therapeutic of the type of snacks and then she just brought up le petit moir i think that's how you say yeah little death so i don't shake spirit talks about this yeah a little bit so what you're saying is when you have your orgasm when the belt is around your neck there's no more oxygen going to everyone does it different yeah no i that's not book ahead what that's the only way you can have an orgasm is if you strap kids listen to me there's a belt in your closet listen to bink rosby's kids he beat him with the belt and then they messed up there are a lot of children listening go on david i'm sorry there's a reason there's a belt in your no don't do that do not do not do not do that don't try any of this at home show briz yeah but if you do if you by the way if you do walk into your closet and your adolescent son is unconscious his name is alex brazil you wrote that joke and sue show briz studios they're an llc and okay so go on though i don't want to so that that when when you have an orgasm for that for that brief moment for a man for a woman it just never stops you are dead everything every your whole body you are dead right you've surrendered your well all that's left is right yeah so i think that's more the idea that like we were even talking about this earlier when you said about like rectifying like feeling like you're conquering someone versus but your respect is someone i think to me that's what i found hard because i'm not used to being like like out of control really or like i feel like for the most part i come off as kind of an alpha personality or just kind of like not i don't know people like i'm not gonna fuck with angela i don't know so to me it was kind of like jarring almost like you know because it was like this is nice but this is weird do i trust this person enough to even be in the you know what i mean so like it but i think that's what i mean what a time we had that's uh yeah we did we had a good time me and lance yeah nothing oh was this during uh hurricane katerina katerina it's during all the all the hurricane in college during um katerina so that's probably when it should have been like anyway but uh you were freshman in college during katerina is that how you lost your virginity no i lost it during hurricane sandy years later get the hurricanes but anyway people are sick of hearing about this anyway my point was you lost your your virginity during hurricane sandy yes i was 25 four years ago yes okay so anyway hi lance how you doing um i remember that yes you were there too what are you doing all of you wow we were all crazy everybody had sex i remember chris christie hugged barack obama everybody got everybody got horny during they had sex they're called poor obama anyway um so you've all you've been in the game for five almost five years yeah four and a half years yeah but anyway the point i guess i was trying to make was that that let me just process that first thing that's where the emotional connection comes in because you can have set like you don't i don't feel emotionally vulnerable when i have sex with somebody i don't give a shit about it just like whatever you know i mean it's almost you feel more i think you feel more vulnerable when you actually give a shit about somebody you know wait a second so did you so you lost your virginity because you thought you were gonna die no no no that's actually not why no that's not why where were you um what well how specifically we get here i was on a futon no i uh no where else are you yeah where are you there's other spots no i'm talking about like so there was a hurricane you were in jersey no i wasn't in jersey why would i be in jersey hurricane we're talking what hurricane sandy okay yeah sandy they was named after bruce springs she's out of rockaway asbury park at the rockaway taco no that's where he was people are very sick of hearing about this i just want you to like i don't mind talking about but i think a lot of people are sick of hearing about this but not on my show we've talked i feel like we've talked about it i think like that i talk about two and p and i feel like i've just but it's funny to me it becomes funny it's like i try to then incorporate everything into like let yeah you think i talk about too much look i can corporate the election into my virginity yeah but uh no but i'm sorry they would go on no you go ahead it's like uh a musician playing the greatest hits yeah yeah it's like but but people love the greatest hurricane sandy is my hey jude it's like man a bunch of people pop out it was me it was me it was me it wasn't i'm like no it wasn't you um oh i'm just wondering if if if we're all like if i can get laid using hurricane sand like oh trump is president all the disasters oh well yeah well i we all that matters as we love each other yeah zipp flop suck zipp flop flop all right um i i uh no well with the election thing that's what why i even said about like make uh virginity thing really into the election because the last election you know it was during sandy like basically well a little after you know i mean like that was the last like presidential you know obama got reelected yeah so when this kind of rolled around i remember being like feeling like oh like i feel kind of like oddly nostalgic and then the results of the election made it even worse i'm like holy shit i thought i'd be said for other reasons on the night now i'm like this is but also you get excited during every major disaster every major disaster anyway but apparently when when we get wet so does angela there you go um have you done that joke no there's a reason when you said there you go have you done that you're like there's a terrorist threat it's a red level right no but other people have even joked about that with me and anyway um but uh i think that i do think though with what you were i don't know maybe this is what you're getting to about using trump or that kind of thing i do think that it's made people put into perspective certain things like like uh i mean one of my friends even joked with me like when hillary lost the election because the guy had lost my virginity is a big hillary sport too she was like look like it's going to bring you to back there i mean i i feel like families have probably reconciled over shit you know or like maybe people have started to make it like put things aside it's like look what we're dealing with here you know look what's in charge now let's maybe we can i'm sorry i cut you off last year on the under street you know we're like you know so i was at the javits center the night oh yeah i was there wow yeah yeah with triumph i was in Rockefeller center right in the ice rink where they were doing all the coverage really yeah i took pictures of women yeah at night at the javits center uh there was no way you could walk up to a woman that night and say hey you know let's let's have some great that's because you actually are respectful have you ever had a slump buster land swiss have you ever been a slump buster no could you have sex with a woman and never call her again no not the kind of guy wait but see i don't think that means it's a slump buster i think that's just whatever we had sex and that's it like i don't think i don't know the so slump buster thing implies that it's almost like uh like a uh like it implies a certain meanness of like the one person feels like they're like above that person like maybe physically or whatever and it's like all right i threw him a bone they should be grateful by you know what i mean or like i don't know do you owe somebody if you have sex with somebody what do you owe them besides the 50 no i think it depends on what the relationship was before you had sex in other words i think like if maybe if you guys were like good friends for a while let's say maybe you've known each other while and there's already like a certain sense of respect for each other or whatever then there's probably like you know some sort of like you at least gonna text them the next day or something like that you know versus if it's somebody like a tinder date you just met i think it's kind of expected that like it could go either way you know i mean i don't think there's any obligation if you don't really know each other or like um you know i think it's more about kind of going into it what the relationship was versus you know i mean your generation understands it's much different than my generation cultures are changed but i'm like sappy and romantic too is what i'm saying but if if a guy has sex if you have sex with a man does he have to call you or do you have to call him afterwards but like what's the context i don't think anybody owes any anybody anything in life i think it's about the context we all expect things regardless of sex or anything we all everybody expects things to happen first like but no one owes anybody anything you know if somebody even though like opens a door for you you don't technically be nice if they said thank you but you know they didn't ask to have the door open they didn't you know no one owes anybody anything we all just expect things because we're like why did that for you why don't you do that for me or you know whatever that's why i think it's more about the context of the relationship like if um yeah i think it's about the context of the relationship like if i if i had sex with somebody who like i don't really know that well and it was fun whatever but then like he never texts me he doesn't contact me um i'm not going to be like oh my god because there was there was no real like emotional history or connection to begin with do you know what i'm saying versus somebody that maybe you like then you're like oh okay like so i think it's more about the context of the relationship versus i don't think it's like if you have sex you must do this it's you know that's you know what does that make sense well it's almost like if somebody uh like we're friends right i don't see a lot but i see you and me yeah i see all right let's have sex i'll have sex i'll have sex i'll have sex i'll have sex no but it's like uh granted i did i'm i'm bad at responding to messages in general but like if i saw you you know i've been on here a couple times i see you at a show that i know your last couple years the last few years and if i see you you don't owe me anything but if we're for the party and then you i'm like oh boy and you like and you didn't say hi to me or like or if i emailed you about something you didn't even be back because it's like you know i'd be like a little hurtless i thought i thought we were like you don't owe me anything but i would but i would feel hurt you know what else it is too i think you can also because they're because they'll even like you said i'm not the best at responding to things whatever i think it also depends upon the person because once you know someone well enough you know almost like they're texting habits or their response habits you know if this person responds super quick then you become paranoid if they don't respond right away yeah wait what's this person doing yeah i mean so i versus someone who doesn't text back it like three days but that's just who they are you know see i filter everything through class struggle i apologize i'm 58 i view everything through corporate manipulation okay so you're 58 i'm 50 you look good thank you you're welcome uh i you know i was one of those guys who was ugly in his 20s 30s then in my 50s i like that uglier i get uglier i get so ugly i can't wait to see the 60s hold so here's the thing with me i was with the same woman for pretty much 30 years i never cheated it's like my parents did i never flirted fell in love with somebody in the mid 80s thank you god that's it i'm done here my here's my penis here's my libido you got it i'm the luckiest man in the world and now like i'm a guy in a coma who suddenly woke up 30 years later right and i'm going oh the game is changing that's how my parents now when i was 30 years too and that's how they feel when i was in the game as they say uh it was a different country it was reagan was just ruining it but but now i find you meet a woman and they don't have health insurance or they're broke and you go really i i'm gonna have every you begin to work like you just can't have sex with somebody who doesn't have health insurance or is struggling financially or is i i just don't i and when you say to me you're young people and you say to me you don't know anybody anything and you don't have to call them the next day i can't help but feel that you have been programmed hold on i'm checking my instagram account with with the the the bumble and the the tinder and the grinder that you have been programmed by the corporate elite to treat your sexual partner as some disposable item made in china but see this is where i feel you cannot feel disposable if you don't have an emotional like i felt disposable by people that i really cared about because that like you can't be hurt by somebody you don't really give a shit about in my opinion so to me it's like if some if somebody i slept with once never gets back to me i'm not going to feel disposable because who gives a shit you know i don't you think you're being programmed to treat people as though they're disposed like their iPhones that can be replaced that's not how i grew our cultures like that for sure no question like that when i was no question like that you know even go to appliances like uh if these microphones broke uh you know 50 years ago somebody would fix the parts now like ah fuck this microphone go buy a new one but also see that's where i think it's both good and bad because you know how people in faith they'll always post that meme on facebook of the old couple holding hands and had you stay married for eight years we grew up in a generation where if something broke you fixed it you didn't throw it out it's like um that's dumb i'm sorry if you fall out of love goodbye your divorce like you know that you have to also be realistic about things you can't like there are plenty of people who stay because they're miserable and just like well we're gonna fix this it's like you have to i think it's like there's a gray area so i think on the one hand we've lost a little bit maybe of the like respect or decorum of like courting or whatever the hell it is but also on the other side it's also we've gotten more real about it and less of the the fakery of pretending like let's face it like this people who dated back in the day who like waited to have sex they wanted to have sex on the first date but they didn't think they should or something like that you know what if you're wrong i could be wrong i'm not what if you're wrong yeah what if what if i'm not saying everybody wanted i'm saying that i think there's a gray area that there's been given this sort of disposability element you talked about i think there's both good and bad aspects of that you're right you know there's a narrative that your generation angelic ob yes my general is telling itself but are you telling it to yourself or are you being indoctrinated by the richest one percent by the corporate elite to believe that sex is a physical act that you that you are detached from it and that it's not necessarily love and that way you eventually don't care if 20 million people lose their health insurance i i mean that again see that's why i think it's all a case by case basis because i i feel what happened we're getting the wrap up so go ahead i feel like it's it's not about being like i think you can be in love and have sex with someone and then also like have sex with someone and be detached because you're not in love with you know what i'm saying i think that i think it's the whole world we live in i mean you even look at at grammar grammar is not even corrected on on major news sites because it goes down the feed yeah it's not it's not a two page brilliant article written by i like i've blogged for some like pretty good sites and i'm not an expert and i'm and i'm you know what i mean like a lot of times a blog written by like cnn or like forbs or it's written by like a 21 year old who's who like and it just goes down the feet like the whole world is disposable that's what we're living in yeah you know um i actually think have started to have sex later in life actually on that regard actually helped me a little bit because like i i kind of have my own ideas i feel like to a certain extent about like how i feel about you know like i what like because i didn't have like a conventional experience where it's like you know i had sex at my first boyfriend when i was 16 and then we went to you know so like i i feel like because i grew i grew up feeling so like almost um like alien to a certain extent about a lot of stuff like well these people are like how does this even happen that i really kind of felt like i did it all kind of you know now i'm navigating it myself which i think almost gives me less of the like shit that people feel like men and women you know like we have to do this we have to do that you know i always thought love was being selfless the theme of the show is love in the age of trump and this is an age of selfishness it was an age of selfishness when ronald reagan took off as we became an age of selfishness love is selflessness love is not individualism love is you lose yourself in another person no that's codependency now i'm just well that's a that is that a coping is the term codependency no i i i think that there's a selflessness in love but i also think you have to have a strong sense of self to be in love that was pretty good okay hey alex you're giving me the wrap up sign and i i want to get to something so we get what what are you talking who's here all right let me let me give me i don't feel i feel cheated when i get to hear that this inside showbiz so you can tell i'm i'm hurt when you hear when i make a sound like that i'm sorry it's because i talk too much go ahead no you know i like by the way angela not to embarrass lance we's here i've had a great time you're a genius so are you no i'm not i'm really not but she i don't know a lot of stuff that's sweet of you thank you i'm just out here trying to navigate the world of them on my own i learned a lot by the way i was just you know when you said i'm okay with my mother brag about she'd say angela's a genius so why can't you pay a rent or why can't you get up in the morning how about this how about this maybe i'm the genius angela has something to prove i just probably have undiagnosed autism go ahead go ahead film and i'm sorry uh no it's been diagnosed or listen no no you are uh no so laszlo i could keep going laszlo because i watched the third man maslow's hierarchy needs my ex-wife always used to bring this up whenever i was having my daily panic attack he was a psychologist abraham maslow he wrote a paper 1943 called a theory of human motivation he studied elinor roosevelt frederick douglas albert einstein jane adams who i really don't know that much about jane adams i'm hosé arroyo always used to talk about jane adams and uh he looked at neurotic people emotionally stunted people and then he studied the healthiest one percent of our country and there are steps to that you have to accomplish the triangle yes the hierarchy of needs do you know about this angela i was going to say see that's what i'm a genius but i'm not that smart i know a little bit about it yeah i know a little bit about it i love the way you said that alex can you just cut that as the opening for our show as the sting for our show next stop you would have you should have your own sitcom the way you just said that thank you anyway but please talk about the hierarchy of needs and no i probably don't know as much about it as lands does and love is number three first is physiological needs so in the age of trump how are how are we gonna how are we gonna survive in the age of trump and according to abraham maslow in 1943 first you focus on your physiological needs breathing your breathing water your body shelter maybe next yeah you put on the the oxygen mask first before you take care of your baby sure right yeah that makes sense physiological needs health care first thing i've always said this in america universal health insurance sure so what this is really important folks there's a lot of noise out there number one medicare for all medicare for all medicare for all that is the only thing you should be focused on politically medicare for all that is your physiological need you you're being there it's shocking all right now there's a blitzkrieg focus on medicare for all i know black lives matter they really do i know gay rights matter i know israel and the palestinians that has to be solved medicare for all that's all that matters medicare for all then it's safety needs number two is safety needs so you feel safe and there's different aspects of that too because you can feel emotionally safe and physically safe i think there's layers to that yeah i feel pretty good you feel so i don't only i don't um i don't i feel all right now yeah i don't get them wrapped up in that stuff like i don't care who the president like i don't like trump but i i don't i don't get i don't care if whoever's in there doesn't i don't live my life based off uh that that who's in there maybe that's bad people argue that's bad i just i tap out i think you know what i i will say this i think that and not to sound like some kind of i don't even know but it's funny i think there are people with trump who more not everybody has the same luxury with trump i feel like and i'm saying this like as a as a white woman obviously i get like there's something like trump says about women whatever and i'm like oh my god yeah that's bad but at the same time like i get that like you know i am not in any way shape or form like affected by this is directly as like a black woman a muslim family or you know what i mean so like i think to a certain extent some of us have more of a luxury that's true let's be like let's see what happens and some people are like uh no let's not you know i don't want to see what happens i just don't i don't i don't even i don't care what's i don't i try not to live my life based off what the banks do what the government yeah i kind of just like i'm more like unless like you're in my family like we're dating or like we're really good friends like i'm kind of like i don't like i said earlier almost like unless it's like a real intimacy there i'm not going to really give a shit that much but it's also obviously going to affect me because he's the president well what he's doing is he's making us feel less safe yes that i could say the carnage the human carnage that he talks about in the inauguration he is he is he just isolated us well when you feel when you don't he treats america like an abuse spouse that's basically it so let me tell you what safety is folks i'm gonna get to all these of them we're gonna end the show and it gets a safety love and belonging esteem self-actualization and self-transcendent self-transcendence whatever you pronounce this is meslos hierarchy needs i'm gonna wrap it up alex but i want to get to this if you don't mind okay this is important and this is one of our best shows but i'm being replaced by marty felton he passed away unfortunately okay safety needs number two okay hierarchy means safety is money safety is security safety is money not the police not the military money focus on money focus on the one percent we are the 99 percent occupy wall street we'll go down in history is one of the greatest movements since the populist movement focus on money who's got it who's manipulating you with it who's who's holding money in front of you and depriving you of it after medicare for all focus on money who is getting rich off you and exploiting you unionize pay attention to the minimum wage focus on who is stealing your money that is safety not the police the police are are god bless the police but they work for the richest one percent when you get your home foreclosed on the sheriff kicks you out the sheriff comes the police work for the corporate state i love the police some of them but safety is money number three love and belonging i thought love was higher on the on the i didn't know is that when you are physically after you take care of your physiological needs being wanted and you're feeling okay after number one is physiological number two is safety once you feel safe that's true three is love you know a woman will not love you unless you feel safe around you lance or have money no but see that's where i disagree about the money well there you go that's interesting i think safety this is one of our best shows alex and you're giving me the wrap-up when people say safety and security though i don't think money like when it comes to dating i think i thought i feel emotionally safe with you i can love you i don't think it has anything to do with like you know i could care less who's gonna you could buy me a slice of pizza good sure you know i'm saying so yeah go on after love comes esteem now i don't know about that i would i would think i've been trained that you need self-esteem first what's higher like you want to love is you want to be wanted in the group and like and then esteem is like now i'm the head of the right love and belong yeah love and belonging we need after safety we need to love and belong we need to be part of a community a steam go ahead a steam you've made it to the top of the group because that's where do you go from there i'm one of the group now i'm in charge of the group right belonging facebook gives the illusion that you're belonging to something you you you know i i do love facebook no but i agree that what you said but it's the illusion that you belong to something i i i you know on twitter but mostly facebook i've made friends on facebook and we've shared information but it it keeps lighting up parts of my brain that cannot be satiated by the way podcasting different this is this is a real community people it is it's a it's a different it's different than facebook number four is self-esteem esteem than self-actualization and then self-transcendence uh i don't know how to pronounce transcend transcendence transcendence transcendiation trans yeah well we'll continue this conversation we have to wrap it up because this is i want to thank you i've been honestly depressed and trying to figure out really yeah a lot of people have yeah oh yeah yeah a lot of people have and i keep struggling with because of this stuff or because of winter i don't know yeah i don't i i didn't watch the tv i read about it and then i watch clips on youtube it's really messing up a lot of people but i don't know if it's it is you know it's like i always wonder how psychiatrists treated people during nazi germany like yeah but i gotta wrap it up angela cob yes people follow you on twitter at angela car and you do a monthly show my first time my first time it's about losing your virginity and it's a q ed in the story yes third wednesday of the month it's at nine p.m virginity lost stories and i you know q ed in the story i love it's great cambrie it's great it's great space christian finnegan god bless them it's a great space god bless god bless them q ed in the story if you want to support great comedy in america when you're visiting new york i want to have you on the my first time show well when i lose my virginity on the last time show that is a good idea for the last time you had sex oh i okay that you done it no no i'm saying but that's a good idea on a new segment yeah i thought like you had sex then you died you know and angela cob follow her on twitter her tweets have been featured on at midnight in the huffington post and lance we just let we gotta wrap it up lance weasd dot com that's it gandhi is that you how do we promote gandhi is that you just lance weasd dot com it's all there all right make it simple friend me on facebook light up my brain for a nanosecond by friending me on facebook and following me on twitter go to david feldman show dot com we got great information at david feldman show dot com love in the trump age love elizabeth warren find out who elizabeth warren she is a beast find out google elizabeth warren senator elizabeth warren follow her on twitter follow her on facebook follow elizabeth warren do what elizabeth warren tells you to do she's amazing yeah do what elizabeth warren tells you to do simplify your life get rid of the clutter get rid of the noise do what elizabeth warren tells you to do medicare for all medicare for all from the show bris studios in downtown manhattan that'll do it for us medicare for all that's our show thank you for listening we've got a lot going on over david feldman show dot com please go to the david feldman show website go to david feldman show dot com and route around we've got a lot of interesting stuff i'll talk to you later


Give me six hours to chop down a tree and I'll spend the first hour sharpening the axe I can assure you that the axe is sharp our alliance is sharp Thank you for your hospitality and thank you for this awesome experience since April captain steps paratroopers from company C Second battalion 503rd infantry regiment 173rd airborne brigade have been training with their NATO ally partners in Estonia Today they are heading back to their base in Italy But only after handing over the reins to troop be first squadron 91st cavalry regiment 173rd airborne brigade My hope is that in the coming months. We continue to show mutual support and solidarity of our allies We're better trained as soldiers and paratroopers We maximize unique opportunities connected with the citizens and the communities of this great nation So say so long the chosen company and hello to our new partners Mati Radma is the Estonian National Defense Committee Chairman and he spoke at the handoff ceremony at a Mari airfield He says the NATO alliance has brought the two countries together and this training is a continuation of a longtime partnership Estonia and American soldiers have fought together in Afghanistan for many years Your deployment to Estonia gives us a chance to pursue this valuable cooperation Reporting for the 145th mobile public affairs detachment at a Mari airfield in Estonia. I'm US Army Staff Sergeant Christopher Bruce


Welf yn y Toffey TV'r ysgol yng Nghymru, Fahab Meshiri a'r ysgol yw'r ysgol yn Everton. Mae'r ysgol 68.6% o'r clwb a'r ysgol yw'r ysgol yw 77.2% o'r ysgol yng Nghymru. Mae'r ysgol yw 49.9% o'r ysgol. This is all part of the plan, it was in a contract, he would... RADIL of his shareholdings and will remain on the board, as will John Woods. A lot of people have raised their eyebrows about that, but I suppose they've been in situ for a while as part of the club and football, so therefor, byfarae Hadmashiri, he's got all her console, just there probably is ear and some knowledge for him to continue with it's progression in yng Nghymru, mae'n gwneud y cwestiynau o Alasio Uzmunoff a'n gwneud. Alasio Uzmunoff wedi'i gweithio i'r busnes ym Meshiri. Mae'n gweithio i'r busnes o'r ysgol, ac mae'n gweithio'n gweithio'n gweithio'n gweithio'n gweithio'n gweithio'n gweithio'n gweithio.


One of the best things about OneSearch is that you can now use your MyMind username and password to log into Library Resources. While you can search OneSearch without signing in, you may not get all possible results and you may not be able to access online resources. Signing in will ensure full access to all online library resources, both on and off campus. It will also provide you access to your account, which we will go over in detail in our next video, and further services, such as document delivery. To sign in, simply go to the top right hand corner where it says Sign In. Clicking on this will take you to your MyMind login page after choosing Month students, faculty, and staff. Once logged in, you can start searching for resources. If you have any issues, be sure to ask us for help.


Yeah, thanks. So yeah, I'm thrilled to be here. We have four speakers from the Tilburg Meta Science Group. Each one of us is going to focus on a different aspect of the research process and also provide some ways that we can maybe improve them. So jump right to it. First up, we have Hilda, who will discuss peer review. So go ahead and take it away when you're ready. Yes, thank you, Rick. Let me see. Share the screen. I think this should be working, so hopefully you can all see me now. So welcome everyone. I will be talking about the evaluation of scientific manuscripts and more specifically about peer review, as well as thesis grading. So as you all probably know in the published literature, there we are, in the published literature and especially in psychology and psychiatry, the research fields I work in, there is an overabundance of statistically significant results in the published literature. So over 90% of studies support tested hypothesis. Maybe we're just really great at doing research and we have very plausible hypothesis. But this doesn't seem to be the case since we have extremely small sample sizes with a median sample size of 62. And this is not sufficient for the small to medium effect sizes that we generally investigate. So that results in low power, which is estimated to be 0.5 or even 0.35 for psychology. Furthermore, we know that there's a lot of publication bias, there are questionable research practices going on, and people have a lot of reporting errors in their studies. And all of this has resulted, as you're probably aware in a so-called replication crisis, where prominent studies published within all kinds of research fields have turned out to be very difficult to replicate. And that makes us wonder how do these apparently not replicable studies end up in the literature, and what kind of quality control do we have? So for the published literature, we have peer review as quality control. So peer review should act as a gatekeeper to make sure that published literature is of high quality. And we already know that peer review is the best option we have, but it isn't very perfect. We know that peer reviewers often disagree. You might have experienced this yourself as well when you get feedback, and things are going wrong there as well. So what do they actually pay attention to? What are their quality criteria? What do they think is important when they look at a manuscript? And peer reviewers have a second job often as academic staff, where they also teach their students. And it also makes me wonder whether these academics, the people who educate the new generation of researchers, what do they teach their students? Do they preach what they shouldn't practice? Do they preach what they actually should practice? And what is it that students implicitly learn or explicitly learn in our thought? So for the published literature, we had peer review and in education, we have grading as a system to check the quality of the students' work. And specifically, we will be looking at the grading of the master's thesis, which is the final project usually that a student has before they graduate. So what do we pay attention to when the teachers, when they grade these thesis, and what do students believe is of importance to their supervisor? So our main research question for this research project was, which characteristics of a manuscript being it either an article or a thesis? Do students and researchers believe to be of importance when assessing the quality of this scientific manuscript? So which aspects influence assessed quality? Is there a difference when they're assessing the quality of a submitted article versus when they're assessing the quality of a thesis? And do students and researchers differ in their quality assessment of these thesis? So we set up a study, which was a vignette and survey study. We pre-registered this study on OSF. And our participants were both students and researchers. So for the participants, among the researchers, we emailed a lot of authors and editors who had published within psychology in the past few years. And we had three rounds of sampling. And then we ended up with 687 usable and complete responses after two months. For the students, this turned out to be a bit more difficult. We use social media as well as our own network. However, this didn't went very smooth. Facebook kept deleting our messages and stuff like that. And after 11 months of data collection, we decided to close it and we had only 113 usable and complete responses. So therefore, we decided that all hypotheses and analysis that include the data from the students should be considered exploratory because we did not reach the power that we intended. So first we had the vignette study part. There we had 32 conditions. So participants were either a student or a researcher. And they were all asked to read an abstract of a scientific manuscript. And for students, they were told that this was the abstract of a thesis. For researchers, there were two conditions. It was either a thesis or a submitted article. And within the abstract, we manipulated three factors. So the abstract itself was on best anxiety. And we manipulated the sample size, which was either small or large. There was either a reporting error present or not. And the results of the main hypothesis were either statistically significant or not. We asked all participants to read the abstract carefully and then to rate the quality of the manuscript on a seven point scale and to name three aspects that were relevant for their quality assessment. So for the vignette study, we hypothesized that sample size would matter. So large sample sizes would yield higher quality ratings. The statistical significance would matter. And that the reporting errors would not matter. When we looked at the results, we saw that there was only a small but statistically significant predictor effect of the sample size being small or large, but we found no effect of significant or non-significant results or being an error or no error present. So for the first two sub-hypothesis, we saw that sample size matters. Statistical significance didn't. But we have hypothesis that would be no effect of the reporting error. So we cannot answer this with frequent statistics. So we used Bayesian posterior model probabilities. And there we saw a lot of evidence for the null effect. So we can conclude that the reporting error did indeed not matter. We also looked at the open question where we asked them to name three relevant aspects for their quality rating. And there we saw that they mentioned sample size of power 160 times. So in 23% of the responses, the non-significance or significance of the results were only mentioned three times. And the error in the p-value was never mentioned. So it seems that nobody noticed that there was an error. Or at least they didn't think it was important for their quality rating. For second hypothesis, we hypothesized that there would be an interaction effect on the article and thesis with the three aspects that we manipulated. And there we saw no interaction effects. So thesis is generally rated as higher quality than when they think it's an abstract of an article, but there are no interaction effects with the three factors we manipulated. And for the student versus article, this was the same. So students rate the abstract as higher quality than the researchers. But there were no interaction effects there. Then after the vignette study, all participants received a survey study. And there they were asked to rate 29 different items on the importance when they assess the quality of a manuscript. And these items were all related to either the theory, the design of the research conduct or analysis and presentation of the results. There were six conditions here. So participants were still either a student or an academic. For the academics, they received either a thesis or an article condition. And they were asked to either to assess the quality of the when they would what was important to them when they were assessing the quality of a manuscript, or what was important to them when they were grading a thesis or when they assess the publishability of a manuscript to see whether there were differences between assessing the quality or assessing whether it's fit for publication. And here we have the results of our 29 items for all the different conditions. And what you see in general is that when that all conditions or all groups were kind of similar. So they either think an item is important or not that important. But they all kind of agree and they show the same patterns for all the different items. So for the sample size, which we manipulated in the in the vignette part, we saw that they were only of moderate importance. So these are either having a large sample size or achieving high statistical power. For the error free reporting, sorry for my bad for the sample size. Yeah, for the statistical significance, we saw that they told they thought that that was not very important to them. This is either observing large effect sizes, observing the main effect in the hypothesis direction, or reaching statistical significance of the results of the main hypothesis. Students think that this is slightly more important compared to researchers, or that it will be more important to their supervisor than their supervisor actually thinks what a peer reviewer actually thinks. For the error free reporting, we see that their rate is quite important. And they actually state that it is that's reporting the statistical results without errors is of importance to them when they assess the quality. Then we also looked at responsible research practices, which we did not pre register, but we were interested in this anyway. And we thought what is of importance to them there. And doing a power analysis was only moderately important. Pre registering part of the study was also only moderate important as well as sharing data, materials or analysis code. And please note that for both pre registration as well as sharing apparently the students, which are the diamond shaped figures, are think that this is more important than their supervisors do or the peer reviewers do. So our new generation apparently thinks that this is more important than the old older generation. And furthermore, we also asked them for the distinguishing confirmatory from exploratory analysis, and that they thought was of higher importance, especially the researchers. So to conclude, surprising to us was that reviewers did not seem to be a great source of publication bias, yet no impact on the quality rating of the abstract. And it was also rated as one of the least important characteristics. Sample size did seem to be of importance. So this had a significant impact on the quality rating of the abstract, but it was only rated as moderately important in the survey part. And statistical reporting errors are of importance. They rated as very important, but they're really hard to spot. And we also noticed from earlier research that peer reviewers have a hard time spotting errors. And it had no impact on the quality rating. And nobody mentioned the error in the open ended question. And finally, responsible research practice indicates I'm not rated as super important. That was it. Thank you for your attention. Great. Thanks so much. So I see we have one question already. So which field of study were the participants from? Yes. So they were all from, they all published within a topic of psychology. And we asked them what fields they were in. So I can actually, I have a slide on that here as well. Let me go quickly there. Yeah, just a sec, almost there. So the participants were from all kinds of continents, both the students as well as the researchers. The study phase of the students was mainly bachelor and master students for the academics. This was all kinds of career phases. And these are the research fields that they were from. So it's quite diverse. Social psychology and applied psychology are the largest ones. And the other category are, of course, is a bunch of all kinds of descriptions that people had, but they all published within psychology. Yeah. OK, great. So mostly psychology. I'm not sure if there are any other questions. If not, I would ask Juan. So I find this, there's no difference between significant versus non-significant vignettes and how they're evaluated. I wonder if you could just opine on how we square that with the excess of significant results we see in the literature. Yeah, I think that is very interesting. So it surprised us. We expected that peer reviewers would maybe not explicitly state that they, in the survey part, that it was important to them. But we definitely expected that it would have an effect in the vignette study. So it could be that the peer reviewers are actually not a big part of this. Maybe it's really about the actual authors not sending it in. I don't know. But it is interesting, definitely, to see this. Yeah. Great. And then we'll do one quick last question. Gabriel asks, why do you think that statistical mistakes are hard to detect? Yeah, they're really hard to spot just with the eye. So you do have special softwares such as SpotCheck, which is used more often now and also already at the journal levels, which I think is great because we do find it important. So this stretches the importance of this kind of software. If we do not want errors in there, we should facilitate the reviewers to spot this. Because it's really difficult to really see this with the eye. And software could definitely help with that. This was also in our vignette, it was a small error. So it was statistically significant and it remains statistically significant even without the error. Because we did not want to influence it being either statistically significant or not. Because that would also impact other aspects of the peer review as well. Yeah. Okay, great. Thanks. Well, we had a time there. So let's go ahead and move on to the next talk. So next up we have Marjan, who will be discussing whether sample sizes have increased in response to the replication crisis. Go ahead and take it away. Yes, thank you. So as said, I want to talk about, let's see, yes. I want to talk about sample sizes in psychology. Hilda also talks about something about sample sizes and how they are evaluated by researchers when they have to peer review or evaluate the thesis. But she also stated that in psychology, yeah, power, statistical power is typically quite low because the sample sizes are low. And of course, the, yeah, the most, the easiest way to increase this statistical power is to increase the sample sizes. And we have quite some studies that investigate statistical power already starting by Cohen in 1965, if I'm correct. But sample sizes directly are not that often investigated. But there is at least one study who did this and this was published in 2011. This is a study by Marsalek, Barber, Colhart and Holmes. And they looked at studies published in 1955, 1977, 1995 and 2006. And these first two years were already used by Holmes in some older publications. And Marsalek had all added the letter two years because they wanted to know whether the sample sizes increased as a response to the Wilkinson and task, the task force on statistical inference from 1999. But as you can see, I showed here the median sample size of the four journals that they include. So they had four psychological journals from different fields in psychology. You can see that it not really increase, maybe even a decrease, but not really evidence of an increase over in sample size over time. But of course, a lot of things happened after 2011. We had the replication crisis and followed by different initiatives to improve psychological science. So we had preregistrations, registered reports, awarding open science batches, increased focus on direct replications and null visuals, and also an increased attention to the problems of small sample sizes. So we were wondering whether we could update this Marsalek at all study to see that our sample sizes in psychology have increased after the publication crisis. So we wanted to add a new year to this data and add 2019 because of course then we had all the researchers would have had some time to incorporate these new changes and see whether that has an effect on the sample sizes. So these were our research questions. So our question was mainly half sample sizes increased over time. And we also wanted to know whether this was a response to the replication crisis. So to see whether the sample sizes from before and after whether they differed. But we also wanted to know whether the journal level policies might have an influence on the sample sizes. So we wanted to compare journals who really focus on open science practices, also with journals that doesn't focus on open science practices and also whether differences on the paper level might have an effect. So better studies that practice more open science. So have for example open science batches, whether they have higher sample sizes than studies who don't do that. So to do that we used the original data from Marsalic et al. So we had full data from the years 1995 and 2006. So the older data wasn't available anymore. And these was data, the sample sizes from four journals. So it was abnormal psychology of the journal of abnormal psychology, journal of applied psychology, journal of experimental psychology and developmental psychology. We added a 2009 volumes of the same journals. And we added two journals that focus also more on open science practices and award for example batches, so psychological science and journal of experimental social psychology. And we also hope that that would cover a broader range of topics in psychology. And of all those articles that are published in these volumes, we collected the sample sizes. And here you can see how many sample sizes we collected. And that was a total of more than 3000 sample sizes. But I also have to give a warning because these are preliminary results. So we did a pre-registration and one of the things is that we also need to check a part of the collected sample sizes. So do an additional check to that. And I didn't have time to do that before this talk, but I still wanted to present some of the results already. But yeah, just a warning that it's preliminary. But you can see that we have a lot of sample sizes, but there is also some differences in the number of sample sizes in the different journals. With quite a lot of sample sizes in journal of experimental psychology for example. And relatively less sample sizes from journal of abnormal psychology and journal of applied psychology. And here we can see the box plots for the different journals in the different years. So the colors are the different journals. And yeah, for every journal we have three box plots. And the first one is 1995, the second one 2006, and the last one 2019. Of course, there are also some very high sample sizes sometimes, especially from people that use survey data from a big public surface. So I only show until thousands of participants because otherwise it didn't really fit in the figure. And if we look a little bit to the median over time, then yeah, there might be indeed some kind of an increase over time for the different journals. And here you can see that as well. If you look at the different, the medians for the sample sizes for the different journals. There's also seen also to be a difference between the journals. For example, journal of experimental psychology has a relatively low median sample size, but journal of experimental psychology also contains a lot of studies within subject design. And we see the highest numbers for journal of applied psychology. So in here we can also see it in the table. So for the different journals and also for the total median sample size. And then we see that in 1995 the median sample size was 40. In 2006 it was 57. And 2019 it is 120. So there seems to be an increase. And we also tested that with a multi-level model with a negative binomial to incorporate the distribution of the data. I mean indeed found a significant effect of sample sizes over time. Or second and third question were more about whether it was a reaction on the replication crisis. So we compared 2019 papers with the ones before. And also whether there was this difference between journals. So we compared the two new journals that focus more on open science with the older journals, the original journals. And we didn't find an interaction effect. So we don't see a stronger increase in journals that practice open science practices. So you don't find any confirmation of third hypothesis. However the main effect of replication crisis was significant. So we see indeed this difference between sample sizes of studies before the open science, before the replication crisis, and after the replication crisis. And then we also wanted to look at the difference between papers with and without open science patches. And therefore we can only look at papers from 2019 and only from journal of experimental social psychology and psychological science. People say awardee patches. And if we combine those two journals then we see that the median sample size of the papers that have no batch is 160. And for the ones with a batch it's 190.  However if we test that with a Wilcoxon rank some test then it's not significant. So it's not a significant difference. We also checked it for the two papers, two journals, separately. And then we did not find a significant effect for journal of experimental social psychology. But we did find an effect for psychological science. So to conclude we see some increase in sample size over time. Which might be a reaction to the replication crisis and the reforms that followed onto this. And this increase seems to be general and not dependent on open science practices on the journal level. And we see some mixed results about the difference in sample size between papers with and without open science patches. But of course there could be other reasons also involved. So it might be that papers that have larger sample sizes also investigate topics that are for which it's easier to get these larger sample sizes but also to get these patches. So there might of course other explanations to be involved. So these were my conclusions. So I just want to say thanks to you and also to Jake who helped with setting up the study and giving more information about our original data collection. And also Yvonne who helped me with collecting all the sample sizes from the papers. Great thanks again. Okay so we have a few questions coming in. One we have you mentioned the problem that within subjects designs generally have smaller sample size. Could the sample size per study condition be a fair metric to compare studies regardless of their experimental design? Yeah that's a good thing. So one of the things that we I look now and I only presented the results for the total sample sizes but if they compare different conditions then we also collected individual data sizes. So that means the individual group sizes. And so we are also going to look into that as well. Because of course as you said it is important to take also the research designs into account especially if you want to say something about the power of a study. But yeah that's still something that we need to do. Great there are a few more questions. I think what we're going to do is just move on for now and then we can revisit these at the end of the session just to make sure we can get through in time. So unfortunately a third speaker can't be here today but we got the next best thing he sent along a video. So next we'll hear from Robbie about a project assessing errors in COVID preprints. So we can go ahead and play that video. Okay here we go. So do shout if this isn't working for any reason. Welcome everyone. Unfortunately I couldn't present in person due to other obligations and that's why I pre-recorded this presentation. And this presentation will be about a registered report that we are actually currently working on about statistical inconsistencies in COVID-19 preprints. So we're working on this project which means that we are currently collecting data. So I cannot share you any results but I can tell you something about the setup of the study and what we are actually planning to do. So this is work together mainly together with Michel Nuitet but also with other members of our research group at Tilburg University. And the study is about the quality of COVID-19 research because what we know is that there is currently some sort of information explosion with respect to COVID-19 research. A lot of research on COVID-19 gets published now. And what we also know is that there are these special fast-track review procedures in order to be able to publish studies on COVID-19 very quickly. And we also know that these studies are more often shared prior to publication for instance in terms of a preprint. And then the question that we are interested in is does actually this high-speed science does it negatively influence the quality of research? Because what we know is that based on the seminal work from John Ioannidis in 2005 we know that if there are financial or other interests that this will lower the likelihood of a finding being true. So in case of COVID-19 research there are definitely financial and also other interests which may play a role. And another factor is the extent to which research field is halted. And in this COVID-19 research there are many different teams involved who are doing research on COVID-19 research. So this is also an important factor. It's actually also playing a role here. And what we also know is that based on some studies that have already been conducted to study the methodological quality of COVID-19 research that the methodological quality could only be evaluated as high in 41 percent of the COVID-19 studies. So this was determined based on applying the standard quality checklists to these studies. And if you compare this 41 percent to the control group then what you see is that 73 percent of the studies in the control group were of high methodological quality. So this already indicates also together with some other research that I do not have time to discuss right now that the quality of the study seems to be lower in COVID-19 research compared to non-COVID-19 research. So this motivated us to look at another indicator of the quality of research and that's the statistical reporting because incorrect reporting of a statistical result might lower the confidence in a study. So if you see a study with a statistical inconsistency in it then you might put less trust in the study in general. Examples of statistical inconsistencies are for instance a percentage that doesn't match up the event and the total sample size. So for instance if there is stated that seven out of 100 participants were infected by the coronavirus then and there's also reported that this is 5 percent and this is of course a statistical inconsistency and another type of inconsistency is for instance if an odds ratio is reported but if also a two by two frequency table is reported and these two are not in line with each other then this is also a statistical inconsistency if this recomputed odds ratio based on the two by two table is not in line with the reported odds ratio and the hypothesis that we want to test is whether the prevalence of statistical reporting inconsistencies differs between COVID-19 and matched non-COVID-19 preprints and the good thing is that we have a population of studies because we are going to look at preprints and at preprints that are published between January 2020 and the end of January 2021. On the preprint service med archive and bio archive and the reason that we focus on these preprints is that first of all they play a central role in disseminating research on COVID-19 and they can also be easily located since they are published on these preprint so we really have a population and this is important because we can use this population to draw a random sample from and we draw a stratified random sample of this population of preprints using straight out the number of authors because you can imagine that if there are multiple authors involved then people might check the statistical results whether these are reported in a consistent way in a correct way whereas if it's a single author paper then of course there is no one no co-author who can check these statistics. We will also using the sampling procedure the subject category so the subject category of each preprint that is preprint servers are assigned by the preprint servers and we will also take into account the date a preprint was actually published and if you have a stratified random sample from the COVID-19 preprints then we will select randomly a matching non-COVID-19 preprint which you serve as a control group and by doing this we actually conduct a natural experiment where we have an experimental group and a control group both based on existing groups. We will look at the number of statistics that we will extract from these preprints using a protocol so we will look at the percentage versus the number of events cases we will look at the test properties so look at the accuracy sensitivity specificity for instance of a test we will check whether the total sample size is in line with the subgroup sample sizes so if subgroup sample sizes are reported we will check whether these sample sizes sum up to the total sample size we will also check whether the marginal values in a frequency table match with the values in the cells we will compare prevalues with test statistics and degrees of freedom to see whether these two are in line and finally we will always we will also compute effect sizes based on dichotomous data if a frequency table is available so based on a frequency table we for instance compute this odds ratio and then we compare this with the reported effect size so we are very thankful that we got some funding for this project by Tilburg University and we could use this funding to hire two research assistants and the idea is that they in total extract data from 2,400 preprints or 1,200 preprints on COVID-19 research and 1,200 preprints not on COVID-19 research and they are currently already collecting these these data and they are about halfway so we need a bit more time for the for the data collection and prior to studying the data collection we also did a power analysis a power analysis in a way where we try to figure out what the effect size would be that we could detect with 80 percent power because the funding is limited so we know we can include approximately 2,400 preprints in our sample and then we can detect an odds ratio of 1.38 with 80 percent power so if the data are collected now what we will do in the next step is we have written automatic scripts to check for statistical inconsistencies and we will apply these scripts to all the data and if there are inconsistencies detected then we will double check these inconsistencies by hand we'll go to these preprints and then check whether these inconsistencies are indeed inconsistencies in the next step we will fit a logistic multi-level model with a dependent variable whether a statistical result is consistent or not and with an independent variable whether a preprint is about COVID-19 or not and then we will run a frequentist hypothesis test to test our hypothesis in an alpha level of 0.05 and we will also compute a base factor a base factor that is comparable to the the frequentist hypothesis test and we will repeat this analysis also with including some control variables so we will include the number of authors and the extracted statistics of a preprint and also the date when a preprint was published we conducted the study oh we are set up the study as a registered report and there's also the reason why it took a bit longer to start with the data collection because we first had to pass this first stage of the registered report the stage where the introduction and method section method section are reviewed so this was this was done and we got reviews from six different reviewers and in the anti-proposal was accepted as a stage one registered report at the Royal Society for Open Science and now we hope since we already have all the materials that stage two can quite easily be finished after all the data are collected because we have already all the scripts so we only basically need to run these scripts and write the results so we hope that this can be that this will be a quite straightforward process and we also worked on a side project that side project that is really related and that is that we also want to enrich the pre-prints and we want to enrich the pre-prints by posting short reports about the consistency or inconsistency of statistical results in a pre-print so such a report can for instance be added to the pre-print via the pre-print server because we can post the report over there as a comment and such a report will add value to the pre-prints because it notifies the authors and also the readers whether there are any statistical inconsistencies in a pre-print and I think what is very good about this is that if inconsistencies are observed in a pre-print that they can hopefully still be fixed before a pre-print turns into a publication and these reports were actually developed together with a research master's student of our university Hong-Wai South she spent a lot of time in developing and improving these reports but thank you for your attention so unfortunately I cannot answer questions now in person but if you have any questions any remarks feel free to send me an email via this email address over here yep so that's it and I pasted Robbie's email into the chat so yeah if you have questions you can either put them in the Q&A and I'll get them to him or you can just email him and then for the final talk this is kind of like that search for a Jeopardy host I have in fact selected myself and so I'll be talking about some privacy risks associated with open data go ahead and share my screen here okay so hopefully that's all set up okay and then first before we talk these days because I'm still working from home at the moment I do need to apologize for my co-worker he has gotten very spoiled and does not like to be shut out of the office so you may end up hearing some grumbles in the background hopefully that will all be fine so we'll be talking about data privacy in openly available data sets and I think this is an important topic at the moment because we are seeing a rapid uptick in the sharing of open data other sessions I suspect will address this more closely but multiple metrics are pointing this way from OSF usage to signatories to the top guidelines and this is of course a great development this is undoubtedly a good development for science the pros greatly outweigh the cons and I say that even after doing this project but I do think it presents some new avenues for risk that need to be managed and so for example a dramatic demonstration that it's surprisingly easy to identify individuals using metadata one study found that the vast majority of American voters could be identified with only three pieces of metadata zip code gender and date of birth so if you're not mindful of this stuff you can end up sharing data that's actually far more identifying than you intended and so we ended up doing this project the sampling frame is a little disjointed because we're merging separate projects and really we started this because we actually wanted to use these open data sets ourselves and we are concerned that if we sampled a whole bunch we'd end up resharing personally identifying information and so we didn't want to be responsible ourselves for privacy violations so we end up with a sample of three journals and a few different years for each and then we took all of the almost all of the articles with open data from that sampling frame we had two coders go through each data set and assess them for re-identification risk and the sensitivity of the data so that is whether you could identify an individual and then also whether the data touched on sensitive topics that someone would feasibly not want to be shared and then when we did detect problems we informed authors in many cases these have already been corrected and this was actually a quite a bright point of this project was that authors were usually you know not happy to hear that they had shared potentially identifying information but were very fast to correct it and very thankful that we had alerted them so how do we go about assessing re-identification risk we looked to the HIPAA safe harbor guidelines as a starting point here and we tried to classify each data set into three different categories so HIPAA has some specific variables that need to be removed in order for a data set to be considered anonymous for that we're looking at concrete things like name, email, IP address initials, birthdate and zip code there's a larger list but for us these are the most relevant and we categorize those as high risk we categorize an additional set as some risk this was data sets with rich data with rich demographics which you could feasibly combine these and identify at least some of the individuals in those data especially if there were outliers for instance maybe an outlier on age within a certain university major or something like that and we also coded for sensitive data for this we looked to the GDPR guidelines because they also lay out some great specific topics here so here we're looking at things like racial or ethnic origin I'll have more to say about this in a minute political, religious, philosophical opinions health related data and we include mental health there since these are a lot of psychological data sets here and data about sex life or sexual orientation and again we code these into three different categories so if GDPR said it's sensitive we categorize it as sensitive if it didn't contain a GDPR violation but we thought that a common person might still consider this sensitive we categorize it as possibly sensitive and if there was just no nothing sensitive at all of course that's its own category so each of these gray squares represents a data set and we're going to jump right into the results for data sensitivity what we see is that overall about a quarter of the data sets contained at least potentially sensitive data most of this was definitely sensitive according to the GDPR this is not that surprising I mean a lot of us research sensitive topics and it's not necessarily problematic as long as these are appropriately anonymized before they're shared breaking down the reasons the very first one is race or ethnic origin now this is frequently collected and shared I think you know in the U.S. and other areas so I'll just go ahead and say I understand there's probably going to be some disagreement on that if we just ignore race then it drops from 25 percent sensitive to 18 percent sensitive then after that in order we have political views health items oftentimes we'd see things like measures of depression anxiety then religious beliefs and sexual preferences or behaviors to a lesser extent and again this is not necessarily problematic until we look at re-identification risk so here ideally all of these squares will remain gray but let's see unfortunately we see that about five percent pose a definite risk and an additional roughly five percent pose a potential risk that you could re-identify individual participants in these open data sets with the publicly available information here getting into these reasons so this light red the light red bars here this is all categorized as potential risk and those are all cases where we deemed that the demographics were so rich that it was likely or possible that you could identify individuals based on triangulating these variables then in terms of concrete HIPAA identifiers IP addresses were quite common they were the number one violation in terms of HIPAA then we also saw date of birth fairly frequently and then kind of just the flat out identifying information names initials full names we did also see some of that I'll note that for some of these like IP address date of birth we can kind of debate on exactly how identifying that is on its own I'll note that in almost all of the cases that we observed these were also accompanied by rich demographics that would allow you to further triangulate down to an individual now you may be thinking well Rick you haven't demonstrated that there's a problem here because maybe if someone has a sensitive data set they're particularly careful to de-identify it and unfortunately we see that that's not the case so if we narrow down to the 208 data sets that we observed with at least some risk of re-identification we found that about half of those also contain sensitive data and so it's actually the opposite these data sets that have identifying information are also much more likely than those that did not to have in addition sensitive data and so this was about five percent of data sets overall and I think these are the ones that are truly quite problematic so then the big question should you care I'm not going to tell you how to live your life I'll tell you that the exact numbers here are debatable they are subject to your definition there's not always agreement there was not always agreement between our coders and if you're a cyber criminal in the audience are you kind of licking your chops and just waiting to get in there and start exploiting these data probably not I mean there's probably softer targets to consider on the other hand if I was a participant I would be pretty upset if I was giving you honest answers on a depression inventory and then that was shared alongside my IP address so I think there's there's some room for debate here and I would moreover say that we didn't identify any cases where the really identifying information like IPs like names were actually used in the analysis in other cases for instance data birth was sometimes used in the analysis to derive an age which can be rendered much less of a problem if you just convert it to age and then share age instead of the exact date of birth so I would say we're not sacrificing any scientific utility by addressing this and either making sure that we're removing some of these variables or transforming them into less identifying versions this does get tricky sometimes so I've put some resources here that you might refer to if you are in one of these trickier situations but the vast majority that we saw simple changes to the data sets would have resulted in no loss in scientific utility and a great gain in terms of being unable to identify them then on to solutions so I think the good news is that actually most of the cases we did catch were fairly easy you know if someone was just aware when they were submitting did an extra check of their data they would have spotted IP address and they would have said we don't need that we shouldn't share that and I think that's borne out by when we contacted people with these concerns very often they just said oh you know whoops I'll correct that so I think a little education and awareness can go a long way this could be simply in the form of you know a check mark on a submission portal kind of a higher reach goal would be maybe if you have editorial staff on staff that could both check for these sorts of issues and also you know while they're checking maybe data documentation maybe code reproducibility I realize that's kind of a larger investment a simple tip just in your kind of personal research lives is that you might want to consider whether you're collecting unnecessary data that might be identifying one of the major violators we saw I think the majority of IP addresses that we saw were from Qualtrics data collections which by default will collect IP address and insert it into your data set whether you want it or not now you can turn that off and maybe if you're not going to use those data at all just don't collect them in the first place and then the one that I'm I think most excited about is that a lot of these violations follow semi-standard syntax that could be detected through regular expressions and the like and so we actually submitted a grant about this we're waiting to hear back and we might be developing an open source tool that would be able to automatically flag these say you know before a researcher uploads their data just hey we we caught a few columns here do you actually want to upload this this column that appears to be IP addresses and stuff like that but of course this wouldn't catch everything and especially some of these cases with triangulating demographics where it's really a kind of a judgment call that would be more difficult to detect so the takeaways for me I think open data is absolutely worth it this shouldn't lessen our enthusiasm about open data but it's worth doing responsibly and I think there are some simple and low-cost interventions that at this point if we implement them could really mitigate the risk moving forward as we see increasingly more data going on so thanks and at this point I'll take questions on both my slide and I think we can open it up to all of the presenters if anyone has some new questions there just get situated here okay so yeah maybe no questions as of yet so here's one going back to okay could you share the name of the standard that you used to code the data you mentioned the early slide when I missed it HIPAA oh yeah so this is HIPAA which is a I'll paste it in chat specifically the HIPAA safe harbor guidelines which is a it's a standard or it's a it's a regulation in the United States that we used and then I think there's a question for Marianne also oh no we already answered this one okay and I answered some of them in the bytes a bit text okay great and yeah we just have a few minutes we can see if any questions come to light here and if not maybe we can just give the west coasters a little time for a power not maybe before the next session and call it there so thanks everyone for presenting again if anyone has questions for Robbie feel free to send those directly to him via email and yeah thanks for thanks for listening


Human language is a system of extraordinary complexity. Nonetheless, young children managed to acquire a first language in a matter of a few years, without a parent effort and without the need of formal instruction. As a starting point, this e-lecture concentrates on the following topics. First, we will look at the relationship between language, language acquisition and cognition. Then we will briefly introduce the main stages of language acquisition and will finally list some fundamental aspects from phonology to semantics, that is, from sound to meaning. First language development has generated much interest in linguistics, psychology and various other disciplines, particularly because it provides concrete answers to various fundamental research questions related to language and cognition. For example, one question concerns the aspect of modularity. Do children acquire language by means of a specialized cognitive device? That is part of their genetic endowment? Or does language emerge from our general cognitive abilities, learned through trial and error skills such as doing addition or riding a bike? We will see. Human uniqueness is another issue. Do only humans possess language or do other species also have the capacity to acquire language? Various attempts to teach chimpanzees and gorillas aspects of human language have not yet produced convincing evidence against the position that language is a uniquely human ability. A further question concerns the relationship between language and thought. Is language simply a tool for expressing our thoughts? Or does the form of language determine the structure of our thought processes? That is, does acquiring a language mean learning to think, not just learning to talk? Well, we will discuss these things in further e-lectures. And finally, the question concerning the relationship between learning and innate-ness. All children have some innate capacity for language, but it depends on where a child is brought up, whether he or she will acquire English or Japanese, for example. So both heredity and environment play a role in language development. But how do the two interact? Well, that's a very important research question in linguistics and psycholinguistics. Let us now look at the central stages of language acquisition. Language acquisition begins very early in the human lifespan. The ascent to adult level competence is a complex process that involves several, more or less distinct stages leading from pre-speech sounds at the very beginning to full sentences at the end or at some sort of end of the acquisition process. It is controversial whether or not discrete phases are involved in the course of language development. The diagram shown here displays the stages that are commonly identified in the relevant literature. Several things are worth noting about these stages. The first question concerns the boundaries between these stages. It is relatively clear that these stages have no clear boundaries. This is indicated by these fading edges. The second question concerns the sequential character of these phases, of these stages of language acquisition. And it is relatively clear that they do not occur in a strict sequence but overlap to some extent. So here we have an overlap, here we have an overlap and here too. While normal children pass through all of these stages, individual stages can be stretched out or can be compressed to a different extent for different children. So in other words, these stages are different in length as far as individual children are concerned here. However, the diagram generalizes over such individual differences. Let us now look at the stages in greater detail. At a very early age, we can identify three stages.  We can find comfort sounds such as cooing and laughing. And we find a stage which is normally labeled by the term vocal play where children produce speech-like sounds where interestingly vowels emerge before consonants. After this period of early vocalization, so this is the period of early vocalization, all young children go through a phase of babbling which lasts for something like six to nine months fading out as the first words appear. By producing these speech-like sounds, infants practice articulatory movements and learn to produce the prosody of their language. There are two types of babbling. Now the first type can be called, so here we have the babbling phase, reduplicated babbling where we find syllables or syllable sequences such as ba-ba-ba that is the repetition of vowel consonant patterns. And we find the system of non-reduplicated babbling, sorry, non-reduplicated babbling where children produce things like ba-da and maybe even gi. First signs of comprehension accompany this stage, so children now learn or acquire the association between situations and strings of sound. And then we can observe a phase which is called one-word utterance phase where children first use names for objects, then they name actions or motions later. They use to pick out thematic roles played by objects such as agent, action and object. And then we find a phase where we can observe an enormous vocabulary burst that is an acceleration in the rate of vocabulary growth. At the same time, these new elements, you might call them words, are combined into more complex constructions and the child gradually uses sentence-like structures. First of all, in terms of two-word utterances where two words are combined expressing various semantic relationships such as agent or action in cases like daddy run. And then again a burst, a morphosyntactic burst where we can discover an enormous increase of inflectional and functional elements. Once children have acquired the ability to produce two and even three-word utterances they start to add function words and grammatical inflections to their utterances. The age of 24 to 30 months has been identified as a period where most children show a kind of flowering of morphosyntax. Towards the age of three we find a stage of telegraphic speech where three or more word combinations with few functional or inflectional elements like milk all gone occur and then even full sentences with increasing utterance length and utterance complexity. Along the way, the child masters the essential ingredients of his language. These central aspects will be discussed in a follow-up e-lecture on language acquisition but let's have a brief look at these central issues first. During the first year of life children achieve control of the speech apparatus and they develop a sensitivity to the phonetic distinctions used in the target language. We will discuss this in a second e-lecture how this is managed. Then we have a level of morphological development that is the acquisition of the relevant morphs plus the rules governing their use in the target language. The children indeed possess morphological rules at a relatively early age has been shown in several classic studies which we will also discuss. And then the big area of syntactic development that is development of sentences starting with one word utterances that do not show any structural properties they are used to name objects in the environment. Later then at the one word stage children also use single words to articulate complex thoughts involving those objects and then more and more complex utterances how they exactly proceed well we will see.  Acquiring a lexicon is a formidable task. It has been estimated that in order to build up an other size lexicon of about 70,000 entries children have to acquire new words at a rate of something like 10 entries per day. How they do manage and how they acquire the meaning of all these items well that's an issue for a follow-up e-lecture. Well as pointed out in this e-lecture there are so many interesting aspects to be said about language acquisition so see you again in Language Acquisition 2.


This retrospective analytical study evaluated forensic toxicology analysis results from 2011 to 2016 in Tehran Province, Iran, finding that a total of 1388 polydrug use associated deaths were investigated during the six-year study period. The victims were mostly young men of 20 to 40 years of age and methadone and amphetamine type stimulants were in the highest category for polydrug use associated deaths. Additionally, opium, tremidol, and tricyclic antidepressants were also commonly used with other drugs in some cases. The study highlights the major role of substance abuse and death. This article was authored by Maryam Akgari, Fariba Sardari Ravani and Masood Gadapasha.