السلام عليكم هل أنت لا تنسوا هذا؟ أنا أخذت the 4 ورطة فهي لم أمتلك جيد وإذا حييتم بتحية هل أعلم؟ أين مريم؟ وإذا حييتم بتحية فحي بأحسني منها أو ردوها عندما أنت أنت، وهذا هو الوضع of your Creator, in mind. It's not mine. It's not someone's opinion. عندما أنت أنت مجرد، وإذا حييتم، عندما أنت مجرد with a greeting. السلام عليكم is a greeting. And what a greeting? سلامه أهل الجنة. It's the greeting of the people of Jannah. And there's two orders here. One is an order, the other one is a recommendation. فحيو بيأحساني منها. It's an order. It's not my choice. Respond better. I say السلام عليكم, peace be upon you. Don't say وعليكم. وعليكم السلام ورحمة الله وبركاته. Don't forget this. أول ردوها, minimum, is to respond. So there is, I don't know, maybe we are close to 100 in this room. Maybe I heard 10 voices. Don't do that. You missed the focus. The best thing I heard today. مي الله ري وردو يأوسنه السوسة. Which we miss all as women is the focus. The focus, we are distracted, we are shattered. We go right and left. Anyone say something, we go. Stay focused. And after I listened to all the speakers, I said to myself what I'm going to say. سبحان الله. But I need to bring you to reality. I have been living in since the morning. Since 11 o'clock. We've been living in the past. And I always say, and Allah is my witness. I wish I was at that time. I wonder how these people didn't believe. Can you imagine?  سيدة خليجة، سيدة فاطمة، سيدة عائشة. What struggles they had. But we are his beloved. They are his companions. You know the hadith. We are the people who are loved to him. Provided we deserve that title. So let's come to reality. We live in 2021 almost at the end. How many of you are out of town other than me? And I know. Some of you are out of town. Majority are in California. So Sunday we are in November 28 2021. I'm not living with سيدة فاطمة. I'm not living with سيدة خليجة. I wish I am. No, I'm either a student and I'm going tomorrow to the college and Allah knows what I'm going to see without going to the details. Right. I mean I can share with you what she sees every day at Stanford. Or if you are like me and Dr. Aranya tomorrow we are going to work. We are going to reality. Or if you are going to home you are going to reality with your children and all the struggles of raising children in this day and age. Am I correct? So what do we do? Have you ever asked yourself this question? He put me here. He did. He chose and he is who? Capital H. Capital H. He chose me or he chose for me to be in 2021. He could have easily made me with the Raswa Ali صلى الله عليه وسلم and breeze. Even the difficulties I'll breeze because he's going through it عليه صلى الله عليه وسلم. But that's not his choice. And everything Allah choose this is the first thing if you're going to write anything as a woman it should be every human being but specifically women. Anything Allah choose for me is the best. There's no other answer. I like it. I don't like it. It's hard. It's difficult. It's may Allah forgive me for this word that we all say it's unfair. Why me? It's good. Then next question is going to come. What does he expect from me as a woman? That's why the title The Muslim Woman Are you? And I'm asking everybody Are you? I need an answer. I want an answer clear. Are you the Muslim? Are you a Muslim woman? Absolutely. Now the next question Are you the Muslim woman? He wants you to be? The like of Fatima of 20 May Allah be pleased with her of 2021. The like of Sayyida Khadija of 2021. The like of Sayyida Asya 2021. And like the Sayyida Maryam of 2021. Yes or no? I didn't hear an answer. You're all right. We're not. Why? Have you ever asked yourself why? What is the difference? You need to ask yourself that's how we change unless we know reality we will never change.  Why I am not and all the speakers may Allah bless them all eloquently explained to you they did not live easy life. They had all the challenges we have. What is the difference? Can anyone say any word? What is the difference? And what is Allah said in the Quran about this قالوا شغلتنا Who can finish it? Hiya Maryam أموالونا وأهلونا They say we are busy with our children and with our wealth homes كرير How much we have in the bank account She has bigger home I need to do the same She just bought this The purse competition I call it It's so sad but it's reality Purse competition Shoes competition Home competition Children competition We are busy with this They had all this but they did not allow it to move them away from Allah Refocus Exactly the word that Shaykh Hassan said I keep reminding myself every morning Number one who are you And I'm going to give you one by one Number one I and you and every creation of Allah from الجن والإنس On this earth We are here for one reason And what is that reason وما خلقت الجن والإنس إلا ليعبدون I did not think إلا ليعبدون I did not create Inse engine Allah said this In صورة الداريات But to worship me Worship me is a loose translation It's a very loose translation Because when I tell you What is the Ibadah What is worship What are you going to tell me What are you going to tell me Fast Pray Go to Hajj Alhamdulillah I work a job What's wrong with me That's not it That's superficial إلا Ibadah Act of worship It's everything This is the whole amount of scholars That defined it differently The one I'm going to share with you Is the definition of Imam Ibn Taymiyyah And it's very practical We don't have to be scholar To be a servant of Allah In fact Most of the real Ibadah Of Allah Majority were not scholars كانوا عارفين بالله They know Allah إلا Ibadah Act of worship Everything Everything Allah Loves Loves And like I'm sorry Loves And he's pleased with You're a boy of Allah He loves And he's pleased with Look at this Internally And externally So I'm not with people Something When I'm known I'm something else Internally And externally From Words And action Words And action One more time Everything Allah Loves And pleased Internally Externally Saying And actions Then you are The servant of Allah Then I am The Fatima Of 2021 And I am The Khadija Of 2021 May Allah Be pleased with them And Sayyida Asya And Sayyida Maryam If I follow this If I follow this From the moment I open my eyes To the moment I close my eyes To the last breath he's going to give me If I live with these six Then that I am Who he wants me to be Wherever he will put me As a mother Or a motherless As a child Or a childless As a professional Or taking home Or staying home As a student Or not It doesn't matter It doesn't matter This is who you are Or Who he wants you to be Are you? That's the question You have to ask yourself Every moment Since morning We are here Where you are Ibad Allah Inshallah Yes Ya Rabbi Amin But have I shown him And I've said And did And act And prayed In every way He loves And pleased And pleased with How many times Let me ask you this question When you want to do something The question inside you What people will say about you Will this person will be happy Will that person will not be True or false True or false How many times You ask this question Are you happy with me Are you happy with the way I am With the way I dress With the way I speak With the way I respond Do we ask ourselves this Do we? Honestly Do we? We want to be the Abdullah You want to be The Sayyid of Fatima Of 2021 Work on your relationship With Allah That's number one And let me take you through What He said about the Muslim woman In the Quran Do you know that? Do you know Allah described us In the Quran? Not by name But what does He wants from me Yes or no? Absolutely Unfortunately We read the Quran Ramadan is coming And some of us have memorized Some of us understand Where is the proof Where is the practice Number one You look at yourself As a woman You are two parts You are external The way I look The way you look And there is internal Only He knows Let's take the external first I'll leave the best for the last What does He want me to look like? Not the way He created me I have no choice in this How does He want me to look like? What did He tell me? قل للمؤمنات يغضضنا من أبصارهن ويحفظنا فروجهن ولا يبدين زينتهن إلا ما ظهر منها And then He goes on ولا يبدين زينتهن إلا لبعولتهن أو آبائهن God is surat al-Nur The light And He is saying First He said it to the man This is one of the times where الله سبحانه وتعالى He separated the order One for men One for women And came to the woman Say to the believing woman You and me Do what? External I'm going to tell you What He wants from me You say to yourself Check it I do it I don't And if you don't do it Say why Number one Lower your gaze How many of you Lower their gaze When they are talking To the opposite gender Muslim or non-Muslim Don't show me hands It's not about you It's in general Whether with Muslims Or non-Muslims Lower your gaze Lower your gaze That's who He wants me That's what He wants me to do That's what He's pleased with me Then I am Then I am Say the Faltima at work And I am Say the Faltima in college What do you think Say the Faltima When she was talking To Sayyidina Abu Bakr Or to Sayyidina Omar Or Sayyidina Muad She would be joking And you know How we speak these days Lower your gaze That's the first thing He said Number two Please forgive me I don't mean anybody here What do you wear What do you wear What is this focus On beauty external And no focus On beauty internal And He said it The idea that everybody Wanted to translate And explain the way they want To tell me hijab And I don't want to use The word hijab I'm going to use proper Islamic attire Is not an obligation Let them say Whatever they want to say Let's meet On the Siraat And let's answer Allah that question Don't show your beauty Period And always women When they ask me I'm sure all of you Have heard this question Can I put What about the Muslim Nail Polish You all hear this question I won't go through that I say one thing He said Don't show your beauty What does Nail Polish does Where his makeup does And then you answer Your beauty ladies And that's the hardest Thing for the woman One of the hardest Things of the woman When you are in front Of that mirror Remember you're A servant of Allah Remember this And say this to him Is this how you want me To go out Is this pleasing you Does this makes you happy If you hear the answer Yes, go out If you start Justifying it Then you are Not say the fault About this time Or say the Aisha Or say the Hadija The way we look I have no idea Why pleasing people And pleasing ourselves Is more important Than Allah It's astonishing fact to me Everybody else Is doing it That's how I hear it Young and old Everyone is doing it And I say What about Allah No answer The way you look The way you look What do you hear What do you listen to What do you listen to These days with social media And TikTok And everything else The poison around us When you turn it on Again ask yourself This question Is this pleasing to Allah Is this something He wants me to do Well Allah And I said his name Each one of us Internally knows the answer But you justify You know He's not happy With what you are hearing What you are listening to Regardless Three What do you say التنق وما أدراكم التنق What did he say ثكالتك أمك يا معاذ This famous Hadith about speech سيدنا معاذ This Sahabi This companion هو الرسول عليه الصلاة والسلام Said يا معاذ إني أحبك معاذ I love you Imagine who is that معاذ May Allah be pleased with him Imagine if الرسول عليه الصلاة والسلام Look at you Or me And says يا هيفاء إني أحبك يا الله I'll be dead right away يا ربي أمين But doesn't come from vain Do you see my point It doesn't come because I am who I am Or you are who you are I have to earn it And سيدنا معاذ And he said يا رسول الله Are we going to be taking accountable About what we say And he asked very simple Question ثكالتك أمك يا معاذ He answered May your mother mourn you Meaning You will be dead And your mother will mourn you And your mother will mourn you What else will put people Into narration On their faces Or on their noses In the hellfire But The harvest of their tongue What do we say women And I specifically say here women Because we are more In that aspect همازن مشاعن همازن لمازن مشاعن بنمين We don't like her We don't say anything But our face say a lot In مساجد I'm not saying outside In مسجد She comes in And everybody looks at her And maybe this is the first time She ever comes to a Masjid And we start judging And looking at each other And then start talking Watch your tongue ladies Watch your tongue سيدنا أبو بكر سيدنا أبو بكر حلد his tongue سيدنا أبو بكر Who I and you He held his tongue And سيدنا عمر صاحن And he said what is this He said هاد أوردنين موارد This Took me through the path Meaning the wrong path Jail it As one of these scholars said The thing that needs long jail Is my tongue You are a Muslim woman And you are the servant Of Allah Nothing comes out of this But what pleases Allah And sometimes I say this to myself I wish I can have selfie 24 7 Because there is selfie by the way رقيب و عتيد They are taking selfies Of everything we do And say And not do and not say And just let me hear And listen to what I say To what I say لا خير في كثير من نجوان Allah said this on صورة النساء There is no good in most of what they say Listen to this Most of what they say Has no goodness لا خير إلا 3 أمر بصدقة You say something to promote charity Any charity Not necessarily money إلا من أمر بصدقة أو معروف Goodness أو إسلاحين بين النس أو you bring people together ركتفع relationship See what we say Someone comes to you And said She did this to me Most of us do what Most of us do what How many of us will respond and say Maybe she didn't mean it Maybe you misunderstood it Maybe it came the wrong way What do we say Really And what did you answer If I was you I will not talk to her anymore Don't do that Your tongue Your tongue Your tongue The way you look The way you look externally And the way you look Use your eyes The way you use your ears And the way you use your tongue The way you conduct yourself Please forgive me We live in a society I'm a working woman And I know How difficult it is To practice what I am saying But والله الذي أقلهم The only one who can help you Is him And you can do it Absolutely you can do it If you focus on it And you want to please him And you turn to him every morning Make me do what pleases you Make me say what pleases you And don't let me go to myself Don't let me alone with me With me How do we conduct ourselves With each other And with the other gender Masjid outside Masjid حياء You know this word باشفلness همبلness The way you speak The way you walk الله صدت In Surah Al-Qasas And it's about a woman فجاءتوا إحداهما تمشي على ستحياء And there is a reading They say على ستحياء قالت When she speaks And this is in Surah Al-Qasas The stories When Allah سبحانه وتعالى Mentioned Sayyidina Musa Just before he married One of the daughters Of Sayyidina Shuaib She came to him Woman You have an opinion Say it You are right Don't be shy But be shy In the way you say it She came to him This is a woman This is a daughter of a prophet She came to him Sayyidina Musa And she said Come on in My father Is inviting you To thank you For what you did for us But how did she say it على ستحياء Allah said this Go back to your Quran She talked to him With humbleness With Bashfulness Lowering her gaze She was not shouting She was not walking In the Masjidu Hi, how are you? How is everybody? And everybody has to hear What I am saying That's not the Muslim woman The Muslim woman You know How I describe her Very strong Very pious Is the combination Of the four you heard this morning From each one Lower your gaze Dress properly Walk and talk With حيا Don't worry about With other people I walk in my work You know what I say اللهم اغفر القومي فنهم لا يعلموا You are Allah Forgive these people They just don't know That's what The Rasual He used to say When he walks Between his people And they don't believe They just don't know And part of it Is my fault Because I'm not showing it I'm not practicing it Don't be like everybody else Be who you are In fact Who Allah wants you to be Who Allah wants you to be And the last but not the least Is who are you internally Will you be described As a Sayyeda Maryam How was she described In the Qur'an There's no other description سبحان الله Twice والتي أحصنت فرجاء وكانت من القاني The one who Protected And guarded Her private part And she was of those of القاني تين القانت Is the person who is In a complete submission To Allah Complete Not who she was Complete And always in a state Of worship of Allah Connection And submission That's the Sayyeda Maryam That's who she was Are you When you're Driving your car I'm not saying When you are in the Masjid Or in Ramadan I'm saying 24-7 You're driving your car Going to work Dropping your children Are you a قاني Can you be Have you ever thought of this Of course you can The way you speak If you are alone Do you contemplate on Especially living In this beautiful state When you're driving Do you contemplate On the things around you And look at the beauty of Allah You're a قاني Versus Trafic When I'm talking to my friend And Allah knows What I am saying Then you missed it Then you missed it Spiritually Spiritually Is what we need internally This connection of Allah A friend of mine Just asked me the other day And she said How can I always remember Allah I said He's around you He's around you 24-7 We are distracted He's there Look at this Look at this Look at this Look at this What did Allah Say about this In the Qur'an Anybody can answer What did he say about that Anyone say it Don't be scared Say it But what did he say Specifically about The drinking war I gave you a hint now أرأيتم الماء الذي تشربون أأنتم أنزل To move him from the mosque أحنا المنزل Do you see the water that you drink How many bottles of water you see a day How many times you drink water a day Do you think of this verse So what is the truth Most of you know it Do you see the water that you drink أأنتم أنزل To move him from the mosque Allah is asking Rhetoric question No answer Did you send it down That's what he said أم نحن المنزل Or we Him And then he gives you A statement That by itself is enough لو نشاء If we will We have made it أجادة Better فلو لا تشكر Why you are not grateful If you live this way In your life In case you wonder How do I get there How do I become that woman We are all talking about Since morning In every part of your life In every minute in your life Connected with Allah In every minute in your life Connected with Allah You are eating You are cooking You are shopping You are driving You are tired You are exhausted You are stressed out Everything is not going well In your day What do you need to do Be that Qanita Be that Sayyida Maryam Go to your room Alone In your Sujood In your Sujood Cry to him And say I can't take it anymore You are the one Who is going to make it easy Then you are Sayyida Maryam In that moment And the last And I'm going to End up with this Because I want time For questions and answers And Allah سبحان تعالى Said this As sheikh Sousan said this That Allah سبحانه وتعالى When it comes to Ibadah The real act of worship He did not differentiate at all He actually specified Separate And I want you to Memorize this ayah It's a long ayah Memorize it It's worth it It's a suratul إن المسلمين والمسلمات It's a suratul أحزاب الحمد لله You know it I'm going to say One by one And I'll translate So you learned it I don't know the number إن المسلمين والمسلمات Verily The Muslim Men The Muslim Woman Separate This was the answer To the question Of Said That's different to opinion About it But this is one of them Now look at all these Description He put descriptions And see where do you score إن المسلمين والمسلمات The Muslim woman The Muslim man The Muslim woman Quick question What is a Muslim?


How did I recover this file? Yes, you can easily recover this file in few easy steps on your Excel. You can recover lost files in few easy steps on your Excel and I'll be showing us how we can do that. So this is an Excel workbook which I have dominated set created by me just to test this out. I'll click on this closed icon so I'll close this workbook without saving it. Close it to actually do I want to save it. I don't want to save it. I click on don't save. Then I have a blank Excel workbook here already on my screen loaded.  I can see among the homepage I can see couple of files that have worked on previously that I saved so I can even see the date and time when I worked on those files. So but you can click on more workbook by clicking on more workbook you'll be redirected to this portion of my screen. So this more workbook you can see a lot of stuff in more workbook. I will go deep down to see more information on the files you've worked on previously but click on recover unsaved workbook. The moment I click on recover unsaved workbook so I can see unsaved workbook in my Excel are stored somewhere in my system. So I can see a lot of unsaved workbooks that I have on my Excel. So you can use the date and the time at which you last worked on the file to recover that. So by my time today today is the 28th of February. So by this time this was the last file I worked on and I clicked on open click on open. In the moment I click on open I have that file which I didn't save. So I can do a save as and save it somewhere else back in my system. So that's how I was able to recover this file which I lost easily. So you can do this for files which you've lost for up to hours ago files which you've lost for 10 minutes. And you can even do this for files which you've just lost you forgot to say for a single minute. How can you do this? By default Excel sets your auto recovery options to 10 minutes. You can't afford to lose 10 minutes what's of what's of work.  So my view may be different based on the version of Excel which I'm using. But if you can navigate the options tab on your Excel you can equally do this as well. So if you click on options the moment I click on options I see a lot of Excel options. So we will release other videos stating what you can do on general formulas as well. But for this tutorial I'll be showing on what we can do on save. So save we can see save auto recovery information every. I've already changed mine to one minute but by default yours will be set to 10 minutes. So you can change this to one minute and this will also affect all your office files. So thank you.


Hi, everyone. Happy Monday. I'm Joe for jaspyscasebreaks.com and I'm coming at you with this right here 2023 Panini prism football just a one-box break Random team break number two. You can see the next one's already loaded up spots are moving on that already. So check it out One spot gets you two teams all card ship big. Thanks to this group for making it happen. Let's double you up Like sir mix a lot. Oh double up. Oh, oh All 32 teams are in no combos. Let's roll it randomize It one and a two three times each one two and three We've got Logan down to Ryan one and a two three times for the teams one two and good luck third and final time Got the jaguars up top and the dolphins on the bottom All right, Logan with the Jags William with the Cardinals Eric last Bob Mojo bills Michael with the Broncos Patrick with the Lions Douglas with the Steelers Eric with the Bengals Ryan with the Eagles Douglas with the Saints and Niners Gary with the Texans Brian with the Colts Douglas with the Bears Michael he got my Raiders Tyler with the Ravens Gary with the Panthers Ryan with the Vikings Logan with his Packers Ron with the Patriots Ryan with the Jets willing with the Seahawks Brian with the Falcons Michael with the Rams Anthony with the boys Ron with the Bolts Michael with the Browns Anthony with the Chiefs Patrick with the Giants Tyler with the Commanders Douglas Bucks and Titans and Ryan with the Finns It's alphabetized by a team. We'll pause the video just for a little bit when we come back We'll see if there's any trades and then we'll have that one box break. So stick around. We'll see you on the other side All right, welcome back everybody TWC trade window closed here on a Monday the 22nd There's the final printout hot off the presses. Thanks everybody for getting in The same as what you saw on the previous screen, but it's just official now Now we got two loose boxes right here that I found I think after we finish These two right. I think the next one box break would be from a fresh case All right, so one two three for the left side four five six for the right side It's gonna be four right side. We'll save this for The next one box break that's already on the site And good luck. A lot of excitement in the divisional round. I Made some plays as you know, I'm wanting to do I made some plays on the day I've went to and to But I'm a little I'm down a little because I had a number of props that I had said none of those first touchdown props none of those hit but Those are hard. I should just stick with any time touchdowns but I feel like all of the All the games are pretty Except for the Houston at Baltimore game Which which looked good in the first half And I think they went into the half tied 10-10 and then Baltimore just ran away within the second half But the Packers Niners game was close a bad throw By Jordan Love Kind of scuttled any chance for a Packers upset Same with Tampa Bay a Baker Baker Mayfield had the ball They've driven down the field, but early interception within the first couple plays Missed that chance. Those are all pretty close games. And of course that missed field goal in Buffalo you know You know also came so we got we had some pretty exciting games Hopefully the conference championship games will be as exciting Prismatic Josh Jacobs and we got T. Higgins 98 out of 125. Oh, I would love to get that 2022 NT football filled up Yeah, it has been that has been marinating for a little bit You know if we can get that a little bit closer to single digits. I could pop the remaining teams into Into maybe some sort of random number block style filler So let's work together on that Eric K with the Bengals Tanner McKee and we've got a no-offent to 149 Red Wave Seahawks William We'll have a new coaching staff out there. In fact, the Seahawks offensive coordinator went to Chicago. I think to be their offensive coordinator or something like that and He has connections to Caleb Williams There's Nick Bosa lockdown and it's Lucas Van S to 175 so And if you connect the dots And this will go to Logan and his Packers and it seems like Caleb Williams number one overall pick go to the Bears we got Purple Ice Drake London to 225 that will be for Brian and the Falcons and There's a CJ Stroud rookie card base rookie card, but we'll take it Gary With the Texans What a season he had Rookie rookie season great rookie season goes to the playoffs wins a playoff game Excellent start to his career We got Calvin Ridley 44 out of 60 orange wave for the Jaguars. That'll be for Logan We got Kenny Pickett and Aiden O'Connell is our autograph. Nice red wave auto rookie red wave auto Aiden O'Connell Seem to improve with every start bit by bit Michael with my Raiders Raiders might get a quarterback. It was 117 out of 149 I'd like to see Aiden O'Connell get a full preseason You know give them a Give them a good shot at the job You know start building The rest of the team I'm not worry about a quarterback just yet. Here's Marquez Valdez scantling to 149 we got Rishi Rice for the Chiefs Still in the playoffs and he got out of Buffalo We'll face a even tougher challenge in Baltimore, I think It's Christian Watson silver datan win to 175 for the boys Anthony We've got Justin shorter to 225 purple ice Eric K with the Bills and We've got a Demarvian Overshawn rookie autograph silver for the Cowboys Anthony Dallas they've got some things to Know that thing. I mean they had a great regular season They just got a you know Get some more talent in the draft and then free agency Try to get over that hump that playoff hump. I'm sure they'll be in the playoffs next year They just got to figure out how to Win a couple games We got orange Kurt Warner 81 out of 249 that's gonna go to Michael and the Rams. There's a Bryce young for Carolina He's gonna have a new coaching staff to work with so let's give him another shot Gary with the Carolina Panthers. He Gary has the Panthers and the Texans I've got a Patrick Surtain and a Rishi rice Patrick Surtain's to 49 Emergent it's for Denver and that's gonna be for Michael and another Numbered parallel and orange Rishi rice for the Chiefs that will be for Anthony in Kansas City That's the 249 and then a couple cards here to close things out There you go gang. That's a quick little one box break of prison football We got another one a box break loaded up in the store. Let's sell that one out tonight. I'm Joe I'll see you next time for the next football break. Bye. Bye


Hello everyone and welcome to the September edition of the Wikimedia Research Showcase. I'm excited to be here today with some guest speakers. We have Mikkei Tatsumi from That's Gonna Easy in Turin, Italy. We're just going to be presenting on some pretty exciting piece of research without any collaboration with Wikimedia on monitoring the impact of health outbreaks on the public attention using Wikimedia and Wikimedia traffic data. And the second presentation is going to be by Jane Im from the University of Michigan and Amy Zang from MIT presenting a big overview of RFCs, request for comments, one of the key processes for deliberation in Wikipedia and in our communities looking at what we can learn from this large corpus of online decisions. So without taking more time, the format is usual. We're going to have about 30 minutes for each presentation including Q&A and you can stick around for a longer Q&A at the end of the session. Jonathan is going to be our IRC host, so if you have any questions on IRC or YouTube please direct them and he'll relay them to the channel. And with that Mikkei, let's say use yours. Thank you very much, Dario, and thank you to the Wikimedia Foundation to give me the opportunity to present work done in collaboration with colleagues at Fundazione Easy, the Institute for Scientific Interchange Foundation in Turin, Italy. So this is work done with my colleagues on the Rappanissone, Daniela Paolotti and Ciro Cattuto about the impact of news exposure on collective attention in the United States during the 2016 Zika virus epidemic. And as an introduction, the main idea of this study relies on the concept that it's known that behavioral responses during epidemic outbreaks can influence the spread of the disease dynamics. And awareness during epidemics is a key concept in epidemic modeling and as shown in the picture as an example during a Middle East coronavirus outbreak in Seoul in South Korea in June 2015, the response, the behavior response of the population was quite relevant to the outbreak. There's a large number of theoretical studies that tackle this concept and try to incorporate the behavior responses into epidemic models of infectious disease spread. But actually there are fewer empirical studies, mainly due to the lack of data and measures of awareness during outbreaks that it's something that it's hard to quantify and even more difficult is to quantify behavior changes during epidemics. So here I'm just citing a few key references to the subject which is getting quite relevant in the literature, especially in the past 10 years. Most of the modeling approaches in epidemic modeling incorporate media exposure into the model structure to some kind of media function. So it's pretty clear that media play an important role in raising awareness of the public during outbreaks and the typical assumptions of models is that media coverage increases, has the incidence of the disease, the number of new cases grows in time and at the same time the susceptibility of individuals decreases as the media coverage becomes more alarmist. So the more cases there are of new infectious diseases, of an emerging disease, then the media coverage gets more alarmist and then people tend to stay home to reduce their contacts and thus reducing the spread of the diseases somehow and ramping the spread of the disease. And there's a good review I mentioned here on BMC Public Health about how many models are considering this type of effects of media exposure. In our study we focused on a specific epidemic outbreak that is the 2015-2016 Zika virus epidemic. The Zika virus is a mosquito-borne infection, it's a virus transmitted by it as mosquitoes and it's vector-borne and also if transplacental and sexual transmission can occur, the infection is mild and most of the infections remain asymptomatic, 80% of the cases, but actually it can lead to severe complications, especially during pregnancy because it causes microcephaly in newborns and there is no vaccine or specific treatment and the worldwide attention started on Zika virus in 2015 when a first cluster of microcephaly cases in Brazil was associated to a Zika virus epidemic and from 2015 onwards the virus spread to the rest of the Americas and reached the US, reached in the end more than 45 countries, 47 countries in two years, and the WHO declared the epidemic a public health emergency of international concern on February 1, 2016 and cases in the United States were first reported by the CDC at the beginning of 2016. The United States are a special case for the epidemic because only a few states could report local transmission because of the presence of the vector, especially Florida and Texas where the states, where most of the local cases were reported, although all states in the contiguous United States reported cases because they were imported from abroad due to travel. So the research questions of our study were mainly how collective awareness and attention patterns to a public health threat such that Zika virus can be captured by digital sources in general and how does media coverage shape the public attention during epidemics and we answered, we tackled this question by combining different data sources. First of all, the Wikipedia page views data of selected 128 Zika related articles, so mainly the Zika virus page and all translations in 94 languages and these page views were geo-referenced. So page views that were geo-referenced in the US, in the United States, down to the level of the city. Then we combined this information with a number of web news items, about 100,000 web news items citing the word Zika and the United States from about 7,000 new sources in 2016 and this is data available from the GDALT project. And next we consider also time spent mentions of Zika in TV programs that were aired in the United States in 2016. This is data available from the TV news archive and these are taken from close captions of TV news programs aired in the United States. And finally, we linked this media coverage and attention patterns to the epidemic data, so the weekly Zika virus case counts reported by the United States by the Center for Disease Control. So just to give an overview of the time series of the temporal evolution of these four data sources, we see here in the four panels the daily Wikipedia page views of the pages under study, the TV mentions of the Zika word and news items mentioned in Zika over time. And we can see a clear pattern of all the three, of all the three times series with a huge spike at the beginning in February corresponding to the declaration of the WHO of an international health alert, while after March more or less the attention on Wikipedia decreases and even though in summer there is again news covering the Zika outbreak again, especially due to the Olympics in Brazil that were also raising concerns for the public health, the attention remains low on Wikipedia page views and it doesn't get back to the peaks of the beginning. At the same time it's very interesting to see that the Zika cases reported by the Center for Disease Control, the red curve are actually increasing over time, reaching a peak exactly in summer, in summer 2016 with a very different pattern compared to the attention and news coverage time series. And this is clear from correlations if you measure correlation of time series, all the Wikipedia page views and the news items in the TVs are highly correlated with a person's correlation coefficient higher than 0.7 while the correlation of the three times series with the Zika virus incidence is almost negligible and it's very small. There is only a weaker correlation with news items but actually the correlation with the Wikipedia page views is actually negative. So this suggests that the attention measured by Wikipedia is actually not much driven by the epidemic incidence but the epidemic profile of the disease. And this picture remains the same also if we look at the 50 states. So all the Wikipedia page views time series were highly correlated across the 50 states in the United States. So here I'm showing a cross correlation table where we can see basically the time series, the Wikipedia page view time series in each state and the level of correlation with the Wikipedia page view time series of all the other states. And we see that the correlation is all above 0.8 for all the states. So basically there is a high correlation across states and also correlation of course with the national timeline which is above 0.8. So the attention measured by the Wikipedia page views was synchronized over time and in space across the United States. There is only one case, quite special of Montana that is the only state for which there is a slight correlation with Zika virus cases reported in that state while on the other hand for all the other states the correlation between the attention patterns and the Zika virus cases reported in that state are not significant. So it really seems also that at different spatial resolutions the attention is not much driven again by the number of cases reported. We also looked more specifically at attention patterns in cities of the United States. So we looked at a higher granular resolution in space and we looked more specifically at about 800 cities in the US with a population larger than 40,000 and we ranked those cities by the relative attention to Zika virus pages compared to the total page view that was observed in the whole 2016 to all the Wikipedia pages. So we compared how much the page view to Zika were ranked the higher or lower with respect to the global rank on Wikipedia page views for that city. And in that case some patterns start to emerge and for instance if we look at the cities where the attention was the highest so the top 10% of cities in attention we clearly see that they are most in Florida. So here in this case we can see that at the city level there is a correlation with the risk of infection. So where those places especially the area of Miami for instance was at high risk of local transmission of the disease and where the largest number of cases was reported. At the same time cities with the lowest pattern of attention so with the lowest attention to the disease were cities that were quite far from the area most at risk like in the Midwest for instance. So to conclude our study what we did was to try to model the Wikipedia page viewership by a linear regression model that includes all these media signals and at the state level and weekly. So what we wanted to model here is the number of page views to Zika related Wikipedia pages by week in each state of the United States and we want to predict this value by just only using the TV mentions of Zika and the mentions of Zika on news at the national level. So what we want to do is to model the Wikipedia page viewership not as a time series analysis in a sense but by week predict the number of page views only based on the number of mentions of TV on TV programs and the number of mentions of Zika in news and to explain in more in details the model we are using the modeling approach we are using so what we do is to model the Wikipedia page views scaled by the state population because of course the volume of page views is proportional to the population of each state and naturally we find that this relation is likely super linear and at the same time we predict this number as a linear growth with the media signal so as a combination of a linear combination of the TV media coverage the news at the national level and also the news at the state level news at the state level means news that mentions Zika and a specific state so we of course we predict the page views to grow with the number of mentions of Zika in media outlets at the same time as we have seen that we observed from the time series that the page viewership the attention to Wikipedia pages decreases over time and this does not increase again even if during summer the news were increasing this suggested us that there is some kind of memory effect and this is also something that is known in the literature then of course people look at Wikipedia pages once when there's something new but then they don't go back again to the Wikipedia pages because they already know about the matter so of course there is some kind of memory effect that we incorporate into the model by including an exponential kernel that basically dumps the response to news after over a certain time frame where here the memory kernel is dumped exponentially with a timescale tau that basically gives us the average the average timescale over which the memory takes place the memory effect takes place and here we consider two different components of the memory effect so a memory effect on the TV signal and the memory effect on the new signal and we do this week by week separately and state by state so what we do is we do the prediction statewide using a k-fold cross validation with k equal to 5 and what we found in the end is actually the model performs very well across all the states if we consider states with a population larger than one million individuals the model is able to predict quite well with an R-square that is an average of 0.76 but it gets higher for instance in Texas or Illinois it predicts very well the number of page views week by week and as I said before this does not take into account previous weeks on the same time series so it's only based on the number of news and TV items that we see each week separately and so the model gets pretty accurate but what is also most interesting to see is that actually the model gets really pretty accurate when we only consider TV or web news together without the memory effect so the average R-square is already of 0.6 and basically we compared all the combination of the features so we train our model by including all the features that I described before one by one and then by adding them together combining them together and basically a model that includes all the features performs only slightly better than a model that includes only the TV signal the web news and the memory on the web news or the memory on the TV so in the end we see that the media signal is highly informative already at the very basic level of the page view dynamics at the state level and this is again the TV and news sources at the national level already highly informative to conclude my presentation what we have seen is that Wikipedia page view data can be used to measure attention during a public address and this was also already initially studied by some previous works what we have done here is that we have done it at the higher spatial granularities and we've seen that at all spatial granularities attention seems to be mainly driven by media outlets and more in general the correlation with the incidence of the disease was found to be weak and this is contrary to what typical assumptions what are the typical assumptions of several theoretical models that actually expect the attention to grow with the incidence of the disease and of course we need to consider several peculiarities of these specific studies especially the fact that the Zika virus as I mentioned is a vector-borne disease that usually has mild symptoms and the low transmissibility so it is a very peculiar infection and of course other diseases like flu or measles or Ebola for instance could lead to potentially to very different dynamics of attention patterns and at the same time it's important to know that we looked at attention patterns what we didn't make and click on links with behavioural changes this is something that is missing in our case and it would be very interesting to do with some additional data sets at our hands and of course I would like to acknowledge my colleagues at SA Foundation again and also colleagues at Wikimedia Foundation that helped us in setting the problem and in the study and also thanks to the Open Access Policy for the data of Wikimedia Foundation and there is a preprint available if you are interested in knowing more about the study you can find it at the link here online and thank you very much for the attention and I will be happy to answer questions from the audience thank you very much Thanks for a great presentation Michele I'm going to ask Jonathan first if there are questions from the channel or from the room I have a few I'm going to keep them for later No questions from the channel at the moment I'm going to start coming in with some of my questions so something we discussed during the making of the study Michele So first off I guess it's a question that you mentioned in passing about the relation between population and pages being super linear that's something we discussed during the early version of the study and I was wondering if you could expand on that and also add some thoughts maybe about the relation between population but also issues such as internet penetration and connectivity to what extent we can take basically population as a good indicator of what level of traffic we will observe for these topics coming from a given state or country Yeah sure so I would say regarding the internet penetration yeah of course in the United States we can assume that it's high or kind of almost equal across states that's the resolution we are looking at we think so the idea of looking at the scaling with the population comes from the fact that it's been observed in several studies several important studies especially those led by the Louis Bettencourt that several of these human activities like crime or number of patents or other indicators of human activity scale super linearly with population size at the level of cities and naturally we tested this I would say quite extensively and found that actually this holds true also for Wikipedia page views and we use that to inform our prediction model in a sense that we target in our prediction Wikipedia page views rescaled by population with a super linear scaling factor although this was not the aim of our study so actually it would be very interesting to investigate more on whether this is true not only for the United States of course but also across countries because then actually as you mentioned there are other factors that might play an important role and I'm sure they play an important role so I'm not sure that this is true for countries where of course the internet penetration rate varies a lot across cities for instance or it's very low in general and also this should be considered also as something to investigate depending on other features like the type of access to the page or things like that but yeah, I would say in the end the fact that the page view scales super linearly with population is interesting in line with a huge literature on the subject about scaling of human activity with population size. Cool, thank you. I think I have time for maybe one more quick question from Chris and we'll save more for the second Q&A. Thank you, I'll ask that so I'll just read what I put here in chat so I was wondering if there was any information about how viewers of these pages on Wikipedia on Zika are actually interacting or using that information and if there are any specific behaviors known what factors might be associated with those kinds of interactions or might be predicted of those interactions and as an example I just one thing I thought that could happen is someone could continue to click through like a link on there whether that's an internal link to Wikipedia or some reference that's cited on a relevant page. Right, we haven't used such kind of information so we really looked only at the number of Wikipedia page views. I know there is information about user behavior so it's potentially available and would be very interesting to understand that a model, that kind of interaction during outbreaks, that would be very interesting to somehow discriminate on why people actually visit the page and for sure also the main reason for visiting those pages changes during the outbreak so at the very beginning it will be led by interested for something new and then over towards the end of the outbreak there will be other reasons maybe more health related or what so there's a lot to explore in this area I would say we just really looked on a very simple question in a sense. Thank you. I have a quick shameless plug it sounds like super relevant to this question so it turns out that we just started a few weeks ago a new project that starts to look precisely at this question so one is characterizing the usage of citation like when readers follow citations in general and external links but it's one specifically with a team we're cooperating with that's looking at the role of Wikipedia as a gateway to medical and health related information and so I think we're going to have some solid answers to that question looking at specifically these patterns of interaction not really to a specific outbreak but in general like the interaction with articles in the context of medicine and health related information so stay tuned alright thanks again Michele again please stick around to my additional questions at the end of the session and we've got a transition to Jane I think Jane is the one who's going to be presenting am I right? Yes. Alright, fantastic. Can you guys hear me? Yes. I'll start. Hello everyone my name is Jane M and today I'll be presenting about deliberation and resolution on Wikipedia a case study of requests for comment I'll first introduce the team members I'm a newly starting PhD student at University of Michigan and I did this work while at Career University the other members are Amy Zane PhD student at MIT CCL Christopher Shilling member of Wikimedia Foundation David Carger professor at MIT CCL and Jonathan Morgan member of Wikimedia Foundation today I'll be talking about requests for comment so what are they? Request for comment is a major and common process used by Wikipedia editors for requesting input from uninvolved editors in order to solve content related disputes so it's basically a way of getting help from outside in order to solve a content dispute that's not being resolved locally and the request for comment process consists of initiation, discussion and one of the three outcomes which I'll be explaining shortly let's start with an example so here is a request for comment started by an editor about an unresolved dispute about whether the lead paragraph of Donald Trump's page should say he's the current president or not and after this RFC has been initiated we can see editors coming in writing down their opinions and along with the reasons and sources after this deliberation has run fully we can see an uninvolved editor who we call the closer come in and formally the request for comment the closer evaluates the consensus of the discussion and writes it down as a closing statement at the right top gray box we can see that the closer here has evaluated that the discussion's consensus is to include that Donald Trump is the current president on the Donald Trump's page here we can see that this request for comment has been closed and the deliberation has been met with a consensus with the dispute being resolved and this is a very ideal case of a request for comment's ending but we found out that it does not always happen to all RFCs a request for comment can meet one of the three endings and the example we just previously showed is a case when the request for comment is formally closed by a closer and the dispute being resolved however there are cases when a request for comment is not formally closed like this one here this is a request for comment about whether to enlarge section on policies on Bernie Sanders page and it is currently left without a formal closure among request for comments like these however there are some that are still informally ended usually by a participant and initiator who thinks that there's already an obvious consensus and there's no need to further discuss or there's no need for formal closure and here we can see that the dispute is also resolved the problematic case is when the request for comment is left stale ended and closed by nobody in this case the dispute is not resolved and the deliberation is left stale for example this is part of a request for comment that is left stale and we can see an editor referring to the stale RFC as another sad Wikipedia fail we found out that actually many request for comments need these sad endings we found out that roughly a third of request for comments are stale without any closure and we also found that many that do get formally closed do not get closed in a timely fashion so the average period of a request for comment open up to the formal closure was about 45 days and this is 1.5 times more than the time period a request for comment is allowed to be open by default so it appears that many request for comments are stale so why are they a problem first they can be discouraging to editors if a request for comment never gets closed when they have put a lot of effort into it it basically means wasted labor second they can be a problem for productivity as editors involved in request for comments may wait on the outcome before further editing so the next natural question is why do many request for comments remain stale and to answer this question we did a number of things which I'll be presenting in the rest of the talk and we believe this constitutes the first study of investigating the process and issues of request for comments and I'll continue by explaining how we got the data so first we had a quantitative study where we gathered and analyzed 7,316 request for comments from the English language Wikipedia since 2011 to 2017 we built models predicting request for comments outcomes using this data second we had a qualitative study where we interviewed frequent and closers and we also inspected 40 randomly chosen stale request for comments from the data set in order to find out why many RFCs remain stale we also consulted with two members of the Wikimedia foundation and discussed this study on Wikimedia's research mailing list to further describe about the RFC discussion and closing data set we first used the revision history of talk pages provided by the media wiki API and the edits of a bot that manages request for comments we gathered the URL of the original page where the request for comment was started at however one problem is that threads on Wikimedia gets archived when time passes by so we iterated through the archives to find the current version of the URL of the RFC and using the URL we retrieved and parsed the request for comments content using libraries like Wikichatter in total we grabbed about 7300 requests for comments and we extracted initiator participant closer information and comments initiating and closing statements we also kept the reply structure intact using python libraries now I'll provide a description of requests for comments over time including their issues using the data set that I just explained about first here's a graph showing the number of requests for comments initiated each month from 2011 to 2017 although we can see a sharp increase in 2011 we assume that's because that's the point when the bot managing RFCs became active so overall we can see a steady volume of requests for comments being initiated about 60 to 120 per month we also found out that closers are first their more experienced than initiators and participants for instance they have a higher number of average edits made on Wikimedia second we found out that there's a smaller number of closers compared to initiators and participants this may imply that not everyone closes so we found that there's a steady volume of usage of requests for comments with experienced editors as closers now let's get back to the main question the major issues we found in the RFC process to recap first we found that many requests for comments that is a third of them are stale second we found that among RFCs that are formally closed many of them are not closed with a timely fashion it took actually about 17 days since the last comment up to the formal closure and this is a graph showing the timelines of all the RFCs in our data set and the yellow line shows the time between the opening and last comment while the blue line shows the time since the last comment up to the formal closing statement if there is one and we can see crazy outliers existing here we can see RFCs that took a long time to close after the last comment and we also can see RFCs that just dragged on and on not being formally closed and among them there were many RFCs that were stale so why are many requests for comments stale now I'll explain the reasons we found behind the stale RFCs to recap the methods first we conducted interviews with 10 frequent closers on wing English Wikipedia and second we had a qualitative analysis of randomly selected 40 stale RFCs from our data set so in total we found 5 reasons behind stale RFCs and the first one is related to problems with initiators and initial proposals among the 40 RFCs we found that some of them contained 2 vague initial proposals making it hard for newcomers to further participate in the RFC and the interviewees also mentioned that they found unclosed RFCs mainly some of them due to having no clear question in the initial proposal in a more severe case we found initiators using biased words in the initial proposals trying to solicit participation in an unfair way and editors will not participate further in this case making it more likely for the RFC to become stale second reason is related to behavior of participants among the 40 RFCs we found some of them having excessive figuring which led to long and complicated threads with lots of back and forwards which made it hard for newcomers to come and examine the content and further participate in a more severe case we found out that some participants became sock puppets which means that they create multiple counts in order to sway the discussion in their favor and interviewees mentioned that they would not close when they are suspicious that there was sock puppeting going on the next case is related to lack of interest or expertise from uninvolved editors among the 40 stale RFCs we examined we found that some of them didn't contain a wide RFC remain stale but among them we found that some had small participation from new uninvolved editors this implies that if an RFC does not gain much interest from the outside editors it's likely to be more stale and interviewees mentioned that when they find an RFC that they believe that not many editors care about they sometimes just pass it by and not close it thinking they can't create an impact on the RFC anyways this category also includes the case when the request for comment requires a certain amount of background that not many closers have the interviewees mentioned that they sometimes do not close RFC because they feel that they do not have the expertise needed to understand and close the request for comment this implies that if request for comment is in an area that not many closers are aware of then it's more likely to become stale the next reason is related to the RFC being too complicated or contentious the interviewees mentioned that they sometimes find request for comments containing huge amount of comments and where the feelings are running very high and they told us that in this kind of situation they will not close it and leave it to someone who is more experienced or closer with more authority interviewees also mentioned that there were just sometimes some cases when they couldn't just understand the request for comment because it was too complicated the last reason is related to interpersonal issues and Wikipedia politics just like anyone else Wikipedia editors also have interpersonal issues and interviewees mentioned that they sometimes will not close an RFC because they have a bad relationship with an initiator or a participant so up to now we have incorporated these findings from the interviews and a qualitative inspection of all the RFCs now I'll be explaining how to incorporate these findings into building models for predicting request for comments outcome our goals of building models is to first we want to understand the features that can predict whether and request for comment will go stale second we want to help initiator and participants to prevent stale RFCs and considering that we want them to take action beforehand and that features change over time we also need to build timely models when I mean by building a model I mean by building a predictor which needs feature selection and for this for this step we'll use the five reasons we found through the qualitative study and after that we'll train the classifiers using those features so in total we came up with 61 features grouped into eight categories and the first one is related to initiators experience so during the qualitative study we found that problems with initiators and initial proposals for example the proposal being too vague or the initiator using biased words can negatively affect the RFCs outcome and we thought this was potentially connected to the initiators level of expertise and therefore we calculated features like the number of edits made by the initiator on Wikipedia and whether the initiator is an admin next we also considered participants interest we learned from the qualitative study that if an RFC does not gain much interest from editors it's likely to become more stale therefore we calculated features like number of participants of RFCs and the ratio of new participants to the top page where the RFCs thinking these two reflect participants level of interest next we also considered participants experience we learned from the qualitative study that behavior participants can impact an RFCs outcome such as soft buffeting and bickering therefore we considered features like the age of the Wikipedia account of participants and the number of edits made by the participants on Wikipedia next we considered size and shape of discussion we learned that if an RFC is too long or too complicated with lots of back and forths it can scare away closers considering this we calculated features like number of comments of an RFC and the average depth of replies per comment next we considered contentiousness we also learned during the qualitative study that if an RFC is too contentious it can also scare closers away therefore we calculated features like number of reports and post votes in RFCs and weighted reciprocity next we considered tone of participants discourse we learned that behavior of participants like bickering can impact an RFC's outcome and therefore we calculated various tones including hostility, anger, cognition and certainty we also considered initial proposals tone and length we learned that problems with initial proposals for example they can be too vague or too short we learned that they can negatively affect an RFC's outcome so we calculated features like number of words in the proposal and the same tone related features that I mentioned previously last one of the least we considered popularity of RFC and its topic we learned from the qualitative studies that if an RFC has lack of interest from editors concerning its topic then it is likely to be stale therefore we considered features like number of words in the RFC thinking it reflects the popularity of the RFC and we also considered features like number of revisions made on the top page where the request for comment is started at before the RFC initiation thinking it reflects the popularity of the RFC's topic so using these 61 features we built 4 types of models using logistic regression adaptive boosted decision trees random forests and support vector machines using radial basis function kernel the baseline here is just predicting close for every RFC and it reaches 67% of accuracy we can see that the adaptive boosted decision trees perform the best overall except the recall score and it reaches about 75% accuracy this is about 8% increase in the baseline performance we also built classifiers using features for each category because we wanted to know which category was the most important and we can see that the size and shape of discussion was the most important category followed by participant experience and participants interest and this is the top 14 features in the ADT model incorporating all data and we also can see the correlation between each feature and closure and the red box ones are the ones that I'm going to be talking about first we can see that all features related to size and shape of discussion were included in the top 14 features interestingly the number of comments and the average reply depth of comments had a negative correlation with closure while the average number of replies had a positive one this may imply that if a threat is too complicated along with lots of back and forths it might scare away closers however a certain level of interest which can be signaled through the average number of replies can be beneficial for an RFC to avoid staleness we also found out that number of participants which is related to participant interest was also included in the top 14 and had a positive correlation with closure also implying that a certain level of interest of participants can be beneficial to an RFC's outcome lastly we found that almost all features related to participants experience were included in the top 14 with all of them having a positive correlation this may imply that experienced participants may help an RFC to avoid staleness on the other hand it may imply that experienced editors may know which RFCs are likely to be closed out of experience and participate in them so up to now we trained and tested the models using our entire data set however considering that one of our goals is to help initiator and participants to prevent RFC's staleness our next question that we have to answer is how soon after an RFC is initiated can we predict the likely of closure reasonably so for this we used all 61 features that I previously explained and also using a new feature which is the number of days since the last comment up to the current time and we built models using features immediately after initiation after 1 week after 2 weeks and up to 11 weeks and this is the result of the time we models we built the X axis shows the number of weeks after RFC initiation while the Y axis shows the accuracy level and the pink and purple lines each stand for the accuracy level of baselines for predicting just close for every RFC and predicting unclose for every RFC while the other four lines stand for the accuracy level of the four types of models we built and the first take away from this graph is that we can predict above 70% accuracy as early as 1 week after initiation with the ADT model and random force performing the best second we see that the baseline for predicting close for every RFC decreasing and the baseline for predicting unclose increasing over time this is because for every time point we only consider RFCs that are not closed yet so as time passes by some requests for comments become closed and we discard them from the data set this makes the ratio of unclosed RFCs increase making the baseline of predicting unclose for every RFC increase and in the sixth week we can see that it's a 50-50 chance for both baselines and our best models improve over the baseline by over 15% with the random force and logistic regression performing the best the implication of timely models is that they show which features are important at a time point along with the prediction of outcome therefore initiator and participants can take actions using these top features for example let's say after 2 weeks the models show that participants expertise level is crucial in order for an RFC to become closed so participants see this and they can invite experienced editors to the discussion in order to increase the likelihood of the RFC to become closed and avoid stillness. To summarize our contributions first we created a new comprehensive data set of request for comments and anyone can access and download the data set using this link second we found that roughly a third of request for comments do not get closed at all remaining still and many do not get closed within time third we conducted a qualitative study showing insight from the closers themselves as to why many request for comments remain still and last but not the least we built new models to help predict which request for comments are likely to go still and also timely models that help initiator and participants take action a paper on this work was accepted to CSCW 2018 and anyone can download it using this link and these are the mail addresses of mine and Amy's thank you for listening to this presentation and I would be happy to answer questions thank you thanks for the great talk Jane going to pass it on to Jonathan for questions if Jonathan is still around and can hear us well also with one here well he's coming back I really appreciated the design recommendations or policy recommendations towards the end of the presentation I think they're very clear and actionable one general question that I have which is similar to what we've always seen in the past where you know there are obviously there's a different participation in this governance spaces from newcomers as opposed to to experienced editors all of the data that you have points of the fact that you know the higher likelihood of closure when more experienced editors are participating and the negative effect of length to me these two data points really suggest that we're creating barriers for newcomers to participate in this conversation I think the second point is very much related to the work that also Amy has been doing on the importance of summarization for people who are not already familiar with an existing discussion so I'm curious in general about your thoughts about participation from newcomers in this specific type of discussions you're getting additional insights what is desirable I mean there are I guess there are questions about like at what point is somebody's tenure on Wikipedia is appropriate to participate in this discussion oh so your question is about my thoughts on newcomers participation and request you come up correct yes so from the interviews it felt that the interviewees felt anyone is allowed to participate in request for comments however from the studies results I thought that it would be great if there is a way for newcomers to get feedback from maybe more experienced editors on how to participate in request for comments like during the interviews there was an interesting point that editors learn from other experienced editors while participating by looking at the way how more experienced editors use reliable sources and newcomers seem to learn from by looking at them while participating in the discussion and I thought maybe if there's a way for newcomers to get more maybe active feedback on how to participate in request for comments from more experienced people maybe that would be a great way to improve a lot of request for comments outcome that was my general thought yeah what Jane was saying is basically even more pronounced when it comes to the role of closer so newcomers may feel concerned about participating in RFC but for taking that lead to actually try and close an RFC which right now anyone can do it's not something that only admins can do they're there for people who are new to the process thank you I know that Jonathan by the way is having some technical problems coming back in so I think we'll try and we'll see what happens I want to open up the stage for others so Chris if you're around if you have additional questions and I'll check RFC I did have one thing I could add to that question of yours actually the other thing I think that is acting as a barrier to participation either in terms of closure or just getting involved with RFCs in general involves just understanding guidelines and policy and how to engage in kind of not necessarily argumentation but discussion around those I think to the extent that we can encourage people to participate in RFCs that are perhaps not as guideline and policy heavy that is a possible gateway for people to kind of get started because there are certainly proposals that don't rely on really heavy or nuanced understanding of editorial policies and guidelines alternatively if we had a better way to teach people about policies and guidelines because I am very reluctant as an English Wikipedia editor to just throw people into those pages to the extent that we can present those in a more accessible way those are two ways I think that can help people become more involved in these in this discussion process in this kind of proposal process there are currently no questions on IRC sorry I dropped out suddenly I have a question for the speaker if no one else does are there any other questions from the room looks like there is one question from the YouTube live chat Jonathan I just put it in the chat log I'm happy to read the question or if you'd like to this question comes from James Salisman are there any features other than hostile tone of initial proposal that have to do with the initial proposal ergo cognitive tone or hostile tone or effective tone well we tried out all the tones for the initial proposals as well but it turned out that other than the hostility of the initial proposal nothing was included in the top 14 so it seemed that it was the most important tone of the initial proposal excellent and personally I'm always curious about design directions one thing and I apologize if this was asked when I was booted out of the meet but when it comes to helping Wikimedians and potential closers assess how to support a discussion that seems to be running down without consensus or try to move it in a more positive direction with machine learning models having the models output its predictions is one thing but there's also been a lot of interest recently around making interpretable models that allow end users to understand something about the decision making process and making that information available to them in a way that will allow them to make more productive decisions I wondered if you had any thoughts about that in this context so I think that goes along with the implications that I explained about the timing models so with the timing models they not only show the likelihood of whether an RFC will be still or not at a certain time point but they also provide insights on which features are important at that time point which is an example that I showed in the presentation after one or two weeks the timing models show that the participants experience is the most top important feature for an RFC to become closed that the participants can see that and oh we need more experienced editors and maybe send invitations throughout Wikipedia to like more experienced editors and get their neutral suggestions on the RFC to improve the likelihood so I think that's a great implication for the timing models and do you think that you might have you given any thought to how you might evaluate the effectiveness of this model in use cases like that I see to evaluate I guess if I were to evaluate I think I would try to first find RFCs that where this model wasn't used this tool wasn't used and then also get another data set where this model was used and try to compare those over time yeah I think there are many cases of RFCs out there where the people that are participating or the initiator are really interested in getting it closed and they might post to the administrator's notice board kind of asking for participation but may not get the kind that they're hoping to get and if that's the case it would be great to be able to find them or for them to find this work and think about additional strategies for getting input that's great thank you this is just to me thinking aloud we've never tested as far as I know these kind of interventions on top pages or deliberation related pages such as RFCs or AFDs RFAs or what not but I'm just wondering if one could test with a model like this and plugging into a bot that basically would post on the top page at a specific point in time like we have we have a high confidence that this RFC is not going to close unless we bring in more domain experts or unless we diversify the participation rate or if any of the recommendations we presented in your results I'm just wondering this is like a big question not just empirical but also a community standpoint a question to figure out if a bot intervening in such a stage to sort of like a nudge or redirect a discussion with a stated goal of maximizing the chances that it might be closed is something desirable we never done that I'm just thinking aloud that this is something that potentially a bot if we find a community willing to experiment with that yeah I think that would be a really great uses for the models we built like Amy and I we found out that bot is like one of the main tool used in Wikipedia for sending out notices and we also know that a bot is currently used in notifying some random people about the RFCs but this model was used to maybe get the right audience to participate in the RFCs I think that would be a great use case yeah yeah so there is kind of this bot that you can subscribe to the bot and tell it how many like maximum requests that you want per month or something and the bot will just randomly go through and alert you about an RFC and we haven't done the details to look at you know how effective that bot is but it would be interesting to see that another thing is actually right now when an RFC is looking to get closed there isn't a very good mechanism for publicizing that so there is a request for closure page and right now there's kind of a few editors maybe like one major editor who is actually going through and manually posting those to that notice board which you know maybe that could be a more standardized process where you know if this person stopped doing it it would probably stop happening so yeah oh and there's one more question yeah one more question I'll read it for archival purposes this is another one from James Salisman did you measure the number of incoming links to the RFC section? I suspect that a lot of RFCs died because they aren't advertised in wiki projects and Wikipedia Central Notice Board etc. yeah that's actually a great point we actually figured that oh this feature might be a really important one because we noticed that people really try to advertise them but if there's like a difference of some RFCs that they can advertise actively maybe that is a major reason why they come sale but unfortunately for this study yeah we couldn't we weren't able to measure the number of incoming links and the main reason was because we couldn't find a really clean way to do this so we we found some advertisements on various places but we couldn't find a really clear rule to get a really clean set of the advertisements so that was one main reason why we couldn't measure the number it sounds like subscribers to that bot does initial notifications like look in distribution of types of editors that are subscribing to that bot and receiving these notifications which I presume is mostly skewed towards experience editors is going to give us some insights into how people discover an RFC but I agree that's a very important point sweet we're almost going to close I want to check if there are any additional questions I don't want for Mikayla if he's still around just to close this because I didn't get a chance to ask him before so Mikayla give me a sign oh you're still there so one thing that I find fascinating about that study is also very relevant is like this issue this divergence between incidents and the tension that's something that probably will be studying more and more given the current way in which information is propagated over various channels and social media I mentioned to you recently there was this case of a hoax of a nonexistent Ebola outbreak in Italy which apparently is making the rounds on Italian social media and also being used for political purposes I'm just curious if you think this method of use here in the case of Zika could be meaningfully used and adapted to study the spread of hoaxes related to public health threats lacking any actual incidents in the area where these hoaxes are spreading yeah thanks for the question that's a very good point I think this is the specific case of a hoax is related to infectious disease outbreaks hasn't been investigated much and this would be very very relevant to study I think nobody has really a clear idea of the impact of on attention of this type of misinformation and definitely as our study shows I mean the attention is driven significantly but what people read on the web at least on news, web news that was what we mentioned would be nice to have other data sources that you mentioned other social media mentions of the disease and whether these are more significant drivers than the actual infection epidemic spread in this case so this would be very interesting to study as a follow up of our work that's great, thank you thank you awesome with that I think we're almost at time so again thank you all of our speakers thanks for joining us today please remember to share a copy of the deck so we can upload it and share it with our audience and see you all next month for the next showcase bye everyone


Hi everyone, Joe for jaspyscasebreaks.com, coming at you with 2021 Tops Chrome Baseball Sapphire Edition. Five boxes, random team break number one. A lot of great stuff here, a lot of fun parallels to work on. Big thanks to this group right here. Good rally at the end and all 32 teams are in. Let's roll it. Randomize names and teams, two and a two for the hard way. One, two, three, and four. Got William all the way down to Chris. Two and a two for the hard way for the teams. And we got the Cubs after four all the way down to the New York Metropolitan. All right, so here's how it shakes out. Good luck. Nice. I appreciate that, Mark. Mark saying, Mark Rouse saying, Hey, just throwing a dart on this half fire. Don't do too much baseball. Maybe this break changes your mind.  Let's sort this alphabetically. And we're going to pause the video when we come back and we'll see if there's any trades. Then we'll have that five box break. Stick around, be right back. All right, welcome back, everybody. No deals. No other deals were done, but we did get one. A's for Twins. So Chad, who is a big Mariners fan, does not want the division rivals, gets out of the A's spot and gets the Twins. George is out of the Twins spot and now has the A's. Let's see how it works out. Now we can print and rip and put the T next to there so you know that that was a trade. And let's see who draws first blood in that trade, if any. So here's all five boxes right here. Thanks, everybody. Another five box break in the store right now. This break does not take very long. So we can run this back pretty quickly if you want to. And there's the official print out right there. Hot off the presses. Thanks for spending a bit of your Monday night with us. I appreciate that. All carship, of course. All right, good luck. We already got a little orange peeking out there. And behind Luen Diaz is a Ray. That's Joey Wendell. Mr. Wendell. That's for Jeremy Taylor and the Tampa Bay Rays. 11 out of 25. Got a nice Alec Baum rookie. And the autograph is a Ray. Luis Patino. Nice rookie auto for Jeremy. Nice. And Alec Baum for the Phillies. That goes to Nick. Last spot mojo. Nice rookie card. First box, next box. Next box. I don't know where Corey Seeger is going to end up. I don't know if the Dodgers, Dodgers probably make an offer. I don't know if it's going to end. Ooh, look at this. There's Joey Bart. Probably should be taking it. Probably will be taking every day catching duties now for the Giants. Now the Buster Posey has retired. So this could be one to hold on to. Dan with the Giants. We got Christian Pache for the rookie auto for the world champion Braves Douglas with the Braves 24 out of 25. Subrex. Right. It's going to be it is a Jake Fraley. Super Fractor. Nice. And that goes to Leonard and the Mariners. One of one out of fives and under train whistle Leonard. All aboard the Big Hit Express. Next box. Got another five boxes in the store, ladies and gentlemen. Go and get it. Jaspy'scasebrakes.com. Seven Longoria. And we've got a Red Sox. Ryan Brazier 25 out of 25. Orange Parallel for Josh Smith and the Bo Sox. Casey Meis rookie. Brian with the Tigers. And there's our autograph Christian Javier. EA with the Astros. He's pretty good. Some people say he's got some top of the rotation stuff. Nice auto EA. There's Gavin Lux Future Stars. Yeah, he might have to become a Future Star if Corey Seeger heads elsewhere. Next box. And we've got a Sixto Sanchez. 10 out of 10. I slow number here for the fish. Jeremy Taylor and Miami. Check out Miami starting rotation. They've they've got some big. We've got some big potential there too. And Loyote Tavares rookie auto for the Rangers. I read that too. That was just some G that was some like analysts just speculating though, just putting dots together. I don't know if that's actually been something that has actually been discussed though. I could connect the same dots. It's not actually something that's being discussed between those two teams miles. Yeah, absolutely. It's like a 10 minute break. We can we can fill it and break it plenty of time. One spot gets you three teams in that break too. Alright, fifth and final box so far so good Rangers auto going to Jeremy Taylor and let's see what this last one can be. Last box holds for us and a league leaders one out of five Shane Bieber for the tribe. Now two train whistles in this five box break.   Nice Chris Taylor could be on the move as well for the Dodgers and the autograph is Esteban Floriel for the Yankees. That's Frank with the Bronx Bombers and the Yankees will probably try to make some big moves in the offseason too and that is that my friends. Pretty nice five box break boys and girls two train whistles some nice auto some low numbered cards. Love the the orange parallels. Nice Jaspy orange that really pops. Another five boxes in the store. I'm Joe for Jaspy's case breaks.com. I'll see you next time for the next break. Bye bye.


I'm charging your heart. I'm in AK269 and I'm a gunner on a tank. I feel pretty special about being one of the most modernized brigades because we waited a long time to get these tanks and we just got them and now we're out here doing what we do and we're becoming the best. So, you know, I really enjoy it. I feel kind of special. As a gunner, making sure my soldiers are taken care of, the maintenance on the tank, making sure I hit them targets most of the time. I love learning new things, especially when it comes to my job. So, it's been an experience but it's been a good experience. So, I'm glad to be a part of that. I'm glad my crew can be a part of that and I'm glad we can be a part of that as a team.