Welcome to this second session where we will be focusing on the process of peer review. Before going into the session, I would just use the polling option in A-view to administer two survey questions. So, this survey question is related to the process of peer review in IIT Bombay X. So, in as you all know, in RCA01 and RCA02 of FDP 101X, we had used the process of peer review. Now, this is a very particularly in courses like this where there are huge number of participants. Peer review is a pedagogical tool to ensure that there is learning and assessment happening together and we have received lot of email queries which informed us that there were problem in understanding the question, there was problem of what do you say improper peer review etc. So, I am first going to pose a question to all remote centers now. I within your remote centers check how many participants in your RC had faced navigation issue in RCA01 and 02. So, by navigation issue what I mean is they were unable to understand how peer review is done within IIT Bombay X. So, where to go, what to write etc. The remote center coordinators just take a good quick survey within your remote center, check how many participants had faced this issue. So, there are four options, the first is more than 50 percent, second is between 25 and 50 percent, third is less than 10 percent and fourth is 10 to 20 percent. So, if you look into your review screen right now, you will see a poll that has come and the poll the question is how many participants in your RC had faced navigation issues in RCA01 and RCA02. So, take a quick count and answer the poll. The poll is visible in your review screen. So, remote center coordinators are requested to take a quick raise of hands and then so, the poll will be open for around one minute more. So, you will have to give an answer within another one minute. So, I see that around 50 remote centers have given responses. So, I will be now displaying the poll results. So, around 108 remote centers have answered till now, around 60 of them have responded that less than 10 percent participants faced issues in navigation, but there are also a few. So, around there are around 20, 22 RCs who say that there are 20 to 25 percentage of participants in their remote center faced issues and there are around 9 RCs where more than 50 percentage of the participants had faced this issue. Yeah. So, a larger percentage we see that around less than 10 percentage of participants in around 70, 80 RCs had this issue I will just do one more refresh. So, 139 remote centers have answered and within 139 remote centers. So, you will not be able to see the poll results, but it is visible over here right now it says that around 80 RCs there are around 80 RCs where less than 10 percentage of participants had faced this issue and there are around 29 RCs where the problem was between 10 to 25 percent. Another 14 of them we see that the problem was there for between 25 and more than 50 percentage for 14 RCs. So, the there are so what this survey gives us information is that there are navigation related issues within IT Bombay X peer assessment process. Now, let me administer the second poll. This second poll is regarding whether you received peer reviews which were not expected or let us say an improper peer review. So, remote center coordinators we will put up the poll right now. The question for poll is how many participants in your RC had faced issue of improper peer review. We have started the polling the options are first option less than 5 percent, second option 5 to 10 percent, third option 10 to 20 percent, fourth option 20 to 30 percent and final option more than 30 percent. So, if you look into your review screen the poll has come up this poll is available for 1 and a half minutes. You can start answering the poll how many participants in your RC had faced issue of improper peer review. Once again around 80 RCs have pulled so around a half 50 percentage of them there are they are saying that less than 5 percentage faced issues, but there is also around 10 RCs where they say that more than 30 percentage of the RC participants had faced issues of improper peer review. So, around 137 RCs have responded. So, I will just read out the results. So, around 56 RCs they have responded that less than 5 percentage of participants faced issue of improper peer review. Then there are also 36 RCs where 5 to 10 percentage of the participants had faced this issue. There are another 21 RCs where 10 to 20 percentage had faced this issue, 20 to 30 percentage of people had faced issues and there are 12 RCs where this issue was more than 30 percent. So, first thing that we do did with the survey is getting a quick feedback about both the navigation and review process that was conducted in RCA 01 and 02. This is because the upcoming session is closely connected to first the navigation aspect of peer review interface in IIT Bombay X and also about the actual activity of peer review. In this particular workshop, there will be lot of resource creation assignments, particularly the open education resource creation, which is very important and where we will look at peer review mechanism for finding out the best resource created by the participants. And it is important that as participants all of you are familiar with the process, the how of the process as well as you also understand why we are doing this peer review and why is it important that you give accurate peer reviews. So, I will now transfer the session to Dr. Sameer Sahasrabude who is joining us from RC 01-228 to further elaborate about the peer review process in IIT Bombay X. Hello and welcome to this second part of the morning session. I hope everybody is back to their seats and thanks to Jay Krishnan who has beautifully managed to bring all of you to the topic. This is the example of contextualizing your lecture also. So, for example, the next lecture is about the peer reviews and how to conduct peer reviews, the pedagogy of peer reviews, if that is the topic of the session which was already announced in the schedule. What he has done is that the polls which were done as an activity while people were settling down, some people were having the cup of their tea also carrying inside and all that. During that time he has managed to capture your attention to the topic which is supposed to be delivered next and that is I think one good takeaway for all of us of how you can place the activity and what should be the content of that activity so that our session or the lecture or the content whatever we are going to deliver next has a good base to start on. So, this is a very interesting thing and I wanted all of you to note this. Therefore, I am making a deliberate mention about this. So, coming to the topic which we are going to focus on and as Jay Krishnan has mentioned already that we are going to look at two aspects of it. One is because the navigation of IIT Bombay X is pretty new for many people. They have not tried this type of navigation. So, we have seen that there are issues about it and frankly speaking we are also experimenting with it because the audience is diverse. We have teachers from all parts of country of all disciplines and because we have such a huge number we are getting very rich feedback about every aspect of conducting this course. Not only about the conduct of the course, but also for the website developers like we want this button here and we want we do not want this color here and this kind of things are also very important and that is precisely the point of the navigation issue. One point you can definitely look at is and I would like to share my screen now. So, can you just share the desktop now? This is the website of Lyset where I am sitting right now a beautiful place and really overwhelming. I cannot show you the other side but it is all full of people who have gathered here to attend this session. What thing they have done is that apart from the participants who are something like 50 right? Yeah, 35. They have called others who may be interested in knowing about it. So, maybe they are our future participants or I do not know some of them are past participants of the course. So, this is a very nice thing to do and what I want other remote centers to take away from this is that irrespective of whether people are enrolled or not since this is happening in your college and you have invested in projecting it on screen and having a big room open for all this. Maybe it is a good idea to ask people and sit down and have a look at what is happening in good lectures like what Professor Shridhar or Professor Sana is going to speak in the afternoon. Could be a good point of knowledge for many others who are not doing the course but yes they can benefit from it. Okay, I digress but this is the website for the FDP 2 which has started on 14th and I am sure you can see some difference in the look and feel now and can you actually spot some difference now? I want you guys to put it up on chat and I will ask locally here if there is a there is a striking difference that you can see between the website of FDP 1 and FDP 2. So maybe locally you can answer me because I can hear you people on chat so this is how the page looked like for FDP 1 this is how it looks like for FDP 2. So can you look at and tell me what's one of the differences we can just give the mic or we will look at the chat if it has started already. We have some chat here. Yes, okay, colorful captions. Is this the answer of this RC? Colorful captions, you want to change it? Add to it. This is, look is better. It's Sushila Jhanshan Gauravath Valapur saying that the look is better. Yeah, people here also agree that it look is better. Can you be more specific? Header image, welcome to week one. The header image. Yeah, but it is written there also. The image. Go to this thing. We'll see welcome to week one here. No, the image which is included sir. The image. What's so different about that image? The feel what we get. What is that feel? Learning, learning. So it's like from black and white movies we hire color movies. So is that the only difference that we have colors now? What's the white? The format is different. The format is different. Okay, it is more focused, more catchy, color combination of the caption, more focused environment. Mentor-ment interactions are not included in the tab. Okay, they're going slightly haywire also. Content is structured. Okay, okay, so hold on. What I wanted to focus has come in some parts. But yeah, there was a feedback from a lot of people in our earlier courses also that the course looks very dry because it's all text everywhere and there is no break for your eyes and you have to keep reading all the time. The aesthetic part is good. The aesthetics, the design aesthetics. Yes, so the aesthetics is something which will add to the experience of the user. So if you have difference aesthetics, then the user will feel we'll get different experiences. Better the aesthetics, better the experience is what is proven. But it is also proven that unwanted aesthetics will take away user from whatever they have to learn. So that is the catch and we are trying to have that tightrope walk from now onwards because we never had any images and now we are introducing images. The challenge in front of us is that whether we will overdo it or we'll do it in a certain limit so that it is eye catching. Also, it means that we will have to be sure about how people will access it. So we are trying to fix that. So having the session of how to access is a part of that scheme that we introduce the entire navigation through a lecture so that people will also take notes about it and when they do it on their own probably they will do it better and that is one way of trying to plug what was given in the poll that so many RCs found that navigation was difficult. So let us see after this session when they do peer review next time it reduces to negligible number or not and that depends on how I deliver this lecture. Anyway, so let us start by going to the screen where we have this big one and we have the graded activities. Now before jumping into this activity screen I wanted to just touch based on one important thing. You all agree that we have a massive number here so it's a class of 5000 students and it's practically impossible to grade assignments physically by any number of instructors we put in and even if we are so many instructors but still it is not practical that we check each and every submission and that too when it is subjective. So if it is objective then we have computers to do the thing for us but when it is subjective like write a list of learning objectives then how will you do that? In that case this technique of peer evaluation or peer assessment is a huge bonus and it can be used very nicely. However, in our past experiences we found what you actually just gave the poll that some RCs found that 30 percent of the peer review was not done properly is the case which has actually reduced and I would like to note it here last time this number was almost 50 percent of participants felt that the peer review was not done properly. That was one reason that I introduced this topic in my last session also in the FDP one and I am happy that things have worked better this time that only couple of RCs have complained that the peer review was not up to the month. It actually points fingers to all of us at times and please take this sentence with a pinch of salt it is the interpretation which is actually creating the problem. So I see a sentence like I showed you a image and people interpreted it in different ways some people say it's adding aesthetics some people say it is break from the text based thing some people said it is more catchy and there could be some people will say it is too loud I don't want anything there it should be like a book which is only black and white and nothing else then I'll feel that it is academic content and I'll read it more seriously adding images and all makes it comics and I don't want to read comics and academic structure. So there can be views and views is what actually makes that peer assessment at the same time challenging as well as interesting challenging because if by unfortunate incident you get three people who tell you that adding images is taking away my attention then you will get zero marks in your assignment on the other hand if you find all three people in tune with adding the image to enhance the aesthetics and look and feel of the image or the screen then you'll get 100 or 100 and if you get mixed back then you'll be placed somewhere in between so this depends exactly on how people associate with this therefore what we have done is to provide you with a rubric rubric is something which is mirror to the overall percentage of things and we have given you some markers to identify if you want help on what is the score of this particular submission then you have to go through that rubric and place the appropriate thing there now this also requires your own subjective reasoning that if it is written that so we will go through that but then that is reduced to minimum because if the rubric is written well then you will not have such kind of problems so that was our motivation in doing this so let us go and see what happens here one important thing which definitely happens here is that you are actually in a double role now so a lot of movie goers and they constantly keep telling me why do you give examples of movies all the time but i can't help it being a filmmaker myself i i constantly go to that so i was talking double rules double role here is that on one hand you are submitting an assignment right so you are a student at that time on the other hand you are evaluating other assignments so you are a teacher at that time or you are instructor at that time so you have to toggle between now it has happened n number of times and i have met people telling me this that whenever i am looking at other submission i get ideas about how i should have written it or how i shouldn't have written it because i can see the gaps or the pluses there this actually is learning because whatever you write at that particular timeline if the exam was between 10 to 1 and whatever you wrote in that is what you could think about it at that point in time that's just a mechanism of assessment but what is learning learning is where you know various aspects of doing the same thing and if you see we have chosen questions so carefully that it will have multiple correct answers so there is not one correct answer if it was then we could have just done an auto grading of that because it has multiple correct answers this particular methodology gives a scope of getting all those possible correct answers at one point you can at least see three of them and there could be all correct answers or there could be a mix back like i said earlier but this aspect has to be thought at a slightly bird's eye view level so you have to go back and assess the procedure also at times we have to remember that okay at if i can read this answer and then i compare that with my answer then i realize okay maybe my reviewer is going to cut my marks on this because i have not learned that so that that realization is so nice because without actually receiving your review you already know how much marks you are going to get it may happen that they will not coincide with what you actually get and that's where that more than 30 people were not happy with it while a area will come up but that is what we are trying to fix and one way of doing that is to understand the navigation as well as increasing the level of interpreting the rubric to the highest possible level so these two mechanisms will help you in getting a step forward which is what we are trying to do with this session okay so let us go to the resource creation assignment one i like this graphic very much uh my team has made it so i don't have to really say it so what we have going to do here is that in not more than 250 words explain how the use of ict brings the changes in your own classrooms now all of us now are aware of what ict interventions can be used in the classrooms you may have tried one or more doesn't matter what we want to know is that what were the changes which have happened in your class and that has to be captured in 250 words now if that is the idea the chances are that people may go haywire and keep writing something which is not i may write a essay on something which is completely not related to what others want to read so in order to do that what we have done is we have given a criteria and we have also given examples of how you can actually create your example uh to suit that so for example uh criteria is evidence of usage check whether the answer has some evidence of usage of ict in his or her own classroom and the second is reflection of usage so when the ict is used what has happened so these two has to be definitely mentioned in that answer that is everybody will agree with that right but within giving that answer there could be levels of different people trying different things so we have given the range also here so the first is no evidence has been provided in the answer or there are one or two pieces of evidence and the answer contains three or more evidence so this rubric levels are on the occurrence of the particular ict or the examples used by the teacher so if the occurrence is zero or one or two and three you can say that okay i have used a b c d in my classroom obviously you know that it has been to be given at exemplary level because he or she has used more than three uh things in this particular thing similarly how is the reflection captured so i used a wordpress site or i used moodle based something in the class is not good enough has it resulted in something i have to capture that and it should not be at a level that okay it was very nice so it was very nice is absolutely no it is in this category the answer does not describe any reflection about the actual use of ict but if the teacher has tried to reflect the use of ict and fewer details are provided for example how tools like powerpoint and moodle are integrated in the classroom but fails to provide information like what worked what did not work so if that results are not shared it is of no use to the third person who is trying to do that so suppose there is somebody in the audience right now who is not participating and they hear from you this word called moodle so i use moodle in my class or i use powerpoint animation in my class and they will ask okay then what happened you will say it was great children loved it but what is that loved it because uh if you have no evidence of what actually was the result it is going to have no impact on the listener so the teacher has to provide rich details about the usage of ict these are her observations on why this work why didn't work for example if i have to write such a case i'll say that i had used animation 3d animation in my class where i was teaching subject on thermodynamics and the particular machine structure was not visible by naked eyes so we had a cross-section done in animation and we showed internal structure of how the vapors were going and everything else that was interesting and that is what students have reported if i write this much then it makes sense that you have understood how it has worked and you have given a example now people who are listening will take away that example and say that okay so in cases where the students cannot see a particular machine from inside so i'm talking about a furnace for example mechanical engineering people will relate to it the furnace at 2000 degrees centigrade uh where the uh molten mass will disintegrate into multiple things now i cannot show that by putting even a camera inside where it will melt first of all now how do i do that but animation is possible of that now if i use animation there and then report that students now realized that how it happens without because they cannot see it inside was reported by some students if that is the comment i write then probably the message is gone through and they know what is to be done for them so we will also have one more checkpoint whether student feedback like that's what i was writing and saying just now that students reported that okay now we can think of options which we could not otherwise see in the so the textbook was giving two images of what happened before and after but they didn't know what happened in between and that is shown in that animation so such kind of things if they are present then that is a good answer if it is absent then that is not a very good example right now let us start doing this activity from the website itself i hope i i tried it earlier now i am i am a fresh student now okay so in a 250 words explain how ict is bringing in changes within your teaching and learning so let me gather some examples from people locally and i would like to ask others also to participate so any any intervention you tried in the class unanimously you can come up to something what is that any intervention yeah quick we have to be quick other remote centers just wait because i am going to ask you something okay um actually i've used different types of icd related which one ict you can comment on i've used moodle moodle okay so we are here right yeah so evidence of usage as some evidence of usage okay so moodle is used okay now and any other thing um yeah within moodle within moodle what was the model i've used quizzes okay i've used videos okay video sharing then ppt's documents assessment and assessment yeah so we say we we have used moodle yeah and we have used four features of moodle for example i don't want to name them right now that's okay now the second question is two remote centers where i'm sure there are a lot of people who have used moodle animated flow chart people are saying good valchin college solapur thank you so somebody used animated flow chart but i am sure a lot of people use moodle anyway so let us go by the moodle theory first of all if you have used any features of moodle what were the visible effects on the student's participation because you used these features of moodle so please write a sentence about what was the effect of a particular usage of moodle feature on the students so take a minute and write that okay i hope you all can see this what was the effect on of this selected feature in the moodle on the students okay so write one sentence about it for you can write the feature and the effect so that both things should come in that one sentence i'm using google classroom digital classroom students interested in only mcq is what ratnagar is saying elimination of duplicate vertex is what darwad is saying okay in the quiz immediate marks were seen as well as correct answers could be seen after the quiz okay is this a moodle feature okay i'm sorry i'm kind of illiterate in moodle these students were able to see results immediately yes so video sharing helps students accessing the content okay so look at the look at this sentence formation now you have the reason and you have the effect both in the same thing now i want you guys to slightly modify your suggestions by quantifying it so did this happen to all the students did it happen to some students did it happen to negligible number of students just try to be more specific say most of them many of them few of them some of them whatever let's see if we can sound better okay somebody's saying assignment submission is easy that's slightly vague so assignment submission of moodle is easy right easy is a slightly vague answer because it will not give you what is the difficult part in that then okay you can just attach it and send it also but you actually have some other reason in your mind but the way it has been framed is becoming vague so maybe you can think over it and write a better sentence okay so i have some interesting things coming up yes we can quantify saying that 67 percent have scored or through moodle conducted flip classroom and collected student reflections which can be conducted easily using moodle okay 90 percent of took them the quiz okay so this is participation level so north goa says that 90 percent of people took the quiz with itself with the achievement because otherwise they were not taking it very seriously but because it was on moodle and they knew that online assessment is happening and their marks will not get things so 90 percent people attempted it right uh collecting course exit survey and its analytics is convenient in moodle okay convenient okay so uh why what was the cumbersome way of doing it getting a hard copy circulated or emailing people or what was the other way without moodle how will you get the survey google farms is also you have google farms okay so why google farms are not very good it is fine actually they are also good right okay uh using discussion forum students can do okay active learning strategy uh somebody from aurangrad it is so fast that i can't read it active learning strategy implementation and effective discussion forum uh students can see justification okay so i think we are coming there let me go back to the website now because that is where we have to uh see the next stage so i am i'm not going to actually copy any one of them but just look at the uh the guidelines given and now compare your sentences with these guidelines and you'll get the answer yourself you provide clear examples of how you have used ict in your teaching learning okay so you started a feedback form on moodle uh is the feature what you're saying you started it at the end of the course middle of the course you conducted various uh levels of forms is what you can elaborate on writing has your reflection on the changes that you have observed now that is where that quantification could have helped that many students are participating as compared to less people participating earlier is a reflection on what changes have occurred or they are faster in reflecting they are uh earlier they were not responding maybe months together now we can put a deadline we can have a time affair we can track them so this has helped me in getting something and the third is you provide minimum of one instance of student reaction or student feedback in the use of ict that is actually the evidence part of it so how you can actually convey to people that okay because one student has told me this i am very confident in telling this so such kind of thing is also required and then that will make it 250 words right so be elaborate so right now i am only going to say uh 250 words and uh i am just going ahead because i am not going to spend time on that you guys have answered already enough but uh yes let us go ahead because we have to check the second part of it now this is this one uh was mainly to know how to submit a response and how to think to come to that level it is your response part right so what you have to write and the second part is how to assess other responses now i think enough has been spoken about how you have to write your response and everybody has understood i will just go to the chat once because there are many people who were trying to write something okay there are too many things already google castle with a good start i use ict uh in moodle quiz discussion forum is provided but the evidence okay feedback option using pickers to check whether the students have understood the concept is not very effective okay content sharing with learners is the half answer okay i don't know what they have to say more than that there is a question here let me see everything what is blinking it is that uh what actually have to with rca1 10 10 am it's a old question i'll not and ignore that okay i'll go ahead in report and grades we can find the students how many have attempted or not and what is the grade so we can actually reports help us in in checking hours is there are many things but as i am trying to tell you if it does not have these three uh points then it is very likely that you will not be getting very good review so please ensure all these three things are present actually treated just like you are prompted to make a password of a website if you make something they'll say or not strong enough then they'll say okay add a capital letter okay then add a alphabet or a special letter or similarly we are giving you instructions okay have the name clearly mentioned have the evidence clearly thing written and have some anecdotal evidence of some student telling you something if three things are included most likely you are through with it okay now are you through also with assessing others because if you are not good at that we will give you marks on that also if you have not done the assessment properly for others we are going to tell you that now how do we do that okay so this is the submission example and now now is the time for you to reflect so everybody look at the monitors i find like i'm running a kbc here but so look at the monitors example solution submission number one ict provides lot of flexibility i'll just increase the font size is it visible everywhere i hope so now i can't increase more than that ict provides a lot of flexibility in teaching learning it is good to use ict in the class as it will help students a great deal students are more interested in the use of ict but have only a short attention span this will cause problems but still if teachers uses ict well then it is good for students now remember the three pointers which we had mentioned that it should have a b and c remembering that let us try and grade the answer on whether it is poor fair or exemplary i want the responses to be sent to me on chat reading this sentence and tell me whether this particular submission can be treated as poor fair or exemplary rc coordinators can take a poll locally and give one answer from your rc right what we can do here also is the same thing what is it it's poor okay i i hate this site every rc is writing poor there so for me it is looking very bad that wal chan institute of technology solar poor poor that is very bad okay so bad joke whereas so they were very smart they wrote zero points yeah so let us see if we give it poor secondly let us also see whether the answer provides rich reflection on teachers usage of ict in the classroom is there some reflection does it describe does not describe any reflection it has tried to show some reflections and it has provided rich details now out of the three what would be the choice now please mention in the answer you can write two and poor or two and fair and two and exemplary because i will get confused between the first question and the second question so now make it the answer should be two and then whatever answer you want to have let me see what's coming up too poor oh it's like too bad too poor okay too fair okay somebody's saying fair for this uh there are poor more poor somebody's writing only two also so fast in typing that they just enter okay so a lot of poor's actually what what is that our rc says here locally is it fair as he as the teacher tries to reflect on use of ict however there are fewer details provided in the answer are there few details too many details or no details louder how many people feel few details how many people feel no details all others feel too many details you have to have some answer you can't say you can't be on the banks of much of my ebony or mopini see have to give someone i think poor are more should i click on poor okay let's go ahead okay rc's wait stop on the chat look at the third question now check whether there are quotes or instances of some student feedback in that answer absent present all present are saying absent okay all present in front of me are saying absent okay so let me see what rc's are also saying absent absent absent oh people are saying three absent good okay so we have absent all over the place great so let us see here when i press compare i will be told whether i have assessed things properly or not so this is actually not the writer's test this is my test and i'm doing on behalf of all of you so if i fail you all fail let me see so this was clear because the color was green if we had clicked on fair by any chance in any one of them then it would have been different and i did a mistake of not doing it otherwise you would have seen it but i'll do that mistake now so that you see how the system will tell you if you are wrong let us do that now i've been uh most obedient student here so that is why we are not getting exact okay so the part two of the question uh ict has proven so this is the response now let us read the response ict has proven to be a great game changer for teachers like me now this sentence can be uh interpreted in any which way and if only this sentence is present then immediately you have to click on pure right but the person has written something more evidence of uses usage is i extensively use powerpoint pdf documents interactive simulations and facebook page not only the teacher has mentioned what has been used but for what it has been applied is also mentioned here which is important to note right so powerpoint to present slides in the classroom and pdf documents to share resources important points uh so also note pdf documents is to share information they are not doc doc files because they can be tampered so pdf is something you can only share with people so some very critical points but you have to remember that student feedback student enjoy these resources and they are very excited one student had explicitly written on facebook post that the simulation helped me clarifying the concept that he learned they are widely shared by his friend and other colleges reflection thus ict has increased the access and efficiency of the teacher learning process in the class however i find following drawbacks and then the person had listed something of with use of social media we have to be extra careful about data privacy so somebody's assignment you have posted on facebook without consent that person may sue you for that and you have to face the music but yeah barring that it is supposed to be very good but this is important student seem to be more inclined to social media gratification so teacher giving phi on phi is not very important having five likes on facebook is more important so that is how things are and that teachers are understanding that is why they have reflected here so let us see how much will you give the score to this submission is it poor fair or exemplary exemplary why because it is very long so okay let me see what the remote centers are saying exemplary yeah i just modify my question why exemplary i just modified my question remote centers and let us hear it on the microphone so the evidence is there as well as reflections also here mentioned the reflections also evidence feedback from students and reflection everything is there in that they have written reflections also yes that is one reason why we should be exemplary and feedback students feedback students feedback also is given and evidence of using ict yeah right so whatever was used also is explained so these three criteria match therefore we have to do exemplary is one definite answer right all questions are covered yes exemplary because examples and evidence is there yes all the requirements are fulfilled three evidences with reflections yes so now look at it the person answering the remote centers answering three evidences with reflections is said by shirpur durai now they are quantifying the quality of the answer they are saying because there are not only one in evidence there are three evidences of reflection which is important right so if you can give 20 also but then we have put a limit of 250 words so remember that and do that let us go and this time i'm not going to listen to anybody and i'm making it poor so this is how it happens so somebody writes a beautiful answer and gets a poor tag on that so what happens therefore what we have new mechanism actually will tell you if your answer is not matching with the actual rubric then how it will show up let us see that okay determine whether the answer provides rich reflection on the thesis usage of ict the first question or the about some evidence of usage of ict by the teacher in their own class so evidence was already poor that is what we are determining and then whether the answer provides rich reflection let us say it has tried to reflect on the usage of ict and see what happens i have been like conjuice reviewer so i will not give full marks to anybody i'll say fair okay and let's see what happens and check whether there are any quotes and i say they are present okay let us see now with these settings and you all know what is the answer actually but you know that samir is a conjuice reviewer and he has done something hanky-panky here so what will happen is that hanky-panky will no more be accepted because it will not turn green it will show me a orange color which means that your assessment differs from the instructor's assessment in the response therefore review the response again and consider why the instructor may have assisted differently so you have to go back and read the answer once again and find out your own mistakes what you have been doing there now this will enable the point of filtration which was happening on wrong reviews getting each other and we are trying to see how many people falter in this stage itself we are going to keep a record on how many people have done mistakes here because then we can actually slot those as bad reviewers and keep them separately and not mix up with the entire crowd which are doing a religious review of things and not like conjuice reviews like samir so we will find out those people now selected options differ in this particular point is also specified here so not only the entire review it's a goal answer then a person will also get confused what is missing in my thing so selected options differ here so okay i think i'll be fair now and even here so i'll make it exemplary now because i realize but this option is correct and that is reflected as green so you can go ahead now let me see it is still not getting me because this is exemplarily written a piece of review submission and because i've been clicking on fare it is not allowing me to go ahead similarly here because i changed it to exemplary it has allowed me to and made it green now this was already green and because i have changed it to exemplary it will get me to the next level i'll try to play more mischief and make it poor now and see what happens again still it will not allow me so this is how the software has been built and the rubric has been built now there is no need to write down these options because this question is going to change the examples are going to change the rubric is going to change so you will not have any chance to copy by the way so jai krishnaan is making a strong note of these things and we have we are going to come up with a new example with new text in that so that you have to apply your mind once again and see for yourself okay so now let me see compare and yes so learner learn to assess responses are done properly now and you are at the complete stage and when you actually complete these two stages you will get a chance to assess the peers and similarly the peers will get chance to assess your submissions and that's how the system works so unless and until you do it right you are not going to go to the actual assessment that is what one more filter we have added and this is how this entire thing works I hope we are clear about how things are going up here so let us take questions on this now because we just finished the part which I wanted to share with you let us go to Gitanjali institute and start interaction Gitanjali institute please ask me a question actually I have submitted RCA2 in the first two FDP programs sir some of the piece has reviewed my RCA2 sir there has given only one out of eight points sir okay then I communicated with my mentor Rajini madam sir madam has once again uh paired my RCA2 to work sir she has given six out of eight points sir okay are you happy now then how to rectify the progress sir actually I have done all the work sir my mentor has given six out of eight points but the person who reviewed my RCA2 they has given only one out of eight points sir right I got this now so how to rectify I'm sure Jay Krishnan is listening to this and making note of it you are representing many such people who had the same problem I think somebody here had the same issue yes no yes sir Rajini madam has already mailed to IIT Bombay also sir regarding this issue we have given feedback also I would sympathize with us because there are 5000 people mailing us continuously and we have a different subject line for every 5000 mails we get and it's a huge task by the way to to sort them out and actually see what's lying beneath and this effort is one of them so yeah we we take your feedback and we'll come back on this if you have mailed be rest assured that we will take some action on this point definitely because of this score has reduced sir score yes because of that the score has reduced is actually of course I have promoted to second FDP sir there is no problem regarding promotion I have got a 75 percent score in the first FDP you could have got 80 percent or yes sir but I did the work sir yes I did the work there is no result regarding that sir right and also because we had selected some top performers in first FDP people are now really having a competition here that okay but it is very good actually I mentioned it with important things I have some message coming up yes so Jay Krishnan is waiting there to answer this kind of question so let me see if there is anything else in the other questions and then I'll pass on the mic to Jay Krishnan at IIT Bombay let me just go over to Symbiosis and let me ask them the question or Symbiosis go ahead if you have some other question about the peer activity what I explained just now yeah sir there may be many people among us who may not be knowing about ICT tools hello yeah yeah I didn't get the first part of the question who may not be knowing the ICT tools I could hear yeah there may be many participants who may not be knowing about the ICT tools they may pursue that use of model in the classroom they may interpret the wrong peer review ah right right okay so there could be a situation where the matching and so if your review goes to somebody who doesn't know that model is a valid ICT tool then what happens is that the question yes sir same question yeah this this is precisely which can happen and it has happened and that is the reason actually we expect it not to happen frequently now because of two reasons one is because this is fdp2 so by this time people will at least have and if they are passed fdp1 probably they will be definitely knowing about what is this tool and which is not a tool and other things plus we don't have just one reviewer assigned to you there will be three reviews so if in case this thing happens with one of the reviewers then there is a chance but yeah we will so we have mechanism for that that's how we can actually counterbalance it let us go to icircm and see if they have any other question and then I think I'll pass on to Jay Krishnan and yeah sir my question is how to write or how to student feedback in rca01 how to write or how to feedback in rca01 okay okay so how to enter it into okay okay fine so yes all to jk because Jay Krishnan because he is going to speak about two points one is the policy matters about what happens in case where you got lower marks because of bad reviews and second what happens with the entering of data not able to log in and other stuff so I am just going to stop interaction here and let us take the question here and then I'll transfer the floor to IIT Bombay sir in posting the response to rca01 whether we have to provide any link or like that modal link or wordpress link in the particular response or just we can type the sentences alone that's sufficient okay so Jay Krishnan at IIT Bombay can take back the floor and answer all the questions which have been asked to you directly a couple of things were related to the UI part which I have tried to answer and others which are pertaining to policy you please take back the floor so can you take back the floor from here yeah so thank you Dr. Sameer there were two queries that came out from the remote centers regarding peer review the first was regarding what is the mechanism to handle improper peer review so in the cases where somebody has done very well but the peer has not reviewed that person well and the second one is how to provide answers or how to keen answers for rca01 so let me give you a standard policy that will be applying in this particular fdp we understand that resource creation activities are crucial and are also instrumental in identifying top performers so we will be thinking of so as a policy we will the course instructors will be taking a call on the peer review process and we may incorporate a mechanism of penalty so which means that if somebody has done a poor peer review then that poor reviewer it is visible to us so that peer reviewer will the reviewer will have will introduce a thing known as penalty points and if it crosses let us say threshold of some will decide a threshold so there are three resource creation activities and based on the grades that is their overall grade we will look at giving penalty point for each criteria so how this is going to be implemented we still be having the mentor mentee cohorts so at any point if the mentees feel that they have been given wrong reviews or incorrect reviews then please bring them to the notice of the mentor so mentor or the associate faculties who have taken this particular course in the previous offering will now review your submission and based on that they will put up one score mentors review score so the mentors will be consolidating all these scores and sending a peer review report to IIT Bombay so we will be having a mechanism to do this so we will be collecting this through a survey from the mentors and based on the mentor's feedback we will be looking at cases where there has been an improper peer review and we will be looking at penalty points for the reviewer who has done this now there is also a case where the review is proper but somebody has complained that the peer review is not correct so here also the mentors review of the scores we will be looking at the mentor will be given specific instruction to look at the validity or the genuineness of the review and based on that provide as the feedback so we will be having penalty points for both improper review or even improper complaints so these so this it is why the mentor-mentee interactions are even more crucial in this particular FDP where there is more focus on resource creation activities the entire open education resource the flip classroom activity creation everything is having a crucial linkage to peer review process so as a policy we will be investigating mechanisms of introducing penalty points for poor review now regarding entering into RCA01 so in this particular FDP the first question is all about how you have used the three technologies that we discussed in FDP 101x in the previous month so you can note down mechanisms through which you have done it and for the student feedback you need not what you say you need not write very long explanations but suppose you had a survey you have conducted a survey and let's say the students provided feedback on to that all you can do is you can write two lines saying that I had administered a survey and based on which I got the following in which let's say more than 60 percentage of the students found it useful so these kind of summary of the survey can be provided as one way in which the student feedback is there or if there is a very specific student feedback that you want to specifically note down let's say somebody said one of the students said I got interested on seeing this particular model I went and explored and I created a model server on my own so these are expressions where students are showing interest and taking the ownership of use of technology on their own so these kind of experiences can also be shared as answer so you need not give what you say your wordpress link or other things the first RCA is a descriptive explanation so it is like essay question and we have said that not more than 250 words because the reviewer has to read through everything and provide you the feedback so be very crisp and ensure that you have looked at the review criteria and then provided the answer so that is the way in which you should be going ahead so please do not worry I hope all of you have got the message so all the associate faculty who are there just like what you did in RCA 01 and 02 in the previous FTP in this particular FTP you can consolidate all the peer review grievances and share it with IIT Bombay core stream so that we will be understanding what the how the variances in peer review and take appropriate actions from our end as course instructors will be discussing this in the subsequent days and we will be putting up the policy decision on the course info page also so we will what we will do now is we will just break for lunch right now please do not worry once you come back we will I will again do the same I will repeat this policy once again and then we will move towards the next session where Professor Sahana Murthy would be discussing about moving from 20th century to 21st century teaching learning process so we will break for lunch right now thank you