So, welcome to this second lecture in the series of lectures on flip classroom. So, today Professor Bhaskaran will be sharing his experience about flip classroom method and also about two tools that he has he and Professor Kameshwari from computer science department have developed to facilitate flip classroom model. So, these are one is Bodhi tree. So, this is a software that allows you to create your own lectures which help you to assess the students as you as they progress watching your videos and safe is a platform or is a method is a software tool that helps you to conduct exams. So, this is something which is unique because he has been involved in developing it and simultaneously been deploying it in his teaching. So, this is I think journey for four and half years for him and almost it is a six years five year work together on development of the students. So, I hand over to Professor Bhaskaran. So, since this is a lecture on flip classroom seems like a oxymoron because in flip classroom you never you do not have lectures. So, we will try to keep it interactive and also I have a demo planned in which you will be able to do something hands on. So, you will get a feel for what we have used. Thank you for inviting me to this session and thank you for the introduction also. As Professor Sachin said today I will be talking about two of our tools Bodhi tree and safe both of which have been developed completely in house by our students various student projects M tech students B tech students R and D projects and so on. Bodhi tree and safe have a joint existence they also have an independent existence independent of one another. You will know what I mean by that once we get to learn about them and as you mentioned all this is joint work with Kameshwari and a significant part of Bodhi tree another faculty Varsha Abte another colleague of ours she has also been involved that has been a later addendum to Bodhi tree and the number of students who have worked on this is too many to fit in here. We have been very fortunate in terms of getting very committed students and they are so committed that even after joining job even now there are many students who contribute to this. So, it has been very encouraging that way. So, this is a intro slide if you look at you know how technology has affected various parts of our lives you will see that we think back it has affected all aspects of our life. So, this slide shows you know transportation pre industrialization in early days of industrialization and today it is completely changed as you can imagine. Similarly, communication technology pre industrialization and in the early industrialization days and today is supposed to be the information age although it is fast becoming misinformation age. So, that is how technology has affected how we communicate. However, if you look at technology in teaching it is pretty much remains the same. We had Gurukul in our pre industrialization in our Indian mythology Guru teaching a bunch of students similarly it is nothing much has changed throughout the world actually in terms of teaching use of technology in teaching. In fact, the last slide there shows how things have worsened because of technology you probably cannot see but if you zoom in lot of people will be browsing on their phone and maybe open laptops and so on. So, technology is actually a hindrance to teaching in many ways. There are many colleges which completely ban cell phones and laptops in classrooms many teachers do not like these kind of things coming into their classroom because it is a distraction it comes in the way of learning. Similarly, exam technology has not also changed it is pretty much remained the same paper pen. So, in this context we have looked at how technology cannot solve all problems but technology can at least help in addressing some of the teaching problems especially in terms of scale which we all face in our classrooms today. Our department core course class sizes have become 140 and probably with the additional expected increase in numbers it might touch 150, 160 beyond a point it really does not matter. I have stopped trying to remember my students names at one point I used to try until about class size of 90 I had reasonable success beyond that I just gave up. So, I will talk about Bodhi tree at a high level which is a multimedia book platform it is a interactive multimedia book and it is a platform constructed to handle flip classes specifically. And I will talk about our experience and some evaluation also of the system. SAVE stands for smart authenticated fast exams which is the use of smartphone app for conducting quizzes and exams. So, that also I will talk about little bit about the design and design and evaluation. I am going to rush through many of these partly because you all already know partly because I want to get to the demo part of it quickly. So, our starting point was this if you look at academia the education system the stakeholders are the various academic institutions the trainers and then the students who get trained and then the industry which is supposed to use the trained people. Each of these parties face certain set of difficulties if you look at it students face inadequate opportunity for quality learning lot of places insist on road learning and subsequently they have trouble in terms of placement. In academia the structure is poor in terms of what they teach is not what is tested and there are also this mismatch in terms of teaching load versus expectations of what is expected of them. And finally you know industry faces lack of sufficiently trained students who they can hire. So, in the context of this and also in the context of our own experience where we have large class sizes and poor attendance we started looking at how technology can help. And Bodhi tree and safe as a result of this our vision is that Bodhi tree is a platform where we have interactive multimedia books which will be the content will be created by so called star teachers. And this will be used for flip classroom conducting flip classrooms in various institutions including IITs and various other institutions also. This is similar to if you are familiar with the exceed effort in school curriculum they standardize the teaching material. So, that there is lesser variability across teaching quality. So, this is a effort similar to that and with this hopefully we will address the problems faced by all three parties in the system. And we envisioned safe to be a mechanism to conduct exams in a scalable fashion easy fashion using just students smartphones. So, these are the key technologies Bodhi tree itself has two parts one is the interactive multimedia book itself and interface for the instructor to manage a flipped classroom using this interactive multimedia book. So, flip classroom model I think you are all familiar with it is basically one where the role of what happens inside a classroom and what happens outside gets interchanged. So, Bodhi tree is designed to conduct flip classes by organizing material in just like a regular textbook, but in terms of videos divided into various chapters and sections and importantly the videos have embedded questions. So, let me show you an example now I will switch over to the browser. So, I will actually show you the course which I ran the last semester I taught this. So, this was the computer network course and I will actually show you the student view first and this is just like a textbook divided into various chapters and sections within those and let me show one example let us say reliable data transfer this is a section within a chapter. So, it has multiple sub videos we try to keep the video length short and also divided into various titles at a slide level granularity. So, that students face it find it easy to go through the material and importantly. So, let me play the video now you will see something happening. So, this is what happens as the video plays there are questions which are popped this is very similar to an interactive lecture. In fact, it is much better than an interactive lecture because even in an interactive lecture however good the instructor is if the class size is large there will hardly be one or two people who get to participate. But here everybody gets to answer without having to feel shy they get to answer the question which is posed we have a mix of both subjective questions as well as objective questions. Objective questions we keep track of how many have been attempted how many they got it right and so on. Subjective questions are just for them to pause and think. So, in this way the video is interactive as you can see in this outline here on the left you know we try to keep as many questions as possible. So, almost like one question per minute or sometimes even more than that sometimes we have numeric problems also where the students as they watch these videos only when they pause and think try to solve something they realize that maybe there is a gap in their understanding. So, they have to go back in the video and relook at it and then try to answer of course it is possible to you know cheat by answering something and going on. But this is we do not enforce it the system does not enforce that you answer it, but that is the intention the student answers it before going forward. So, these are the videos which are there and Bodhi tree system also has you know discussion forum chatting with others and so I will also show you the tracking of progress with respect to others. So, I will show you here for this course for example there is a score card we maintain and this is so we have a bunch of questions in video and out of video out of video questions are like questions at the end of a chapter in a regular textbook and we track which student has attempted how many and what the score they have gotten by default it is kept open because it is not related to marks really. So, sort of a friendly competition builds and if a student does not want to show this here she can hide it from others view, but instructor gets to see everybody's progress and I do see as an instructor you know I once in a while check as to have they really watch the video have they attempted these questions. So, they have not I ask them as to why they have not and so on. And this material can be accessed via smart phone or a browser okay and so let me show you the flipped classroom interface what I have shown you is the interactive multimedia book view from the perspective of a student from the perspective of the instructor. So, if I go to the instructor view so I can announce a schedule of which of these videos should be watched when okay. This is like similar to announcing some schedule on Moodle this is not enforced and there are many other things like discussion forum if you can see in the discussion forum there will be lot of discussion related to different topics and there is a email archive and so on. So, this is a complete platform for managing flipped classroom by giving material for students to watch during the class and what I do in class is solve these problems that is the way I have structured my course before before it is a flipped classroom yes. So, they are expected to watch it before and during the class what I do is so for every topic so for example here if I go here I will again I will go to the student view for example yes that is where safe also comes in system tracks whether they have answered the questions okay. Now I do not know whether they have just done guesswork whether they have really understood those cannot be gauged from this. So, that is why we have this safe platform for conducting quizzes that I will come to. So, that is where we felt the need you know so if I assign this watching material or reading material it turned out that more than half the students just do not watch before coming and what I do in class is solve further problems. So, this is the philosophy behind flipped classroom right. So, you solve problems in the classroom in the presence of the teacher who knows how to solve those problems and as you solve problems you have the student gets lot of doubts which he or she clarifies and there is a discussion around what questions arise during the in class session and what we found in the initial few semesters of experience is that if you ask the students to watch videos there is a significant percentage of them who do not watch because they just want to do what is minimum possible. Yeah, the question was how are these videos created does the platform have support for creating videos. The platform has support for once you have a MP4 you can upload the MP4 video format and annotate it you can insert those interactive questions in between those can be inserted at any point by the teacher and you can give video markers as I showed in that example. So, here for example so these all these marks here whether they are quizzes or just marker without quizzes those can be edited by the instructor later on. We use the Camtasia software mostly we have also done many just using open source software like Kazam. This is the problem solving session again there is a bunch of numerics and discussion and so on which the students answer in class. So, this is also interactive. So, they can do that they can choose to do it anytime really. In fact, the entire content of the course I usually give it in the beginning of the semester itself. If you want to speed ahead of the rest of the class you can do it. If you want to go in pace you can do it. Whether they have opened the video once we do not track that we just track how many of those in video questions they have answered. It will stop by default it will stop there are ways to cheat it which we do not prevent. For example, I mean there are plugins for any browser which using which you can download that MP4 and watch on some other player which does not have those interactive questions popping up. We do not do anything to prevent such things alright. So, this site is open for anyone and we have a bunch of video material on it. So, anybody can sign up and look at it. Currently we have I mean computer science courses we have computer networks computer architecture. There is a course on Unix and networks Unix and scripting and there is a course on wireless networks which I am actually currently using. So, there are some differences between CDP and NPTEL similar platforms. So, in terms of we view this more like a multimedia book like I said interactive multimedia book. Interactivity is something key and you know the fact that we say that it is a book also means that creating the material takes much more effort than typical NPTEL videos. At least that is the way we have created the content is this effort is more in line with writing a book. So, this started to develop around the same time as all these book platforms like edX, Coursera and so on. There are many similarities, but our focus has been on this flip classroom model whereas the MOOCs have gone in a different way they want open massive enrollment and all that. So, we are focused on the flip classroom model. The other differences also are that we have over a period of time added support for labs. So, there is a portion of Bodhi tree where students can in a typical lab what happens you do some experiment write a lab report. So, we have interface for those things also. And we importantly also have the module. So, this part is relevant mainly for programming. So, we have a module where programs can get auto evaluated. So, this has been used two times so far for CS101. This time also it is being used. This is primarily for programming and we have used it regularly for conducting programming test for project staff hiring also. Project staff hiring as well as MTech research positions. Any programming test we want to conduct we use the platform and I take this opportunity to invite any of you also who want to use it similarly to use the same thing. So, a few things about the case studies. I have mentioned all this already what happens before the class R during the class R. So, the weekly plan goes something like this. We have this three one hour slots and our batch size is roughly about 120 to 140 for core courses. So, what we do is assign about two hours of video watching time one and a half to two hours of raw video. It actually takes much more than that in order to absorb it. So, the expected amount of time is about 4 to 5 hours they are expected to spend outside the classroom and each of these three groups is mandated to attend one of the three sessions in a week. So, you know for a normal six credit course the so called contact hours is supposed to be rather the time spent per week is supposed to be about 6 hours. So, this is how it gets divided in our case and the advantage so the in class session I call it a tutorial session really because that is what happens problem solving happens. There is some amount of lecturing also which happens in the tutorial session for concepts which may have been difficult to grasp just watching the video that happens. And the main advantage is that it is conducted in very small groups much smaller than typical core class sizes. So, I have more or less stopped lecturing for the last three years all my in class sessions I just go around and look at how students are solving the given problems. So, one other thing is highlighted here which is in order to check whether they have really processed and understood the material given assigned to them before the class. We started feeling this need to conduct a quiz and pedagogically also it is known that if you conduct frequent quizzes then it keeps the students on their toes their learning level retention level goes up. So, we felt this need to conduct quizzes and if you conduct a quiz unless you assign a mark nobody is going to take it seriously. So, we assigned grade for it in fact in the early days where when only both entry existed and safe did not exist we used to do this just by paper printouts and so on of course that was laborious. So, this leads to a requirement of being able to conduct these quizzes in a easy fashion even for you know 30 students managing the logistics of printing and distributing and collecting it too much overhead for every class ok. So, the end result of all this use of Bori tree turns out to be what we call as PFC learning P for personalized it is like everybody gets to have an instructor for themselves they can cause the instructor there is no fear of embarrassment in answering the questions and so on it is flexible flexibility is something which the students like a lot they can watch the videos at any time or students are all their brain is active mostly at around 1 a.m. or 2 a.m. So, that is when they watch the videos they all watch it multiple times which is a very useful thing they have marathon video watching session before the exams. So, this is all based on feedback from students and the fact that we have periodic quizzes discourages them from postponing everything to the last ok. And since it is a book it is in some sense complete it tries to cover various aspects and there is videos slides reference materials practice problems in that sense it is complete. So, we have lots of usage of Bori tree in our department as well as outside colleges also several of them have used it. This is a small list of colleges which have used it in the past we also used it for a teach 10000 teachers workshop which was conducted as part of IITB project. So, here is a little bit of evaluation based on a student survey the survey was conducted in a computer networks offering as well as in the teacher training workshop. Some other subjective statements which they mentioned flexibility they like they like the fact that they can rewatch the videos they get more attention in small groups. And the fact that they get instant feedback in those in video questions is they like it the score board is also a feature they like there is a healthy competition of who gets more score. Some negatives are that some concepts are difficult. So, without the help of a teacher it becomes difficult until you come to the classroom session. And for many students you know flexibility kills discipline. So, we try to account for it by having the in class quiz, but still there are some students who ignore. So, you know there will always be some 5 to 10 percent of students for whom this mode of teaching they are not able to adapt to it may be because of this aspect more flexibility you give they tend to misuse it. It can happen that if you do not design the videos carefully it can lead to you know just watching without really absorbing attention deficiency problem. So, that is why we have those in video quizzes. So, that all requires very careful design of the it is basically like you know what a good lecturer would do by asking questions frequently in a class. So, some survey statistics whether students felt the need for instructor presence most of them said sometimes that is the maximum number sometimes they felt some felt not at all. Helpfulness of quiz within the video most of them say they are all very helpful in understanding. Helpfulness of problems outside the video most of them say it is very useful and typical time spent on a 20 minute video is 20 to 30 minutes. So, that is the bloat factor I mentioned right. So, you do need to rewatch many things many times in order to absorb it properly and in comparison to traditional model subject understanding increased is the maximum response we got and amount of time spent it varies as you can see some say it stayed about the same some say quite if you say it increased the amount of time spent has increased compared to traditional model of teaching. Exam preparedness significantly improved that is the response and that is overall score most of whom give a thumbs up for this model of teaching as compared to traditional model. We also did a formal analysis of whether this has resulted in improvement in learning improvement in grades. So, there is some amount of subjectivity in that I mean the same instructor without using this platform compared with same instructor using this platform the exams were different but assumed to be of the same difficulty level because instructor was the same and we found that the percentage of students who got A Bs and B Bs increased significantly. Behind. Yeah. Yes. Is that number increased significantly or I do not know I do not know is the right answer but I do know for a fact for example that last semester one of the core courses was taught by another instructor in the traditional model of teaching. I had taught it in the previous year using this approach and I know that many students continue to watch these videos because they used to write to me when the server was down we have an exam tomorrow please. So, I know that many of the students who repeated the course under a different instructor in the traditional model used to watch my videos for reference. So, this did happen so at least that is one data point. So, the first offering is a lot of effort because it is like writing a book but from the second offering onwards it is a breeze. So, that is how it is been for me for the last 3 years now because the material is all available readily so that is great. So, I am going to move over to SAFE now which as I mentioned you know its requirement came about from use of both e-tree really speaking because we felt the need to conduct these quizzes every class session. So, the end effect of SAFE is summarized here this is the notice stuck outside our classrooms and which turn into exam rooms during exam time and those are my students taking exam. So, while traditionally mobile phones are not permitted we turn that into a system where you can while completely preserving the integrity of the exam that is very important. So, they can use the system only for giving the exam during that time. So, this is of course very different from many instructors use Moodle quiz because you can use it but you are assuming that students do not cheat there is nothing preventing the students from using the same platform for doing Google search or chatting or whatever it is. So, the primary motivation I already mentioned for student participation flip classes and you know there are also attendance woes attendance falls off and you feel demotivated as an instructor. So, regular quizzes having a quiz every session improved attendance although there used to be cases I always conduct the quiz at the beginning of the class first 5 minutes. So, there are many cases where students just come for the quiz and then leave I do not prevent them but it happens. We have also used this for admission test and also project recruitment test pre-interview screening once this platform is there. So, that also formed a part of original motivation for safe. So, we wanted to conduct the exams periodically and in large scale the challenges being the scale is large. So, you cannot do paper pen it just is an impossibility to talk about for even a class for class of 30 you want to conduct quiz every class forget it you just cannot do it. But with this platform it is a breeze. So, our goals were it should be easy to use otherwise people would not use it. It should be easy for both the instructor and the students integrity very very important and robustness. So, because it is an exam with marks you cannot ignore even one or two students having failure. So, then you know as an instructor you want to have fairness. So, even if one or two students have problem it is a problem it is a you cannot use the system and hence robustness in the system is very important. So, the architecture is very simple students come to a classroom just like they come to a classroom for any purpose. They are typically already logged on to the safe app and the instructor simply gives a quiz ID and quiz starts on each of their phones they attempt the questions and submit. Then they can immediately view their marks if the quiz is so configured they can even see the answers instead of waiting instructor can get statistics of the how many students got which how much marks and so on. So, we have further enhanced this architecture by not requiring Wi-Fi during the classroom. So, during usage we encountered many instances where Wi-Fi was unreliable. There will be few students for whom for one reason or another the network does not work for whatever reason they may have typed the password wrong some configuration mistake something. So, this will unnecessarily delay the exam. So, we have rearchitected this to have a feature where the exam is downloaded in the background in the app periodically every 2 hours right now in an encrypted fashion. So, it is already there in each of the students phones when they enter the classroom when I want to start the quiz I just provide the decryption key no need for any network and exam gets conducted if the network is still not there no problem they the app stores it locally and whenever the network becomes available it gets uploaded. So, we built in that kind of robustness also to handle scenarios even though rare where network created problems you cannot open it well you ok. So, you can open it again but we will come to know I mean it will show up in the logs as student has attempted twice is like student are submitting 2 answer sheets you will come to know yeah. So, it is primarily meant for objective questions ok. So, we have different question types. So, let me since you ask that question let me go to demo part of it. So, this is the instructor interface. So, these are the yeah I mean that part is quite simple I will show you. So, let me show you for example, this is the quiz I conducted on Monday. So, it is similar to creating Google forms. So, you just edit and there are different types of questions we support single choice correct multiple choice correct fill in the blanks in fill in the blanks we do a exact match and numeric answer numeric answer is very convenient for engineering setting. There is a last option here which is known as image answer ok. So, this we have to support even traditional exams we can conduct using this student can write the answer on paper and just takes a snap and submit snap using the app and submit. Why this is useful? So, there is a back end support for correcting the question this has lots of uses for one thing there is a record of everything online we can back it up and so on. TA correction management becomes very simple one TA can correct one particular question in an exam as opposed to one particular paper. So, that process becomes very easy and right now we do not have it, but we are also building in support for what are known as rubrics. If you give a question let us say a phi mark question typically as a instructor you will have in mind you know if this mistake is there then I will deduct one mark. If this aspect is there as a positive aspect in the answer then I will give two marks out of five. So, these are called rubrics typically as an instructor is correcting the questions the rubrics are in his or her head these can be formalized once you correct 10 questions the rubrics are all entered into the system then correcting the remaining 130 becomes very easy just select the rubric whether this positive part is there whether this negative part is there in the student's answer and the student also gets to see why he or she has gotten a particular mark. So, that is I am talking about this image answer we call it as image answer you know it can be a paragraph it can be a diagram it can be an equation it can be anything. So, this system is actually more secure than a typical paper pen quiz because we have an option to shuffle the questions it becomes very easy to shuffle the question order. So, over the shoulder copying becomes much more difficult you cannot you know also mime for question number 2 answer is b you cannot do that. So, those kind of things become very difficult option order also we shuffle. So, those are things we do and we also have a feature of question group whereby you know question group is it does not get reordered it is a group of questions it does not make sense to shuffle it with other questions but as a group it gets shuffled with other questions. So, these are the features we have. So, this is a quiz I conducted on Monday actually and then so I mentioned the you know password feature. So, there is a encrypted zip which is downloaded to each of the students when I create the instance and this is a decryption password which is visible only to me of course I would not be projecting this is in classroom I will just write it on the board. So, decryption key they just type it and get started with the quiz. There is a dashboard we have where you know I get to see how many students have submitted whether there are any alerts. So, if student for example tries to go outside the app to refer to a cheat sheet or if the student tries to chat or if the student takes a phone call. So, all these things we track and these come as alerts. So, these are all info level level alerts I hope there are no let us see there are some critical net ok. So, this we need to turn it off. So, earlier we did not allow mobile data network that we need to change in the system. So, that is why it is showing as a critical alert, but right now we allow mobile data network also. And that is about it you can see the submissions you can download the mark sheet and so on. So, you have doing that period you have to look at only one. Yes. In fact, I have to go on saying that I mean the student can force it is like you know you do not physically prevent a student from leaving the exam room. If you leave the exam room without instructor's permission you are forfeiting the exam basically is like that. So, this is one of the reasons why this we need a exam room. There have been there have been such cases there have been such cases of two mobile phones. So, we do need a exam room setting this cannot be done in any setting ok. There are too many other ways of cheating in a non-exam room setting. So, in a if it is an exam room well you are supposed to have the phone on which you are taking the exam in front of you. If you have some other mobile that is equivalent to writing a physical exam with a normal mobile that has to be caught through other means. We do not do anything in the system to prevent that. Yeah. So, since this is simple quiz each week I create three versions of the not three versions three different set of questions and all of them are simple. So, they can discuss, but I mean since the questions are different ok. So, let me come back to the presentation. So, these I have covered ok. So, some technical aspects of what we do to achieve cheating free operation. So, we track whether the user is focused on the app. So, this is one of the key technical mechanism. We have authentication based on LDAP that is there and we log various things and report to the server ok. User in call whether the call was accepted or not, what connection the user is using, the phone's identity and so on and all this logging is robust against disconnections. So, it is not that student can disconnect the phone from the network going to airplane mode cheat and then come back that is not possible. I mean that is possible, but we will track it still. Genuine phone call we will come to know I mean it will be visible. I mean in smartphones app cannot take over the phone it cannot hide incoming phone calls. What we can do we have done it in some cases, but right now we do not enforce it is we can enforce airplane mode. So, if an instructor wants that you can do it that is like you cannot take a phone call during an exam and then you know this is our red screen. If you leave the app this red screen will pop up and there is a timer which will run and the timer expires. In fact even if the timer does not expire a report will go to the instructor saying that app was out of focus. So, this is a laundry list of various safeguards we have for different kinds of threats. We have a paper on it so I will not go into the details of this table, but I will point out one aspect which you brought up which is that you know we do need some non-technical mechanisms to go hand in hand. Everything cannot be solved through technology. So, for example you know we do not do anything to proxy another person comes in front in place of you and gives the exam we cannot prevent it unless you do an ID check. So, that it can be so we are exploring at least giving a selfie photo, but we do not want to use biometrics that is a decision design decision we have made for a bunch of reasons for one biometric is not there in many phones now a large percentage of phones do not have biometrics. Second is we do not want to keep biometric in our server then we have to be like UIDAA denying in denial if something gets broken then I do not want that headache I do not want biometrics in my it is too sensitive photo is ok. Various features apps you can have equations you can have images there is a countdown timer in the app. So, another feature which the students like is that you know everybody gets the same time if it runs out with the timer runs out it will auto submit. So, there is no question of somebody not submitting on time. Various exam settings we have duration of course you can configure negative marks whether you want to randomize the order whether you want to show the marks and answers at the end of the quiz. You can modify the answer in case you make a mistake in the answer key you can modify it and reevaluate. So, these kind of things we have is a live dashboard I showed you the current this is actually you know old one I showed you the current one. So, it turns out that the there are really no other apps which do this there are lockdown browsers and as some of you may know TCS is big time into this business of exam centers. So, there they conduct exams online exams on gate is also done this way they do it on desktops which are locked for that particular purpose only. So, here the advantage is that this is a bring your own device model there is no overhead of maintaining any lab in fact we have made it such that you do not even need Wi-Fi now any classroom you take call it an exam room you can conduct the exam. So, huge list of various courses as well as non courses which have used this system currently it is being used in 10 different courses in 2016 we used it for MTech admission within our department various colleges have used it for conducting national exams and mojo networks a company used it for some pre-interview screening and so on. So, some instructors so safe was originally meant for mental attendance check many instructors also wanted just physical attendance marking currently in our institute we use this biometric readers which aside from the disadvantage which I mentioned the hardware does not work many times there are many classroom is a maintenance issues there. So, on the other hand here physical attendance marking is just like empty quiz. So, we have subset that in order to support that feature also. So, I will just talk about this third one is logistic of how to handle students without any smart phone ok. So, that is a practical question and I will just talk about that. So, there are some students always who do not have our quizzes supported currently only in Android attendance is supported both in Android and iOS, but still there are always some students who do not have these devices.  So, we have turned on a selfie option to handle that and we do a face match in the back end. However, although theoretically it can happen I believe most students will not do it because their cell phone is like their heart and soul they cannot part with it for 5 minutes. They are not going to part with their phone to a friend just for marking a proxy most students will not do it. So, but still we have this selfie option. So, currently some of the instructors are just using this manual attendance marking we have a manual attendance marking on a server for students without smart phones that is the interface they are using. It is also possible to just pass around a spare device which in our experience only about 5% of students do not have smart phones at all that is a very small number typically you either do manual attendance for those or just pass around a spare device. So, for quiz it becomes a more difficult issue because quiz has to happen simultaneously for everybody. So, for that the two options we have used are divide the students into two batches or two or three batches like I have done in combination with both the three. So, then I tell them you know you borrow from your friend and get it. So, that they do sometimes I have also done this printed paper we can print a paper version of it. So, I carry around some 5 copies of it when I come to the class and just distributed for those who do not have smart phone. The other option which we have used also is we have a you know bag of some 20-25 spare devices and that goes around classroom to classroom. We have a staff also who does manage this and that is given to. So, this is currently this is the option being used currently for CS101. CS101 every session has a quiz in the last 10 minutes. So, they are using this option to handle those cases. So, I think I will close with that I had prepared for a demo you can try this out. So, these are some student you can just pass it around. There are some student accounts demo student accounts I have created. So, what I am going to do now is I will tell you how this quiz is run. So, this is a demo quiz I am going to create offline instance now and the password you can note it down password for the quiz. So, that is the login for safe the password for this quiz itself is PM and D. So, you can try it anytime and yeah. So, the instructions for doing it is here it is the quiz works only on Android. So, you can install safe app from play store and login using that those credentials and you need to press sync to server once this happens in the background every once every 2 hours and then you are all enrolled in this course the RT101 I mean those demo accounts are enrolled. We do not support that because again it is a lot of the safety aspects come because of support given by Android for such usage. No, no, well iOS also it is possible iOS has lagged behind for quiz because of logistic issues we have not had a iOS consistent iOS developer. So, do let me know you can write to me by email if you want to try either safe or Bodhi tree safe either for attendance or for quiz. Quiz can be in a class or like I said we have used it for pre interview screening also for project recruitment. In fact, another mechanical engineering prof is going to use it in the next 10 days for that same purpose. In fact, that is an exercise we would like to take it up at some point but yeah, so you can do it if you get an instructor account which will be glad to provide you just need to use the interface to insert those quizzes and so on. I can be used even without those but the real benefit you get only if you use those features. The previous slides on Bodhi tree, you are trying to say a couple of slides as seen this is a point that you are trying to make is careful design of questions in between the video. At the same time, careful design of questions in the class. So, can we just throw a light because you have taken so many courses. What is that you keep in mind when you design such. So, when I prepare a video for example, I think about what are the questions I can ask to really check whether student has understood something and what multiple choice questions I can ask or what numeric question I can ask. Sometimes it is just a yes no question. So, for about every minute or so of the video I keep this in mind so that the video does not become one way. So, this is what I meant by being careful attention. I do not know if I answered your question. You even pointed out saying there needs to be careful in design of questions. So, could you refer back to the video. No, the in class can be really anything. In class can be question. I do that many times. I mean it requires as much care as any question does really, but knows further specific attention for the tutorial sessions. So, are your videos only the form of books or it could be instructor explaining some concept or what exactly is the content of the video. All our videos are you know screen recordings of guide presentations. It does not have to be that way. I mean we do not do anything to enforce. It can be any MP4 like I said really. Thanks a lot. I am sure there are more questions to be taken later and I hope this video will be in effect more later by the faculty. There will be more acres for budgetary and safe. Thank you. Thank you.


This town's campaign is a partnership between Livewell Colorado and the Colorado Municipal League to increase access to healthy eating and active living through residents. And in 2013, when we passed our HEAL resolution and became a part of the campaign, it really served as a catalyst for giving us great resources on how we could further deepen our commitment to healthy eating and active living. The area is a focus. We have active living, access to healthy food and healthy workplace. And in each of these areas, we have content experts that provide free assistance to municipalities that join. The Cities and Towns campaign resolution really got some conversations started about what our priorities are around healthy eating and active living in Golden. One thing that came up was that we had these big displays, these big vending machines that had soda and junk food in them. With the schools taking up the healthy snacks guidelines, we decided to just go ahead and change our vending. And one of the benefits of having joined the campaign is showing funders that you have a plan on how you'll increase access to healthy living for your residents. One of the surprises that I saw was that our economic development department was really excited about it. They began to tell our involvement in HEAL through the perspective of businesses locating in the city because generally businesses like to locate communities that invest in health, a healthy community that's healthy employees. About a year and a half ago, we decided as a city to do an overall survey. A lot of people wanted to see far more in the way of rivers and trails and healthy activities and what I'd call quality of life items within our community. It was really important for us to join the campaign just because it's such a great way to tap into additional resources and help us leverage the good work of it HEAL is doing with the city projects and really get the word out. The campaign is meant to be flexible regardless of whether you're rural, urban or suburban. There's something in the program for you. As a leader in your community, you decide what the next steps are and the campaign is available to provide assistance. So contact Movewell Colorado today and get started.


Well, I paid for this party, so I kind of got a seat at the table twice. But right now we're going to share the stage, and I'm very excited about this topic, because I'm sure with all her magic happening with chat GPT, Google bar, we're all getting hyped up, right? We've seen this movie before with other things such as Web3, NFTs, crypto. And we're at this peak right now, kind of questioning, okay, but what's really next? And what are some of the real applications, especially in product? So I'm here with three product executives that are going to give us their take, the real take. We have a pretty sophisticated audience here, so we can go deep just to make sure that this is for real. As you know, I'm the founder and CEO of Product School, and I would love for maybe the rest of the audience to, the rest of the panelists to introduce themselves and add one more thing, which is from one to five, how excited, if you had a crystal ball here, what do you think is going to happen with AI? One being, ha, it's just another trend, it will fade out, five is like, oh, my God, this is happening, it's a paradigm shift. So maybe you, Jessica? Hi, everyone, I'm Jess Hall, I'm the Chief Product Officer of Just Eat Takeaway. Great to be here today. I'm definitely at the top end of the scale. I'm going to go for a five. I think it's super exciting. Iway. My name is Iway, Chief Product Officer at Talabad, and part of Delivery Hero, very similar sentiments. So over the last two or three months, I've been diving deep into the space. I'm a solid five as well. Shabayu? Yep, my name is Shabayu, and I'm the Vice President for Product and Growth and Tier, and I would go for a six. Oh, wow, how doing us all. Let's ask the audience. Let's start with the optimist. Please raise your hand if you are a five plus. All right, maybe 50%, four, not bad, three. Still decent? Okay, pessimist, where are you? Number two, still some, one, who thinks this is just a trend that is not going anywhere? Okay, I see some. You can change your mind during this conversation. So let's go to the nitty-gritty of it. Maybe you guys could share a real use case for AI. Maybe you are already applying in your current company, or that you see could also be applied for other companies in product management. I mean, for me, it is less about the specific use case, but just the absolutely exponential pace of change in technology that we're going to see as a result of AI becoming more and more used. I think right now we're still learning what those opportunities could be. And I think that's exciting. It's the scale of the opportunity, which is amazing. Where we are focusing in just each takeaway is on really providing training and opportunities to engage on this subject, because we want to be more efficient as a business. We want to find those opportunities, but we also really want to upskill the people in our teams so that they understand and that they can make the most out of this technology, and we want to make sure that we're developing our talent for the future. So for me, it's really about the scale of the opportunity, and I just think that the change over the next five years is going to be immense. Yeah, very similar sentiment. At Talabad and Delivery Hero, we operate in a very complex world. We serve our riders, our customers, our restaurants, and what's really amazing, and for me, what distinguishes a technology that's a bit of a hype and a real technology is how quickly you can start prototyping and testing and implementing new technologies to see if it actually makes the lives of your customers better. And what's been really exciting over the last couple of months is that we've been testing, we've been trying a bunch of different things, and whether it's using chat GPT or a bunch of other technologies, we've tried things like, what would it look like if we helped restaurants made it easier for them to market their products? What if we made it easier for them to write a menu description using some of these AI tech? And very quickly already, we've been able to take things to market. And that for me is the exciting part about AI. Not too long ago, it was a bit of a scary topic. I remember we would have our data science team trying to explain the concept of a neural network and how it all works, and there was a small fraction of people who understood it. But now it feels tangible, it feels usable. It feels like we can jump in there and actually see what it can do. We can run tests behind it. And I think that feeling of realness is what I'm the most excited about and giving this a shot over the next couple of years. Yeah, for me, it's about like chat GPT is everywhere, right? So basically it's about text analysis and how we kind of enable growth. People are mostly looking at it from a marketing perspective. I would like to see more in the deep learning space, the CNN in particular, where we are working on geospatial imaging. And in the medical field, imagine the power of AI that could no pave ways for cancer treatment, right? We are so fixated on the text base, but I think there's a lot of scope there. All the believer being a part of tier and sustainability for good. And I hope that this field catches up pretty soon. Suvai, you were at Amazon before, right? Yes. And they have a big team that works on this technology. We're facing now the classic buy versus build with AI. There are models out there that can be implemented already. Chat GPT, me, one of them, but they will see engineering teams really working on their own proprietary systems. So maybe starting with you, what do you think are some of the common misunderstandings in AI for product? What is the opportunity versus the fluff? Yeah. So I think one of the things as product leaders is we get scared like a general public. We get very scared with the term AI because it's kind of a black box, right? So I think first to Eva's point, like be bold, right? Dive into it and understand, and then you'll probably realize that it's not that scary. Most of the AI development happens from a solution led first, rather than a problem space led first. And then we try to fit in the, which problems does the solution fit into, right? As a product leader, I would like to have mechanisms and ways of working to manage that problem. And I think in Amazon, we really nailed it. There are AI PMs, tech PMs who know exactly how to kind of do that. I would like to also see large scale implementations of it. I think I would also add there that some of the misconceptions around this are that it is this miracle thing and maybe that's why some of you don't wanna go with the five score. It is imperfect because it's trained on the data sets that we're giving it and it's trained on information from society. So I think one of the other really important parts of the product role is to be aware of that and to be taking action to correct for those biases that are in the data sets that are in society today because the speed at which we will advance with AI means that if we're not cognizant of that and we're not making decisions about that, that there's potential for those things to become even more embedded. And I think all of us as product managers, as product leaders have a duty to make sure that we are really thinking about that as we develop products with AI. So just to follow up on what you just said, yes, I see a lot of startups now throwing the magic buzzword. I said, yeah, right? Back in the day it was like, we do machine learning. Now they are like, we do AI. They're kind of throwing AI to whatever they do and even their domain is .ai instead of .com. So from your perspective, what are some of the real wins that some of the companies can leverage today to start showing real value for these AI applications? I mean, I think it very much depends on the business and the customers that you're interacting with. The first place that I'm really thinking about is that I guess there's a bit of a fear isn't there that AI is gonna replace jobs. And I don't think that's the case. I think it's something that we've got to learn to work with and I think AI allows us to scale our cognitive abilities. So I'm quite excited about how we can use it to improve like technical tasks that involve human interaction today and remove that and allow for like more purposeful, exciting work for people. Like that for me is the beginning and the understanding. I think there's loads of applications in customer service in providing great testing and other elements that help us really learn quickly, learn quicker than we do today. Imagine if you could use AI to run experimentation at like way faster pace than what we can do with customer testing now that might take us two or three weeks or longer. So that's where I'm really looking for the value in the beginning. And I think it's gonna grow from there. I think it's very important for almost every function in an organization to stick their finger in there and see what it can do, right? Between a finance team, between a customer service team, between a sales team, a marketing team to write copy. I think it's a real opportunity for all the different teams to sort of figure it out. And I think over the next couple of years you'll see a verticalization of a lot of the technologies. I think you'll see some successes, some failures. Some companies making some very funny errors along the way, but that's really part of what breaking edge technology looks like. Yeah, I think for me at the risk of probably repeating myself, but what I'm really passionate about is when we are always trying to monetize AI, we're always trying to optimize the funnel, right? For AI. And that's fine, though I call it greed, but at the same time, we never thought of ourselves as customer, as product people, right? How does AI enable us? And I think that's power, right? And I think we should kind of, that's why we should embrace the technology and do that. I make sure that our team spends most of the AI into discovering the problem space and not moving into the solution. So kind of one of my principles is if all the AI is a deployed customer facing, there's something wrong going on. I remember 12, 13 years ago, I was a computer science student, I had a subject on AI before it was cool. And that was horrible. It was literally all about coding and trying to apply some intelligence to a video game. And now it's cool. And to your point, Yiwei, around sticking the finger on each team and see how they can leverage AI today. And hopefully there are ways to do it in a non-so technical way. So I'm curious from your experience, for product teams, how can some of the product folks in the room who might be thinking, okay, how do I learn AI? Do I need to code? Are there any other ways for me to kind of experiment with it without breaking the system too much? Like, what's your take on that?  And I think we're on that journey. And I think the beautiful part about it right now is how accessible the technology feels. ChatGPT for its highs and lows and pros and cons makes it really easy for you to boot it up, throw some prompts in, throw some commands in and see the potential of what it can spit out, right? And so, you know, funnily enough, as product people, I don't know how many of you guys have tried to actually use it in your day-to-day jobs, but you know, when I walk down the hall, I see product managers with ChatGPT open and, you know, may or may not be writing their user stories and PRDs using ChatGPT. But I mean, I legitimately think that by testing it on our own, we'll be able to see the potential, right? And, you know, not in the not-so-distant future, I'm sure there's gonna be a customer service rep who also thinks, hey, I can make my job a lot easier if I throw in a customer query into this thing and see what happens, right? So I think a lot of that sort of skunkworks, bottoms-up initiative needs to happen and organically because of the accessibility of the technology we're seeing that already. I completely agree. I mean, ChatGPT is the one that everyone's talking about, but I'm talking to people in my life, including my dentist recently, who was telling me about all of the tools that she's found and she sent me a list of things that she found that were helping her with her website. You know, these are people who are not computer scientists or even product managers who are really getting in and experimenting with this technology. It has become so accessible that actually, it's in the hands of our customers and I'm a big, big proponent for getting close to your customer and getting different perspectives on things. So compared to other advances in technology in the past, I think this is so different because it is really in the hands of everybody and it doesn't take a great deal of specialist skill to start to interact with it and even go beyond just prompts in ChatGPT to, you know, there's all sorts of Google Sheets that you can download that will, you know, write you a talk or not that I wrote mine.  So, and I think that's really exciting too. I think that's probably one of the misunderstandings today because it feels rushed suddenly because ChatGPT released their public version. Surprise, surprise. Week later, Google releases their own AI bar, right? And now a bunch of people are talking about AI as if they had to because it's hot. However, we know from experience that there are a lot of companies that have been working on this type of technologies for a long time and that is starting to emerge. So for those teams who might not have the resources to invest in AI from scratch today, they don't want to hire AI engineers or AI PMs. Have you seen any specific APIs or tools that would allow these companies to start showing the value without over-investing? Yeah, I mean, there are so many open source AI's available tools, especially like Google. When you Google up, you can find a lot of geospatial information about a particular location for customer, if somebody is using a mobile phone and you have a GPS location, you can have access to about that location instantly just through API plugins, right? And then there are so many platforms that enable you to plug in APIs like million APIs, right? I don't want to name the companies, but then those are the smart decisions as product managers we need to kind of or as product leaders we need to take, but there are so many. And even Amazon, Google, most of them, they're all about open source APIs, so yeah. And if I were to make a bet in the next five years, we will see a massive rise of companies that are able to make this very easy and accessible and verticalized. So you want to dig into locations, there's probably a company that will have a verticalized version of this that solves for that problem. You want a solution that solves for customer service and make sure that people respond in half the time to extra quality, there will be a service for that. You want one that helps you detect for fraud, there will be a service for that. I think the next five to 10 years we'll see a remarkable rise of just AI technology being massively accessible that I think, there's a good chunk of this room that will somehow end up in some of these product roles and a not so distant future. I've seen this movie with product tools before and it became a commodity. Now we don't have to reinvent the wheel to build a roadmap or a data analysis. So I agree with your perspective. Hopefully it gets to a point that we don't have to talk about AI because it's so embedded into our products that it's just a default. For the other two, what are your predictions for the next, I would say five years? So one AI is just, so like as we said, last two decades has so much happened and what you're seeing, the chadgivity, et cetera is an outcome of it, right? But don't forget the series that I'm the, sorry, I'm all about Amazon now. So the series in Apple, right? So those are also ones which came. So every 10 years you would see, but I would expect product as a service where you would embrace to you as point to all the APIs and all the instant plugins to instantly understand the customer will become so easy and then that will enable small cross functional teams or two pizza teams to unlock extreme potential. That's the space I'm looking out for. I mean, I agree with everything that's been said so far. I think we will interact with AI every day in five years time and the key skill we will have needed to develop or the key skill we are developing is how we interact with it, how we use it. There are tools already out there like co-pilot. I think we're gonna see more of that and to touch on your earlier point, I think we need to start thinking about AI as just part of everything we do and not a specialist subject and not a skill that sits to the side that we sometimes bring in. If we're really gonna achieve the maximum potential from it, we need to be thinking about it in all of our products and all of our discovery and all of the different applications. Like you said, it's not just about customer facing, it's also about how we operate internally and what we can learn that way. I love what you said about AI as a service, comparing this with software as a service. Hopefully it becomes that type of understanding for builders. In the few minutes that we have left, I want to use this opportunity to talk to the people that gave us a one or two in terms of their... optimism here. What if it doesn't work? We've seen movies where talked about virtual reality. It was going to change the world and it's still unclear. We saw NFTs not so long ago, we saw blockchain not so long ago and now it seems like we're throwing a new term out there called AI. So what is the worst case scenario? What if this doesn't work out?  If it doesn't work out, we're going to move on to the next thing, right? But the difference for me here is how accessible this is compared to blockchain, for example, which the general public, people who don't work in tech, struggle to understand or really had to work hard to understand. Right now we're talking about a website that literally anyone can navigate to and put in a prompt and get an answer. And they don't have to go very far to find, learnings on how to make that better. And I think that's the crucial difference here and I think that's what makes it different from some of the examples that you've given. And I think one beautiful thing about the solutions that we're seeing today is that it's complementing work that we're already doing today. It's not a new frontier. It's not a new way of... It actually just solves a lot of problems that we're currently having today. I think that's very powerful. So I think for those who maybe gave a one and a two, my observation as well sometimes is that, I mean, chat GPT today says some pretty silly things. Make some mistakes and we've seen public demos from really big tech companies that didn't quite work out. But I think that's all part of the learning process and as we hone things in as some of these models are able to fact check themselves and it will just come in a matter, I believe, of months. I think we'll see a much higher bar of quality of products that will come out. Yeah, for me, it's like it will not work out if we go on, like we will replace everybody. AI will do everything. It will definitely kind of not work out in the next five to 10 years at least, right? What will work out is if we have realistic practical goals, right? Of leveraging AI to their strength and leveraging humans to their strength. Our strength is our connection. Our strength is building culture. Our strength is vision, right? I don't know if that's a strength for AI. So we play to our strengths. AI strength is processing large database and if we learn to coexist, to me it's a win-win. Thank you all for sharing your thoughts, the good, the bad, and the ugly on AI. Please just give it up for Jessica, Giwei, and Subayo. Thank you.


This video is sponsored by Mellow Light. One thing to think about when it comes to productivity is when you are most productive. And in this video, you're probably gonna see me working a lot when it's dark outside or later on at night because I get my best ideas and I just get really inspired and motivated to work more at night for some odd reason. I'm definitely not like a midday person. I'm definitely more of a at night kind of guy, like literally like two in the morning. I try to get as much rest as I can so I try not to stay up that late, but that's just me. What is up, fam? My name is Jocelyn Jay for those who are new here but just call me Jocelyn, especially if you see me in person because really no one calls me Jocelyn Jay. But I like to make tech and lifestyle videos at least once a week. And today I'm gonna be talking about how I like to stay productive. I'm actually really excited about this video because I get a chance to really just sit back and talk to you all about my productive or my creative process. So earlier I talked about the time where I'm most productive. So it's super important to know when you work the best, what time is best for you, whether it's morning, midday, or the evening. I also wanna talk a little bit about my setting. So I'm gonna talk about some of the tech that I use. So some of you all know that I work as a full time, full stack developer. So that takes out 40 hours of each week. But I also love spending time with my girl. I love playing basketball on the weekends. I love working out, spending time with family, and just doing other creative work outside of making YouTube videos. But if you include all those things, YouTube videos and videography, a lot of people are always like, how do you find the time to do everything? I like to edit my videos at night because that's when I feel the most creative. But also I've noticed that if I get up early enough in the morning, I can get to work earlier and clock out earlier because I'm getting my eight hours done at a lot earlier time frame. So if I can get into the office at 7.45 a.m., that means I'm gonna be leaving at 3.45 p.m. So then I'll have more time to shoot, more time for daylight. But videos like this, it doesn't have to be daylight outside, but you get what I'm saying. Since we talked a little bit about how I stay productive, I thought it'd be a good time to hear a word from our sponsor. MailerLite allows users to become email marketing experts with advanced features and 24-7 customer service. A very important aspect of email marketing is an email list. So I know some of you are probably asking why it's important to have an email list. Well, an email list is important because it allows your audience, consumers, and or users to stay up to date with blog posts, products, services, and promotions. Also an email list allows you to build more engagement with those who are following you or purchasing your products or services. Creating the right email list can also deliver a return on investment and help increase your customer base. You can do this by knowing what your audience wants, creating offers that they will like, making it easy for them to subscribe. Also, you can do this by building an email list through pop-ups, promotional pop-ups, and embedded forms on your personal site in which you can convert your website visitors into newsletter subscribers. With just a few clicks, you can create intuitive and beautiful signup forms to keep your audience engaged and up to date. And by using MailerLite Landing Page Builder, which is an easy way to build professionally styled custom landing pages, by using MailerLite's Drag and Drop Builder. You can integrate these landing pages through social media and they're responsive for mobile devices. Build your next email list with MailerLite today. I also just got the new iPhone 11. I got the Pro Max, it's a mouthful. I got the Pro Max and the military green colorway. And this camera is insane. So if you wanna learn more about the iPhone, about this camera, just comment down below, Pro Max. Another thing I like to do is I like to plan ahead, especially now that I've been working with more brands, I've had more deadlines, but it can be really hard with having a full-time job and just a life in general and not having YouTube as my like full-time job. And I'm gonna get better at that. But if you plan ahead, so let's say you wanna start doing video work or maybe you wanna build an app, take a little bit amount of time each day to work towards whatever end goal you have for whatever you're working on. So if you're working on an app, maybe do like 30 minutes a day where you're learning or researching or doing some programming.  One thing I've noticed is when I don't procrastinate and I go out and start shooting for a video that I know isn't due or I know I don't need to get done for like a week, I just have so much more footage and I have better quality videos because I'm able to start editing maybe the intro two days before I start working on the body instead of trying to cram everything in one. Keep in mind, there's no formula for productivity, at least not when it comes to a lifestyle or towards your own goals. Everyone has their own way of being productive that is beneficial to them. I know some people, they may need a whole month to do a video, some people may only need a couple of days, some people may only need a week, but I've noticed that you're more productive when you actually just do something instead of just planning for everything that you wanna do, I'm kind of a more go with the flow type of person, more of a, okay, I'm having this idea, I'm having this thought, I need to start putting action to my ideas. Putting action to your ideas is the start of being more productive. You can plan all you want and do, you know, formulate ideas and all that, which is great, but you have to put some action to your plans. I'm also not gonna lie, gear helps a lot. So just for an example, when I didn't have this box light, I wouldn't be able to shoot videos at night. So as it's becoming, well, it's already fall, I was about to say, as it's becoming closer to fall, well, it's already fall and it gets dark now at like 7.30, 7.45, which means my daylight window is really small, especially because I don't get off from work till like 4.45 most days.  Another thing that's helped me a ton is getting that on microphone that I have back there. But that microphone has helped me a ton. It's helped me a lot with my voiceovers. So instead of trying to film voiceovers in camera, they may be taking the memory card out and listening to what the audio sounds like, I can just use my Blue Yeti, for example. So I will say the tech that you have plays a huge role. I have a tripod that is way better than my older tripod. One, it's not broken. Two, it's just so much more configurable. I can move the tripod head a lot easier. It has a release clip, which allows me to remove the camera from the tripod a lot quicker. I also got a new monitor. And believe it or not, a monitor has done a ton for me. It's a 27 inch Dell UltraSharp monitor. I mentioned it, I think, a little bit in some other videos, but this has made a huge difference in my productivity. And the reason being is because now I can have like three screens. I can open up my laptop and this monitor is wide enough that I can actually display like two windows side by side without them looking too small. And another thing, of course, is the camera. I'm shooting with the Sony a7 III and it is a great camera in low light. I also have a Tamron 17 to 28 millimeter lens, which allows me to create videos that have a wider angle. So I like to shoot with 17 millimeters to give you a better idea as to what my environment looks like. I think I shot with 17 millimeters earlier in a video, but you don't have to have crazy gear. It took me some time to get to this point.  Also can't forget how important it is to exercise. When I don't feel motivated and I don't feel really inspired, just plugging in my headphones into my phone and listening to some music, it inspires me because I go out and I like maybe take a walk, I'm going to run with Lee, or maybe I'll go to the gym and work out or play a little basketball and that inspiration starts ticking again. I'll maybe get an idea when I'm playing basketball or while I'm working out, where I just feel very creative at that point. I think it's because I'm getting the blood flowing and I'm moving my body and doing something that I enjoy, even if it isn't creative for an example or for example, but that helps a ton. You gotta exercise. So yeah, that's my, I guess, rant on productivity. Like I said, no formula really to it. I also didn't write a skit for this video, which I actually feel really good about. I like just having an honest, kind of conversation with you all, with my audience talking about my life or things that have made me become more successful or more productive for example. I didn't get into too much of the technicalities besides, you know, talking about some of the gear that I have that's helped me and just talking about how I balance YouTube and software development. But if you're more interested in learning about some of the apps that I use that helped me be productive, I have the car linked above, you can check that out. So that really concludes this video. Thank you for watching it. If you're still here, give it a thumbs up. Share it with someone who you think might find it beneficial. Comment below some of your thoughts or some video recommendations and subscribe to become a part of the family if you haven't already. And hit that notification bell to become part of the notification squad. I don't know why that's so hard for me to say. With that being said, I'll see you all later. As always have a blessed rest of your week. Peace.