Major sponsors for Ableton on Air include Green Mountain Support Services, empowering people with disabilities to live home in the community, Washington County Mental Health, where hope and support come together. Media sponsors for Ableton on Air include Park Chester Times, Muslim Community Report, WWW, this is the Bronx.info, Associated Press Media Editors, New York Power Online Newspaper, U.S. Press Corps Domestic and International, Anchor FM and Spotify. Partners for Ableton on Air include the HOD of New York and New England, where everyone belongs, the Orthodox Union, the Division for the Blind and Visually Impaired of Vermont, the Vermont Association for the Blind and Visually Impaired, Center Vermont Habitat for Humanity and Montpelier Sustainable Coalition, Montefiore Medical Center of the Bronx, Roosevelt Kennedy Center of Bronx, New York, Albert Einstein College of Medicine of the Bronx, Ableton on Air has been seen in the following publications, Park Chester Times, WWW, this is the Bronx.com, New York Power Online Newspaper, Muslim Community Report, www.h.com, and the Montpelier Bridge. Ableton on Air is part of the following organizations, the National Academy of Television, Arts and Sciences, Boston, New England chapter, and the Society of Professional Journalists. Welcome to this edition of Ableton on Air, the one and only program that focuses on the needs, concerns and achievements of the differently able. I've always been your host, Lauren Seiler. On this edition, before we get to our guest, Dan Groenberg of Montpelier Relive, we would like to say special thanks to our sponsors, Washington County Mental Health, Green Mountain Support Services, and many, many others. We would like to welcome Dan Groenberg of Montpelier Relive to Ableton on Air. Thanks for having me. Welcome to Ableton on Air. Tell us the missions and goals of Montpelier Relive. Sure. And what you guys do for the city of Montpelier for a month. Great. Montpelier Relive is a community and economic development organization with a mission of making Montpelier a more livable and vibrant community by celebrating our downtown, which is really the heart and soul of Montpelier and what I think makes Montpelier a really special community. We're one of 23 similar organizations across the state in different cities and municipalities. And we work in sort of four areas. One is economic development, specifically focused on supporting our small businesses, especially the downtown businesses. One area is downtown beautification, and that's everything from flowers and benches to public art work. One area is events, and we do a lot of our own events, and we also support other events in the community. And one is sort of promotion and marketing, spreading the word about Montpelier and what's going on to locals and visitors. When you say municipalities, what exactly do you mean by municipalities about that? Yeah. So we're one of the 23 designated downtown organizations. So the state of Vermont has a program called the Downtown Designation Program. And it's communities of a certain size that meet certain criteria. So anyone from Montpelier, Brattleboro, Rutland, Waterbury, Springfields, communities that have sort of a traditional downtown where there's lots of things going on that need supporting. Okay. Well, exactly how does your organization mesh or help the special needs community or how would your organization do that? Yeah. Or what have you done to help the special needs community within your organization? Yeah, absolutely. So I would say that Montpelier Live does work for everyone in the community, everyone who lives here, visits or works here. And so, you know, I can't necessarily point to a specific thing that's been specifically targeted towards, you know, people with disabilities, but I would say that, you know, our events we try and have really accessible and open to everyone. Our public artwork is visible. You know, we worked with the Public Art Commission on the new mural on the side of the Shaw's Building. That's something that makes Montpelier more beautiful for everyone. Having a really vibrant downtown business community is something that's great for everyone. More specifically, we have worked with the Center for Independent Living and hosted a workshop for downtown businesses on how they can improve ADA compliance in their businesses. We've also had an audit of our July 3rd Independence Day event, which is, as you know, one of the biggest events in Montpelier each year. Because it's an event we do with the City of Montpelier, the City's ADA Committee brought in an outside consultant to help review that event, to make sure that everything we do is accessible to everyone.  But overall, what it found was that our event, like many of our events is really available for everyone. Okay. Now, you mentioned, I know this is a past, and then you can go through some of the other events that you guys have. Explain how the July 3rd event came about and why you guys decided to start that, because it's a huge, you know, a lot of people say, why not July 4th? But go ahead. So at this point, I want to say it was 22 years ago, Beth Hill, who was at the time assistant city manager, I believe, for the city of Montpelier, decided that Montpelier should have fireworks on Independence Day and not wanting to compete with neighboring smaller communities that already had events on the 4th, like Worcester, for example, decided to have the event on the 3rd, so that people could do both. The Warren Parade is another example that's on the 4th that's a local favorite. We want to compete with them. Well, it would be a conflict of interest? No, no, no. Just that people love to go to that event and we wanted people to be able to go to both if they wanted to, so that they didn't have to choose between the two. And it's sort of grown from there over the years. And so now if you come to that event, you'll see fireworks, but also music throughout the day, family events, a parade, a mile road race. We had 35 food trucks this year. It's just sort of a big festival that takes over town. And we had 12,000 people in attendance this year, so it's a really big event. COVID, you know, COVID shut down a lot of things from medical doctors, people having problems with that to outside organizations like Montpelier Alive doing events.  How did that work out? Yeah. So, you know, first and foremost, I would say that Montpelier Alive is a community building organization. And the biggest thing that the pandemic impacted was the ability to come together as a community. So that made it really, really challenging and made our job that much more important. So, you know, we did, at the very beginning of the pandemic, we did some sort of fun event things that you could do at home to bring the community together. We had a community sing where we invited everyone to go out on their front porch at their own house and provided, you know, three songs that everyone was going to sing together and enjoy that. And, you know, joined in with, there was a time where people were banging on pots and pans to support essential workers, you know, every night at six o'clock or something like that and promoted that. But, you know, we decided that we weren't going to really pivot to online events because our whole goal is to bring people together sort of in person. Is online or was online events or how can I word this, would it be impossible to do an online event? Certainly not and we supported a lot of other organizations that were doing online events. I think of Scrag Mountain Music as an example, we provided a grant to them to support an event they were doing which was concerts after hours in businesses to bring attention to the business and also provide a fun event for people online. We really as an organization wanted to think of ways that we could, you know, safely bring people together in person where possible. Okay. Talking about accessibility for a minute and accessible venues because a couple weeks back we've had the Montpellier Parks Department on talking about accessibility with parks. How important is accessibility when it comes to doing events either outside or indoors, especially in the City of Montpellier? Because now I know that the city is planning to fix the pavement and they're fixing all the things within the city municipality. How important is accessibility for events within your organization? It's very important. We want everything we do to be accessible to as many people as possible. So most Montpellier live events take place outdoors in venues that happen to be accessible. We do some of our events on the State House lawn. We do some of them literally right on the street in downtown. We do our summer concert series in Christchurch courtyard. All of those venues are easily accessible for everyone. And then when we have events that take place indoors as well at Art Walk, we make sure to indicate where which venues are accessible. Explain, since you said the Art Walk, explain a little bit about that event. So Art Walk is an event that takes place six times a year. So it's every other month on the first Friday of the month. The next one will be the first Friday in October. And you have a Halloween also, right? We do Halloween. Yeah, that's another event. Art Walk is just a fun opportunity to see art by local and regional artists. A variety of venues take place in it. We usually have between 20 and 25 different venues which are both sort of traditional art galleries, but also restaurants and stores that display artwork and people can go around and discover the art, discover the business that they may not be familiar with. So it's just kind of fun casuals, start at whatever venue you want, go in whatever order you want, see as many things as you'd like to see. And that's the first Friday of every other month, like I mentioned. Just a celebration of all the creativity in Montpelier. Tell me a little bit more about the history of Montpelier alive and why you guys really exist. Because, you know, yes there are community organizations, but there has to be more historical behind it. Yeah. So we were originally started in actually the 1990s. And at the time it was the downtown merchants who were really pushing for the creation of the organization to help them band together and be able to do more together. You know, they wanted to promote themselves, they wanted to hold events, but you know, they're very busy running their businesses and didn't have the time to do that necessarily. So it was originally called the Downtown Merchants Association? Yeah. So it's gone by various names at various times, but it was originally sort of the Montpelier Business Association and we grew out of that. It was Montpelier on the move for a time. And then in 1999 it was founded as the Montpelier Downtown Community Association and rebranded as Montpelier Live I believe in 2006. So now in terms of your website how has your and I'm looking at it and it's a wonderful website, how has your website changed especially when it comes to accessibility? Sure. Well, we just launched a brand new website about two months ago working with a firm called Egg Works in Waterbury, so a local firm and the goal of our website is to make all the amazing things about Montpelier that you and I know about from living here available to everyone to help people about the upcoming events, whether that's a concert or a lecture at the library or anything like that to share our outdoor recreation opportunities to share all the great dining that we have and downtown shopping that we have both for people who live in Montpelier who might not be keeping up with everything that's going on, but also for people who are interested in visiting Montpelier. So the new website incorporates all the latest technology and it's really great for people who need to use a screen reader making sure that there's alt text on the photos, things like that that was definitely a focus as we developed the new website. Okay, now I noticed that during the pandemic, and this is a big question, the restaurant industry has taken a huge hit some things closed within Montpelier and then some things opened like there's a new bakery that just opened telling me a little bit more about how the restaurant industry has impacted Montpelier but kind of come together to help at the same time. Yeah, sure. Well, Montpelier is very lucky in that we didn't lose any businesses as a direct result of the pandemic. Some businesses closed early in the pandemic but they were actually planning to close anyway. I'd say Neckie is an example of that. I didn't want to mention names. I'm sorry. No, no, no. But there were some businesses that were in the midst of closing already or for sale already before the pandemic, but the pandemic itself didn't cause any businesses to close and I really credit that with the businesses being really creative. They did more takeout. More takeout. Walk up ordering windows some of them added delivery all sorts of different ways that they pivoted to be more flexible outdoor dining certainly and parklets that the city encouraged more outdoor seating and things like that. What's a parklet for those who don't know? Sure, a parklet is where it's named after a parking spot. So where a business takes over one or two parking spots on the street and turns it into outdoor dining with a sort of outdoor deck essentially. So before the pandemic there were two parklets in Montpelier. There's now I believe eight. So a lot more outdoor dining options available for people. And so you asked about what restaurants can contribute to Montpelier. I think there's... There's obviously a big pandemic or outside the pandemic. Sure. So there's obviously this big legacy from the culinary institute being here but also from just amazing Vermont produce and dairy and all that. There's great food here, right? So we have a really... Especially certain ones like Julio's for example. They do a lot of outdoor dining. Yeah. So I think it's pretty cool that little Montpelier with 8,000 people has 20 some odd restaurants, right? That's pretty impressive. And we have Thai food and Vietnamese food and Mexican food and quite a variety for a small town I would say. So restaurants are really important to our community and food obviously. During the pandemic I think people broadly realize the importance of supporting local businesses, whether that was restaurants or retail stores. This has always been a community that I've heard a lot about our local business. But I think that people took it to the next level. Buying gift cards to businesses to use later when they reopened or getting... Takeout Tuesday was sort of a trend nationally but especially here where people would eat out more often to support local restaurants. So it has been really challenging though in spite of the state grants and federal grants that have really supported. The PPP loans? I'm talking about PPP. I'm talking about the EIDL. I'm talking about the state I can't remember the names that's how long ago it was at this point but the state grant programs that they provided for businesses as well. So the state of Vermont provided money for restaurants to stay open, correct? For all sorts of businesses but I'd say that restaurants were definitely in need at the time because they took biggest hit and that's what our data show locally as well as that restaurant business was down more than any other kind of business. Now, let's talk about some more of the other events that you guys are that you have in the winter, have in the spring. Go ahead. So we do July 3rd. The next big event upcoming is on September 10th which is our Taste of Montpelier Food Festival appropriate to mention now since we were just talking about food and restaurants. That was a new event that we started last year and really in part to help support Montpelier restaurants and also to recognize that we have So is it like a fundraising event? Yeah, let me tell you about it. So there's also to celebrate all the food artisans in and around across Vermont. So it'll be all weekend, we'll have things going on but specifically on the 10th from 1-4 we'll take over State Street between Elm and Maine and have food trucks have Montpelier restaurants providing samples of their dishes we'll have tables from Vermont artisans like Cabot Creamery and Vermont Creamery and Lake Champlain chocolates vendors like that will be providing free samples and there'll also be a lot of fun street performers juggler and yo-yo artists and brass bands and fun things like that. Okay, now let's talk about the well in terms of pandemic now that we're getting more people outside let's talk about the farmers market in Montpelier for a minute. It's it did a fundraiser recently for the food bank or the Montpelier food bank had something to do with that but how does the farmers market help Montpelier or work with Montpelier alive or anything like that? Sure, so the farmers market is a separate organization from us but we work closely together because the farmers market is one of the things that makes Montpelier a great place to live and to visit. The farmers market in Montpelier it's every Saturday from 9 to 1 at the 133 State Street parking lot just west of the State House and a really incredible market for, again we're a pretty small community but we have 60 or 70 vendors at the farmers market every week and Yankee Magazine which is this New England wide well regarded magazine named it one of the best farmers markets in New England I think it's really just a great celebration of Montpelier's Montpelier food and it's also a really fun event as a local to go to because you run into so many people you know and it's a great sort of community It's like everybody knows your name that TV show instead of a bar we have a farmers market pretty much is there anything that we haven't mentioned that's extremely important with your agency? I think just that we're involved in really big breadth of things in Montpelier and we often serve as sort of a connector for people so we'll have you know someone might email me and say I'm working on this project like what do you think and I'll say oh I actually know this other person who's working on something similar you two should get together and talk about this or just bringing the community together in a lot of ways and that's really what we're all about and we're always open for some feedback of how we can serve anyone in Montpelier better where do you see um this might be a far fetched question but where do you see like Montpelier businesses expanding for the especially in these communities especially with accessibility you know do you see that more coming up or you know the question would be possibly to have businesses have more ramps outside their businesses where do you see that going forward yeah well I was excited to host that workshop for the Montpelier businesses with the Center for Independent Living because a lot of businesses saw some like low hanging fruit let's call it some easy things that they could do to make their businesses more accessible you know there's a lot of projects that would require a lot more work you know for example well we have a lot of historic buildings and some of them don't necessarily have accessible entrances and are you know because for example it took forever for the art gallery to get an elevator some time ago yeah and that was an incredibly expensive project that took them several years to raise the money for so that's an example of how it can be difficult in these historic buildings it can be expensive but you know businesses care and are trying to you know be accessible for everyone and will always provide alternative methods of you know if you can't get physically get in the door they're always happy to help you over the phone or something like that as well I will say that I think restaurants outside seating has added more options because all of that outside seating is accessible even in a case where the restaurant inside may not have been so you know I think that you know I don't have any specific examples of upcoming work but I know that it's something that businesses care about and are thinking about talk about some of the future goals of Montpellier because as I understand it you said off air that well we can say it on end that you're leaving Montpellier alive if you'd like to plug that or why are you leaving Montpellier alive obviously for better things but how is that going to impact obviously it's not going to impact at all because you have somebody else but you go ahead if you want to mention it sure yeah so Montpellier live has been here for more than 20 years and like you said it's not going anywhere it's going to get better it may get better without me I've been in Montpellier live for four and a half years and moving on to work for the state to do similar work at a statewide level I'm excited about that but I know the organization will be in good hands under Katie Trouts who's my colleague now who will be interim director we have a really great board who's really involved and engaged in the community and I know we'll keep doing great work and I think the strategic focus is going to be continuing to grow our role as a partner and a collaborator and bringing together all the great work that's happening across Montpellier by many organizations now in terms of your website you have if you want to talk more about that and notice here the Hunger Mountain Co-op has a brown bag concert series we haven't mentioned yeah so our our brown bag summer concert series is Hunger Mountain Co-op's the presenting sponsor and that's a free summer concert series on Thursdays at noon in Christchurch Courtyard there'll be one tomorrow I don't know when this is going to air so to speak but there'll be one well yeah Thursdays probably in two weeks we'll air this sure so through September 6 I believe it's the last date there you can find out more at montpellieralive.com but it's a series of six free concerts by local and regional artists just a fun concert series that we do for people who want to grab a lunch and enjoy being there grab a lunch or bring their lunch bring their lunch exactly okay so last thing I notice here on your website you have a section for one minute oh yeah it's called shop so you list the it says here Montpellier is the best mall town for shopping according to USA Today that's true talk about that so in 2021 USA Today 10 Best which is a USA Today property named Montpellier the best mall town for shopping in the United States and was chosen by judges including journalists from USA Today and then it was a vote to pick the top top one Montpellier has been in the top five for the last five years now so in 2022 we were at number three we fell to number three but I still think for a small town that we have an incredible array of shopping and I think it speaks to you notice here and it's a large print for the visually impaired that you have different categories food and drink, games, gifts so you're listing all the businesses within those categories yeah we have you know such a great variety of businesses and I think the fact that we won this recognition is because our business owners are really wonderful at what they do and you know you get great customer service and it's just a very different experience than walking into Walmart or shopping on Amazon right the Berlin mall does need more stores it's just a different experience a more personalized experience with more unique products and like you mentioned we have everything from clothing stores to you know independent kids toy stores, toys or us doesn't even exist anymore let alone independent stores actually no they are coming back but you know we have two independent you know hobbies, craft stores so quite a variety which is really impressive for a small town well I would like to definitely thank you for joining me on this edition of Ableton on Air for more information on Montpelier Alive and what they do and all the activities especially the website is accessible for people with special needs you can go to www.montpelieralive.com and if you want to find out more about their shops in Montpelier you can go to www.montpelieralive.com forward slash shop so that's forward slash x-h-o-p again the website is accessible for people with visual impairments as well so www.montpelieralive.com forward slash shop and if you want to find out more about Ableton on Air and what we do here for people with special needs and their families and other groups you can go to orca's website at www.orcamedia.net that is www.orcamedia.net this puts an end to this edition of Ableton on Air thank you to all sponsors Washington County Mental Health Green Mountain Support Services and the many partners including Ableton on Air for today's show and also the association for the blind and visually impaired and the division for the blind and visually impaired and so many others thank you again Arlene is not here today I'm Lauren Seiler see you next time for the next edition of Ableton on Air major sponsors for Ableton on Air include Green Mountain Support Services and people with disabilities to live home in the community Washington County Mental Health where hope and support come together media sponsors for Ableton on Air include Park Chester Times Muslim Community Report www this is the Bronx.info Associated Press Media Editors New York Parrot Online U.S. Press Corps Domestic and International Anchor FM and Spotify Partners for Ableton on Air include Yechad of New York and New England where everyone belongs the Orthodox Union the Division for the Blind and Visually Impaired of Vermont the Vermont Association for the Blind and Visually Impaired Center Vermont Habitat for Humanity and Montpelier Sustainable Coalition Montefiore Medical Center of the Bronx Rose of Kennedy Center of Bronx, New York Albert Einstein College of Medicine of the Bronx Ableton on Air has been seen in the following publications Park Chester Times www this is the Bronx.com New York Parrot Online Newspaper Muslim Community Report www.h.com and the Montpelier Bridge Ableton on Air is part of the following organizations the National Academy of Television Arts and Sciences Boston, New England Chapter and the Society of Professional Journalists


at the NSF and also at the Lawrence McKinley-Gone Professor in the Biology and Cognitive Science Department at Carlton. And she's, of course, been a member of many national-level committees in the United States. And particularly, she's been the chair of the committee that authored the DBER report recently. And she's been specializing in the undergraduate education, particularly specifically biology and environmental education. And even I was stunned to see that even she's interested in other areas like sustainable energy and various other aspects of the STEM education, particularly at the undergraduate level. And she's going to, of course, talk on a subject which all of you know, because the abstract has been already sent to you. She's also been part of the entire effort in the United States in trying to see how STEM education actually moves towards solving national problems of various kinds, which could mean both the social, economic, and other kinds of problems as well. So she's been at the center of STEM education leadership in the United States. And we are very fortunate to have you with us today, Susan. So over to you. That's terrific. Thank you, everyone. I am so proud I can't be there with you in person. Before we jump in, I guess I should add one brief biosketch update. I am no longer at the National Science Foundation. About a year and a half ago, I started as Provost and Vice President for Academic Affairs at Rawlins College. So you could see on my first slide there that reference to Rawlins. So I'm in Florida, which isn't quite as warm as it usually is this time of year. So in terms of my talk with you today, and I'm especially looking forward to the conversation at the end of the presentation, what I would like to do is two parts. One, establish the context and a little bit of the history of the undergraduate STEM education improvement effort in the United States. Because I think a lot of what's happened informs where we've gone and how we've gotten to embracing deeper as a field of research. It's both a field of research and an area where there is great interest in using the research findings to improve the undergraduate STEM experience. So if we can go to the next slide, the motivation to improve STEM education has always been to provide really high quality STEM workers and a well-educated general populace. More recently, the scale of the global challenges we're all facing has really increased. And these are challenges that require a different kind of preparation to address complex multi-dimensional problems. So to exemplify that, what I'm sharing with you here is an effort at the US National Academy of Engineering to prepare students to address grand challenges. So the National Academy's every 10 years plans to introduce 14 grand challenges. The current ones fall into the four categories that you see on the left. You can see we're talking about everything from clean water and energy with sustainability to delivering health care, addressing strife inequalities. And I think it's particularly important that quality of life falls into their concerns also. What's interesting, and I think will be informative as we move through the presentation, are the competencies that the Academy of Engineering thinks are important for graduating engineers to have. So in addition to understanding the content, really being able to conduct research to have a creative approach to problems, to be able to address things in a multidisciplinary way, and to have a sense of business and entrepreneurship because we need to translate the basic science and engineering work into the marketplace, the importance of cross-cultural competencies, and then the importance of social consciousness that problems aren't solved in a vacuum. If I can have the next slide, could we have the next slide? OK, so what we need to do is to think more about educating T-shaped individuals that have deep disciplinary knowledge, but also the ability to work across disciplinary domains and have strong interpersonal and interpersonal skills. So things that fall more in the socio-emotional domain than in the cognitive domain. And all that we're learning from DEEBER and from other fields is really providing guidance as we think about redesigning the undergraduate experience. If I can have the next slide, I want to talk a little bit about how we've gotten to the point where DEEBER has come into being. So the next slide is very historical. I'm a biologist, and so I picked biology as an example. But for those of you that are physicists and chemists and engineers, please map your own discipline onto a timeline. Back in 1887, not so long ago, our biology was trying to make the case that they were actually a discipline that should be taught in higher education. So this has been a domain in higher ed for just a little over a century. In the United States, fast forward to 1958, when the Russians launched Sputnik, there was a huge shift in the US perspective and a deep interest in advancing science and engineering education. So you start to see a focus on an improvement agenda, but you're still not seen at the undergrad level the focus on research on how to maximize the learning. And by the mid-90s, the professional research societies had to recognize that they had a role, an important role in advancing the quality of undergrad education. This particular monograph was a group of there's about 147 life science societies in the United States, created a coalition of educators in life science, proposed a way to improve education, still didn't get a lot of traction. More recently, an effort called Vision and Change and Undergraduate Biology has very much taken the US biology departments by storm in a lot of ways. Next slide. I don't intend for you to read all the details of this timeline, provision and change, but very briefly, this was an initiative that the US National Science Foundation, the Howard Hughes Medical Institute, the US Department of Agriculture, and the US National Institutes of Health supported and nurtured over more than a decade to bring together leaders in biology departments across the country to rethink how we educate our students in the undergraduate biology courses, as well as to provide tools, resources, supports, mechanisms to advance. On the next slide, what you'll see is a little broader context, because I think it's important to realize we didn't just wake up one day and say, wow, we're not doing a very good job preparing our biology students. It's the ethically right thing to do to get better at this. Rather, what happened was there were rapid changes in biology. Again, for those of you in other disciplines, substitute your own discipline and think what was happening there. Biology over a generation moved from a descriptive science to a very data-intensive science. And students that were coming out with undergraduate degrees in biology were not prepared to work in the field of genomics or to do the large-scale systems level statistical thinking that was required in ecological studies. So the field was saying, hey, we've got to do something. It becomes the workforce development argument. And more broadly, this area of convergence, it's a term that was coined in the National Science Foundation. It's one of the major points of emphasis right now at the US National Science Foundation is convergence. We can only solve the modern problems in health and in agriculture and a lot of fields if we bring together engineering, physical science expertise, and life science expertise. And so the vision and change document see a strong push across disciplinary understanding. And simultaneously, not just in genomics, but in other fields, we've been growing the big data, data-intensive research. And that's important not just for the disciplines, but I also think as we begin to imagine where we can go with undergraduate education research. So the third publication up there is a summary of two workshops we organized at the MSF to look at the future of data-intensive research in education. And the one to the far right was an MSF-supported effort at MIT with their online education to get them to think about ways that what was being learned about learning could actually be integrated into this large-scale online delivery. So we've got three things going on here. We've got changing disciplines, driving education. We have changing ways that we're educating students, taking advantage of online and other resources. And then coupled with those two, we have the opportunity to use data-intensive research to more rapidly advance our understanding of student learning. So that's a little bit about the context, a brief overview, but let's now move to the next slide and jump into the world of Deber. So Deber rose out of the improvement agenda, but it's been an undergrad at a fairly late effort. So what is Deber, right? Deber investigates teaching and learning in the context of a discipline. So it's really grounded in disciplinary priorities, the world view of the discipline, the knowledge that's important, and the practices. Now, this is a field that pulls on cognitive science, educational psychology, K-12 science education research, which has been very robust since the 70s and 80s, mathematical educational research goes back to the turn of the last century. It's just that it hadn't really found its way as robustly into the undergrad curriculum. So again, in understanding the motivation for Deber, it's important to understand that disciplinary scientists felt they were more likely to get traction with their disciplinary colleagues if the undergrad research became very specific to their domain and got embedded in their department. This is good research that it could occur in any kind of department, but in terms of the improvement agenda, the science and engineering department home base became critical. So this is not a field that's independent from all of their education research. Indeed, it's very dependent on and should and needs to collaborate across other arenas of educational research. In the next slide, I want to make a case if we can switch slides that Deber itself has actually become a field of research. So looking back at the emergence of science education in very late 60s, 70s, and 80s, what ended up being more of a K-12 effort was actually quite groundbreaking because within the sciences, it was a break from a more generic let's understand all education to the context of the discipline matters. I'll click to the next slide and what you'll see are some of the criteria that emerged from this analysis that Fensham did on what determines a legitimate field of research. And so when the committee looked at the discipline-based education research area, the conclusion was that Deber has emerged. It's in early stages, and it has its own field of research. So it now has a lot of the structural criteria that you see up here in terms of academic recognition. Within the US faculty positions where Deber scholars have been created, even Ivy Leagues like Cornell just hired a physics education researcher in the physics department. So that's a huge step forward. There are research journals in biology, CBE, life science education is actually a very high bar in terms of standards for research that's published there. The physicists have been at this a long time. The professional associations have embraced Deber. There are research conferences. Research centers, I think it's still a bit of a stretch. And there is training. There are individuals that get graduate degrees from postdoctoral training in Deber as a field. Intra-research criteria, the methodologies and all are emerging. The emphasis on having a theory of change and understanding a theory for the field, I think in education research at all as a whole is something we're still working towards. A lot of conversation, work, but progress is needed. And then definitely there are outcome criteria that are emerging. So I think we can claim that while it's fledgling as a field, Deber is indeed a legitimate field of research. If we go to the next slide, I share with you from my colleague Carl Smith at the University of Minnesota, a really first grade engineering education researcher. A bit of a timeline to contextualize when Deber has really gotten legs. So in this timeline, and it only goes back to the 50s, right, the post-Sputnik time point, the solid bars are where there's actual education research and more open bars indicate a commitment, a lot of efforts to improve STEM or aspects of STEM education, but not informed by research. So the most well instantiated field is actually the medical education research, and we often forget about that, but we can learn a lot from our medical education research colleagues. Chemistry and physics have the longest history for more than two decades. There have been degrees, a limited number, but the degrees of PhDs in chemical engineering at education research. Engineering knew the arena, but has grown very rapidly. There are actually a number of departments of engineering education research in the U.S. now. So hopefully that gives you a sense at least of where we are timeline wise. So moving to the next slide, I want to talk about some of the factors that have allowed Deber to advance fairly rapidly in the last five years. So this is a U.S. centric story, but I think it may help you understand why things have moved here and there may be things you can take away that you've translated into the context in India. So really, I want us to think for the next few minutes about the intersection of research, policy, and in this case, federal level policy, and funding, and I'll focus on the federal funding level given my lived experience. So in 2012, two key reports were released, and they were released together fairly intentionally. The former chair of the Board on Science Education at the National Academies, who had been involved in getting the Deber report going and all, was working in the White House at the time and was supporting the President's Council of Advisors on Science and Technology as they were delving into work on the state of undergrad STEM education. So the Deber report and Engage to Excel came out. It also happened to be the gear of the MOOC, right? It's when all this hoopla was arising around MOOCs. We're at a very different place now, I think in our understanding of where online education fits. It's not taking over the world, but blended approaches have been very valuable, and online is reaching populations that may not otherwise have access. If we go to the next slide, and I put a lot of text on these slides because I wasn't sure about the voice quality and all, so I apologize for the overly crowded slides, but I want to compare some of the key takeaways from the Deber report and key takeaways from the Engage to Excel report because the crosstalk between the two and what followed is important in terms of how Deber, I think, got moving in a fairly positive way after the report. So the report shows that, you know, we have pretty good evidence for students grasp of concepts, a little bit less expert right now in how we get conceptual change to occur, although there is research there. A lot of good work on helping students become good problem solvers, good research, good understanding of how we use representations in our different disciplines to help students learn. This is really tough for students, right? It's a bit of a shorthand that we use in our fields, but for a newcomer, not easy, and we actually know a lot about effective instructional strategies where there's room and there's been some work in the past five years, but for those of you that are launching Deber efforts, there's a lot of space is understanding what works for different populations of students. Most Deber studies have been fairly small and the data was not disaggregated amongst different learners. Also not as many long-term longitudinal studies. So when you think about system level change, you want to understand how student experience connects over the entire undergraduate years, prepares them for graduate school or work. Not so much interdisciplinary work or work bringing in the cognitive sciences. Deber grew up within the discipline, so it's been very siloed in terms of disciplinary domains and there's some exciting work to get out of that. There's a group of colleagues in the U.S. that are bringing together Deber and Cognitive Science and another group, the Deber Alliance. We can follow them through the Trellis site at AAAS that are working to look at questions that are important across all of the STEM domains and how we can advance the field more quickly if we all work together. If you go on to the next slide, one of the key conclusions from the report is we actually know a lot about doing a better job in the STEM classrooms, but there has yet to be widespread change and so the recommendations for the report were focused on how we bring about that change and I think the report wisely calls out multiple actors in this process. You don't just go and say, dear faculty member, you need to change the way you're helping your students learn chemical engineering or geology. We all need to work together and provide supports and we also need to change the reward system at least at the major universities in the United States. Tenure, promotion, decisions are based almost entirely on one's research success within the domain and there's very little incentive and often a disincentive to spend the time that it takes to change what's happening in your classroom. If we go on to the next slide, we're shifting to the engage to excel report, the report out of the President's Council of Advisors in Science and Technology and you'll see they are mirrored many of the things that came in the D.B.A. report. You can think about the D.B.A. report as the research document and the engage to excel as the policy call to action document where again, we know what works in classrooms. Let's actually use that in the classrooms versus simply talking at students. The second recommendation focuses specifically on laboratories and getting more discovery based research based experiences into the laboratory learning for students and the third one, my sense in looking across different countries and all this is a unique challenge in the United States but our failure to prepare students well for the mathematics that they need to go on and stem by the time they get to college and this was a point of great consternation for mathematics educators who actually have a very robust body of research on mathematics education research especially in K-12 but it moved quite rapidly into the undergrad arena. There's a new mathematics education research journal that's been launched quite recently post-2012. There's a group that are called themselves transforming post-secondary education mathematics that are working very hard on national level change. There's work at both the calculus courses and with the getting ready for college kind of algebra statistics level courses it's moved quite quickly. So some very, very exciting work in that arena. If we go to the next slide a year later the federal government released the first ever five-year strategic plan to improve STEM education across all education levels formal and informal education and if you go to the next slide you'll see that there were four strategic objectives specifically for the undergrad community and again, you know, as you look through those they map on to what I was showing you in the DEEBUR report in the Engaged Excel report but the push on can we get these evidence-based practices actually used in classrooms. The second one we haven't talked as much about in this particular convening this evening but we have two-year and four-year colleges and improving the two-year experience of a transition between the two years of four years emerged there and then the other two map on to the undergraduate research experience and improving mathematics education. So in the next slide, right, you can have plans you can have policy statements how do you begin to implement them so in the last administration there were cross-agency priority goals STEM education became one of them and if you go to the next slide 14 federal agencies worked together I had the privilege of convening the agencies that representatives that were working on the undergrad strategic objectives in the next slide you know a number of things happened I picked a couple to highlight here one was that across all of the agencies there's all sorts of great research opportunities for students and funded research opportunities elsewhere very difficult for a student to access that so we created a common portal we also worked together undergraduate research playbook that captured the collective learned experience across all of these agencies next slide and as that's coming up this is not for you to read the details but this is to foreshadow where I want to conclude with my comments a little bit later as part of the implementation of this cross-agency priority goal orderly all the working groups posted metrics on their progress on the White House website and the reason I raised this is it's really difficult you know what indicators one can use at what time frame is useful you know in terms of measuring change right it takes four years for a student to progress through an undergraduate curriculum at a minimum and in many cases it's longer than that so we're going to come back to the indicators question at the national level towards the end of this talk if we can move on now I really want to shift gears a little bit so next slide I hope I've given you a little bit of the context of what was happening in the United States about the undergrad improvement agenda and how Diber rose out of an interest to improve undergrad STEM education but is rightfully a field of research and as the field matures that can be a bit of a challenge because there is a difference between being an effective teacher and using the research that's out there and being a discipline-based education researcher so that's something that I think one needs to be very sensitive to and aware of I think we also now are at a point where great Diber is launched but we have to really think hard about the trajectory for where the field can go, what are the intellectually exciting questions and also how are those questions aligned with providing information understanding findings that will advance the quality of STEM education so we've actually known since 1972 that actively engaging students in their own learning rather than having them passively listen to someone has a much greater impact on their learning. We don't need to keep reinventing that we certainly need to figure out how to change that in the classroom but as far as Diber is concerned we need to move forward and there's a lot of ways one can do this to frame it, what I'm going to do is draw on four recent reports that came out of the National Academy of Science Engineering and Medicine through the Board on Science Education these are reports that were commissioned by the National Science Foundation to take a committee of experts really really expert folks that look deeply at the research that's out there synthesize it and there's a very very high bar for the research that is used to draw conclusions and make recommendations so the way I want to do this is first talk about the undergrad research experience then talk about the and that right that was in the area you saw as a priority then talk about this gap that we have in terms of what works well or which group of students and when and this shift that we're seeing in the United States from access for everyone to really ensuring success of all students I then like to get us to think about moving beyond the cognitive domain so there's a very recent report supporting student success in college that looks at the socio-emotional domain what do we know about advancing and measuring student competencies in the intra and interpersonal competency sets and then conclude coming back to this idea of how do we know if we're making progress and we can look at that at all sorts of levels but again at the institutional level how would you assess the improvement agendas impact so let's move on to the next slide and take a look at undergraduate research which for those of us in science it's really sacred right it's the apprentice model for preparing students if we go back and look 200 years ago humbled by this idea focused on unified teaching and research what's surprising is beyond descriptive research on undergraduate research experiences we do not yet have a robust body of research on what works well for those students this is a very, I think very exciting opportunity for deeper scholars and again I'm not going to do any of these reports the service they deserve I'm doing a very brief overview with a few salient points to the deeper field I'd recommend if any of these specific areas capture your interest or align with your own research you download the reports from National Academy Press I've included the URLs the PDFs are freely downloadable and there's tremendous amount of good information references and analysis in there what the report does well is play down that there are so many different ways we can integrate research experiences beyond the traditional summer experience that capstone experiences see your theses internships co-ops which have long been common in engineering cures are the course-based undergraduate research experiences wraparound experiences in the US are for students where there's a whole package of mentoring and other supports in addition to the mentoring for their overall experience not just the undergrad research bridge programs for students moving into undergrad or moving into grad education projects research projects that are coordinated across the nation so there's multiple ones there's an annotation project with the fly genome there's a project where students go out and gather fashions from the soil and sequence them and collectively the data is shared it's a crowdsourcing approach to addressing real problems and meaningful way and then more and more community based research where classes students are working in their local community using research skills to address relevant real world problems within that community if we go on to the next slide one of the very helpful things the report did was try to define what is undergraduate research right given that there's so many different forms you can take and not all research experiences the report states need to have all of these elements but many of them should be there I think it provides good guidance I think it also provides guidance as one tries to frame research questions about undergraduate research learning so getting students engaged in arguing from the evidence generating novel information working on relevant real world problems mastering specific research techniques and reflecting on the problems and again this is something that goes back to much earlier national academies reports the importance of reflecting on your lab learning is about the only way to know students come to understand deeply what the nature of science is communication and then recognizing that these are structured not free for all experiences and the importance of having a mentor as one is becoming a researcher if we can switch to the next slide and then we'll be past I hope for a while such worthy slides my apologies for so much text we do know that undergraduate research increases graduation retention rates especially for groups that have been in the U.S. at least traditionally underrepresented in the STEM fields it may increase a sense of belonging which has been tied to persistence within STEM fields may increase confidence in understanding the content doing data analysis understanding the nature of experiments one of the places that it's quite striking when you think about it it's not at all clear that a very rich body of evidence on how students learn has in any way been applied to the development of most undergraduate research experience group and the published work that's out there has yet to really delve into what are the benefits to students in terms of their learning from engaging in undergrad research and which aspects of the experience are most effective in bringing about that learning we also know that mentoring is very effective but we have a long way to go with developing professional opportunities for faculty to become better mentors there's some great work that's gone on at the University of Wisconsin at the University of Wisconsin at Madison, for example but we need to spread that work to be effective I'm going to move on to the second theme, next slide which is how do we make STEM education inclusive for all students this barriers and opportunities report is replete with data again it's specific to give you one illustration of that the graph on the left is looking over time literally over a generation at the percent of 24 year olds that have completed degrees and this is across all domains not just STEM as a function of family income so for the highest quartile in terms of income in the U.S. from the 70s to the present we almost doubled the degree completion rate right now it's up to about 77% for the lowest economic quartile again moving left to right on the X axis gone from 6% to 9% so we doubled the gap in who is Bernie for your degree there are other groups other demographic challenges that we face and they're called out in the report so this is something that is a key area of interest in the United States and again the report is very rich I'm only touching on a few points that are relevant to this particular conversation but the committee concluded that the culture of many STEM courses and departments actually is undergirded by the belief that natural ability whether you're good or not good at STEM which we know is not true gender and ethnicity determine one's success in a STEM and you can see how that becomes a very negative self-fulfilling prophecy if we don't change that one of the other important things for us in the US is that the pathway to a degree is actually fairly complex the average student is no longer an 18 year old and the majority of students do not go straight through four year full time and complete a degree it's more like six years and as a result they talk about students swirling through degree completion so as a result, STEM degrees often cost more for students and our large scale data sets in this country are just not adequate to capture the movement of students until this past December we tracked through federal data sets only first time full time students that's expanded and there's still work to do there if we go on to the next slide parallel can we shift to the next slide, thank you parallel to the work that's been going on in all the cognitive domain the deeper work in the US there's been a big student success movement pushing on graduation rate driven by data within institutions so the growth in data analytics has fueled a number of for-profit consulting firms I've listed some of them here as well as homegrown efforts within analytics teams at universities to look at all sorts of patterns with students which courses are students most likely to have trouble with there's some courses where introductory courses where the difference between getting a B and a C in the course makes a 50% difference in retention there's a lot of work done with modeling with financial aid and who's accepted to colleges and then how that feeds into which students are most likely to graduate a time really interesting work I worry with any kind of predictive analytics tools that you can in it inadvertently disadvantage students by advising certain groups of students out of STEM versus really figuring out how do we focus on the disciplinary learning not discipline but disciplinary as in chemistry physics and figure out how we make our classrooms welcome and engaging for all students so I think a very important area of research ahead for us is bringing together the predictive analytics related to student success and the deeper informed and more broadly learning science informed work on how to create classrooms that what we do the data analytics will be pleasantly surprised with the outcome so let's move on to supporting student success and looking there now the cognitive domain at these inter and interpersonal competencies this was a report that the board of science education from national academies under to do a number of things but first they looked at which of these competencies there is evidence for correlating with college success and then looking where there's promising interventions the overarching goal was to understand what do we know about the assessments we have for these competencies how when do they work what do they tell us and what do we need to do to get better at the assessment what's quite interesting about the analysis is where the data is right and we need to be very careful when we say the lack of evidence does not does not mean lack of impact we just haven't demonstrated it yet so if there are competencies like teamwork for example that probably you and I both believe are very very important to students like long don't show up on this list that might be a very interesting area to delve into in terms of research so the three competencies really rose to the top in this study and also have very low cost interventions that could be used at scale are a sense of belonging so if you feel that you are part of the future of chemical engineering you belong in the engineering major or you belong in the biology major you're much more likely to be successful in college if you have a growth mindset so let's think about math for example or the faculty you know in one of my previous slides don't have a acknowledge a growth mindset in students if you believe either you're good at math or you're not good at math you're not going to actually do very well long term even if you start out having a fair amount of success if you believe if I work hard I'm going to be fine and I'll get there it makes a huge difference and also utility goals and values if a student comes in to leading that what they're learning and doing has internet value in terms of where they want to go in life they're much more likely to persist now the remaining competencies on the list are quite promising the research base is not yet as robust the committee called out behaviors related to conscientiousness conscientiousness is a personality trait that's not malleable and certainly we need to be very careful about focusing on things where we can't change the outcome in fact conscientiousness is almost as good a predictor of success in college as one's SAT scores for example also academic self-efficacy believing you're going to be successful at academic pursuits having intrinsic motivation or pro-social motivation wanting to do this work because think about my very first slide about grand challenges that you think by doing this you can help solve very important problems in the world maybe water supply or health issues and then having a positive image of your future self okay let's move to the next slide and talk a little bit about the research gap so I've called some of them out but if you think about my list not my list actually the committee's list none of those competencies were interpersonal and again if you go back to the beginning of my talk the importance of individuals being able to work across multiple domains working effectively in teams we know those are very important workforce outcomes why is this not showing up yet in the research maybe we need to ask different questions but we also need to think are we actually valuing this in the undergrad arena more about community colleges the research that I shared with you is discipline agnostic so we need to know more about the stem domain so that's a great opportunity for deeper colleagues and then we need better assessments and the report does a nice job with that if you're interested so what I want to do is wrap up with how would we know if we are successful so the last couple slides are the next slides just released this past month from the Board on Science Education is framework and goals for an indicator system and so this is looking at a whole range of indicators that collectively will let us know if we're making progress there's three goals so focusing on students mastery and the young concepts and skills by making sure they have evidence based stem experiences so the theme I keep harping on we know this from Bieber we got to get better at doing this the indicator system recognizes that we can't go in and assess learning of every student we don't have national tests in the US so it's what they were focused on is how could we deliver the experience the second goal is focused on equity and diversity and inclusion and the third is making sure we have an adequately sized stem workforce if you go to the next slide um whoops did we miss one this is fine um this is that there's one that somehow dropped out no worries if we look at the model they developed there are a whole bunch of specific goals including inputs then looking at the actual learning environment and then looking at the educational practices and then looking at the outcomes if so just having a model is a big step forward next slide um I just wanted to show you what one of these goals would look like when you break it down and again the point that I was making in the earlier slide that if you want to you use evidence-based practices to advance students mastery of concepts we aren't going to we don't have the capacity to go and measure their learning so you'll see on this list that there's a number of indirect measures that can be used so there's forward momentum there there's an interesting framework if that's something of interest to you and again where I want to leave you and open up for questions is Deber is informing much of this work and its research that's tightly tied to practice and the big challenge is the translation from the research to the practice and moving on and asking generation meaningful questions in Deber so with that let's go the next slide has just opportunities ahead it's sums up the kinds of things that I just shared with you and maybe useful in helping you think about research agendas of your own and with that I'd like to close and address questions comments that you might have the final slide does include my email address if we don't get to your question and you want to reach out to me I'd be very very happy to communicate with you via email so thank you much for your time and let's take a little bit of time to see what's on your mind thank you so much so we'll take questions from the audience I'm looking at the suns coming up in Florida it's not just a black drop behind my face you can see there's actually light in windows okay, yes so is it possible for the she can see the audience I can see the audience so if you take the microphone back I can hear even in the back of the room so we should be able to hear everybody okay, yes thank you very much for this very comprehensive review and I think it's very useful the resources that you have pointed us to seem to be very interesting I just wondered you know so you've been talking about dber, discipline based and but all the sort of pointers or you know you talked about evidence based practices you talked about competencies which are related to success you talked about assessment now in all of these I I was wondering where the discipline entered I mean was there you know how is it that you know I mean perhaps these competencies or these evidences are specific to disciplines or are specific to areas of particular disciplines and I found it somewhat contradictory that you were able to draw such general conclusions and so something is missing I felt exactly so this is a wonderful question so let me tell you the story behind the supporting students success in college report when I was working at the NSF we funded the academies to undertake this study and what we were interested in is specifically your questions what do we know within STEM at least about these competencies and what was fascinating to me was as they dug into it we don't have the research yet that STEM specifics so we've got some of these global conclusions across undergrad education the same with students success and we haven't dug in to ask say in biology right we know you're not going to be able to work on any kind of a genomics problem unless you're part of a team right there's all the bioinformatics expertise there's the molecular expertise there's a specific organismal expertise we know the team matters or look at the work with gravitational waves right that huge teams with different expertise working together and the open questions right and the way I framed this presentation was I think to be provocative in the way you know that I clearly have gotten you thinking hard about this that we need to figure out where the disciplinary expertise is most important there are things that are domain agnostic right that we can all work on but I think for those of us that are in the science disciplines we need to think hard about what are the priorities within our discipline where are these pieces important we do know with things like sense of belonging for science students there's been research done more at the K-12 level but for women that come into science for underrepresented groups things that you can do to help them feel like they belong are going to have a huge outcome on their success but what does belonging look like in a physics learning situation and how do we tie that to learning because I don't think any of us would want to spend the time working on exercises that aren't also advancing students learning in the field so we've got a lot of context specific work to do so you are right there's a real dichotomy there and I think a huge huge opportunity for us to delve in and I'll add one more piece I don't want to give an overly long answer but I think it's also very important for us to recognize that if DBER only works in isolation on just the cognitive piece of learning and we don't partner with or educate others that are working on these broader efforts about what our specific challenges are we're going to miss an opportunity to collectively do better work and I don't think that DBER scholars should become scholars in a lot of these other areas but they need to be aware of them they need to partner with them and there needs to be better knowledge exchange I hope that helps a little thank you that's great so the next question here I have two questions if that's okay first question you've touched on it a little bit but I was wondering what is the state of the art regarding gender if you could say a little bit about sort of what we know or more importantly what we don't know what are the pressing questions that you think surround in this field so you know there's many areas where this is really risen to a bit of a frenzy a lot of attention so in cognitive psychology there was a lot of to-do made about differences in the way men and women think and people paid and I think an undue amount of attention to mental rotation the ability to see things in 3 and 4D over time I'm a developmental biologist so you know cells morph into new shapes and everything of all the different ways one visualizes things that's really the only element that there's some small difference and the National Science Foundation funded a number of science learning centers one that focused primarily on visualization Tufts and Santa Barbara and there's lots of ways you can help people learn to do mental rotation and to be distracted by that I think was really a challenge and I think also then I talked about growth mindset talking about positive mindsets is really important see I'm by like who had been at the University of Chicago very good cognitive psychologist she's now president of Barnard College as of this year did a lot of work with math success and math anxiety and it turned out that in elementary schools we were doing disproportionate disservice to girls because most elementary school teachers were women and a disproportionate number had math anxiety and that got passed on and affected math anxiety and success actually for the girls in the classroom more than the boys there was a gender difference that we were seeing so effective practices like pushing for a growth mindset that if we all work hard versus gender bias messages are likely to be very important in computer science there's a huge amount of work that's gone on because we still have so few women in computer science and there the work was showing that classrooms that really favored problems context interests that were more relevant to the men and the women the men in the classroom and the women was a detriment I would say I went to engineering school as an undergrad and I can still remember in my class being the only woman and they were talking about flywheel generators for those of you that didn't take apart carburetors and other things back when they existed in cars flywheel generators were part of that my dad had died quite young and I didn't grow up repairing cars and they're doing problems with flywheel generators and I had no idea what a flywheel generator was so I naively asked raised my hand and the professor found it incredibly funny I hope this does not happen in classrooms anymore but context matters and we don't all have the same prior learning experience so being aware of prior learning matters where I could send you in terms of a really terrific resource is to go to the University of Colorado's website and search for strategic toolkit there's a really great resource that's up there and it's geared more at advancing the careers of women in the professoriate but great lessons learned about climate in general and this comes from a very very good research study by Ian Austin at Michigan State and Andrew Larson at the University of Colorado a whole number of advanced sites in the US so advanced is an NSF program that's specifically focused on women and why we've had so little progress in advancing women in the professoriate and into leadership roles and this toolkit looks at well what's the challenge at your institution what are the research informed approaches that you might want to use to address that situation and I think that's really useful to look at and I think in some fields certainly not in biology anymore but in other fields having more women present as mentors makes a difference and having more individuals of color as well so a sampling there's a lot of research that's going on there I tried to do kind of a sampler that pulled from a range of different areas to get you thinking so that's a mathematician asking you this question it's the issue of gender in mathematics is becoming a bigger issue I suppose that's one of the motivations of having the question from you so we are actually sort of already just about the time we have crossed about one hour that was allocated to this if there is no other question I can pass the second question to Mania the toolkit you want her to repeat what is the name of the toolkit it's called the strategic the strategic toolkit and if you search I'm trying to think of which is verbally the way I find it easily is to use a Google search and do strategic toolkit University of Colorado and if you can't find it please just drop me an email and I will gladly send you the URL thank you we'll facilitate that so there is one question at the back so sorry Mania I'm not taking the second question from you yeah please identify yourself before yeah Susan this is Max Das I've been grappling with a grand challenge since your talk about how do we equip college and university level faculty to adopt those evidence based teaching practices and become good at using them effectively you have thoughts on that I do so one of the ways and in the US we've been pushing hard through learning and teaching centers and STEM learning and teaching centers there's a coalition of STEM learning and teaching centers that are working hard on that so that's one way to provide support to faculty another really beautiful program the center for integration of research on teaching and learning includes 46 research one universities in the US the goal is to prepare the majority of future faculty because most of them go to a limited number the top 100 universities in the US by preparing them as graduate students and postdocs and that's been in place long enough that there's good evidence that when they become faculty they're more likely to use evidence based practices and they actually get their own research launched more rapidly because they're more confident in the classroom one of the things I'm trying at my own institution with my colleagues is a little simpler and more focused and it comes out of work that the American Association of Colleges and Universities has been starting to do and that's a look at assignment design we're actually in the process of hiring a new director for our faculty development center and one of the key things is to work across all the disciplines to help faculty figure out how to design assignments so ultimately right with effective learning you want students to be doing work where they're really engaged, they're challenged the gap in their learning causes growth it's not too big that they're overwhelmed and it's not too small that there's no learning and that's a way we think we can reach all of our faculty in a fairly straightforward way for us the other piece of it is we've been using in our college-wide assessment and we're doing this across the board they're called value rubrics it's an abbreviation from American Association of College and Universities looks at things like problem solving critical thinking and they're rubric based assessments to evaluate assignments so given that we're growing in assessment culture that looks at assignments by working hard on the assignments to work that our faculty give our students we think we're moving pretty far and my current belief right and we're testing this is that when you have limited resources and you want to reach folks by pushing on that you may move things a little faster than some other ways we also have a lot of other wraparound supports new faculty workshops a series regular meetings with new faculty career development gatherings where you share information one on one classroom observations but I think it has to be positive there has to be an incentive we know a lot about conceptual change in adults and I think the other thing that is key and the American Association of Universities which is the very top tier universities is pushing hard on this is changing the currency of the realm how do we change the way we evaluate teaching so that we get a good accurate picture and then how do we use that to inform tenure and promotion decisions because we don't change the reward system all the supports of the world are going to get us far enough it's a big challenge but a good one and I think we're collectively up to the task thank you so much Susan Singer for taking time an early morning day we couldn't offer you coffee or breakfast today but we are all heading towards a banquet the conference banquet right now so people would have asked you more questions if you are joined us at that time so in any case thanks again once more for your excellent talk and for the audience we have the email on the screen so you can continue to interact with Singer at SRSingeratrolling.edu thank you and I can Skype with you too take care, have a great day and enjoy your banquet, I wish I could be there with all of you I'll say goodbye for now thank you any announcements? first of all I would like to thank Professor Nagarjun for sharing the session and just I will present a small token of appreciation and our dinner are about to leave the first bus will leave at 6.30 around 6.40 and there will be a second round if you miss the first bus in about 20 minutes yeah yeah around 7 p.m from our institute gate you gather at our HBCSE main gate okay we gather back at 9.


highlights a comprehensive discussion of the approaches for developing carbon-based sulfur hosts is presented encompassing structural design and functional optimization. The recent implementation of effective machine learning methods in discovering carbon-based sulfur hosts has been systematically examined. The challenges and future directions of carbon based sulfur hosts for practically application have been comprehensively discussed. A summary of the strengths and weaknesses along with the outlook on carbon-based sulfur hosts for practical application has been incorporated. This article was offered by Egon, Jingli, Kayon, and others.