The last day of classes and our last colloquium, I'm really excited today to have Alexandra Toe. She's an assistant professor at Northeastern, jointly appointed in the Art and Design or Games Department in the College of Art, Media and Design and the Query College of Computer Science. Her core research interests are in studying and designing social technologies to empower people in marginalized contexts. And she uses qualitative methods to gather counter stories and participatory methods to design for the future. She additionally has extensive, experience-leading teams of educational game designers and has designed award-winning games.  And she received her PhD in Human-Computer Interaction, HCI, from Carnegie Mellon University as well as a BS and MS in Symbolic Systems with a minor in Asian American Studies from Stanford University. So welcome to Professor Toe. Take it away. Awesome. Thank you so much for that warm welcome. Is everyone seeing my slides okay? Yep. All right. Fantastic. Yeah. So, yeah, as Heather said, I work in the area of racial justice games and HCI. I'm very excited to be here with all of you today to talk about some of my ongoing work and this idea of centering people of color in the design of games and what that looks like and what opportunities are available there. So, yeah, you know, just very close by Northeastern and Boston. Sorry I couldn't come in person today, but hopefully we'll be able to connect in person sometime soon in the future. Yeah. So I always like to start out, talks, giving a little bit more context about who I am. I think that that's always useful as kind of a, you know, relations to feminist standpoint theory, right? Like I think in order to understand the work I'm doing and the context I do it from like you need that information and, yeah, and this also is a bit of a new style of talk for me. I usually only present on like very completed and finished and like not thinking about it anymore work, but this is an opportunity for me to try something a little new. I wanted to talk to you all about my ongoing research. So it's imperfect, it's in progress, but I was hoping that it would give us some good food for thought for discussion afterwards. Yeah. So as I already stated, right, I'm an assistant professor at Northeastern. I'm an art and design in the games group and the College of Computer Science. And I work in this intersection of HCI games and critical race theory or racial justice and the venues that I publish tend to be in intersections of those spaces. So ACM venues like CHI and CHI Play, DIS, FDG, games, journals and conferences like DIGRA and Meaningful Play. And when I do do the work that I do, I'm trying to approach it from this lens of empowerment. So this lens of empowerment, when I say that I mean there's sort of two very specific tactics that I try to use in my work, the first being visibility. There's a lot of different kinds of visibility, but for the purpose of the projects I'm talking about today, I mean increasing the visibility of people of color as already being present in games as being powerful and a very diverse group of people who have different needs and desires. And the second tactic I try to use in my work is this idea of self-determination, which is trying to think about how do we take power and distribute it. So people who are the most vulnerable have agency and impact on the design, deployment and use of technologies, which does include things like games. And also, as Heather stated for my bio, I tend to use two major categories of methods in my work. I use qualitative research methods. So for me, that looks like documenting stories, trying to move people from the margins to the center, doing storytelling work that challenges dominant narratives through the telling of counter stories. And then I also do design research. So when I say I design, I don't design things that are meant to be solutions like the final sort of end solution for any problem that I'm studying. They're more meant to be artifacts that help highlight assumptions or exaggerate underlying dynamics that maybe aren't quite as visible. I do participatory design research, which involves bringing many different kinds of people to the table in design processes to think about designing better or more joyful or more empowered futures. Yeah. So yeah, I and again, I do a lot of this through the lens of games because I love games. So the games on the screen are games that are like particularly memorable to me. They're all digital games, but I'm also a big fan of tabletop games and board games. The ones on the left are like the memorable games of my childhood that like first engaged me in this idea of games. And the ones on the right are like the ones that I've approached more in adulthood and have enjoyed playing recently, things like that. But unfortunately, right, games do not always love me back. This quotation at the top is from Tanya DePas, who's the founder of I Need Diverse Games, and this documentary she did about her work recently. And for me, right, when I'm thinking about working in this field and use approaching it from a lens of social justice and specifically racial justice, right, I always think it's important to acknowledge that there is a middle ground between finding something problematic and trying to cut it out of your life or cut it out of your heart or loving something so much that it can never be critiqued, right, critiquing the media that we consume and that we enjoy is, for me, a really important part of that process and a really joyful part of that process. So I wanted to share this like brief anecdote about my favorite game. Dragon Age Origins is my actual favorite game of all time. I think it came out sometime around 2008 or 2009. It's very much the game that made me realize that gaming was an important part of who I am, my identity, like things I wanted to pursue in life. But I also will never forget this kind of like negative, unpleasant experience I had the first time I played it. So this is an image of the character creation system. Dragon Age Origins is a role play fantasy role playing game. And it has one of those, like, you know, make your own character systems that has like all of this level of detail, right? There's like you can see on here just for skin. There's like skin tone and complexion and your eye color. And you're if you've got tattoos or things like that. The game has a bunch of different hair colors and hair textures. So I think like a lot of people I spent well over an hour really trying hard to make this character that looked like me. That was what I wanted at the time, just to play someone who looked like me. And I was really happy with what I ended up with in the end and like finally started playing the game. But then early in the game on the human human noble path, which is like one of six paths you can choose, you get to meet your parents. So these are pictures of the in game parents that you meet. And they're both very clearly, very visibly white, which isn't, you know, necessarily going to immediately break that immersion, right? They don't refer to why you might look different than your parents. Like there could be a number of totally reasonable explanations for that. So it wasn't really that experience that was that jarring. It was like a little bit of a hint of what was to come for me. But then later in the sort of introduction story, you're speaking to the person, the character who's your mother. And there's this stranger there who's like a friend of hers. And she brings up this like incident in a household that happened like earlier that day or earlier that week. And she like reprimands you and scolds you. And for me, that completely took me out of the game because in my family with my different cultural backgrounds and histories, right, like being scolded by your parents in front of someone who's outside the family is just something completely inconceivable. That would never happen. And that was that moment for me of like realizing like, oh, this game system gave me the ability to make someone who physically looks a bit like me. But ultimately, this game is not representative of who I am as a person. This is like really serious cultural things happening that like. I think we're designed to be open to like many different kinds of people, but really was very representative of a very white experience that like did not resonate with me at all. And it is worth noting that since then, Bioware, the company that makes Dragon Age has done a couple of different things to experiment with like how to address this in other games. In Dragon Age 2, they tried this new interesting system of using the character you made in character creation to then model the family members you meet later to look kind of like that. But in the most recent Dragon Age, they just removed your family members. You never actually see them in the game. It's just like not they're referenced in text, but you never actually physically see them. So they've skirted the problem entirely in the most recent installation of the games. So this kind of brings me to the topic of the talk today, which is thinking about like what are the opportunities that are available when we center the experiences of Black, Indigenous and people of color? What does that allow? What does it enable? What is exciting about thinking about games from that approach? And I do I mean from like a lot of different aspects. I think the conversation around representation can often get really oversimplified. That's how you end up with situations like this where it's like, oh, we let you make a person of color. It's like, yeah, but you didn't actually write. How do we think about this problem a little bit more deeply? All right. So yeah. So today I'm going to I'm going to kind of explore this idea through three different ongoing projects I have, but I want to just dip into a little brief background on racing games first. And really, the important background knowledge here is just that like this concept is not a new concept. Right. So I mentioned that in the talk abstract. People of color have always been in games, right? As game designers and developers and players and critics. So this idea is not particularly new, but we can start thinking about how can we push that agenda harder and further and actually center those experiences in the game design at the early stages of the work? And I really like this quotation as well, but I also put in the abstract from Keeshawna Gray, who I believe you all had here last year, where she talks about how gaming is a really good site for inquiry for resistance and activism and mobilization amongst marginalized users. So the other other bit of background I wanted to share in terms of how I approach this work is the lens of transformational games. So I partially use this because a lot of the work that I do when I'm designing games is designing transformational games. So you may have also heard these referred to as serious games or educational games or games for change. But I like the lens of transformation because it looks at a much broader kind of transformation. But essentially, it's this idea that that games are an incredibly powerful tool for allowing transformation to happen in the game and then to be taken to the out of game context, right? It has the ability to alter how we think, what we know, what we believe, how we act, all of these different sort of range of emotional to psychological to physical experiences are possible with this like very interactive medium. So I wanted to give just a couple of examples of that if you're not quite as familiar with transformational games, right? If we look at an app like Duolingo that uses gamified elements to teach language learning, it's something that happens in the context of that game, but then is taken outside of it. Buffalo is a card game, it's a transformational card game that helps battle internal stereotypes. Never Alone is a really beautiful video game that engages players in learning the culture and folklore of Inupaya indigenous peoples. And then Rosenthrassa is a tabletop roleplaying game that explores the erosion of civil rights in 1930s and 40s Berlin through a sort of historical fiction roleplay of a real life set of protests that happened in Berlin at that time. Yet another kind of category of games I want us to be thinking about as we're talking about this work is this idea of like counter space games. Counter space games I think can also be thought of as maybe a subset or a type of transformational game where we're taking a counter space, which is a safe space for members of a marginalized group that allows for identity expression and celebration and designing those into games. So this is work that is defined by Erica, Principal Cruz, is a colleague of mine where she wrote that, you know, counter space games leverage these like highly interactive and powerful affordances of games and play to cultivate psychological safety, interdependence and collective joy in the way that a real life counter space would work. So we're going to kind of take all of these concepts together and then look at these three different projects. So the first project I want to talk to you about is looking at how gamers of color, specifically Black Sims players are already remaking and creating game content that centers those lived experiences I was talking about. So this project is in collaboration with Angela D.R. Smith, who's at UT Austin. And this is taking a look at a community that she had the chance to participate in is a bit involved in herself. And she's starting to notice some really interesting trends in how that community engages in game modifications. So for those of you who aren't familiar, the Sims is a simulation game. It is one of the best selling PC franchises and the current most recent release is the Sims 4. So there have been four versions of the game over the past couple of decades. They also tend to release a lot of expansion packs with a lot of new content at regular intervals. This screenshot is from one of their more recent releases, which was, I believe, a spa day pack. So the gameplay in the Sim typically just kind of models everyday life, usually of people who are in the suburbs. This screenshot is from the first version of the Sims. And that very early version of the game, the first one that was released was celebrated as being quite socially progressive. It doesn't have simulation of the kinds of oppressive systems that we have in our society or had in our society at the time. There isn't racism or sexism in the game. It allowed for same sex relationships, which was really unusual at the time that the first game was released. And modding is a big part of gameplay in the Sims. So the creation by game players of their own custom content or custom traits or other ways of changing the actual format of the game is a big part of the gameplay. It's like something that the publishers allow for relatively easily. So the kinds of custom content you might see would be things like different houses in the game. You can see here like this is the sim is in a house. Like you can release different designs, clothing, skin tones, hair textures, makeup in the game. More recently, there's a lot more like meta gameplay modding. So you can actually change some of the behaviors of the Sims. You can allow them to do different kinds of interactions, follow different job paths. You can give them different personality traits that, again, affects like their AI and how they interact with other Sims and with the world around them. And I also want to talk a little bit about who the Sims players are, right? So this is a very popular video game franchise. The most recent version has well over 33 million players. And the majority of those players are young women. So specifically women who are aged 18 to 24. And that's part of why I think this is such an important game or games in the genre are important to look at. Because when we talk about game is research and games work, that's an audience that we tend to overlook, even though the majority or quite a large demographic of game players in the US are women over 30. We don't tend to think of the kinds of games that they play and enjoy as being like mainstream games, when in fact they actually are. So what we wanted to explore with this initial study in this like modding behavior is why are black simmers modding the Sims? Like what kinds of content do they want? What is the motivation behind those things? And then like when they're actually modding, what is the kind of content that they're creating and using? So like I mentioned, this is very ongoing work. I think as of this morning, we've conducted, I believe, seven interviews. So these are one hour interviews that we're doing over Zoom. And the participants have all been recruited from a black simmers Facebook group, which has got thousands of people in it who are sharing game mods. They share screenshots of their gameplay with stories attached to them. They help each other out and like post like YouTube tutorials and things like that about how to create mods yourself or how to install mods or do things like that. So some of the questions that we ask in this interview study are, you know, what kind of content is essential to your game play, whether that's content from the base game or expansion packs or mods that you either have made yourself or that you downloaded from other creators. We ask them to tell us a little bit about their favorite sim households, who are the player characters in that household. What do they do? What are their personalities? What's important about them or enjoyable about them to you? And then for people who create mods, we ask them, like, what mods have you created and why have you done that? And then if you if for folks who have only used mods, we ask them like, well, if you could create any mod you wanted, what would it be and like, why would you want that in the game? So because this is ongoing, we haven't done formal data analysis. We've been doing things kind of on a rolling basis, debriefing. So I did want to share a couple of early quotations and themes that are starting to emerge with this work. So the first is just looking at like, what does representation in the context of this game look like and what does it mean and what's important about that? So we have a couple of quotations here from different participants, right, talking about one participant really wanted to focus on black women in their games as a non-binary participant, but who really wanted to explore the sort of softer feminine aesthetic of black women. And they felt like that was a form of resistance against the ways that black women might be stereotypically represented in other games or other game genres. So they talked about hairstyles as being part of that, as clothing being a part of that, but then also these sort of other ways that the Sims interacted again with other Sims and with the world. We had other other participants talk about, again, going deeper on those relationships, interactions, right? When my Sim is talking to other Sims, what are they talking about? Are they talking about things that reflect the real relationships of people that I know in my in my life or in other, you know, communities that I've interacted with? But this isn't something that that the participants necessarily wanted everyone to have access to. So we had this sort of note from from one of the participants about ebonics, right? So she said that she did want ebonics to be in the game. So or, you know, AAVE African-American vernacular English, but she didn't want that to be broadly accessible like to the Sims in the game or to other people who play the Sims, right? She's mentioning like this is you know, I would love to see this screen-to-image represented, but I don't necessarily want my white Sims to have access to that. That wouldn't be appropriate. And I have a couple screen shots here again, just of like what some of these mods look like. So the one in the background is a trait mod for anime lover that a very popular Sim mod creator released. So again, this changes the personality of the Sim and what they talk about and what they like and how they interact with other Sims. Then the screenshot in the front here is different a makeup release mod. So this was this creator created different lip glosses that looked good on Black Sims and released that to the public so anyone could download it. And then the second big theme I wanted to highlight today from the sort of preliminary, very informal analysis we've done is going deeper into what does representation actually mean and what's the purpose of representation. So a lot of participants were speaking about reality. And in fact, I believe every participant that we've interviewed so far has at some point brought up the idea of making the game more realistic. So I want to interrogate that idea a little bit like when every when every single person saying that, what do you actually mean by realistic? And it looks like representing aspects of culture that are not already included in the base game. Right. So we had some participants talk about changing the entire neighborhood so it was filled with other people of color so that the interactions that their Sims had in the neighborhood were more reflective of what real life might look like. A lot of them talk about how the mods are essential to that. You cannot do that with the game as it's already built. There were a lot of other intersectional identity concerns, right? There are other aspects beyond race that participants in the study really cared about.  It's just a way of reflecting reality and specifically reality as a pathway to immersion. So immersion or escapism is a really big part of why a lot of people play games, no matter what the genre is. But when that game doesn't reflect reality, right, very much in the way of the anecdote that I shared at the beginning with my own gameplay, it really pulls you out of it. It can be very jarring. So creating these mods and using these mods are a way of, again, having the game actually reflect what the world around us actually looks like. So with the second project I wanted to share today, I move a little bit away from studying games and look more into making games. Specifically, the goal of this second project was to make a game that represented the experiences of students of color at predominantly white institutions or colleges. This is done with students, Chris, Jamie, Dilruba and Veena. So to give a little bit more background in why this was the motivation behind the project, when you look at the literature on the experiences of Black, Indigenous and students of color at PWIs, the majority of the literature tends to focus on sort of pathologizing the student of color experience, right, tends to focus on achievement gaps and attrition and the disadvantages the students are at. And while there is a certain amount of reality in there, the sort of over-representation of these sort of traumas and the sort of deficit lens of students of color, I think is really detrimental to how we think about and how we talk about and how we center those students, right? That is, it's missing a big part of what that experience actually is. So some of the work that does focus on sort of more joyful experiences or powerful experiences that students of color have, look at things like cultural centers as this site for identity-relevant work. Specifically, there's a paper last year by Leanne Hippolyte that was exploring what is it about Black cultural centers that are so effective at increasing feelings of belongingness or just being a space that is comfortable and safe for Black students. And really the main mechanism that she found that was effective was this idea of seeing other people have gone through the same things as you, right? You could imagine a situation of being one of a few number of students in your classes as a freshman, but when you're going to cultural centers, you're able to meet students in other departments, students who are older than you, people who have gone through the same experiences that you have and being able to see something like a role model or just that your experience is not isolated is incredibly powerful. So that was sort of the motivation of exploring this with a game. I wanted to create a game narrative experience that did that same thing that showed that these experiences are shared by other people, real life experiences of navigating these situations that would do that sort of same thing of showing other kinds of role models. And I will add to that that, of course, like, ultimately, what is really necessary there is that we advocate for those resources, for resources for cultural centers at universities. But again, this sort of game design exploration work is a way of looking at other alternative ways of trying to to share that that mechanism that is so helpful and potentially powerful. So some of my previous work, if we're talking about representation and how games do or do not represent diverse people as well, I looked at a bunch of different tactics that games are already using to to achieve good identity representations. This is not just for race, but for other aspects of identity. And in analyzing a bunch of games that actually do have relatively good diverse representation, I came up with this list of five design tactics. So, you know, there is visual design that can be an important part of representation in games, but there are also all of these other game system things that you can be doing that will make that representation more than just physical appearance, right? So the setting and roles, the way you design conversations, the rule design, the abstract representation of characters are all ways of doing that. So for me, the nice thing about this project was also an excuse to put some of this work into action, because this was all sort of an analysis of existing games that were published and available on the market. But I wanted to be able to take some of this work of mine from a couple of years ago and put it into action into active design work. So in addition to lenses of critical race theory in my work, I also incorporate intersectionality and in my games work, I often lean very heavily on queer theory, specifically queer game studies. So as my team and I were conceiving of what does this project look like? What does the game design work look like? We were looking to extend some of Bo Rupert's work on queer games to think about what does it look like to make a game that is designed by for and about people of color? And then the sort of second question that we're exploring with this project is how do we actually accurately and faithfully capture the experiences of Black, Indigenous and students of color at predominantly white institutions in this game context while respecting and treating those stories well? So we worked on the game design for this proposed game for about three to four months last year in the fall and spring and the sort of conclusion that we came to at the end of that prototyping work that we did was a couple of things. The first was that it was just incredibly special to get to engage in that process of making a game that was again by for and about people of color. So I had the chance to work with two students of color in this project. A lot of our early work on the project was just all of the preparation of setting ourselves up for success. So we spent a lot of time figuring out how to make a creative design space in our project meetings that allowed us to deal with topics that can be sensitive or that can feel a bit taboo when you're dealing with people that you are just working with for the first time, making sure that we found ways to acknowledge and uplift each other's humanity, making sure that it was a safe place to share vulnerable experiences, to design around those, to interact with them with each other, and also make sure that we're doing good and rigorous work. So these are just a couple of examples of what we did that I'm hoping others can incorporate into design processes. One of them is creating a shared list of agreements or community agreements that very much comes from my work in racial justice spaces where you have to think about what kinds of values are you going to uphold in this space and how do you make sure that everyone is accountable to those values, including supervisors. So yeah, the goal ultimately was to kind of create an environment where vulnerability is welcome, but it's not required. That's another really important aspect of that. So again, the conclusions that we came to, right, so one it was like very affirming and exciting to do this, right? This was for me in the space like one of the first times I've shared with students, specifically what it was like for me to be in college as a mixed-race person, the experiences that I had that were uplifting and affirming like student activism, the bad experiences that I had being questioned about my own identities and the students did the same, which I was really excited about because it gave me space to write about those things and some of my other work. So we actually ended up publishing a short paper just about the design process. There was already so much we found out just getting to do that work together. So a couple of the things that we write about in that short paper about what that looks like and feels like to do this sort of BIPOC game design process was that like, yes, it is a little bit scary. We found out that a lot of the game design conventions that are taught to game students and game scholars don't actually apply in this scenario. So one example for us early in the process was we were making a tower defense game and one convention in games is that because of things like growth mindset that are built very well into games where if you fail at something it's sort of psychologically acceptable because you always come back to life, you get to try again. That simply doesn't apply when the entire audience or the entire cast of game characters are students of color at a white academic institution watching students of color die or fail over and over again in the context of the game. It doesn't really have that same impact that like is written about in many different game design theory books. So you know there's a bit of pressure when it comes to doing that kind of game design but for the most part it's an incredibly joyful and affirming process to incorporate those kinds of values into a design process. So a lot of what we did was try to empower each other to speak up to say when an idea for the game was harmful or when it needed to be thrown out because it wasn't working and it was very joyful to just see like mundane everyday representation. Our narrative designer Chris wrote a bunch of scenes of just students going to the cafeteria together and studying together doing these things and just getting to see students of color in that environment doing everyday things was like surprisingly powerful for all of us because we realized we didn't have media that that showed much of that prior to our work trying to spin this up on the game. So beyond all those process things that we learned the other thing that we learned was that yes we did have enough juice as a team to create a game prototype just filling it with our own experiences but at the end of the day that was not enough to build out a whole game and we had to actually return to sort of old standby for me which is collecting people's stories. There are just not publicly available narratives about what it's like to be a college student of color at a PWI. We had a lot to share from our own personal experiences and experiences of colleagues and friends but ultimately if we want to actually do this properly and do it faithfully we needed to go back and actually collect more data and more stories about this. This is another ongoing interview study that's happening in my lab where again we're kind of asking questions about sources of joy and strength and resilience as a student of color at a PWI and then asking questions about like what was surprising? What were you anticipating? What went well? What were some things that like you wish you had been more prepared for for those experiences? And even though we're not at the design phase right now it is this work is trying to take on a bit of a spirit of assets-based design in treating our audience students of color at PWIs as experts and treating those experiences as valuable and something that we should center the design around. So again I wanted to share just a couple of preliminary quotations from our early data analysis. This study I also believe we have around six or seven participants completed at this point. We're pausing data collection until we pick things back up again in January. But yeah a lot of the findings are unsurprisingly about the need for counterspaces and part of what we're trying to do again is drill down on the specifics there. So we have students who are talking about like what it was like to be in a space that leveled the power dynamics between faculty, staff and students so everyone could engage with these ideas of diversity and inclusion. So you could run programming where everyone is in a space of learning together. There was a lot of discussion of what it feels like to be able to lower your guard when you're in a space because you know that people are not going to come up to you and question things about your identity or ask you to teach them things about yourself.  So again these findings are not particularly surprising but what they did offer again is very specific stories that hopefully we can also incorporate into our future games work in addition to just shedding more light on what this experience is like beyond the sort of lens of deficits and trauma. And then the last project I'll touch on today just very briefly is another game design project that more directly confronts those uglier experiences of prejudice and identity that I mentioned do come up in some of my previous work but wasn't necessarily the focus. So this last project looks at again the power of games to teach and to transform and also as sort of a jumping off point for thinking about the future in terms of speculative design and designing for the kinds of futures that we might want to engage with. This is with my other students, Doxa, Shinyu, Hung and Dilruba. So again once again going back to motivations the original motivation of this work was that I just wanted to be doing participatory design work. This is work that happened at the end of my PhD thesis. I was looking at the topic of interpersonal racism at the time so it was a little bit more focused on negative and traumatic experiences but I wanted to engage participants with speculation and thinking about the future of what does it look like to be supported when these sort of negative experiences happen and while there are a great number of participatory design and speculative design exercises that have been used to do that kind of future thinking most of them were not easily adopted to something as sensitive as experiences of racism and for me sort of the immediate thought was like well games are again once again a very powerful tool for intervening in that kind of space because they're so immersive because they allow you to take on the role of another person role playing has been used in those kinds of very serious clinical contexts for dealing with sensitive topics and unlike reading a fictional story or watching a movie the interactivity of games gives a lot of agency to the person who's playing or using them and making choices about how they're going to interact with the content. So if you're not familiar just a brief definition microaggressions are subtle sometimes unintended slight insults and exclusions there are racial microaggressions but there are also microaggressions across a number of other forms of identity like gender sexuality etc. So for this work what I did was wrote an interactive fiction vignette about a college student who experiences a racial microaggression. So again the sort of first person perspective allows participants to engage with an experience of racial prejudice and aggression from a first person perspective but without unnecessarily putting that participant in those actual shoes in the way that like a deception study or something else more live would do. So this story follows a character named Sam who's in a research lab they go to have coffee with a visiting professor where they then encounter three back-to-back racial microaggression statements. So those are your English is so good you're so articulate and where are you from where are you really from where are your parents from and at the time when I designed this game the purpose of the game was to be again a jumping off point for a speculative design so I asked participants to play through the game and then they did this design activity where they analyze the game and they started to find opportunities for design started to relate it to their own experiences and we did sort of participatory design workshops doing those activities in groups where then the participants produced these like storyboards and ideas for futuristic technologies that would better support them through experiences of racism or prejudice. So that work is a bit older the current ongoing work in the space comes from the feedback that I actually got as I was presenting this work after it was completed which was I was constantly getting this question about like oh this is like this vignette is really interesting can you use it to teach people about microaggressions. So last summer I had three incredible master students who extended the work they looked at different opportunities for using the game to teach different ideas about microaggressions so one version was created to look at historical perspectives on microaggressions like where do the stereotypes come from that are then harmfully embedded into microaggressions. Another version looked at this idea of allyship and bystander intervention so when you see a microaggression happening how do you recognize it label it how do you speak up either for yourself or for someone else and then the third version is mostly getting out the information about what is a microaggression what is it that makes it so harmful for the people who are experiencing it so all these first two are a little bit more aimed at allies and accomplices who might be able to do something when they see it happening or who might be able to like learn themselves to not inflict those other people the third version is a little bit more about people who experience microaggressions and understanding like why does it make you feel so tired or exhausted or you know like why does it feel harmful to like your sense of belonging in a space when you hear these microaggressions and part of the motivation behind this is that a lot of people when hearing a microaggression will have the instinct to brush it off and act like it doesn't matter because it's not an overt form of prejudice but they actually do end up being quite psychologically harmful. So one note I wanted to say about this work is again this design work is ongoing it's that I'm very proud of the work that these students have done but one of the things that we're doing right now is is choosing to move forward very slowly and cautiously with these games. There are a lot of really great empathy and learning games out there but there are also some really bad ones that can be more harmful than good so what we're doing now is doing a lot of assessment about making sure that the bystander interventions in the game are validated that we're being sensitive to the fact that these are real experiences that people have had who are likely to read these games. So we're trying to move forward sort of cautiously in how we choose to move forward and release these more publicly. All right so to wrap up today I wanted to just summarize a couple of my thoughts and things that I've been learning through the process of working on these projects and a little bit about where I hope this work is headed for myself and for other people. So for me there are a couple of good opportunities here and again centering people of color in a game design experience. The first one is just to remember when you're doing work that is meant to have some kind of systemic change or you're looking to be more inclusive. The number one thing is to look at what people who are already working in that space are already doing right as I mentioned up top right people of color have always been in games streamers developers designers etc and they're already playing people who are doing the work of reclaiming and remaking game spaces. Some of them are doing it within the games industry and some are doing it by creating their own communities and spheres of influence. So for me that's just a general go-to tactic whenever I'm working in a space where I'm looking at systemic change is that looking to the people who have already been doing the work finding ways of uplifting and supporting it and sharing resources and spotlighting the work I think is the kind of first place to go. The instinct to always start from scratch I think comes from a colonial mindset that I is a habit that I want us as academics to break as much as possible. The second is not really a directive it's more of an exciting feeling that I felt and that I've seen other people on my teams feel which is that like when you get the chance to do that representation correctly and when you get to center those experiences it really does uplift the joy and humanity of all of the people who are involved it's very exciting in a way that like I did not realize I was missing when I first started these projects and then finally like it's not just about the output right of what we're making it's also about the processes that we use on the way to that ultimate design right so embedding some of these you know community values and centering these ideas of like joy and humanity and rest in a design process is really another way of sort of uplifting all of the people who are going to be involved in your design teams and processes so like I said a lot of this is ongoing work there are still interview studies to complete and there's going to be a lot of game design work that's happening in my lab in the spring I'm also looking at other aspects of the work with a couple of collaborations so Chris Martins and I are looking at using tabletop story games as a way to think about speculative, liberatory futures and I'm also working with Christina Harrington on a more generalized design framework that again kind of centers the cultural values of people of color joy, wellness, rest and things like that. I did want to shout out really briefly a bunch of other kinds of things that I work on if you ever want to chat about these or connect about some of my other work I do a lot of work in critical race theory and HCI intersectionality and intersectional feminism and HCI a lot of my work also is at the meta level of looking at the culture of academia a short paper that came out like a year and a half or two years ago I'm lab counterculture like how do we make academic labs that center equity and think about things like power hierarchies and dynamics and flattening those things I use some work on scholar activism and a bunch of other games projects that I really enjoy. So with that I do want to acknowledge my incredible collaborators as well as my students they're the reason why I get to do all this awesome work this was the first semester that my first year that my lab was doing lab meetings so we've been working a lot about sort of ingraining the kinds of cultural values or just like workplace values that we want to ingrain the lab moving forward that's been really exciting and joyful work for me to get to do with my students. So with that thank you all again so much for having me here and for your time and I'm very much looking forward to our discussion. Great thank you so much I know we're all applauding but we're mostly muted so but I know everyone's applauding because that was a terrific presentation um let's open up to questions and comments to discussion with the audience. See we have just a note from TL so interesting it's such important work thanks for sharing. Marvez I think just put a hand up is that correct and then it went away anyone? I can kick us off um it's a kind of it's a sort of an all-question following such exciting and interesting research but I noticed that you were doing this the Black Simmers from the Facebook group study was a collaboration with T Austin and that there was a note at the top that you had IRB approval from Northeastern and there were little details like $25 payment to participants and so on and I thought it might be of interest to our grad students who are working on their theses and formulating their methods and constructing research studies and so on for you to talk about how that collaboration came about a little bit and and funding issues and just sort of give them a picture that would help them as as budding intellectuals in this area budding scholars in this area. Yeah absolutely that's a that's a really great question um yeah it was really interesting. I first met Angela in 2019 we both attended the CHI conference which if anyone who's not familiar is like the really big HCI conference in the field uh this is Scotland that that year which I think was the last conference I attended before we went uh only to virtual things um so yeah at the time um there wasn't that many people talking about race at all in in the field of HCI um or if they were they were attending to use a lot of coded language um you know like things like marginalized or um underrepresented right never actually saying actually race um so when I was attending the conference um and I'm encouraged as for any any students were thinking about going to conferences or who might be able to go or um can find the time um that's that was a really big value right of going to find people who are excited about the same topics as you so I was like going to those sessions with like the coded names for like part you know research with vulnerable communities and got a chance to meet Angela and also Finda who is the other co-first author in the critical race theory for HCI paper that that we wrote along with Kentaro Spayama who is Finda's advisor um so yeah I mean finding people that you vibe with in academia is like one of the the biggest uh most important things I think that you can do like we found that we were excited about the same research questions and problems we did that critical race theory paper together and said like oh well now this is done uh what are other opportunities we have to work together so I think sometimes when you're looking to collaborate sometimes you're looking for someone very specific we're like oh I know I want to work on this problem I need someone who has this other expertise let me go find people but in other cases like um my uh collaborations with Angela it was like hey let's have a meeting where we just sit and talk about all the things that we're excited about and let's find an overlap and see if we can spin up a project from there so that was very much where that project came from um I was mentioning that like you know I'm in a games group um Angela I believe is in information science we're trying to figure out like where is there a good fit um with the things that will get us to move forward in our careers but also give us a chance to work together so that was a big part of that um and then in terms of the the logistics um they ended up not being too too difficult um there's a lot of infrastructure at universities for cross university collaboration you want to work with your IRB offices and kind of figure out who owns things a lot of the logistics come down to like data safety and security and things like that so those are all logistics that like once you know what you want to do relatively easy to figure out you know work with your administrators and people and you know treat them kindly and and those things tend to work out relatively smoothly it takes a while but it's not too bad great thank you um Marvez is uh next and I believe he's having some video trouble but it has it's fine with audio so we might not see Marvez but we can hear them uh can everyone hear me okay yeah okay sorry I don't know why my video doesn't seem to want to cooperate to it but thank you for your talk it's really interesting um one uh in my lab we uh create uh educational simulations to help teachers practice like enacting moments of equity and I'm curious how uh your lab goes about balancing like authenticity with like a simulation design like what elements of reality do you abstract away so people can focus on the like microaggressions or the moments of inequity uh yeah thanks yeah that's a really great question and it's like a difficult one right because you never want to uh accidentally trivialize things by removing the elements that are important so really I think it just comes down to like play testing and user testing for me right like bringing um as many stakeholders who are impacted in as you can with the time that you have and making it very clear that like your your game or your system or whatever it is that you're working on is not complete it is open to change it likely has assumptions in it that are maybe correct or not and that when you're bringing someone in to do a user test or a play test like in the context of games right that like that person does not feel pressure to say that it's good because of like you know the bias of wanting to like make you feel good or pump you up or like uh say nice things about your research um trying to encourage that that process of iteration and critique I think is a big part of it like I said the game that my students and I were working on on the student of color experience it's right we had a couple of of major game design overhauls right where we have been working on this one design idea for like a month and a half and eventually we're like staring at it together and we're like hey I think this is actually potentially really harmful and it's a very painful moment but making sure you're building in that time and those protections to let that happen and to treat it like a good thing because hey at least we're learning something and moving forward I think is is helpful that's also more of a tip for supervisors maybe then for students right but like make sure that these timelines are not going to sacrifice the quality of the work and end up actually harming people thank you we have a question from Tomas who asks a type question thanks for the fantastic talk I was wondering if you thought about any parallels between the sims and theater as a media practice and the strategies that marginalize public views in oh that's a very cool question well I will say I'm I don't know too much about theater so that I probably wouldn't be able to speak with any authority to those parallels but your question did make me think of some interesting things that happen in the the social media groups around the sims that I think have some interesting interactions so I think you know something that I I want to do with the project in the future is do a little more content analysis of some of those things so there are like I said the facebook groups there's tumblr groups around the sims there's discord groups instagram twitter like the community is all over the place but one of the things that especially happens on facebook and discord is that people engage in a lot of storytelling there so there um a lot of participants have spoken about this which is why I'm able to speak to that a little bit more even though it wasn't the focus of the study but people are like crafting and creating their own storylines with the sims and taking screenshots of their sims and like writing up short narratives about their relationships in the game and all these things and then post them to the facebook group for other people to read as like a kind of mix between like fan fiction and short storytelling with these like visual aids of the sims so I think that's really exciting to see how people are like engaging that kind of creative activity I'm not sure if that entirely answered the question you had another thing it also made me think of is streamers there's a lot of streamers who who like play the game and stream the sims to other people some of them create and use their own mods some of them don't but there is kind of an interesting interaction there where people are sharing a lot of their gameplay for a game that is like a single player game so I don't know that's like totally really do the question that you asked but are some interesting things that I've noticed as I've been like diving more and more into the community aspect of it super thank you um who's next uh Mike hi Alexandra I also can't turn on the video but I think your talk was great so we're doing a lot of similar work here in the MIT game lab and one of the things that uh we often think about and struggle a bit with is uh what how do you create sort of a long term change if you come into a community or into a context then you run a couple of workshops you make some games together something like that but then uh you know you at some point you have to leave uh and what you leave behind uh I was just curious about your your thoughts on that yeah I I really love that question um so I one of the the frameworks that I use that I had a very brief slide about is called assets-based design um an assets-based design right is is trying to respond to um that's sort of a HCI framework that we tend to teach our like early HCI students of need finding right so where it's like when you're doing work you go to a community you assess what needs they have and you design a fill those needs and then you leave like as you're saying right where it's like it's suddenly you disappear from the process and assets-based design is meant to look more at what are the active practices of the community already right how do we treat those as valuable how do we integrate any designs or interventions that we create as being embedded in the existing practice of the community as a way to make sure that those things last and that they're more long-term just like dropping an intervention on people then like walking away and saying like oh I did my study and I'm done it's like trying to more actively work with the the current practices um so that's like the the general like framework theory I tried to center when I'm doing this kind of work um but I will admit like a very long-term evaluation study is not something that has been on on my uh sort of research catalog history it is something that I really want to do especially as I'm starting to think about moving into educational spaces with um potentially younger game players but uh has not come up directly at my work yet so I would love to talk to you more about this and maybe other ways that uh we can collaborate with you for in the game lab but thank you that was the good answer and know us to say hi as well to everybody yeah that sounds amazing yeah thank you for the question boy now I wish my cats were allowed in my study but they're not they're too destructive and distracting um we do have video now and as Scott points out now you can see us all smiling and nodding vigorously we can turn on our cameras if we if we choose to um do we have any uh who's next Scott? Yeah Scott unless it's just me I think something's up with your mic it's a little hard to hear yeah it almost sounds like you've got a bad input connection Scott it's it's robotic sounding yeah you're welcome to type your question if you'd like exactly yeah Scott could you type it I'm sorry that's frustrating while you're typing though it is great to see that I'm glad you're able to type I've heard very great things from my PhD advisor Jess Hammer so nice to you okay we're just pausing for a second while Scott Scott who claims he's not a robot I think might be a robot but uh yeah he says his question might take a few minutes so um can we from from anyone else in the interim ah Marvez now uh with working video yeah so uh for the games your lab has been working on what um like platforms you used to develop these games typically and I'm also really interested how you go through the prototyping stages like when you feel that a game is ready to move into like its software version yeah I will say um I'm very enamored of tabletop games and board games so I that tends to be the medium that I like to stick with but you know as someone who's a joint appointed in a computer science department I recognize I probably need to move into digital a little bit more than I am currently um I also I really like twine because a lot of what I do is very narrative heavy and it's you know open source it's a very easy to use tool for for folks who are making games for the first time um I did uh that was one of my summer ambitions that that uh worked for two weeks and then failed which is I tried to take a class on unity over the summer and I was like nope didn't happen don't have the motivation to like learn a whole new thing right now but a lot of my students um because we have a um a really great games undergraduate program at northeastern there's also a master's program there's a lot of really great talented game designers and developers that I have a chance to work with so the um BIPOC PWA game is currently being developed in unity um and in terms of prototyping I think again it's like a very HCI mindset to want to stick with paper prototyping for as long as you can just because it allows you to do that thing I said of like throwing your ideas out way harder to throw your ideas out when you had someone spend like a couple months developing something on a very specific platform with you know sort of very specific mechanics built into it um so I actually I didn't put it on any of the slides but I um years ago published a paper at meaningful play on a process for design transformational games um where I talked a lot about like the iterative cycles you'd go through of um doing research coming up with your idea doing the necessary background turning those ideas into a physical prototype that you continue to play test um and then kind of go back and forth between those cycles so it's mostly just incorporating like a very HCI mindset of iteration and um in terms of when you know you're done uh that's where I think the transformational framework really comes in handy so that's Sabrina Salba's work um the website you can find us like transformationalframework.com she's got a free um PDF of her book available on the website um but she talks a little bit about like how do you define a transformational goal how do you make sure that you define your audience concretely and how do you define the kind of change you want to see and that helps with like whether it's like formal research study measures or just like anecdotal observational behavior that you see when someone's playing your game of like did the change that I hoped would happen actually happen um so it's all very abstract I can give a specific example um again from my like early thesis work I made a a board game that was about encouraging curiosity in uh underrepresented students in STEM at the middle school level um but that idea of like encouraging curiosity is a very abstract big goal so um using the transformational framework we like kind of drilled down on like what's a specific element of curiosity that we can actually see that we can actually measure what we ended up going with was question asking so then it was a very simple matter of like every time we test the game we can literally just like record like how many questions is each student asking when they play the game what are the quality of those questions can we assess them for like whether or not they're using aspects of like hypothesis testing um or the scientific method or things like that um so you find those like metrics that you're looking for and then you can start to track those over time each time you do a play test great thank you Shresti All right this is actually Thomas from Shresti's got me um so this is me again how's it going uh so I'm interested in in in the extent to which moths can serve as a counter strategy to creating media in the sense that you know sure that you can create beautiful things around the sims but first the sims is built as a race blind game but it's also a game about capitalism and the patriarchal family structure right it's like and the if their constraints are very much there the ideological constraints so I was wondering what are the limits to this media making strategies for you yeah that's a that's a interesting question um I will say uh I don't know this again directly answers your question but I do think I've seen how in just the short time working on this project right how much the modding community um by creating this sense of community by creating this fear of influence by advocating and talking about the kinds of game content they want to see in the actual game has had an actual influence on the games industry or like if we're talking at least talking specifically about the sims right so if you look at the promotional material for that that expansion pack I talked about the spa day package it is very clearly targeted towards um black sims players right they're the the content that's in there that they're using like the trailers are all using like Megan the stallion music it's like focused on different um black cultural hairstyles and nails and things like that um so I do think that like any of this kind of work is actually quite powerful and showing that there is at least a market and an audience if we want to talk about it from like a capitalist perspective um but yeah I mean ultimately you're right right like the sims is a bit unique in that the modding capability you can do in there is actually pretty deep like you can actually change the game mechanics quite deeply one of the modifications um that is in the I believe the MCCC uh mod package is a mod for child support right so that is like a deep element of gameplay that's not just like oh I downloaded a a skin tone that wasn't available before it's like actually changing the structure of the gameplay um so at least for that game in particular there's actually quite a lot you can do to change the structures but in general um ultimately yeah it's like what you want is to show that there's a market and a need for these things and that hopefully changes the actual games industry into making that content um can I follow up with a question so I think that's a very interesting point but I wonder because you know most not not all games can be modded so I was wondering if you if you if you if you found anything about EA's discourse around around allowing mods from the sims I understand they are allowed since it seems to um and they seem to be very powerful compared to other video games where the mods seems to be like no skins or like something very superficial I was wondering if you if you saw that as a core part of their proposition that sims builds I'm not sure I'm not sure because I haven't really read as much about what EA if anything they've published about like how they're making any of these decisions I do think that would be an interesting thing to explore the future to like try to see if you actually like get in contact with the the folks who are like leading design and development over there but I I don't I wouldn't be able to speculate about that great thanks um we do have a question from Scott now which I'll read aloud the film television industry seems to have turned a corner in sometimes centering Bipod voices even if it's purely for the profit motive do you see comparable movement in the commercial games industry yeah that's a great question I mean I don't I don't know that I have felt a huge change from like industry with a capital I right like really big game companies or things like that but I do think I've seen a lot of again that that that sort of distribution of power right you know there are a lot more indie developers who are able to crowdfund or get their own funding or self fund their own games or who are able to make prototypes or pilots of their own game content and have found an audience that's really eager for uh games that are again biforn about people of color so I think um the the ability of people to like access the audience directly and having that power not just centered and located on like bigger studios has I think created the opportunity for a lot of change in terms of the industry itself I hope that they catch up I was I this semester was teaching rapid idea prototyping with the undergraduates at at CMU and we were looking together last week at just like basic kind of market game stats from 2020 about like you know like what games are making the most money and and what are the most popular were the most popular platforms and that Spider-Man expansion for Miles Morales was like up there on one of the top 10 lists right like there is a huge market that wanted that game that was excited for it but it wasn't the standalone game it was just an expansion so I think if the the games industry would see that um hopefully that'll motivate some more change but yeah it's a funny thing right like it's these bigger industries like you know entertainment and games it is at a certain point gonna largely be profit-driven and I think that for some people that can be pretty disheartening like I know that's it was a tough thing for me to swallow when I when I you know finally came around to you know seeing capitalism everywhere um but in my um uh critical race theory work right one of the core tenets of critical race theory is the idea of interest convergence right and it means like accepting the idea that um social progress and justice historically has not happened unless it's in the material interest of the majority and again I whenever I've shared kind of that concept of interest convergence to the audiences I've had a chance to speak to I do try to encourage people like try not to to let that bring you down into a defeatist attitude it's more like having that knowledge is always going to be a useful tool in any kind of advocacy work you do like capitalism does drive a lot of the way things happen at least in the states um and I think that that's hopefully a useful leverage point but it's not a difficult one to have to deal with in confront great thank you um do we have anyone else uh queued up or any other hands going up I at least have a question for all of you which maybe folks can answer in the chat or out loud I would love to hear more about the games work that that y'all are doing if you have like links to websites or things that I can check out I'm always excited to learn more and find out what's been going on over uh other places in Boston that's that's um great and I and definitely um I would encourage uh people and our students to email Alexandra later but also if anyone has any links they want to share now or any uh just work that they want to talk about anybody out there please any and all of that I'll put my email in the chat also for folks who don't have it thank you that's great thanks I'm just waiting a second I think we might be uh played out because it is the last day of classes and um uh I think we might just be a little tired and maybe need to end colloquium a little a few minutes early today um I'm just giving another second for anyone out there but yeah I think we may we may be done um thank you so much Alexandra for your time it was really uh terrific terrific to to see you work to learn more about it um I want to take just a minute for a few announcements to sign off um let's see uh all right this is our last colloquium obviously of the semester and we've got one coming up on February 3rd uh with the title changing the subject lean notages by the way meet very stark in the making of black women's film history that presentation is by Samantha Shepard from Cornell so pretty excited about that we also have um some finalists for our job search in the areas of computational and or industrial studies who will be presenting uh throughout February and perhaps into March probably five uh five talks there so keep an eye out for that we'll send you updates when we have them um we've got um someone speaking a Spanish language uh podcasting who is a current Neiman fellow so that should be great and we've also got Raquel Gates coming uh still in the works but she said yes but we're we're waiting to see if she's going to be virtual or in person uh from Columbia University speaking on um probably on Melvin Bam Peebles she she collaborated with the criterion on their box set of Melvin Bam Peebles films so um just to give you a little taste of what's coming in the spring and uh we will keep you posted that moves along uh thank you again everyone for coming and uh to Alexandra for your time it's wonderful and I'm just going to thank you so much for having me yeah this was fun great thank you thank you so much