Okay, there's not much of the agenda. I think we're going to have a quick meeting. And so the third item on the agenda is comments from the chair. There's a few things I wanted to invite Kim to talk about and something he forwarded that downsizing group. But first I just want to acknowledge that our planning department has been operating without a zoning administrator and implementing new zoning. So we're going to have a pretty thin meeting tonight. And as when you get the new zoning administrator in and we're fully staffed, we'll move up and get things going. So we just have to be a little bit patient right now. Or we have to do the work ourselves. Those are our options. We'll be patient. Just to acknowledge that some people are working a lot right now. And then are you at Liberty to announce that he is on the industry? Yep. It is Meredith Strobridge Crandall. So she grew up in the area. So some people might know her and she's a VLS grad from her JD. But she lives in Worcester and doing this. Is she still 8-tenths then? She's still 8.8. Yep. That's fantastic. So it's very good. We have an excellent candidate. I think she'll be good. In addition to everything else, with the vacancy, we have been renovating the office downstairs. Yeah, nice code. So we switched offices. So I'm now, if you come in, I'm on the right. I'm where Sarah used to be. And Meredith is in. For all this. A major site plan. A building permit for your colors. From the downsizing. Oh, I just thought it would be of interest as to what the building is going on in town. What's happening. Those projects. And some of them are out of town. You mentioned the Main Street project. The French Bob? No. The last time you see people pick up trucks. And they're hobbling around on the notebooks. You know you're in trouble. So we had some of those guys around. It's been a long time. I couldn't believe it. They were working last year on it. And they put in some. They put in sketch plan. They did. For a QD. But they never submitted a final. So they'll be on the news. I would think so. I don't know what's going on. Okay. I didn't see it in there. One iteration was to do business with this. Not many people asked me about it. So I couldn't see. You all know. I'm not accused of any. Discussions. If there's any action to be taken. On 250 million. At least that allows you to speak. What's that? You can speak at development review. At other meetings.  I just sent out the links. To several different links. And I'm not convinced the orca one works. So I sent out the one. Through METZero Vermont. Which is much easier to navigate. Thank you for doing that. Thank you. It came in this afternoon. I know it was not early. It's okay. We fell asleep since we didn't have a meeting two weeks ago. I know. It was with the Lucera leaving. Made sense. I had to miss the meeting too. So it seemed to. We'll just skip that meeting. I could give just a brief report. On my visit to the historic preservation. Sure. It would be great. There were two meetings. One was public meeting. And it was pretty testified. Several others. I was going to either see. Either see that. Or no one was speaking. The usual way of thinking. It was a real bust. They told the committee that. I think it did. It did cultivate some. People that are interested in this. Something to be testified. And it was a good start. For the next meeting. We'll see what. Design review ordinances from. Five different cities. Passing them around the table. Against. This is your guy's job. If you're going to get an idea. Through your expert. One of the things that was presented. That meeting was. Essay by. Was essential. Is. Historic preservation. Is. Historic. But I think the idea was. You can imagine. Everybody looks at. The. That was going to go to the expert. I think I figured out why it was. All during this whole. I was. Historic. To tell me why it was. Historic history. And. I. Wanted to know that. Before I throw some. Why it's. Nobody. Historical. Buildings. Whatever. Said this should be. That's where the city began. Probably. Stay. Everybody. Up hill. It's really. To me. It's important. Because. It is so visible. It really is. Yeah. It really is. Very. Collection. Some extraordinary. Things. Really. Design. This is. He says. I don't care. Materials. These. If you. If you want to. Window frames. Things like that. These. Details. Diminish. The. History. So I'm hoping some. Seem to me. Criteria. Not necessarily. Historical. Things. We talked about preservation. Buildings that are uniquely built. Interesting. Twisting. I think. Giving a little thought. Design. Look beyond just individual. Buildings because that's a neighborhood that acts together. It's not one particular. Building is unique up there. So. They expand this. Criteria. I think that would. Useful. I mean it's like the meadow. You know the meadow. I think there's some creativity that might even. Satisfy. People. Part. I'm hoping. Historical. People. Just. There's. A much more creative way. But then after. He mentioned. Using. Design review as a kind of a service. Which is something that I could be. Approaching. Some of it's just changing people's. Perception. Making sure that the rules aren't so coming in. That it does feel more like a service. Where people are going to go. They go and they get these ideas and suggestions. For more knowledgeable people. And. Design review if we can. If we can get to a point where design reviews like that. I think that would be a success. And. And all the while. Thinking about those social issues. It's not used as a barrier. I think that's what I'm going to be thinking about. How do you see it necessarily as a barrier? I'm trying to get. An understanding of what you're saying. Where it's. Where people feel like they can't afford to live somewhere. Because. In an existing house. That's already. We can't use material that's not affordable. Potentially. Potentially they could use this. But if there's. But if design review can be set up. To tell people. That's cheaper way to do the project. That's the kind of service that could be great. A similar concern. And working in affordable housing. I have a lot of. Feelings about historic preservation. Because it just. You know also thinking about energy efficiency. Oftentimes like. The historic. The state historic preservation almost made. The French. Which would be. Very. Not good for energy efficiency. So. Yeah I think that. The sort of rigid application. Of the. Department standards are sort of. They're definitely a problem. And technically design review. Is an advisory committee. Now so. It seems that it would just be a matter of. Making there an informal. Approach first. Before they actually came to design review. I think there's a lot of room. And we can get creative about. About building up how it is a service. And potentially not change a whole lot. Yeah. That's for the public. Yeah and it's even possible too. That maybe that service could expand somewhat. To. Allow for some of the larger homes. That the owners would like to subdivide. You know as basically as we're. Allowing them on the zoning. That in a respectful way. To their historic. Which is certainly. Very easy to do. Generally. It's just a matter of looking at something. One way as opposed to. Another way. And it. I actually. Hope that maybe one of the things. That would come out. With their. Worth book. Not. Of course you don't want to have any examples. You have to find them somewhere else. But you know just to because I think people. If people could visualize what the problems are. It's much much easier to see. Oh yeah. That would be a better way to do it. I could use what they're instead. Certainly has some good examples. The ones that we saw. Who. I like. Shelter. What's it. I think that's really good. They tell you why. It's. Look. I read the thing. Project. Well thank you for attending this meeting. And bar. Developing. They seem very willing for us to continue to. Participate with them. That's good as they're going through this.  Well I think we'll come up on an expert. What are you talking about? You're very creative. But Kim was really good. I want to start a presentation with you. And do I want to say counselors. If we were going to be. There on Wednesday. We're not afraid. Not this Wednesday. No. We did talk. So. We'll talk about this. The last meeting. I got an email. Inviting me to come. Just introduce myself to the city council. And say what we're up to. On May 9th. And anyone else who wants to attend. Is welcome to come. And represent. I look forward to hearing what it is we are up to. So it wasn't specifically to get. Directions from them. Regarding. My understanding was it was. Just so that the new city councilors. Can. Can get a sense of what are all the committees. That are happening. And where. What they're working on. And who the chairs are. Yeah. Is that accurate? Yeah, there's going to be that. There's I mean the planning commission is going to be presenting. What we're up to and kind of making some recommendations. And so. One of which would be. What do you want the plan commission and staff to be working on. My recommendation is that we should. We're recommended working on the city plan. And we're going to kick off and do it this way. And we're just kind of. We're already starting it. And we're just waiting for them to give us a. Yeah. Thumbs up that says that's a great idea. Work on that. It's always better if you could say here's our proposal. For what to do. We're. You won't be. Planning commission because planning also represents housing. So the housing. Task force is also going to be. And there may be some other groups that may. Show up you. You might be going for this week. Yes, we are. Yeah, definitely. The energy committee is. Is this week. This Wednesday. Right. They'll be some other groups that maybe. As well with. The housing. Get mentioned and also to the. Conservation commission. Community services. The message we're trying to do is to get people to come out. Because the council is going to have to make priorities. They've got meetings coming up in a couple of weeks. And they have to. Start to come up with recommended priorities. What they would like to have. The city manager working on. Which then filters down to. What I would be working on. So. When it comes down to they have 10 goals and. Enough staff to do four things. What ends up being the priorities of. Pitching everybody to say well. This would be a good time. If you want to be one of those priorities to make sure that. Increase yourself. Let's see. Just filters through you guys. Some of the more. You know, like path people. Trails or parks or. Terrors trying to say go. Or just waiting for a shovel or something. Yeah, I mean, yeah, most of the. Most of the big projects are. Queuing up to go. For this year. So that's mostly working through public works. And less through. Planning department at this point. All we're doing is kind of some grant. Assistance and grant management. Looks like. Tiff ideas. It's. It's multiple pieces. That'll be start this week. And finish up on the night. With the announcement. But it's a multiple. It's it has multiple. So Tiff. Is used tax increment financing. You. Collect up the money from the private development. And if we fix these needs. Then we can allow. So. The proposal is to work on a number of things. One of which is the parking garage. Another of which is to do transportation. And utility improvements. The utility improvements are mostly on. Barry street. The transportation improvements are mostly on main street. So we've got. In order to fix. The Barry and main intersection. If we do a roundabout. Then we have to have. More roundabouts. If we do lights, we have to time all the lights. So it becomes. And we can't. Develop. More housing on Barry street. Especially the large project on Barry street. So let's say savings faster. And a couple of other projects came in for Barry street. They'll never. If they get intact. So. We can use Tiff to go and take some tax money. From those properties. To come down and fix this intersection. So. That's just one example. Does that come. You approve the district first. And it did. None of this will come through the planning commission. But you approve the district first. Through the city council. That doesn't approve any projects that just. Approves. The concept of what you're trying to do. And lays out. Some likely projects. And some likely public investments. That are going to help. Public and private.  But you're not. That doesn't approve you to build the parking garage. For example. You would then have to come back to the voters. With a. Bond vote that would say. We would like to spend. City council. So. It starts and ends there. Starts and ends at the city council. And. On Wednesday they're going to approve the. They're. Not going to approve it this Wednesday. They're presenting it this Wednesday. And they're going to approve it. On the night. At least that's the schedule. So. Taking this opportunity. I mean here's what I. I understand our goals to be right now. What we want to focus on. In order of priority. One city plan. With. The plan. The proposal for that is to have the kickoff meeting. We'll get into that more. On item five. To the official map. And three zoning amendments as needed. So as we. Receive application as the planning department. Receive application for our. Various projects and realizes there's quirks. And the zoning. To be resolved. We'll take those up as those come. And as they as they make sense. Based on input. We received from. Mike. Are there any other. Design reviews. Right. I see us as more of. Playing a. I guess with the official map and design review. We're more of a liaison there. Than we are in the lead. So who's. Doing the official map. If we're. Working on it with. I'm working on it with. Conservation. The conservation commission. The parts commission. I mean I think ultimately. They'll provide something that we could weigh in on. But. I don't think it has to go through us. In order to go to city council. Now the official map would go. Through you guys. So. And then design review would also go through us. I don't know if they'll be proposing anything for adoption. This year. Historic preservation. Okay so. My guess so. I think those three are probably the three top. Priorities. So the design review. Language for the zoning. By us. So the. Priorities for 2018 would be city plan. Official map and zoning amendments is needed. Potentially for. Potentially for 2019. City plan. Design review language. Zoning amendments is needed. I'm hoping we can get the official map done. Yes. We also talked about doing that in conjunction. With the city plan. So I think we'll have a better idea. About when it makes sense to propose that. As we get further down the road. City plan. Yeah. So let's move on. What was item three. Item four. General business. Comments from the public about something not on the agenda. There's no members of the public present. So we'll move forward to item five. Which is the city plan update. Discussion. There was a variety of things that we kind of thought about. Doing I don't know. I might keep this on the agenda. So we've had something specific in mind. I have some other things to think about too. One of you. I have on that. Even though I didn't meet with. You guys. Two weeks ago. I did a couple of meetings. One was to the housing task force. And one was to the conservation commission. And then he had a couple of members. Of the parks commission were there. So. Starting with that meeting the conservation commission meeting. I presented. Some of the official maps that. I had collected up from around other towns. And it was kind of. Timely because over the past month or two. There has been a lot of discussion. On the list serves. That I'm on about official maps. Some other communities. Have been considering it. And wondering how it has been for. So. We had a good conversation. What they wanted on their. On the map itself. What do the colors mean. We had that green print map. And I was like, you know, you're talking about this. So let's put some words down. Of what does this corridor mean. This corridor is an area where. We don't need the entire 100 foot corridor. We want a path. Somewhere in this 100 foot corridor. So we just need a 20 foot. He's met. Or in fee. You know what are you looking for. So if we give they could. And this is what's on the parks. And conservation commission. To do this. Is that they're going to put that together. This. Block here. Is showing where we would want to park. This is 300 acres in size. But we really only need 50 acres. But as we need 50 acres that's somewhat usable. Somewhere in this block. And that gives us the opportunity. Not to necessarily specifically say. This is exactly where we're going to have a part. But we want to park somewhere in here. And then it. Where there's a development in that area. The city would have the right of first refusal. And could decide whether this is the area. But they're supposed to kind of go through. And refine the map. And work on it a little bit to kind of identify. What it is they're asking for. Do they want it in fee. Do they want a third color. Because they have one that was trails. Which we assume is going to probably be easements. That they're looking for. A second color that was on that map. Was for park land. They probably want to own in fee. So that would be a different one. And then there was a discussion of. Whether they wanted to also identify other. Environmental. So. These preservation pieces. If we had a wetland. Would we want to buy that. It's not really a park land. From the standpoint that we wanted. Visiting it. But it also really isn't. Developable. So they're supposed to look and see. Whether they wanted a third. That was a brutal. Idea. Yeah. So they're going to look at some ideas. And come up with an identification. So that way we can start to work on. I can start to work on crafting that next piece. Which is okay. Now that I understand what this map means. We would adopt it as an official map. But what surprised me was that. When I did the homework. On other official maps. Most other. For every other community. None of them have any ordinance that is. That goes along with the official map. They just adopt the map. And they follow state law. Enforcement. So. We felt. That's probably not. A prudent way to kind of manage this. Especially if we have some of these that are. Really should have a process where somebody comes in. And it's going to have this. Who do we send it to? The first zoning application comes in. Do we send it to the conservation commission for comment? Or do we not? Do we send it to the park commission for comment? It's probably going to help with the adoption process. Of the event. So. So. So. So. So. So. I hope with the adoption process of the official map. Because I can imagine that if I see. That there's a park right on my property. I might not know what that means. And. Start to worry. So having something. Written. Of what that process would be. And when it would get triggered. I think that's key to. It's going to be really helpful. I like that idea. So my job while they're working on that. To. To kind of create this. Ordinance that would kind of go along. With a process.  Official map. Ordinance that kind of a process that kind of goes along with it. But. Certainly not south Burlington. Heinsberg. I haven't read this. That must have some pretty good guidance. It's much more of a. Of a process. But it doesn't go through and say. For example, somebody comes in. In the zoning permit. Somebody comes in and decides to build a house. We've identified a park on the top of savings pasture. Somebody comes in and puts in a permit. I want to build a house on the top of savings pasture. The official map has been triggered. There's a process. You know, relatively short. That's in. Statute. That you would follow. But. I don't want to go through and say, okay, well, what do. What does the zoning administrator. Do when that application comes in. Do we forward it to. The parks commission. For their, for their input. Do we. What does and in a lot of cases. A lot of the other ordinances were much more. The official maps are much more specific. Because the official maps are supposed to be about. The utilities and sewer and water. And if you build a house where we want to build a road. Then we're going to take it. And we know. Exactly where that road is going to go. In this case, they're kind of laying out. This is where we would like to trail. And it's 100 foot wide corridor. And it might be over here. It might be over here. We only want a 20 foot easement somewhere in this 100 feet. And. So when it kind of comes into that. It kind of ends up with a slightly different. I don't know. I think you need to have a process. And maybe we work with. Our attorney and our attorney feels. It's. We're better off not. Constraining ourselves with that process. But. It just seems like it seems to me I would. I would want to as a zoning administrator. Not be going back to statute. Just going saying I guess I just pump this up. The city council. The whole point of the official map. Is to take the place of the necessity. In a condomation. 100 foot. It's one thing. To say. 20 feet snake wonders down here. And that's it. But once you. Once you. Open it up to. Deciding what pieces of this. Then you have a committee. Making a decision. That is. Just. Isn't the structure you're talking about. The committee saying anywhere within this band. We would want it. And you as a property owner can decide. It would be more of a. They would want to be able to try to negotiate. How that would rather than saying this is specifically. Because I think. They're trying to avoid some of the upfront. Time and expense. It would cost to. Very specifically map. Every single. The location of every single trail. And every single 20 foot wide. Path and sometimes they can be pushed left or right. So. Get into what you're saying. It sounds like. Only actions that would make say the trail impossible. To go through that area would really trigger. As long as you could still do the trail. Then. Activity in the area shouldn't necessarily trigger. Because it's not it wouldn't. Still possible. Is that kind of what you're getting at. No I think my problem is. In fact the official map is. First step in combination. It says. We as a city. Declare we need this for the public. But so that. So I was getting out that need wouldn't be there. Unless something we're going was going to happen. That like. Cut the trail off basically. And that would trigger a need. To do something like that. If you're going to have a trail. It's going to have a big. Private property. I foresee difficulties. In a. Committee. To massage what we're actually doing. That's it. You don't have to go to the city council. And say we agree with you. Or we disagree with you. Like I said my push so. The question that will come up for them. Is to come up with their first map. That will have to come through this committee. When we get it. Together in ordinance that will help to at least lay out the process. So. They're going to work on their piece to kind of make sure. They can clearly identify. This is what we want. On this. Parks this is what we want on this. This is. One request that maybe I should make to city council. I don't know. Whether I should do it at the main meeting or. Another time but. I think it would help us in our discussion. Of the official map. Once it comes to us. We also had the legal. At the same time. So that we can. Have actual. Advice as we're. Waiting through these challenges. I don't think I'm going to be able to develop. The ordinance part without. The legal. So it should be happening. Yeah that will happen. And then I think. We may what we didn't do too much with the zoning. But we may do for the other one is just to bring in. Sit down with us. And go over it at least in one meeting. The range of options that we have. There's certain things we have to do. But then there's certain flexibility. I think. I think it's it's. There aren't a lot of official maps out there. So. They don't get tested very often. A number of people. Yeah I think heinsberg has said they've liked it. Alex likes it a lot. They put it out there. For their parks and their roads. And. The developers basically do exactly what. You would hope they would do. The developer looks at the map and says oh okay. I have to build a road. So I'm going to build the road where the city has identified it on the official map. The official map. You know. Oh I've got. Some recreation land that's identified as a part of mine. Well I will use that as my open space. And the city will buy my. Open space. And add it to the park. And he's hasn't had to implement it. From his position. Because it's always kind of the developers have looked at the official map. And followed it. Other places have. Voted you know. Somebody I guess in South Burlington had proposed to put a house where there was supposed to be a park. And it went up the city council. The city council was like we're okay. We'll find another park somewhere else. And not follow through on the official map. And that's allowed as well. So it's. You know. It has different things. And so we're hoping I think with the parks commission. You know sometimes you just put something on the. On the ground. And you hope that. This will help developers who. Want to maybe do the right. These wishes. Make some things happen. We really needed. The. Policy. Yeah I mean I'll look at. To see if that's what it needs to be an ordinance. As a part of it or. Policy or something. Something less than. The ordinance part. Imagine this will take 30. 50 years. Managing another ordinance. About this problem. Condemnation. As we know it is always a. Negotiation. Coming straight. When we're going to do. Combination. Triggers. Place the city council. Sometimes like. But. Say I think what we've seen in a lot of these other. Places is. Basically you're signaling like here's the path of least resistance. And it happens when development happens. It's really not. A big. City council. You know probably. On their agenda where they. Accept something. Subdivision. Final conditions of. Subdivision are you know. Sign this. Subdivision. It's not always like that. It's a hard time figuring out where that trail is going to go. Yeah. Legal issues about it. Well it seems like there's still some work to be done. To be done. So you mentioned you also met with a housing task force. Yes. So. Housing task force I met with last week. So they. I gave them. I was actually meeting with them intentionally about. Our. City plan update. Because initially we were going to start off with. Just doing the housing plan first. And were they interested in coming in. Planning commission to have a joint meeting. And so that was. The agenda. And so in between. We all met and decided we were going to have this all. Committees meeting. And they really like that. They think that's a great idea because. They think it's going to be really effective to. Sit down. Because this plan has so many places where there's overlap. You know. Is energy or transportation or. Community services responsible for public transportation. Economic development. And natural resources. There's going to be some more conflicting areas. And there's different ones that. There's potential places where one's goals may not. Line up perfectly with. Planning commission. You guys are going to have to. Play referee and make a decision of what. You know. Or where are we going to put something. Where do we put. Weatherizing houses. Is that a housing issue. Or is that a. Energy issue. Some of them are going to be obvious. Housing task force. Housing task force is. They're a quasi committee. They are a committee but they're actually. More of an ad hoc group. Nobody's actually appointed to. But they are members of. Montpelier housing authority. Down street. PCIO was. Legal aid. So he's trying to represent some of the issues. And concerns of tenants. Is he still serving on the task force. He is. He was the chair. He stepped down from being chair. Because he's now a counselor. And so Jack is still on the committee. Mary Hopers on the committee. So there's just a number of people. Who have always had. A deep interest in. In housing. And affordable housing. They work a lot with. Trust fund. And kind of how to advance. That difference. They're they're really a really good group. I think like any of the committees that we have there. Just some folks from the state. Housing. The city allocate. A housing fund. As part of the budget. Yes. There is a housing. There is a housing trust fund. And there is a separate housing trust fund committee. Only meets about once a year. To review housing trust fund applications. And I think. Comments that. Is coming out there. We're thinking. We're appointing a few members. Who would be. The voting numbers. So we've got a couple of. We've got some recommendations on that committee. But the initial one was. You know, we want them. Because they were the most. They were the farthest along in their chapter. And your element. Is.  Compat themselves on the back. Because the housing committee really liked that idea. So. So that was. They're looking forward to hearing when. That comes out. Probably. We're looking at. So. The only pieces do we need to meet with the. Specialist. Before we. With the. I mean, that's the only. I mean, other than the whole. Scheduling. I don't think we need. It necessarily for the. Need. To start. It'd be good to have him. Have that. Set up to start going forward. I guess it depends. We just have to start laying out what we want to present. What we want to get back. I think we just need to start having some. Big picture. Discussions of what we want to. What are the outcomes that we want to get. Out of this initial kickoff. Me. Because I think we can certainly go through and lay out a bunch of pieces. But. Do we want. Pieces set up ready to go. At that meeting start using them at that time. Or. Sending out a letter to all of the committee. It would be a great opportunity to explain. How that could work. But we could send a follow up letter if we needed to. I'm just saying. Put it in a one letter. That would be ideal. I don't want to hold up the meeting. Just. That. She's interested in meeting set this interest in meeting. Yeah. So maybe. You can see if stuff could come to our next meeting. And in the meantime, I could put together. A letter. That everybody could take a look at. And comment on at that meeting. At our next meeting. And then we would plug in whatever the. Is that we. Decide. On topic. The other question I have is. I don't. I've been thinking about what kind of venue. We would want to. We would want to hold this. I. Have any budget for renting. Space. I assume we don't. Is that a good assumption. Probably. It's probably a good assumption. But it also I think would depend on. What. Costs. Really. We're thinking. That's all kind of. Right. I'm sort of thinking of a more like a. Or. Or something kind of downtown where it's. Not the city hall but. Something where. If folks wanted to. Stay and socialize. After the presentation. Organic. How big a group are we talking about something. You know like the Capitol Plaza. Conference room. That would be much more expensive. That's where the price comes in. As we started getting into those. Those spaces. I think. Upstairs. I think. Downstairs. Cost. I. Have enough people. To make it worth a while. We have. How many. How many. There are almost. 20 committees. If you get down to. We wouldn't need input from all of them. I think we would need to do 12 different sections right. And as we. Mention there's a lot of people who. Set on multiple. Where I can get everybody. I like this idea of the downstairs. The only problem is we wouldn't have a visual. Eight. Aspect to it but. Maybe that would help. Maybe that's fine. What do you suggest to the power. Power five minute. About the. There's the. That's a. I'll find out. We want something that's like a conference room where we're facing. Each other right. To be kind of bringing this up. Rather that's where I was sort of if you sit downstairs. At NACC I'm kind of imagining everybody around the room. Okay. I was in place for the. It. Yeah, it was the, it was the auditorium, so I was thinking, you know, maybe not something that was strictly a presentation. Oh, that's true. My only concern there is that it wouldn't foster communication the same way that a smaller room would. Right. And we may, if we, if we're looking at it, we may go and ask somebody to send one or two people, rather than inviting an entire committee. So if we had ten committee chairs that we invited, we invited them with. Yeah. But we're not inviting all 14 members of the energy committee in. Well, although they're well, I want everyone to be welcome because it is an opportunity. It just defines the space. If we're going to invite everybody, then we have to have a space to accommodate. Well, maybe we should have it here. We could have it, we could have it at the Lost Nation lobby area. I mean, that's a fairly large area when you set it up, not theater style. It didn't event, it didn't event there. But you have to be wary of their rehearsal schedule. Like, sometimes stuff can be just set up so that it's a challenge. Well, let's see if they've got it down. They've got a schedule, a down schedule that comes up. Well, I know there's, there were sometimes when I was in Perry that the Opera House just had this, like between this month and this month, they were really busy and had a lot going on. But then there was section to time where. All right. Well, I'll reach out to Lost Nation about that. And then that sounds like the best option we have. And then we could also reserve, maybe reserve the neck and gown stairs for anyone who wanted to lose the over-active. If we could do that, that'd be better.  The Lost Nation charges? No, they can't charge the city. We are a city, so they can't charge us. It's just scheduling that becomes the issue. So, yeah, you want to drop to camp. It's a place where we can sneak in. I'd hate to have the big, huge block of rehearsals and performance off, because that would be most of June. Well, they have nights that they're not supposed to see. Okay, so they can go and say, oh, go for the fifth week of June because they don't have anything. Well, my job for the next meeting will be to have some dates. And I'll try to have Seth come in, and I'll get him on the agenda to come in and chat with you about what you want. So think about what you want Seth to try to help set up, because he's the IT guy. So that means John, you think about it. Well, yeah, there's also just the general thing of take this type of... Yeah. Try to swing by and make the most of its time here. Seth, were you going to start drafting the letter to the committees? I'm sorry, did you say that? Yeah, I was thinking. I mean, I'll try to have some dates for the venue at the next meeting and a draft of the letter announcing the meeting. Yeah, and then I'll send that around for comments. We can discuss it at the next meeting. Maybe curving the meeting a year and put on it before I share with you guys the group. It's a nice, different deprivation, I think. You think about it as a differential? Yes. Yes.  Because I'm so... Mostly it's self-employed. It's not. Yeah, maybe you've looked at it. Yeah. Okay. Anything else on the city plan? No. Okay. Okay, so item six, consider meeting minutes from March 26. And then they'll approve it. Second. Any discussion? Okay, all those in favor of approving the minutes? AI. Last item on the agenda is adjournment of a motion. I'll move that. Second? Okay, it's non-devatable motion. Okay, all those move to or accept the motion for adjournment. AI. Okay.


Hopefully you have had a chance gotten some emails from me about the resources that we're going to use today. And these are the packages we're going to use today. Having said that, I always like to start with the Duke University Land Acknowledgement. So I would take just a moment if you will give me that privilege to honor the land in Durham, North Carolina. Duke University sits on the ancestral land of the Shikori, the Eno, and the Kataba people. This institution of higher education is built on the land stolen from those people. These tribes were here before the colonizers arrived. Additionally, this land has borne witness to over 400 years of the enslavement, torture, and systematic mistreatment of African people and their descendants. Recognizing this history is an honest attempt to break out beyond persistent patterns of colonization and to rewrite the erasure of Indigenous and Black peoples. There is value in acknowledging the history of our occupied spaces and places. I hope that we can glimpse an understanding of these histories by recognizing the origins of collective journeys. So I want to thank you for giving me the opportunity to read that. I think it's very important. Of course, we're not going to talk about those issues today, so I only ask that if you have an opportunity to write some injustices that you see, that perhaps you can do so. The goal of today, this is part of a sort of a sub-series of the R workshops that I do. It's called Case Studies, where typically I'm teaching people how to use tidyverse techniques in their R training. And I teach workshops on tidyverse. So the goal of today is to sort of emphasize and apply some of that learning into a specific space. So I want to note I am not a text analysis scholar. I don't publish papers on these things. I'm really not an expert in those things. What I am is an enthusiast just with data and data manipulation. So I'm going to try and reveal some aspects of data rankling and text analysis that will be useful to you if you're new to this. If you're not new to this, I hope that I will expose some things that you haven't seen before. But I want to point out that the text analysis field is dynamic field. Well, it's been around for a while. It's changing rapidly. And I'm going to recommend at least one book, but I'm going to also recommend that to really do this well, because you have to get a lot more background that we'll be able to present in the next two hours. And I'll try to expose some of those resource options where you can learn more. And I'm certainly always willing to consult with you and offer what assistance I can. But I want to make it clear that since I am not an expert in the field, I may not be able to give you a really nuanced answer to intricate questions that revolve around your particular text. In any case, we're going to talk about data cleaning because it's always super important, especially in text analysis. I'll just talk about that briefly. We're going to talk about tokenization. We're going to talk about visualizing. And we're going to use Word Clouds as the main way. But that's just because it works well in this workshop. We'll talk about and maybe do one or two other visualizations today. And I'll show you some methods of visualizing your analysis. We'll try to do a little sentiment analysis. And as time allows, we'll do a word frequency analysis with a TDIDF approach. And we'll define that. Now, the main text that we're going to use, and you can download this for free. Actually, it's not a download. It's up on the website. You can buy it if you want a paper copy. But it's this text called Text Mining with R. It's by Julia Silge and David Robertson. And also, I don't know if David Robertson had anything to do with the TIDU text package. I think he did because they wrote this book together. But you can get the package from this website. And there's some documentation there. And Julia Silge also collected the works of Jane Austen. And so it's always nice to start out with a nice clean corpus to do your analysis with. And use those Jane Austen books. If you've never read any Jane Austen books, certainly as a librarian, I would recommend them to you. She's long since passed us. But wrote several novels, I think six that were published back in the 19th century. Sorry, I don't know the exact time, but they're in public domain. So it makes it easy to work with. She deals a lot with English high society and the implications of marriage and relationships. And you may have seen or many people know the novel Pride and Prejudice, which has been made in several movies. So a lot of people are familiar with this text. And this is a really fun way to start learning text mining. Okay, so this is the website Rfun, which is a sub branded site for my center. And it consists of a whole series of workshops on different modules about tidyverse. So in essence, once you're learning tidyverse, that's why we're doing these case studies to sort of see how it can be applied. But if I'm covering things that you haven't heard before, just know that there are modules here that can be to your benefit. Each one of these modules has code and slides and practice data where you can do these work yourself. It's not the only source for learning about R, but I want to bring to your attention at least this first module. Quick start with R because as I scroll down here in the last year, I took some of my introductory courses and shortened all the videos to make it useful for a flipped workshop model teaching in Zoom. So if I cover things about Deplier that you're not sure of, you can look at this like a 15 minute video or I recommend a quick start. If we're talking about joins and left merges or left joins and pivoting data, things like that are marked down or are projects.  In any case, the backbone of this text mining that Julia Silgi talks about is, so that Julia Silgi, is this idea of working with tidy data, which is the backbone of all the tidy verse stuff. And that's this notion that every variable is in a column and every observation is in some row. So variables or columns are vertical, across the rows are horizontal. And then the observational unit is a table or sometimes known as a data frame or in the tidy verse context, we call that a table, but essentially a rectangular grid of data. Right now, R has lots of different data containers or data types. You can have matrices and you can have lists and you can have vectors. Data frames are essentially a collection of vectors and the important aspect is that each vector or column has to be all the same data type. So it can either be all alphanumeric data or it can be all numeric data, whereas lists can have multiple different kinds and matrices are usually numeric. We're going to be dealing with these tables. That's the advantage. And so what Silgi and Robinson did is they sort of adapted tidy verse techniques to their package called tidy text. And it's this idea that a token is a meaningful unit of text. That token can be a number of different things, right? It can be just a single word. It can be a sentence. It can be a paragraph. It could be a whole document. It depends. It could be a tweet. It depends on the context. But a token is the meaningful unit. And then tokenization is this idea of splitting up your text into these tokens so that what you end up with is a table or a table that has one token per row. Right? And we're going to work our way through that example. But that's why we're using this approach because once you've learned something about tidy verse, you can manipulate these texts more simply. There's a couple other data structures that are important, right? We're working with string data or character data. So that can all be in a vector. It's important to talk about the term corpus. Corpus is a collection of documents, but it's usually not just the string data, right? It can be metadata about the document, things like that. So you have to manipulate it properly so that you can do your analysis. And then there's this, as we move into the advanced aspects, there's this concept called a document term matrix, which is a sparse matrix with one row for each document and one column for each term. And that's where we get into this concept of TDIDF. So just to sort of cut to the end, the concept of TDIDF is this idea of where you're weighing your tokens in the context of a document which is in the context of a collection of documents or a corpus. So not all words are of equal value. And then how do you use that to your understanding in your analysis? Because you want to really focus on some words that have meaning. And you want to ignore other words, stop words, such as leading articles and conjunctions, which may have no meaning. And of course, all of this can get even more challenging if you're working with tweets, for example, where hashtags and abbreviations and other kinds of terms may have more meaning than the algorithms would typically acknowledge. So that's some of the art of all this, is you have to sort of know what your text is about as well. Moving beyond that, and we're not going to cover these things today, but I want you to be aware, there are at least two other packages that a lot of text miners or text analysis people work with. One is the TM package. I find it harder to work with than the tidy text package, but I have a big bias towards tidy verse. I find it easy to work with. If you're more of a base R kind of person, you won't probably won't find TM as hard to work with. But I'm going to couch that with the notion at least that, you know, R comes out of the statistical world. So it's no surprise that it's really easy to work with numbers in R. Many people are surprised to learn that you can manipulate text in R. It's really not that much difficult, more difficult than working with the numbers. There are just some certain techniques and packages that make working with text a more manageable process. In any case, the TM package is something else that you would want to look into, as well as the Quantita package. I'm not really going to go into those, but I want you to be aware of them. Based on stuff that you're learning either today or you may already know, it's also helpful to know that there is the Gutenberg package, which is a collection of Project Gutenberg texts, which are all texts in the public domain. And you might want to work with those just to practice techniques or learn different things about different texts. Project Gutenberg is nice because, like I said, it's in the public domain. And I'm going to say you may be faced with doing minimal data cleaning when you're working with Project Gutenberg, as opposed to gathering just raw data. But it doesn't mean that you won't have to do any data cleaning. So, a little more about that document, the book I told you about, it's free and it's online, text mining with R. There's a couple chapters that I think are particularly interesting. One is Chapter 2, Sentiment Analysis. That's mostly what we're going to talk about today. And as time allows, we'll talk a little bit about TDIF for analyzing word and document frequencies. A lot of people talk about topic modeling for unsupervised classification. We probably won't talk about that, but it's a nice initial introduction. And indeed, Julia Silke has gone on to write another book that focuses more on this kind of thing. And I can recommend that to you. But it's also worth noting that there are three separate case studies. And I think Chapter 7's case study on Twitter analysis, Twitter archives, is pretty approachable. But they're all actually approachable. This is a very concise book. It's not long. The explanations are clear. But this is only a starting point. A further study that I might point out to you that you can also get for free, the Summer Institute for Computational Social Science, which is abbreviated as 6. You can go to 6.io. And in particular, there's a link behind this one. There's a URL behind this link right here that will take you to their curriculum. Their curriculum is linked online. And you can learn a lot of things about text analysis. Chris Bale just published a book on some analysis of Twitter archives. And he and his co-founder, Matthew Salganick, found this institute. And if you're at all involved in social sciences, you might want to keep an eye out because they do this every summer actually across the world in several locations. And if you're a budding social scientist, you may want to get involved in those kinds of things. But as Chris Bale would point out to you very clearly, this is a fast-moving field. And we're not going to be able to even barely scratch the surface of an introduction today. But we will try and focus on a kind of a practical approach just to get started. This should be, what you should see now is the GitHub repository that has the text that we're sharing today. If you have not worked with GitHub repositories, the easiest thing to do is to click on this green button, scroll down to download zip. And then if you want to look at the slides, you should be sure to unzip or expand the zip folder locally. I do have a workshop on Git inversion control, so we won't cover this too much. But that's the easiest thing to do, just download and then expand. But if you want to follow along without downloading, I did make a PDF version which will display on GitHub. In our studio, in this project, if you are expanding it and you double-click on the file workshop underscore textmining.rproj for rproject, then it will open up all of this code into an rproject, which is going to be ready to go for version control. But the other advantage to rprojects is that you don't have to set the working directory and it's kind of a discrete r unit for this, in this case for this topic about textmining. So I'm going to start out here in tokenization. So I'm going to open up this document called 00tokenization.rmd. So this is just an R markdown document that will output an HTML notebook. And at this point we're just starting with these two libraries. We're just going to start with this poem by Emily Dickinson. So it's going to be four lines and you can see in this first step what we're doing is we're making a text vector that consists of four elements and each element ends with a dash. Not exactly certain why I've lifted this right out of Sylvie's book, Sylvie and Robinson's book. But in order to make this a tidy text object, we first want to put it into a table. So you can use the tibble function and you can give every line its own number by making that numeric vector which consists of four elements and adding it as one variable and the other variable would be the text vector. So if we put those together in a tibble, we then have the line number that's associated with the four lines in this poem. So this is the thing that this UNNES token function which comes from tidy text that is really useful because this allows us to have one token per line. So just running that data frame through that function word we're going to identify that the token is going to be word. That's the thing that's variable, that could be paragraph, it could be document, it could be sentence, it could be tweet and you can double check the documentation on UNNES token on that but that's what word means there is that our token is going to be a single word and then the text that we're tokenizing or the corpus that we're tokenizing comes from this column right here. So then you can see what we've got is we have each word broken out into its own line so that's the token and we know what line it came from because we added those line numbers and that's a really valuable step you want to be able to track where that comes from. So 01textmining.rmd but let's run through what's happening here. You can ignore the YAML header at the top, you can see that we've got four libraries running here. Jane Austen R is going to be our source of text. Then we're just taking a look at the Jane Austen books and you can display those but we already talked, I gave you the setup already. It's just each of the six novels starting with Sense and Sensibility which was published in 1811 and you can see that at least the beginning lines are pretty straightforward, right? It's the title and the author, some of that metadata that I was talking about and as you scroll through you get the actual text of the data in the text column. So there's the text and I think we might get to this particular line. They lived in so respectable a manner as to engage the general good opinion of their surrounding acquaintance. I want to bring that to your attention because when we get to sentiment analysis we want to assign some kind of sentiment to words but we don't assign sentiment to every word and it's always a little shocking to me how few words would actually get sentiment assigned to it from a sentence like that. So think in your head, well, I wonder how many words in line 16 would get a sentiment assigned to them. It's kind of an interesting little quiz. Austen books, if you just want to know which the six books are that are in that collection, they're listed right there and then just a note on data cleaning. I just like to point out that there was a New York Times article, a very, very detailed Times article as Times articles tend to be, published about five or six years ago where they put forth the conjecture that they're interviewing lots of different data scientists and they're talking about big data which was a huge term five or six years ago. But they put forth the conjecture that data cleaning is 80% of any data project. Whether or not that number is right or wrong, it seemed to fit with the tenor of the article, it seemed to be agreed to. I don't know that there was empirical evidence behind it, but it's an important point nonetheless, particularly important when it comes to text mining because text is notoriously messy. And particularly when you're adding in other languages, you have diacritics, diacritical marks that you don't have the Latin American English or the Latin British English data set. All of this text cleaning is going to affect you and everybody wants to do the analysis and make the visualizations. Of course, that's where it gets really fun to share, but you should approach this knowing that cleaning text, whether you get it from Project Gutenberg or maybe a corpus of documentation from the UN, cleaning text is going to be a significant chunk of your time and you could spend easily days or weeks trying to solve little problems of how to translate certain UTF codes or what to do with things that don't import cleanly into R. I can try and help you with some of that, but please be prepared to know that this is a very sanitized presentation where we don't have to clean any text. Okay, so what we're going to do here is we're going to start with Austin Books. We're going to use the tidyverse function called GroupBy and we're going to do that same thing that we were doing before with the poem, which is we're going to add a line number to every book or to every line for each book, but we want those line numbers to be unique to the book, right? So we don't want to start a line at line one and then consecutively and contiguously add all the way up through the last or the sixth novel. So that's why we're using the GroupBy function is to restart the count for the beginning of each book and then we're going to ungroup it because having a grouped data frame is not useful going forward, but what you see there on the right-hand side are the line numbers for sense and sensibility. If I execute that code chunk, you'll see that I have 73,000 rows of data, so that's 73,000 rows of text across all six novels. And I'm pretty certain that if we go to the 100th screen, we're just at the 1,000th row and we're still at sense and sensibility. So you could do a little bit of data munging if you want to see a particular other novel, but that's all we get in this preview. That's okay. The next step is to tokenize. So this is a repeat of what we did before and after this, I'm going to invite you to do a little exercise. The important part here is that when you're tokenizing, you have one token per row. And when we tokenize, we have now three-quarters of a million rows because each line that we had previously is much longer and the first line, Line 1, consists of only three words. That's the title. So we scroll forward to Line 16 because I remember we pulled that one out for your attention. You can see that there are about five words there. If we go to the next screen, another seven or eight. And then the next thing we want to do is we want to remove stop words. Now stop words are this idea that there are words that are just not all that interesting to analyze. So leading articles, conjunctions, all kinds of things. And there are stop word dictionaries. So we're going to use this anti-join function to basically say, remove any words from the tidy books data frame that has 75,000 rows at this point because we've tokenized it and remove any words that also are in the stop words dictionary. And when we run that, we're now down to 325,000. So a third of the words that we had originally exposed for analysis are still left for analysis while as the other half a million words we just summarily threw out. Now I'll just bring to your attention that we use the anti-join function right there which is part of Deplier. And here's a little link. If you haven't seen this before, the anti-join looks like this, right? We're taking everything out of the original word set that does not match the stop word set. And sometimes in these text manipulations sometimes we're doing an anti-join, sometimes we're doing an inner-join, sometimes a semi-join. But all of those joins, it's just helpful to have that visualization. Again, if you're not comfortable with joins, you can watch that video on the RFUN site that I showed you earlier. Also want to point out that you can customize your dictionary. You as the analyst may know certain words that are not worth keeping around for whatever reason. Completely, I don't have a specific example, but I made up a totally bogus example. I don't know, I'm getting old enough now that I forget where some of these things showed up in my mind, but Volkswagen used to do a commercial where they referred to dragging their cars as farfignugin and they made up this whole definition. I don't even think it's a real German word, but they had a whole ad campaign over farfignugin. There's no reason in the world why farfignugin would show up in Jane Austen's novels, because those were written 100 years before, but I made a custom dictionary just in case. And I could use that stop words custom dictionary to throw out one additional stop word, farfignugin, from my Jane Austen corpus. Of course that's totally made up, but you understand how that can be applied going forward. The other thing that I want to do here then, I mean that's basically the whole goal, is I've tokenized it, now I can start to analyze and visualize my text. So I'm going to take those matched words where I've thrown out the stop words and I'm just going to count them up and return the count in a sorted order. And you can see that the most popular word in this case is Mr, followed by Mrs, followed by Must, right, going all the way down. There are 14,000 unique words, apparently, in that set of what was it, a quarter of a million that we started off with. And so then I can take that list of word frequencies and I can visualize it.  And in this case it's actually a interactive visualization. So if you hover over a word you can get the count, but you don't have to, I found that word cloud packages are a little bit fussy. And so I've shown you this one because I like the output, but there's another one in the exercise that's a little easier to work with. But at this point let me just note to you that word clouds are kind of maligned and maybe for good reason. But let's just talk about that. Like, I work in the Center for Data and Visualization Sciences and we run across this like, for example, pie charts are much maligned. There are lots of people who hate pie charts and there are some good reasons to hate pie charts. And there are lots of people who hate word clouds and there are some good reasons for hating word clouds. They're not very scientific, they're hard to perceive, but it's also important to sort of recognize what the rules are, what's the standard within your discipline and maybe know why you're breaking those rules. And in this case I'm just showing this to you because it makes a nice visual eye-popping appeal. I can tell part of the story, but I want to encourage you to never stop with a word cloud because there's more information to impart. Oh, here's the other word cloud library. This one's a little more, it's not as pretty, but it's a little easier to work with and sometimes it prints better in documents. And now we're getting to the your term part. So my question to you is, because this is a case study, it's intended to be a demonstration, I want to just lecture to you, so I'd like to invite you to, let me zoom back out to, to open up the file called x underscore o1.rnd and work on that for about the next five minutes and then we'll come back together and that should reinforce some of the things that I've told you today. If you don't want to do that, that's fine, but if you do, those are the questions, and either one of the two documents below it, exercise01answers or exercise01answers.nv.html and that should give you a chance to reinforce that. I'm going to set my timer for five minutes. I see somebody asked what does the width function do and I want to double check that I know where that's coming from. Hmm. That's interesting, I must have borrowed that text from somewhere, you know what they say, the best code is stolen code and that is not a function that I typically use and pretty certain it is not tidyverse function, it's baseR function, but it must in some way be important for setting something to WordCloud, but if I go over to my previous example, am I using width here? Yeah, I'm using width there. It's the beautiful thing about R, there's so many functions to learn. Again, the answers specifically are there. So let's move on and get to sentiment analysis. Our studio, I'm at line 209 and here we're going to use this function part of tidy text called get sentiment and there are different sentiment dictionaries that we'll cover in just a minute, but we're going to start with, we're going to use the bing dictionary and what we're going to do specifically is we're going to focus on only the words that bing classifies as positive, right? So if I just run those first couple of lines if I did it without filtering which I can do right here you should see that there are negative words like two-face and abnormal and abolished but we're going to dump those for the moment and just do the words that bing classifies as positive which is right there and then we're going to use the semi-join function to gather the intersection between the tidy books and the positive words and we'll return that as a sorted set and we have 670 words that are ranked in the bing dictionary as positive for example the word well is used 401 times so what we can do with that is we can visualize a sentiment score but then let's go on and make ourselves a little algorithm here so our algorithm is going to be sentiment equals positive minus negative because what we're going to do is we're going to calculate into a certain segment how many words are positive how many words are negative we're going to subtract that and we're going to get sort of an overall value for a segment of text so in this case while we did we need to have the words tokenized into single word units to get the sentiment we're then going to go back and use 80 line increments as our chunk to analyze to apply this algorithm to and I don't have a good explanation for that that's the number they use in the Silgy book I think it is context specific but the way Silgy explains it is if you have too many lines it kind of muddies the analysis and if you have too few lines you don't really get a very rich number so she somehow settled on and I don't believe she really explains so it's much like my experience when I attend machine learning workshops there's often certain numbers that people just settle on as convention and somehow she settled on 80 and she applies that with this particular base R integer division calculation right here so let's just go ahead and run all that and break that down the Jane Austen sentiment data frame first thing she does is she takes the join with the Bing dictionary and then she counts the sentiment words by those 80 line segments and she still has and that's where you get this index number so that's segment 0 through 79 or 1 through 80 and the next 80 and the next 80 and then you can see that she pivots the data wider right so again moving back to tidyverse because what you get if you just do this part is you get a really long data frame where you have negative below positive for the 80 line segment and she wants to pivot that so that you can just do the math in a tidyverse context that's what's going on here and you can see now you've got three columns so now you can just use the mutate command to get your final answer and what we end up with then is a score for each 80 line increment now presumably it would make sense that if there's a score that is negative that's a particularly dark passage as opposed to a score that's positive which is a sunnier package and is my recollection of Jane Austen books that I am familiar with is that they are generally positive books but let's visualize that just using the power of ggplot I took each one of those segments and I almost like a time series made a bar graph over each segment and then I just colored it so as to fill in the bar graph with the value that is in this less column and I just filled in the value if it was a negative number I made it red and if it was a positive number I made it green excuse me and then you can use that really nice feature of ggplot facet wrap to separate each one of those and it's a nice way of visualizing the sort of flow of the novel of each one of the novels over time right so you can see in Pride and Prejudice there's this whole horrible chunk right here where things are just downhill and sad and for those of you who know the novels I'm guessing I like to look when I'm guessing this is where Mr. Darcy awkwardly tries to propose and Elizabeth kind of reacts in a way that on hindsight she wished she hadn't and it's all very dramatic and eventually as you can see here ends rather nicely I don't want to give it away if you haven't read it or seen one of the movies anyway let's see most common positive and negative words so what am I doing here I'm joining the tidy books with Bing and I'm counting those words and because that's in preparation for this visualization so taking all the tidy books and joining with the Bing words and getting a sentiment count for each word I can then use ggplot to visualize this is a little big for the screen let me change this maybe to 5 and 7 it'll display a little better and you can see over time that again the word well comes up the most frequently positive associated word and that brings up a whole other point that's worth contemplating if you're familiar with the novels Jane Austen spends a lot of time sort of essentially talking about an individual's association with marriage so if you're a miss you're unmarried but Jane Austen doesn't necessarily talk about that status of a person as being negative it's simply the association with the modern sentiment analysis dictionary that associates that word as being negative so I think that this is a particularly problematic outcome to visualize it doesn't really represent the text as well as we might want but it's a brute force method which would then cause us to go back and think about how we might alter our dictionaries or our analysis in any case it makes for a nice visualization and one that I drew straight from the book so I would suggest that to you moving on to dictionaries I wanted to point out that there are different kinds of dictionaries there's the big dictionary the low-rand dictionary the NRC and the AFIN and it's worth at least kind of looking a big dictionary identifies words as positive and negative the low-rand dictionary does the same thing the NRC dictionary identifies words as being into certain categories I think there are seven, maybe there are 12 I don't remember the exact number but trust, fear, negative, sadness, anger and then there is the AFIN dictionary which actually puts words onto a numeric scale from negative to positive so you can do interesting things with the AFIN dictionary as well which is what we'll do next but oh this is where I was trying to figure out how many different words were in the NRC characterization and there are 10 the words are characterized into these 10 different categories and so I guess it's sort of interesting it is interesting to me let me do this just to give you an idea of I think this is maybe a limitation or at least something to keep in mind summarize sum of N so for the NRC dictionary there are 13,000 words that are characterized in the NRC dictionary as one of these categories if you think about that in comparison to the number of words that we use and we write with I don't know what the implications are again I think if you're a text and an analyst you will have a better foundation upon upon which you think through that implication but I just think it's fascinating that we really are talking about a small subset of words and we of course are placing our faith on solid scholarship so it probably is not a problem but it might be worth knowing more about the details so it's not so much of a black box that you're applying to your analysis in any case let's take the book EMA and let's apply that to the AFIN sentiment dictionary which is the dictionary that assigns words to numeric values and when we do that we can see that the word clever is ranked and rich and so forth and we can analyze that as well so there we're just getting a straight word count we could do another word cloud or we could do a simple ordered bar bar chart and we're going to take here I'm taking a variation on Silky's algorithm and assigning to 80 word increments that book using the EMA dictionary and then visualizing it first with word clouds but secondarily just visualizing it with slightly more colors to try and bring out a nuance for negative words and positive words because clearly there are way more positive words that's all that happens there and then there's one more visualization so as much as I think I can sort of tell you about how you might go about applying sentiment to your corpus oh somebody asked I see Ninel asked the big dictionary only functions with English text does it also work with other languages that's a great question there are other sentiment dictionaries I don't know of any for other languages but I think maybe googling around will help expose that it's a really good question not only for sentiment dictionaries but also for stop words because there are all kinds of articles and conjunctions in other languages that you'll need to take into account