It's a flick on, it's great for the City One! Into the area now towards the back post, and Anthony O'Connor rising high there to get a flick on. And that will be the final passage of play to what has been a brilliant game of football between two very capable sides here at Valley Parade. The hype was huge before the game, and it did not disappoint. We've had a brilliant finish to an exceptional game of football here at Valley Parade. On as even, both winning records come to an end for both sides.


Welcome to our panel. Good morning, everyone, and welcome to our panel. As long as the grass grows and the water runs, treaties with native nations and their relevance today. I'm Peggy Mainer, the executive director of the MICA Group. MICA is a national, native-led nonprofit organization that, through grants and technical assistance and partnerships, supports tribal nations in reaching goals they set for themselves. It's going to be my joy and honor in a minute to introduce our moderator, Walter Echohawk, but just one housekeeping note. We only have 50 minutes for our presentation today, so we don't know at this point if we're going to have time for questions. So I'm sure that some will arise, and I'd like to encourage you to put your questions in the chat. We will be watching the chat, and if we have time at the end to answer some of them, we will. But if you would like, and you have a burning question, and you want to put your contact information in the chat with your question, we'll get back to you maybe later this week and answer your question. So it's my joy and honor to introduce Walter Echohawk. Walter is the president of the Pawnee Nation Business Council. He's an author, attorney, and legal scholar. And most of all, to me, he's a friend. Walter has anchored the Micah Group's Cultural Resource Fund Projects Board since 2015. Gosh, it's hard to know what to say about him. His books are so wonderful. He's the author of a number of books, and this is my favorite. I'm going to hold it up. It's called Sea of Grass, and it's subtitled A Family Tale from the American Heartland. I highly recommend it. And my husband, Andy, told me to be sure and mention In the Light of Justice, which is a 2013 book of Walters that we're both lawyers that we really, really value, refer to often, and think very highly of. Walter was the staff attorney of the Native American Rights Fund for a number of years. And in that capacity, he represented tribes, Alaska natives, and native Hawaiians on really all the well-known legal issues in the modern era of federal Indian law. And he's been at the center of the tribal sovereignty movement. He's worked on so many different interesting issues, and I've had the pleasure of being able to talk to him about a lot of them. But he's worked on religious freedom, prisoners rights, water rights, treaty rights, and repatriation rights. He's admitted to practice in many courts, most notably the US Supreme Court. Since he left the Native American Rights Fund, Walter has represented various Oklahoma tribes. And one of the things that I think is so interesting that he's done is he served as a justice on both of the Supreme Courts of the Pawnee Nation and the Kickapoo Nation, and also taught federal Indian law at Tulsa University, Lewis and Clark, and the University of Hawaii. So Walter, I didn't do that justice, but I would like to welcome you as our moderator. And I would like to turn it over to you. Thank you, Peggy, for that very kind introduction. And folks, I'm very glad to be here with this very distinguished panel that we've assembled. And we're all, of course, very honored to be part of this historic preservation convening and to address treaties, which in Native America are a very important part of our histories and of the Native nations here in the United States. And today, as the moderator of our distinguished panel, my tasks are to set the stage for the panel, talk a little bit about our treaties. Secondly, I have the distinct honor and pleasure of introducing our panelists to you. And then thirdly, as we get into it, I'll assist in prompting the dialogue discussion. We have a quite Q&A sort of a format that we've among the panelists here. But so let me just, without further ado, turn to my first task here to set the stage, what are treaties here in the United States in Native America? I guess when you talk about Native Americans, we're talking about America's indigenous peoples, which are the American Indians, Alaska Natives, and Native Hawaiians. And there are about nearly 5 million American Indians today that belong to over, well, 562 federally-recognized Indian nations that maintain a government-to-government relationship with the United States government. And under federal law, these 562 tribal nations are deeply embedded into our domestic political system. The Supreme Court has described them as domestic-dependent nations that came into the Union through their treaties under the protection of the United States government. And so the legal framework for defining the legal rights and responsibilities and relationships among indigenous nations and the United States and the States is called federal Indian law. And the hundreds of treaties that were entered into by the Republic with its Native nations for over 100 years since its foundation constitute a big pillar of federal Indian law. Many of our rights derive from these treaties. And these are 369 treaties, at least at my last count. I think the panelists may refine that number for us. But these treaties were made between tribal nations and the United States. They were ratified by two-thirds of Senate vote, signed into law by the President of the United States. And under the treaty clause of the Constitution, these treaties are the supreme law of the land and are enforceable as such. They not only have historic importance, but they also have modern-day importance as well. Seen in the recent McGurk versus Oklahoma decision handed down by the Supreme Court in the last summer of 2020, which held that under the treaties establishing the Muskogee Creek Nation, the government entered into these treaties, setting aside a huge swath of our, excuse me here, state of Oklahoma for the Muskogee Creek Reservation and that that reservation has never been abolished. And so these treaties are alive and well today. And I wanted to talk a little bit about them and then introduce our panelists. But from the inception of our republic in 1776, all the way into the 1770s or 80s, this was the treaty era of our republic and treaties that I've described played a primary means by which the United States interacted with the tribal nations here in North America. The treaties and through the treaties, the United States pursued its various Indian policies of the day for over 100 years in terms of land acquisitions, war, peace, trade and friendship, military alliances, the removal, civilization, education policies. All of these policies were conducted by the United States government through the diplomatic arm of the government. They were seen as foreign affairs, Indian affairs in that era were under the jurisdiction of the War Department and the treaties that were entered into by the protocols of the tribes and diplomatic arm of the government served vital purposes of the signatories. The land acquisitions, the Supreme Court also says that the tribes entered into the union through their treaties under the protection of the United States government. They were established a political protectorate where the government committed itself to look after the well-being of the native nations. They laid out the boundaries of the tribal nations. They laid out matters of war, matters of peace, matters of trade and friendship, and engineered and implemented the Indian policies of the United States. And to the native tribes, they reserved our permanent homelands that we still have today, the things that tribal people think are important, and the treaties and the reserved rights, the explicit words in those treaties, promises made form a foundation for the native rights that we see today that are enforced by the courts. And so the treaties that we're going to be talking about here today constitute a major source of federal Indian law. And so with that overview, if I would like to turn to my second task here to introduce our distinguished panelists for you, first of all, we have Pamela Wright, who will be speaking first. And she is the Chief Innovation Officer of the National Archives. And as such, she's responsible for igniting innovative projects across the agency, as well as formulating and implementing online public access to the National Archives Holdings. And she holds a degree in English and History from the University of Montana. And I'm looking forward to Pamela's remarks. Secondly, we have Anna Naruta-Moya, PhD. And Anna is a specialist in locating and creating access to hard-to-find information, such as these treaties. And she's the Project Director of the Innovative Treaties Explorer Project, which is a part of the Indigenous Data Archive Project that's led by the New Mexico's Museum of Indian Arts and Culture. She is a certified archivist and has served as an archivist for the Hoover Institution Archives, Stanford University, and the US National Archives. Anna also serves as a member of the Research Advisory Committee of the National Native American Boarding School Healing Coalition, assisting them in searching for documents from the government and church-run Indian boarding schools. And she has received her PhD from the University of California, Berkeley. And then finally, we have Sherri Thomas, Juris Doctorate from Taos Pueblo in New Mexico. And Sherri is the Associate Dean of Institutional Culture and Equity, and also the Library Assistant Director for the University of New Mexico School of Law. She is a member of the Taos Pueblo and grew up on the Navajo Reservation. At the law school in the UNIM, she manages the library collection and teaches courses in legal writing, research, copyright law, and also other areas of law, including federal, Indian, and tribal law. So folks, we have a very fine panel. And what we'll do at this stage is I would like to call upon Pamela first, if she would give her the floor. And then we'll go to Anna. And then after Anna, we will have entertained some questions amongst the dialogue. And Sherri will help me with the color commentary on the Q&A set we've got in store for you. So with that, Pamela, floor is yours and welcome. Thank you so much. It's exciting to be here. And I'm very excited to share with you today some of the work that we're doing at the National Archives that's feeding into the IDA Treaties Explorer that Anna will speak to. But first, I want to acknowledge that I'm coming to you from my home in Silver Spring, Maryland, which is situated on the ancestral homelands of the Nakhach tank peoples. Next slide, please. The National Archives in Washington, DC, has in its custody ratified Indian treaties from the year 1722 through 1869. Located within Record Group 11, which is the general records of the United States government, the treaties are numbered 1 through 374 and were maintained by the Department of State until they were legally and physically transferred to the National Archives back in 1935. This series contains handwritten treaties. As a rule, the manuscript treaties are accompanied by a tested Senate resolutions of ratification, printed copies of the treaties, and manuscript copies of presidential ratifications and confirmations of the treaties. Some treaty files contain copies of messages from the president to Congress, copies of messages or letters of instruction to the treaty commissioners and journals and correspondence of the commissioners. The negotiation of formal treaties with Native Americans by the United States government follows a custom established by Great Britain and the colonial governments. Treaties were made with Native American peoples by the Continental and Confederation Congresses and continued under the Constitution adopted in 1789. These treaties are both historically important and intrinsically valuable. Historically, the ratified Indian treaties serve as one of the basic sources of documenting the US government's policies toward Native American nations, including the extinguishing of title to land, reduction and denial of water, mineral, fishing and hunting rights and the legal status of tribes. Next slide, please. So I just wanted to give you a little look at what a treaty looks like in the National Archives catalog. The National Archives catalog has over 150 million digital copies of permanent federal records, which is amazing, but it also makes it very difficult to find exactly what you're looking for. And this is why we're so happy to work with the IDA Treaties Explorer, which is dedicated to these particular documents and is a great resource to use. In the catalog, you can zoom in and out of each page, which is critical, as you can see from this picture with handwritten documents. You can see how many pages are in the file at the bottom. You'll see all those pages. A blue tag on the top right corner of each page indicates that someone from the public has added metadata tags or transcriptions for the page. These are done all by the public and of the 374 treaties, 358 have been transcribed. And we're gonna continue transcribing until they're all done. And we will share those transcriptions then with the Treaties Explorer that Anna will speak about. From NARA's catalog, you can download these documents, each one as an individual JPEG, or you can download the whole thing as a PDF file. Some of these records have been in very delicate shape and you will see that when I show you some of these. And they took hundreds of hours of preservation efforts, requiring the expertise of our preservation staff at the National Archives before we could even begin to digitize them. Next page, please. So here's a zoom in on one of those pages. And I just wanted to show you that some of the files include drafts that have edits and annotations that may be very helpful to researchers trying to understand some of the intent behind the documents and what the initial drafts look like. And here on this one, you can see in blue on the left, it says strike out. It's one of the draft pages. Next slide, please. The files often include the manuscript instrument of ratification signed by various presidents over time. And here we have the signatures of Thomas Jefferson, Abraham Lincoln, and Franklin Pierce. This is one of the many reasons these are kept in our vaults at the National Archives. Next slide. So some of the treaties include hand-drawn maps and they're amazing. And this is treaty 57 between the United States government and the Delaware, Potawatomi, Miami. People's dated September 30th, 1809. And the next slide shows a close-up. It's a zoom in on that same map. And again, this is one of the advantages of digital as you can really go in and look closely at some of this hand-drawn work. And this one says boundary established at the Treaty of Jeffersonville and outside the shot, it says the word district. So you can read the entire thing. And you can also see there's a fork of a river. It's amazing, these records are really fascinating. Next slide, please. So the treaties demonstrate the evolution of record keeping and treaty making from the use of parchment or animal skin to paper. The signatures and pictographs that appear on the treaties capture the prominent figures in U.S. history and Native American tribal history. The early treaties are generally written on large sheets of parchment and many contain pictographs next to the names of the indigenous signers. One such treaty containing pictographs is treaty number 45 between the United States and the Wyandotte, Ottawa, Chippewa, Muncie, Delaware, Shawnee and Potawatomi signed in 1805 that Fort industry on Miami of the Lake. And this is one of, oh, this is a screenshot up from that treaty. Next slide, please. And here is a closeup of that page that shows some of the pictographs that make these treaties so fascinating just on their physical grounds. All right, next slide, please. So here is a treaty, it's number 14 between the U.S. government and the Shawnee at the mouth of the Great Miami River in 1786. And what might catch your eye initially on this are the red and sometimes they're yellow wax seals for some of the signatures that are meant to attest to the authenticity of the signatures. We'll go to the next slide. But when you look closer, again, you can see that not all of the signatures have wax seals and this particularly shows you the intrinsic value of these documents that are unlike any of the other federal documents that we have. Here you can see the pictograph markings of the half king of the Wyandots, the crane of the Wyandots and Captain Pipe of the Delaware. The next slide, one of the unique treaties is number 96 between the United States and the Kwa Pa Nation signed at St. Louis on August 24th, 1818. And it contains this amazing hand drawn sketch map located at the very top of the treaty. Next slide. And here's a zoom in of that map and what I assume is a reservation area described in the treaty. And you can see the faded red lines in the zoom in. There's also some blue lines on the map as well that are faded. You have to look very carefully to see it. Having these digitized in color is critical to understanding these documents. Next slide. I just also wanted to show you this is another close-up of that treaty and the map that's pretty amazing. Treaty 156 is between the United States and the Winnebago Indians signed at Prairie Duchenne, Michigan Territory on August 1st, 1829. It contains strings of Wampum attached to the top of the treaty. And the next slide shows you a close-up there is a closer look at the treaty and those incredible beads that were attached to it. Ratified treaty number 290 is one of the first treaties where the federal government said it would provide schools. The implementation of native boarding schools all starts in this treaty. People often remark how Carlisle was the first school but it was only the first non-reservation boarding school opening in 1879. The OIA, the Office of Indian Affairs, the predecessor to the BIA would not have opened Carlisle had they not already had experience with on-reservation schools such as Yakima's 19 years before as shown in this treaty. And then we have ratified Indian Treaty number 369 even though the last Indian treaty was signed between the US government and the Nez Perce on August 13th, 1868 and ratified in 1869. Legal issues and rights continue to be contested in the course today, of course, on one such treaty which reflects the ongoing claim to watering land rights of the proposed construction of an oil pipeline by the US near the Standing Rock Indian Reservation. That's this treaty number 369 between the US and the Sioux and Arapaho Indians signed 1868 at Fort Laramie Dakota Territory. And then I just wanted to say that we've been thrilled to work with Dr. Anna Neruda-Moya and her team who have created the IDA Treaties Explorer which has all kinds of terrific features and additional information to support better access to an understanding of these treaties. And here are some other links that I'm hoping will be useful to you. I would encourage you to check out the National Archives BIA Photos Explorer. It holds 18,000 Bureau of Indian Affairs photographs. NARA also has a webpage portal for Native American records and it's all pulled together in that third bullet that I have there. And over the past year, the archivist has published a series of blog posts acknowledging the indigenous peoples who previously lived on the lands of every one of our over 40 NARA facilities across the country. And then finally I wanted to let you know that we are currently working hard to develop the 1950 census website. It will go live in April of 22. This census includes population schedules of selected Native American reservations, which is new. And we are learning more every day about which ones are in there and which ones are not. And so we want you to stay tuned and we're eager to share more with you. So thank you very much. And I'll pass it over to Anna. Thank you, Pamela. All right, I'm here to share with you about the Digitreaties Project, a project of Museum of Indian Arts and Culture, the National Archives and the National Archives Foundation made possible by a generous anonymous donation to the National Archives Foundation. Next slide, please. The Indigenous Digital Archive is a collaborative project of the City of New Mexico Museum of Indian Arts and Culture, the New Mexico State Library and the Indian Pueblo Cultural Center. And we'd also like to acknowledge our funders and Knight Foundation Institute Museum and Library Services and Clear Digitizing Hidden Collections. Next slide, please. This project actually originated from tribal constituents expressing need in strategic planning sessions with our then new director, Della Warrior, the museum's first ever native director. And in these sessions, constituents ask for more archives education and more online accessibility for documents relating to them. Next slide, please. We chose these partnerships in part to spread training and then to create stronger leaks in communities back to the resources of these institutions. Next slide, please. We have an advisory panel member made up of native and non-native scholars, community leaders and archives and libraries, practitioners that we work closely with. Next slide, please. And we started out with what was then otherwise not available online, working with records of the historic boarding schools that the government started for Native Americans. Next slide, please. Thank you. And we put, thank you. I'll try to speak a little closer to the mic. We put things online according to principles of respectful online access. You can go to the Indigenous Digital Archive and read a little bit more about our thoughts and practices for that. Next slide, please. It's very important to us that everyone feels comfortable with what's online and we proceed according to what the community wants to put up next. We also have been able to run a pilot project of Indigenous Digital Archive Fellows from the 23 tribes of New Mexico plus Hopi, people who are supported financially and then also with mentoring as they conduct research with the material that we're making online in the archives. Next slide, please. And that brings us to the Digitreaties Project that we've been able to start with the National Archives and National Archives Foundation. Next slide, please. If you go to digitreaties.org, you can see the IDA Treaties Explorer. Next slide, please. You can search in multiple ways. You can do map views here coming into 1890s map of California that was compiling land sessions in the next slide, please. You can go in a little bit more detail and this map, the set of maps covers for pretty much every area in the US. You can get kind of an index to start researching the land history and what the instruments of transfer were when applicable. Next slide, please. And then we cross-linked through other documents that allow you to search further. So here you can look at those land sessions and then the schedule of sessions start showing you what the treaty was or the statute or other action that made that session into effect, the land transfer. Next slide, please. You can also explore by place. You can go in on the map of the United States and start seeing outlines showing the different land transfers. And to me, this was particularly revelatory. You go in and you see lots of borders over one overlaying the other lots of action and you can see there's a lot of story there. Next slide, please. You can also explore by timeline. So here, again, that's showing some of the same region of the US and the Great Lakes region, specifically focusing on a timeline of documents relating to the Bad River Band of Lake Superior Tribe of Chippewa White Indians. And you can follow, you can click on the timeline and get the documents and start going further. Next slide, please. Moving, we also have a resources section. We have a guide section with video tutorials, workshops on the treaty's historical context and research you can do with this site. Done Graciously by Professor Sherry Thomas, who you'll hear from soon. Introductory materials to the treaties and some curriculum units about the treaties as well. Next slide, please. We also have a sample up of another part, an educational component we're working on is a set of treaties trading cards that we're doing with red planet books and comics. And these are all featuring original illustrations by native artists or details of the treaties and snapshots of what that treaty is. So we're doing an initial set of 24. There's a QR code that leads people right back to the treaty and the other context on digitreaties.org. But this is a way to have a non-screen-based way of exploring with the treaties and getting appreciation for the depth and magnitude of them. Next slide, please. And I think Pamela was showing possibly some of these drawings too. I was hearing from folks, some of the different ways that it's so important to be able to see the original treaties here. The YN dot, speaking with a researcher at the YN dot of Anderton, talking about how important it is to be able to see these clan symbols that people were signing with and it's allowing them to understand more about relationships among their ancestors back at the time. Next slide, please. And again, you can explore multiple areas through timeline and through map here. This is sort of getting at some of the treaties behind the recent Oklahoma decision. Showing the timeline there. And next slide, please. And then the next slide will show us just processing a little bit further on that timeline. And you can see right now it's stopping at 1850 where we're lucky to be doing another round of work on the treaties explorer and also being able to capture some of that work that the National Archives was able to do during the shutdown once they were able to do some of the working in offices again. So in the coming months, you'll see that populated out fuller to the right with the additional documents bringing it all the way up to the full-sided treaties, the ratified Indian treaties that are in the National Archives. Next slide, please. And with that introduction to the online resource, Walter, we're ready for your questions. Awesome. Thank you, ladies. As a lifelong practitioner of federal Indian law, I've had many, many occasions over the years to look at our treaties that the different native nations do have and litigate those treaties, to enforce those treaties. And your presentations have been absolutely fascinating to me as a practitioner of federal Indian law. And it's just, I think historically, very, very, these documents are very, very important. I had envisioned them as a typed up a document that we can look at on paper rather than the parchment paper. Excuse me. Handwritten parchment paper documents. But these treaties, they really do tell the true story of our nation that is etched in American history about how the West was won, how the West was lost, the promises that were made. And these are all vital parts of American history concerning the rise and growth and expansion of our republic across the continent. And so I think that today, many of these histories, you can't read about them in elementary school or college. They're not well-known to the American public. And instead of hard facts, most of our Americans are uninformed about indigenous peoples, indigenous history, indigenous aspirations and the indigenous sector of our society. And so it's good that the treaty's explorer project has been developed. And Anna, Pam, perhaps, could you, in your own words, tell us why that project is needed. Why do we need a project of this nature that could be accessible online? I'll start and Anna can take it away. I think you said it, Walter, that history is not well-known by the American people and I think as a cultural heritage institution, it's our responsibility to tell the stories that many Americans aren't aware of are not familiar with. And the thrill about working with the Digi trees explorer is that it focuses on this particular story and is able to tell it in ways that the National Archives just can't do. So it's wonderful partnering with Anna and her team to get the words out. Anna, you wanna speak? Yeah, I mean, one thing that was really hammered home for me time and time again is researching the treaties is hard. It is amazingly hard, you know, and there's a lot about them, you know, the custodial history is difficult, you know, some of the compilation of land cessations that wasn't made until the 1890s. You know, some of the listings, Deloria, when he's doing the documents of American Indian diplomacy, he describes that, you know, the 1890 compilation was basically somebody going through and cataloging what was in the filing cabinets. So, you know, some of the documents have been hard to find. It's hard to know the resources that you need to bring together to research the stories. So what we wanted to do is sort of take care of some of those initial steps so that somebody doing research, they can start at that point without having to relearn that whole thing and they can start and just go and dive deep in it and, you know, work in their context. Thank you, Anna. You know, to me, American history is incomplete without a full recitation of the true story of its indigenous peoples. And I think that there's a heightened responsibility of historians and historic preservation professionals to know that history and to tell that story. But let me invite Sherri, Sherri Thomas, Dr. Thomas here to elaborate on your thoughts, Sherri, as to the need for a project of this nature, if you would, I'm interested in your take on the need for a project of this nature, especially as it might relate to our audience that is historic preservation practitioners. All right, thank you so much for the opportunity to talk about this. So when I, in my, so I actually do a lot of outreach to many different groups, particularly librarians. I am a librarian at the University of New Mexico Law Library. And whenever I do outreach, particularly to tribal librarians, I always had so many questions about federal Indian law, tribal law and access to those laws. So when I became involved in this project, Anna asked me to start laying a foundation to fill in some of those gaps in history and understanding because one of the things that happens is that many people who are not indigenous think of indigenous and native peoples as either a romantic concept on the planes, riding a horse, when blowing through their hair or they think of them very in a very derogatory sense. And what we need to understand is that these treaties are not a part, are a part of history, but they are still in effect today. They are still affecting the lives of indigenous people today. We look at the Nodapal movement. We look at the Supreme Court decision on McGirt. And it's really important that we have access to these treaties and that we understand what the legal relationship is between the indigenous people of the United States, the indigenous people that were here in North America before the United States was created. And there were some questions that I want to address in the chat really quickly. There was a question about Spanish land grants. While they do affect indigenous people here in the United States, they're not a part of these treaties. They're really looking as Mr. Echo Hawk just recited. They're really about the expansion from the East to the West. And so you're looking at relationships between the United States and the indigenous people. We're not talking about Britain, Spain, or if we think about Alaska, Russia. So for me, the importance is just making sure that people understand the legal framework that the law that was created by these legal transactions is still alive and still affecting indigenous people today. Thank you. Yeah, you know, there's a lot, today there's a lot of misconceptions, I think about Native people. Many Americans think Native people are extinct. Others are hostage to all kinds of misinformation and racial stereotypes. Many are fellow citizens think that Indian people are on welfare, government payroll, that they don't pay taxes and just have no idea. And sometimes, Native people themselves don't either, that things like healthcare, education, food and other considerations were, inducements were often promised in these treaties. If you read the four corners of these treaties, these were promises made. And as the Supreme Court has said, great nations like great men must keep their word. And I think that part of the National Trust's mission is to tell the full American story. And let me ask you, Sherry, while I have you here, how can these treaties tell us about the full American story? Walter, just real quick, Sherry, I think this might have to be the last question. I'm so sorry, everyone, but we're at time and we need to give space for a break before the next one. But I wanted to say that I am saving the chat. I will try and figure out a way to get the questions answered and responded to. And as I said, also in the chat, Peggy and I are talking about other ways to share this information on Preservation Leadership Forum and the National Trust website. So by the way, I'm Priya. Hi, okay, Sherry, go, take it away. Thank you. Thank you for that. Yes, ma'am. Okay, so this will be our last question, folks. Our last one. So, you know, the importance of understanding the history of native people, starting with them as being treated as foreign nations, governmental entities. That is really important and I think a missing piece to the histories that we learn from elementary school all the way into creating, getting our PhDs and writing our dissertations and understanding that the federally recognized tribes, the tribal people that are enrolled in those federally recognized tribes have an additional political status. And that political status in the history of Indian people really start time immemorial. But when we look at the nation to nation relationship that was started with these treaties and we can see the foundation for the development of the interaction between these governmental entities and how that changes from an overlay, from a type of government or international protocol being introduced and used with indigenous people that had different concepts of how to relate with other governmental entities. And so that to me is one of the most important parts of understanding what treaties are. And as you so eloquently laid out in the very beginning, how a treaty starts and how it becomes a part of federal law becomes based, it has the effect of a statute once it has been ratified by Congress and signed again by the president. Thank you. Thank you, Sherry. Folks, I think this brings us towards the end of our time. And I would just say that this treaties project is really a treasure trove of information, it seems to me because it helps to fill a gap in American history on a vital part of our history, these treaties that not only etch its stone, the true story of our nation and how it was built, but these are also, as I mentioned earlier, living documents that have very profound or relevance today to ensure that the well-being of the native people, promises and are made and received by their ancestors are kept today and those promises that were made because as mentioned by the Supreme Court, great nations like great men must keep their word. And so I thank you for that. And again, I thank everyone for the opportunity of our panel to participate in this eminent historic preservation convening. Thank you. And with that, I believe I'll turn the program back over to the organizers.


So, believe it or not, there is another Bush family member who is very ambitious and has big plans for his political career. No, I'm not talking about Jeb Bush. I am, of course, talking about his son, George P. Bush. Now, if you've never heard of George P. Bush, he currently is an elected official in Texas and he is running for Attorney General in Texas.  But to the chagrin of his family, he decided to go full MAGA after Trump humiliated his father in 2016. And the reason why he went full MAGA is because he really wants Donald Trump's endorsement in this race because look, Donald Trump is the Republican Party kingmaker. He still effectively is the leader of the Republican Party and you know, the Bush era is over. Now it's all about Donald Trump.  So he posted this to his Twitter page and embarrassingly he actually pinned it. So it's a picture of him and Donald Trump and it says, the left's out of control policies are eroding the fabric of our nation. It was great to see President Trump today and discuss how he must come together as a party to restore America's first priorities. I appreciate his friendship and kind words as we work together to keep America great.   But before I give you the spoiler or the outcome, does anyone want to know what happened here? Whether or not Donald Trump actually did agree to endorse him after he betrayed his family and kissed up to Donald Trump? Take a guess.   You love to see it. You love to see it, folks. This is great.  So he took his entire family, threw them under a bus, and then he proceeded to get hit by a train, with that train being the Trump train. And just to remind you how detestable Donald Trump was to George P. Bush's mother in 2015, he actually deleted a tweet that he retweeted because even Trump thought, OK, this is a little bit too far. So he tweeted this out. Jeb Bush has to like Mexican illegals because of his wife, literally attacking Jeb Bush's wife specifically because she's Mexican. Poor Jeb. That's your mother, George P. Bush. That's possibly worse than what Ted Cruz or worse than what Trump did to Ted Cruz's wife. And you're OK with that. Like this is explicitly racist. And yet you're saying Donald Trump is your friend.  How embarrassing. Have some backbone. Try to chart your own path. It's just Republicans are so shameless. And I say Republicans knowing damn well that Democrats are the same exact way they do the same thing to Barack Obama. But to be fair, Obama doesn't like make these awful personal attacks on other Democrats. He does kill careers of progressive Democrats disproportionately. But he doesn't make these personal attacks. But Trump does. Like he makes it personal.  But you love to see it. Look, I will say this.  I despise this individual. But the best thing that he ever did is kill off the Bush dynasty and all of their political careers. He may have, you know, initiated a new, perhaps worse political dynasty if Ivanka Trump and Trump Jr. run for office one day. But still, like what he did, honestly, was a public service. Love him or hate him.  That is fantastic. It's not that Trump himself is good.  And this is no different. George P. Bush, you deserve what you get. Girlie Mike Fettuccine needs your support on Patreon.  Visit patreon.com slash humanist report to support the low ratings humanist report. Sad. My views are much higher.


Welcome to the life of two Australian shepherds week 15. Hopefully it's our last snow of the year so as expected the demeanor with the puppies versus our older dogs is is pretty much been the same here They just like playing with or harassing our older dogs and they sometimes double team Them licking their face and just our dogs are very tolerant, but they get really annoyed They walk away obviously can see I'm using a better camera in this shot here The colors are so much better than the cell phone, but they really just Double team and harass our older dogs and they get mad sometimes they get really mad But When when they're not bothering the other dogs, they do have fun by themselves playing around It's one after the other and I still think that the little one sunny is is more dominant than Ocho who's significantly heavier and larger, but He sometimes throws his weight around which is really nice I'm glad he can he's not getting tortured by the little one all the time, but they're adorable and they they Even though they they love their dogs. They also love their owner because we're the ones with the treats And after all they're playing they do quiet down thankfully if they didn't take their naps man. I think I would actually go nuts so That's it for this week. See you next week on week 16 for the life of two Australian shepherds


Some teachers will be familiar with Barrett Rosenshine's brilliant piece of research, the 17 principles of effective instruction But how many of you know about the seven principles of good feedback by Nicol and McFarland Dick in 2007? Here they are. Clarify what a good performance is, so what a good one looks like Facilitate self-assessment, so thumbs up, thumbs down, deliver high quality feedback, haven't thought about X Encourage teacher-up and peer dialogue, so think, pair, share is a perfect example Positive motivation A good example would be to ask a solution type focus questions Have you thought about A instead of B? Why did you choose one instead of two, etc? And when most teachers spend their time and efforts is the interventions in the lesson as well as planning behind the scenes All of this is used as a feedback loop in the moment or after the lesson. So seven principles I'd argue you could squash two, three, four and five into one So potentially four very good principles for effective feedback and probably also a very good teaching and learning policy


So, good afternoon, everyone. My name is Jerry Ryder and it's my pleasure to host this webinar today. Now, on to our speaker today. For those that weren't with us for the previous webinar in this series, our speaker is Martin Schweitzer, who is a data technologist with ANZ in our Melbourne office. Martin has a background in computer science and a particular interest in visualisation, data science and user interface design. He has a very professional background, which includes photography, working on large IT systems, lecturing, as well as running workshops and training courses. Martin is currently seconded to ANZ from the Bureau of Meteorology, where he is largely responsible for the climate record of Australia. Today, Martin is presenting the second in the series of two webinars on data visualisation and today's focus will be on tools and techniques. So, without any further ado, I'll hand over to you, Martin. Thanks, Jerry. And thanks, Susanna, who's behind the controls. I hope everybody can see my screen. So, today we're going to look at creating visualisations and pretty much everything you see is going to be live. I'm using a tool called Jupiter Notebook. You don't have to be familiar with this tool to follow along. Also, I'll be using Python for my examples. But if you don't know Python once again, that shouldn't be a problem because most of the tools and techniques that I will be showing you will be available in other languages, for example, R and other languages like that. So, I'll be going through a number of libraries, showing generally the strengths of each library, where they can be used, how they can be used. And as we progress, we'll move from more static to more web-based type environments. So, Jupiter Notebook runs in a web browser. And so, what you see here is my web browser. And I'll just maximise it now that we know it's a web browser. And what it allows us to do is to type in Python code and then execute it immediately. And this is great for anybody doing research because a lot of the work is in experimenting.  The first two lines I've got is just to set up our environment. And it's often we get error messages showing, so this will just hide them. Some of the libraries we'll be exploring today. The first one is Matplotlib. We'll be looking at pandas, one called Seaborn. Two web-based called Bokey and Plotly. And the last one is one that's used for mapping called Basemap. And as I go into each one, we'll talk about them in detail. Now, if anybody missed the first talk, that's not a problem because I'll explain things as I go along. But a number of these examples are showing how we created the plots that you may have seen in the first talk. Also, one of the things I said in the first talk was when doing any sort of visualisation, it's important to have some sort of story or some sort of reason or something we're trying to say with that visualisation. So the first visualisation I'm going to show is actually based on a problem that I came across just while browsing the web. And I'll explain the problem. Basically, we have a room. There are 50 people in the room and each person starts with $100. Each time the clock ticks, each person takes a random number. It picks a card between 1 and 50. And let's say their card says $26, they'll give $1 to person $26 if they've got some money in their hand. If they've got no money at that point in time, they don't give anything. So the question was, after a few thousand ticks, let's say a thousand, how much money, how will the money be distributed? Will it be fairly evenly distributed among the people? Will some people have a lot of money and some people a little? And so on. So I found this quite interesting. I wrote a small simulation. The first part of this code is the simulation. So all that is simulating what happens. And I'm now using the library called Macplotlib. Macplotlib is as much as you can say there's a standard plotting library in Python, the standard plotting library. And in Macplotlib, to plot my results that I got requires one line. So to run this, I just press, I'm going to press control return. And if everything works, as I hope it will, we get a plot. So this one line of code gave me a plot. It realized that there were 50 elements and that the values inside those elements were between 0 and 350. However, this plot doesn't really give us a picture of what's happened. So what I'm going to do is sort it so that the people with the least money come up first and the people with the most money come last. And so as I said, this is an interactive environment. So all I have to do is press make that change, press shift enter again. It runs at a thousand times. Now I get a very different plot. And there we can see that a lot of people have below $50. Most of them have below $100. And a very few people have between $250 and $350. So one of the things you will note, I haven't done this yet. I'll just change this once again. And now what I'm going to do is to save the plot as an SVG. SVG is Scalable Vector Graphics. And I'll run the plot again. It will save it. And I can now open it in a web page. So we'll just open that web page here. And what we see is we've got a nice plot. And the other thing about that special about Scalable Vector Graphics is that it's scalable. If I make it bigger, because it's a vector, we don't get any artifacts. It just scales. It gets bigger, it gets smaller. We don't lose any quality. The next thing is we can look at this and say, well, this sort of looks exponential. How well does it fit an exponential curve? And so once again, matplotlib allows us to do this. We're not going to rerun the simulation. We'll just use the data from the last simulation. And when we run it, what we see is we get a nice little... So what I've done is I said, added along a polynomial of third degree that fits those points. And I've just noticed that I haven't reset something from the last time I ran it. So I'm quickly going to restart this. I'm going to have to rerun the simulation unfortunately. And when we do this again, okay, which is what I expected, an orange line. So initially, what we see is we've got this thin orange line, which nicely fits the points. And by changing the plot, we can set things like the line width equals five, run it again. And we get a thick orange line, which is much easier to see, but it's crossing over the points. So the next thing we can do is just say alpha, which is the transparency. So equals 0.5, which basically says make it 50% transparent. And now we get a nice, thick, transparent line running through those points. So once again, matplotlib gives us the ability to customize this line. If we wanted x's instead of circles, we can change the plot of the points to x's. And I'll run again and we get x's. So one of the characteristics that we often look for when looking for a library is this idea that simple things should be simple, complex things should be possible. In other words, we don't want a very long learning curve or have to do a lot of work to get a simple graph. But if we do want something special, we want to be able to do it. We don't want a tool that's really simple to use. But as soon as we want something a little bit out of the ordinary, suddenly the tool stops working. So we'll look at a few more examples of matplotlib. This one actually comes from the documentation and the easiest thing is to show it. It plots a polar graph. It's using different colors. And we've just, in this case, generated some random numbers and made them the size of the circle and generated a random number for where around the circle we've plotted it. And then depending on the angle, we're plotting the numbers in a different color. Once again, the code that's doing the plotting are those two lines. Once we've generated the data, all we need are two lines of code and it gives us a really nice polar plot. And here's another example, once again also from the documentation. What we're doing with this one is we're going to display it interactively in Jupyter Notebook. But we're also going to save it. This time we're going to save it as a PDF. So let's run this. And there we get four histograms. It's the same data each time. But what it's demonstrating to us is different ways in which we can create histograms. So we can have stacked. We can have unfilled. We can have bars with legends, et cetera. And if we have a look at the PDF that we've generated, there we go. And once again, because it's a PDF, it's scalable. And as we scale, we don't lose any quality. It just is all done with vectors. And gives us really nice output. And unfortunately, I think that's not there yet. And where that's useful is if we're doing any kind of publication, it's really nice to be able to save our output either as SVG or PDF and include that in a publication. This is one more showing the range of plots we can do. And this one is called a hexbin plot. So it's plotting with hexagons. And what we're doing is it's kind of a cross between a scatter plot, which plots x values and y values on a graph where we've got, like we may have, the x values may be how many fix somebody has eaten and the y values may be something like the wet. And we want to plot those two against each other. But what this is also doing is plotting it against how frequently those values occur. And one of the nice things is it's really easy to do log scales. What we see here is a nice graph showing us that that white area in the center of values that occur very often. And as we move out, values occurring less and less often. The following one is actually what we're going to do is quickly look at a comic. Some people may be familiar with the web comic called XKCD. The person Randall Monroe is a very funny person, but with quite a scientific bend and also quite strong computer skills. This one is called stove ownership. And it shows his health before he realized he could cook bacon whenever he wanted and afterwards. The thing about this graph is that it's hand drawn. And while sometimes we want graphs that look very polished, very professional, there's often a perception when people see a graph like that, that the figures are very accurate. And this isn't always the case. So what people did was to create a style using macplotlib that would recreate the look and feel of the XKCD. And this is quite long because there's quite a lot. In fact, they've taken two of his comics and I'll quickly plot that using macplotlib. And what we see is a computer generated reproduction of Randall Monroe's graph. This is a histogram done in very much the same style which copies another one of his comics. So taking the style, I will replot my simulation. You'll remember the results from my simulation. So if we run that again, we see we get this thing. And which once again, so now that it doesn't look slick and professional, we see really this is very much a simulation that these figures aren't accurate. And so what this does do for us is it does give us an idea of the flexibility of macplotlib. So I'll quickly restart the kernel before going into our next library. And the next library is called Pandas. Pandas is a very useful library for anybody who's working with spreadsheets, who's working with CSV files, who's working with data that's coming from an API across the web. And it also has its own plotting routines built in. So in this code here, the first line, which actually goes over three lines, I'm reading a file which is down storage levels. It's a CSV file. Anybody who watched the last presentation would be familiar that I showed some examples. You'll see the same examples again today. So the first line reads the file. The second line plots it using Pandas plotting. And the third line just adds a legend to or sets the label on the file. So we'll run this code. And there we did get... These are Melbourne dams. And this is showing that the Thompson is about 68% full and things like Taraga are 95% full. So what we've done is in one line, we've read that CSV file. We've coded what we want to call the columns. One of the columns is called name. And one of the columns is called P full for percentage full. And when we plot it, because Pandas knows about this thing called DF, all we have to say, I want to plot the name against the percentage full, and I want to bar chart. And I've also said, I want to plot from the value 60 to 100. So if I leave out those values, plot the same graph, it will plot from 0 to 100 by default. So I'll just run this one. And part of the thing was to show that even though we've got the same figures in the same graph, it looks different when we start our scale from 0. So once again, the Thompson is about 68% full and Taraga is almost 100% full. The point, the take home point here is that to create that plot took two lines of code. And the third thing that we showed last time was what's really interesting though is the gap in volume of these different dams. And that gives us a much better picture of what's happening. So when we run that, what we see is because the Thompson dam is a really big dam, it's got over 200,000 gigalitres of water deficit. So even though these dams on the right are almost full, altogether they don't even make up that deficit in the dam. So that's matplotlib. And its strength is that it pretty much comes standard with Python. It's flexible. However, simplicity often comes at the cost that it's not the best publication ready graphing tool. You can get very nice publication ready graphs by doing a bit of work. But what some people have done is to do that work to make it easier for people to create better graphs. So one of those libraries is called Seaborn. And Seaborn basically sits on top of matplotlib and simply adds some nice styles. So we'll re-plot that same plot this time using Seaborn. And all that we're doing here is importing it and initializing it. So we've just added those two lines. Everything else is exactly as the last example. And we run this and we see a totally, well, similar graph but different styling. And what Seaborn has done is to make it quite easy to change the styling. So I'll say set the style to white, run it again. And we see we get a nice clean graph. And for example, in the next example what we will do is we'll set the style but we want a white grid and a muted palette. And we will run that one and we get that white grid with a muted palette. The next one is just one of the... Well, one thing that Seaborn does, which a few packages are starting to do, is that it actually includes its own data sets when you install the package, which is really great for when you're learning because one of the worst things is you pick up a package, you try and learn it. But the first thing you've got to do is find some data to plot and so on. One of the data sets that Seaborn comes with is this one called Flites. And I really enjoy heat maps. So this is just an example of a really simple heat map using Seaborn and some of its inbuilt data or some of the data that's provided. And what we see over here is these going down the bottom are years across the Y axis are months. And so around about 1960, July, there were lots of flights and in the earlier years, I guess there were fewer flights also during winter there were fewer flights than in summer. Once again, done with Seaborn and done really with two lines of code, which are those lines. Another data set that comes with Seaborn is called Tips. And it's basically how much people were tipped at restaurants. So the first thing we'll do is to load the data set and have a look at the first 10 rows of this data set. So what we see is we've got a few columns. The first one is the amount of the total bill, what tip was left, the sex of the person serving, whether or not there was smoker, what day of the week it was, whether it was lunch or dinner and the size of the party. So we're going to use that data set and have a look at a few Seaborn graphs. First one we're going to look at is a box plot. And what we've done is we've said we want the U to be whether there was smoker or not. So the purplish color means there were smokers. The greenish color means there weren't. On the left hand side, we've got the size of the total bill and across the bottom is a day. So it does seem that on Sundays maybe people tip more and it would look like on Sundays maybe for some reason, whatever smokers tip more than on smokers. Another plot that is often used in similar ways to the box plot but carries a bit more information, encodes a bit more information is what's known as a violin plot. And these ones are quite easy in Seaborn. And in this case, what we've done is we've used a different U for male and female. And so basically you read this pretty much the same as the box plot. There's the median. There's the top portal, the bottom portal, etc. And some of the information is very much the same. On Sundays people seem to tip the most. And we can see they've been splitting this time into male and female. Those people who were the last one will remember I demonstrated something called Hanscom Quartet. It's four data sets, each with the same means and linear regression lines. But each data set looks very different. Here's a very simple example of it being done in Seaborn. So we'll just have a quick look at that. And we see it was quite easy. In this case, we're sharing the y-axis. Across the bottom we're sharing the x-axis of the two plots. And all of this was done in a very, very compact way using Seaborn. The next thing we're going to look at is plotting data on maps. And this goes back to a lot of what I do in my substantive job at the Bureau. So the library that we use for a lot of our mapping is, once again, it's a standard with Python. It's called Basemap. And the first one, we're not actually plotting anything. We're just simply drawing a map. So what we should see now, it takes a little bit the first time we run it. But we've plotted a map of the world in a few lines of code. That's pretty much from there to there. So what we're really interested in at the stage is Australia. And this projection isn't as useful as what we're going to look at now, which is a sort of MacCator. So we'll just change some of the parameters. This should give us a map of Australia, which is great. It looks a bit like the ones I draw by hand. So what I'm going to demonstrate now is some more visualization. But it goes back to a problem I was given about a year or two ago. So we have about 112 reference stations around Australia. And these are stations with very high quality data that have a long record, about 50 years or longer. And these are very important as reference stations to see what's happening with the climate of Australia. One of the outcomes of this, the reference station set is called Acorn. And we do a publication where we publish the names of each station. And one of the things we also publish is for each station, which are the closest three stations to that station? So I wrote some codes that worked out what the closest three stations were to each station. This was the file I was given. Once again, I'm using pandas to read it. And so we've got, for example, a whole screen. We've got the latitude, longitude, the altitude, and the date it was opened. As we can see, these all have a very long record. So the first thing, let's plot these. So using map plot lib, the first parts we've seen that draws the map. This line, after having read the file, plots the date on a map. So we'll just quickly plot those stations. So the black dots, of course, are the stations. And there are 112 of them around Australia. So the question I was asked is, after saying, okay, as a list for each station, these are the closest three stations to that particular station. Bing Santas, though, was asking interesting questions. They said, by going to one of the closest three stations from each station, is it possible to get from any station to any other station? Now, it may seem that the obvious answer is yes. But the thing is, because if I'm sitting here, these may be my three closest stations. But that does not mean that where I'm sitting, which is around Microthorah, that it's going to be one of the closest three stations to this station because this station's three closest neighbors are maybe these three stations. So the first thing I did, because I'm fairly visual, was to try and visualize it. And what I did was to go back to a very old package, which is about 30 years old. I first used it probably more than 20 years ago, called GraphViz. And Python includes bindings for GraphViz. So we can think of this as each station is a node, and we've got lines connecting it to the three closest stations. So what I've done is to do something that will visualize that. And so we'll just run this code, and it creates a PDF. And what we see in this PDF is that I've simply used the station numbers to save space. We can see the layout of all the stations and move across here. One of the things that we see, for example, is that station 7045, even though it's got three stations that are closest to it, there's no station for which 7045 is the closest station. And we can see it in a few other places as well. So I think over here, we've only got one line going from 859.6 to 1293. If anybody wants to guess, this part is, in fact, the stations that are in Tasmania. And if we go back to our graph map, we can see how these are all close together. That station is close to that one, but these are all closer to each other than the main one. So basically that graph helps us visualize. And yes, it turns out, after writing some code, that there is no single path. So the next question, once again, these people being scientists, is where would we have to add stations so that there's always a way that we can get to another station by visiting one of the closest three? So I came up with a new visualization, and it's called a Voronoi plot. And I'll run this code. And what a Voronoi plot does is it's not easy to show yes. I'll show it in a web page that I did. So on this map, you see the ACONSAT stations, and you see all these polygons. And what these polygons are, every point inside this polygon, for example, is closer to this station than to any other station that's not inside the polygon. So any point inside this polygon, this point, for example, is closer to there than it is to any of the surrounding stations. So basically it divides the territory up into areas. And in a way it's saying, OK, well, the temperature there, we could argue, is most influenced by this station. So if we've got a temperature, yeah, and want to check it for accuracy or whatever, we're more likely to look, yeah, than one of these other stations. But so what does this have to do with where do we build a site? Well, if we consider this line, then any point along this line is the point that's the furthest point between this station and the station. And any point on this line is the point that's the furthest one between that station and that station. Therefore, if we were going to... So any point on one of these edges where these lines meet is the point that's the furthest from all the adjoining stations. So this point is furthest from that one, that one, and that one, and obviously further than any other. So what it comes down to is if we're going to build a new station, we want it on one of these points, on one of these vertices. So it's just another example of how we can use visualizations to solve some real problems. So for the moment, that's all we're going to do with maps, and we may return to it soon. The next library we're going to quickly have a look at is called Bokeh. And Bokeh is the first library that works with Python, but its output is targeted generally at web pages. So once again, you'll remember Anscum's Quartet from a previous slide. We'll do it in Bokeh, and it's given us a really nice graph of Anscum's Quartet. And if one sees some of the original drawings of it, for example, in Tufta's book, this is very close to the original. So it was very easy to book. It required some work to make it look similar, but we could, it was flexible enough that we could. I'll quickly show another one, which is another famous machine learning dataset, which is irises. And this one is plotting, so what we're plotting is the petal width of different species against the petal length. And we see that some species are down here. Some species, the green ones are up here and some of you. The thing about Bokeh is it allows us some interactivity, so we can do things like zoom. We can also pan. And if we put the output on a web page, the web page can have these same tools. There's a wheel zoom. We can go back to what it looked like initially. So that's Bokeh. And there's one that also came from that last one called Joy Plots. And the thing about this is we're plotting a whole lot of variables against a common set of axes. I'll just, for the moment, skip over it properly because I want to look at a few tools that are useful in web development. So we're leaving Python for a moment. And the first one is one that I read a few years ago. So this is using Google Maps and I'm putting some data on it. And these are the ACON set stations once again. And when we click on one, we get a graph of the climatology, the average monthly temperature. So let's get Melbourne. So we're now in April. So the average maximum temperature for Melbourne is normally 21 degrees. This is the average rainfall for Melbourne, around 50 mil. We can also get time series and we can zoom in on the time series. So this graph and the time series, we're done using a tool called High Charts. High Charts is available free for non-commercial use, but it does require lessons for any kind of commercial use. And government use is also considered commercial. Having said that, if you are doing web pages and you are looking for a plotting package, it's worth considering High Charts. The next example is another mapping library. This one is leaflet. In this case, this is something I did for work. What we're plotting here is this data is coming from NetCDF files. Some people will be familiar and have used NetCDF and the data is coming straight out of these NetCDF files. The main purpose of this slide is to show this library leaflet, which basically allows us to put data on top of maps. In this case, it's gridded data, but we can also put... Yeah, we've got some GeoJSON. We could also be putting shapefiles and other things like utility boundaries, which you can overlay on the map. It basically allows us to overlay data on top of maps. The third example I'll show is one called Open Layers. And this was one of the more complex visualizations I did. Basically, what this one is demonstrating is east coast lows of the eastern seaboard of Australia. All of this was overlaid on this map using... The map was done with Open Layers. I think that's all I'll talk about. I think finally what we'll do is look at one more library and one more example. The library we're going to look at is called Fager. And once again, it's another simulation. I came across this thing called Perondo's Paradox. And for me, it was quite mind-blowing. So I just had to do a visualization to make sure that I understood it and that it worked. So basically, I'll try and explain it quickly. You've got three games you can play and each of them involves a coin being spun. And in game one, the coin is more likely to land on tails. And so each time in game one, you bet on heads. In other words, it's a losing strategy. So that's game one. In game two, we occasionally choose coin one. Sorry, we've got coin two, which most often lands on heads, but we don't choose coin two all the time. Sorry, we don't choose heads all the time. Sometimes we choose heads, sometimes we choose tails. And most of the times we choose heads, but two or three times we choose tails. And it can be shown once again that that's a losing strategy. In game three, what we do is we randomly decide to either play game one or game two. So if game one, we definitely lose and game two, we definitely lose. We would think that choosing game one and game two, we should also lose if we just choose randomly between whether to play game one or game two. So in this one, I've used this library called Vega. And I think the first thing I would do is just run. So I play this game 10,000 times. I play game A and plot the results. I play game B 10,000 times plot the result. And then I do P three, which is where I randomly choose between game one and game two and plot the results. We run the simulation. P one is when I play game one. And we can see I started off with $0 and up with minus $100. When I played game two, which was also losing strategy, I did actually quite badly. I ended up with minus $250. But when I alternated randomly between the two games, I ended up in the black with plus $150. So these slides or this Python notebook will be included after the talk. You're welcome to have a look at this and find the mathematical explanation why it works. Or you can also just Google Perrondo's paradox. So what have we found out? Well, I guess one of the questions is if I want to do visualizations, what's a good tool? So in brief, matplotlib is a good one to start with. Easy things are easy. Flexible things are possible. It can do dozens of different visualizations. It's very good for static plots. In other words, if you're going to publish your results in a book or whatever. And it also integrates well with Python's math and science toolkits. And if you're familiar with Python, it understands things like NumPy and SciPy. And they're all tightly integrated. Seaborn makes it easier to do, let's say, publication-ready plots with matplotlib. Bokeh has very nice output. It targets webpages. It's got a slightly easier learning curve than matplotlib. And it looks good out of the box. Plotlib, one of the things is it's based on a commercial package and there's both commercial and non-commercial versions of it available. It leverages D3 for graphics. D3 is a fantastic JavaScript graphics library that, unfortunately, the stock didn't give us time for. And because of that, the interaction is more extensive than Bokeh and also the range of things. One thing I didn't talk about at PD Vega or Vega is that it's got an interesting way of working in that it defines a language for defining the graph and it displays it. But when you create a graph with Vega, that graph includes all the data that was used to create the graph. So if you're interested in making your publications and your data available, so it's one thing to see a graph in a paper and say, okay, well, how do I reproduce this graph? It's another thing to say, okay, this is the graph and this is all the data that created this graph. So it's really worth considering if it's important to you to publish the data with the graphs. Basemap is based on Matplotlib. It's on top of Matplotlib. It can be a bit clunky, but it does the job. Cotopeye is still, I don't think, 100% production ready, but it improves on Basemap, makes it easier to use and has some great features. And then I'll quickly go through Leaflet. Its advantages were lightweight. It's quick to learn and use and supports many formats, most particularly WMS and GeoJSON. OpenLayers is more featureful than Leaflet. It used to be a steeper learning curve than Leaflet, but modern versions are actually much easier or they've improved the learning, they've made the learning curve less steep. I didn't get a chance to demonstrate cesium, but it can utilize built-in 3G capabilities of browsers and it works just out of the box. You can install it and immediately you've got a map up and running. I installed it recently just to try it out and about an hour later decided to download some earthquake data from the United States Geographical Survey and within about 15 minutes I was displaying that data on my map so it makes it really easy. What are my recommendations? If you work with Python and you're not interested in learning a lot of programming and getting deeply into it, but you do need to work with data and you're doing research, I recommend learn pandas, use pandas for plotting for static plots and use Vega for the web. Thanks very much. Well, thank you so much, Martin, for such informative and practical presentation and bravely with so many live demos, which we rarely see. So thank you for that. Now we do have time for questions. So if people have questions or comments, please put them into the question pod. Now's your chance with Martin online to ask any specific questions about packages or just some of the things that you've seen today. So please do ask away. We have got time for a few questions. So Martin, we do have a question from Marlon. What's your opinion on tools like Tableau or Tableau, T-A-B-E-A-U? Two people have asked about that one. So Tableau is what's known as the BI tool, a business intelligence tool. It's used in the Bureau. It's a commercial tool. I think I'm correct in saying that it's only commercial. There may be demo versions available. From everything I understand, it does what it's designed to do extremely well. And so it's very good at building dashboards. I think it often assumes the idea that there's going to be a data warehouse available or at least a data mart. I know previous versions where it was used, there were some issues with creating websites that were being presented to the public. This was because it wasn't WCAG compliant. WCAG is the Web Accessibility Guidelines and for government work websites need to be WCAG compliant. It had some mapping features, but the maps only allowed single layers, which would have made something like what I demonstrated with the rainfall maps very tricky because we had sometimes up to five or six different layers on those maps. So I guess I'd either want to sort of recommend or dismiss any packages, but I think from everything I understand, and I'm not a regular Tableau user, but it works well for its design purpose. And one of the areas where I know people have really enjoyed using it is where they've wanted management type dashboards on their desktop to be able to monitor whatever it was that they were monitoring. Yep, thanks, Martin. And John has popped into the question pod that there is a free public version of Tableau, Tableau. I won't get my mouth around that. So if people are interested, they could go and check that out for themselves. Collins asked Martin why Python and not Ruby, and he also has asked if MetVib or R make the grade. Okay, the reason Python and not Ruby is because I know Python and I don't know Ruby particularly well. When Ruby came out, I started learning it and then other things got in the way. I don't think there's any good reason why not Ruby, but I can't talk with authority on how many. I think one of the things is with data science, Python and R really seem to have taken a lot of that mind share. Between Python and R, I wouldn't, it's six of one half a dozen of data. There are a lot of people using R. There are a lot of domains where people really love R. Bioinformatics knows one where it's very common. And as I said in the beginning, most of these visualizations are available in almost any language that people look at, or any popular language. When people come up with a library like Procli, other people will create bindings for different languages. Thanks, Marta. Another question, do you use other mapping tools like ArcMap? That's another question from Marlon. Well, at the Bureau, Esri products are very popular. I personally don't use ArcMap, and probably just because of the nature of the work that I'm doing, and probably because of the current set of toolchain that we've got, I do use an open source product called QGIS occasionally, but even that I don't use often. So most of my work is done in the, well, of this time, is done using things like JavaScript. And so I just use the JavaScript libraries that are there. Okay. And a question from Susan, who's interested in a online tutorial for beginners in data visualization. So apart from recordings of your own webinars, Marta, are there any, anything that you could recommend to Susan? That might be one to take on notice. I think it is, and I'll definitely have a look, but there's a lot of MOOCs. So I might go to places of things like Udacity or EDX, and later I'll be noticing, particularly with sort of the current level of the monthly data sense, a lot of these places are offering courses. But yeah, certainly I'll have a look at, maybe we'll put a, in one of our snippets or something, at beginners data visualization. Okay. Thank you, Martin. And that's probably a nice segue to, to plug our updated web page. Now, we, Martin's kindly spent some time updating the content of our web page on the Ann's website. And I'm just showing you the link here. So a lot of the tools and the libraries that Martin's spoken about in the webinars are available and described there. So please go and have a look at that. And also, of course, these webinar recordings will be made available. We have one last question, Martin, from Sophie. Do you recommend Code Academy? I haven't used Code Academy. I've got an account, I know, because I keep getting emails from them. But I think it's pretty much, there's a lot of good stuff available. So I think it's pretty much trying and trying something that suits you. So that's great timing for the end of our webinar today. Thank you all for coming along and a big thanks to Martin for two fantastic webinars and presentations and making all the materials available through the presentations and through our updated web page. We look forward to seeing you at one of our future webinars. And in the meantime, have a great afternoon. Thank you very much.