Thank you very much. This paper is based on the collective ideas of archivists, librarians, museum curators and ref research information specialists. That's why on your programmes there's four names, two of my colleagues couldn't be here today. It's very much in the spirit of collaboration as the theme of the conference is, and we're trying to collaborate more even within our own institution. It was conceived from our awareness of the increasingly complex information infrastructure that's supporting the ref and our wish to create a more joined up approach to what we're doing. I'll just move on to the next one. While ref in its current form may not stay with us for all that long, the function of supporting research is something that libraries and museums have been doing at Glasgow for centuries. Librarians since the 15th century, museum curators since the 19th century, archivists and research information managers only 20th century, so doing it not quite so long. There are increasingly more professionals joining the university services to support the ref, marketing, web designers, public engagement specialists, social media officers, all consuming the information that we as librarians, archivists and curators are putting out. And we're needing to find ways to communicate with them through their own channels, so social media is one of those. I would say that we don't necessarily have all the answers to the questions that we're going to raise in this paper, but we thought this would be a good forum to begin to discuss them. So, to give you some of the statistics on Glasgow, founded 1451, and we were 12th overall in the ref 2014. I'll not read all that out, you can see that for yourself. In line with other Russell group research intensive universities, we've been investing in refs related support, and as professionals in memory institutions, we need to find ways to interact with them. And to try and persuade them that there is more to the history of the university than just the five year, five or six year ref cycle. Our values at Glasgow, as per the strategy everybody's got them, passionate, professional and progressive, it's particularly the progressive one that we've been using to try to communicate with the wider teams to show that you can learn lessons from the past as we move forward. As RLUK has identified, there's a particular challenge in providing online systems to cover access to centuries of research. That's indeed what most RLUK members are working towards. The biggest challenge for us at Glasgow we feel is not delivering the online content, it's delivering it in an integrated, efficient, relevant, engaging way, and we'll give a few illustrations of what we're doing from our library archive and museum perspectives. For those of you based in universities, these sorts of tools will be very familiar to you. Publications repositories have been developed by all universities to put out their research data. The latest one to be developed for us is the impact repository. All of these are delivering truly excellent services to support the ref, but research started a long time before the ref and our combined institutional college and subject impact at Glasgow has been built since 1451 and recorded in our library archives and museums. How might we integrate the information from our catalogs into the publications repository is one question that we're beginning to look at. The collections held by almost all of us in this room have an impact on the ref in some way beyond our own institutions, but it isn't always easy to collate and pull that information together. That's assuming that society wants us to justify what we're doing to pull all that information to be able to justify why we have archives. While we might know who's visited us to use the archives, we can capture very little of the impact as that moves forward and what do they do with the knowledge that they uncover when they use their collections. What is very clear is that we're now moving from open collections to engaging collections and Jenny Chambers, head of public engagement at the Research Council's UK has recently spoken of moving from the research dissemination phase to a research engagement phase. So what can we as heritage professionals bring to support that? This is something very familiar to those of you at the National Archives. Preserving archives is important not just for the ref and to make information available for a very specific time. It's an important part of a democratic society. So as an archivist responsible for documenting the University of Glasgow's history, this year I've been working with my digital library colleagues to create an online archive for priority-born digital materials to enhance the ref 2020 submissions should it be in 2020. We'll be creating a pilot project of self-archiving, the communications office, press releases and filmmaking. Several efficiency drivers for doing this, not least because they adopted this procedure without really thinking, they adopted filmmaking without really thinking about the information management aspects to it. So we're kind of coming in to solve a problem, but also that will give us an end to create a digital repository for that filmmaking to permanently preserve it to sit and support the ref. So what else are we doing in the library to integrate and streamline to present our researchers and the research to the world more efficiently and engagingly? We're investing in linked data approaches, particularly looking at the person's linked data because there's such a confusing array of ways to present an individual researcher in the online world. We are working with the Hunterian, my colleague Maria will be talking about that, and with Axial on KEE new content management system to make object metadata interoperable with print archive catalogs and the repository and to maximise their own online discovery. We are also collaborating with Maria and our university research office to try to develop key performance indicators for how we as heritage services will be supporting online research dissemination and engagement. My final slide is, I want to talk about where I think my work is converging more with the work of Maria as a museum curator. Since 2006 the university archives have led a project called the University of Glasgow story which gives the context to the university's history from 1451 to the present. It started as a way of managing routine repetitive enquiries like who was the professor of chemistry in 1727 etc. It's been through several project phases and the underlying technology is clunky but based on the funding that was available at the time. In this new era of integration we are working for this to become a set of data that will be part of the wider library and museum systems and we are hoping that by integrating that past and present data we will be able to show the data from all our research in an interesting and more dynamic way. It will make it easier for the public to see how research today brings so many possibilities for humanity tomorrow. Is that often more easy to see how something from a hundred years ago has impacted on us today rather than saying this is the breakthrough science. It's sometimes easier to tell that story so our online users might be inspired to be the next James Watt or Adam Smith or today's equivalent or maybe a more modest ambition would be that they would wish to visit the university and its four star visitor attraction which is the Hunterian Museum. So that's over to Maria. You see we're trying to apply and practice the inter-institutional collaboration so we're doing a bit of a double act but it's also my own role which was created a few years ago is at the University of Glasgow but it's a joint one half between the Hunterian the museum and gallery and the other half within the School of Humanities in the College of Art, the HATI the Humanities Advanced Technology Information Institute and as Laura mentioned because my role is to be a little bit not just a split personality but really a go-between trying to increase the use of the collections it's very interesting to see today the different papers and panels how the collaborations both within and outside the university are making us rethink among other things the ref and the impact on different communities and users so university museums like the Hunterian are all rethinking in the new possibilities to make better use of their teaching and engage in new ways in the groundbreaking research they're undertaking so it's interesting to look at some of the specific ways in Glasgow we just moved to the Kelvin Hall project that you might have heard about which is a very large capital project that brought us in partnership the University of Glasgow and the Hunterian being one of the three partners the Moving Image Archive of the National Library of Scotland the other one and Glasgow Life which has both the Glasgow Museums and the Glasgow Sport Branch being the third one so having the town, gown, the civic, national and academic institutions collaborating together brought its own very interesting challenges and a lot of opportunities for example you will notice sport is there together with the museums which was quite a challenge for some of my curatorial colleagues and I mentioned the collection stress conference a few weeks ago that maybe throwing the sports hall the basketball and the dance studio that we have next to the collections and seeing the different kind of audiences maybe in the rack would be very interesting to watch it was the only thing that was tweeted from the rest of my talk so it will be interesting to see actually in practice this but apart from the sports it's also the collections of the three partners are being brought together in the open collections portal and that has created the need for more support and resources so we opened up a post to support this and we need much more in that direction as part of that it was also developing case studies and guidelines for assessing the ref because I think it's becoming already obvious not just from this panel but from some other comments in the conference and from your own experience nobody really knows that's why I made the Brexit but I hope it's not going to be as painful as that one, the next ref but the truth is nobody really knows exactly which direction it will take but what I don't know is that impact is here to stay and it's very important and I think one of the things we are trying to figure out in line with a lot of other institutions is what is the best way to use this not just something we all have to do but to also follow in the direction of doing impact engaging with audiences that we all feel is very important without stopping within the close refines of the ref only and still do that effectively so one of the ways for example is for us as Moira mentioned this collaboration with the library and the archive to integrate more integrated portals and manage and use our assets the Kelvin Hall you see chopped down version I'm afraid of the building it's only one third that has been developed from this vast gigantic building and the remaining two thirds we're putting a bit together at the moment there's one second shameless plug here I'm also coordinating as part of this collaboration the Scottish digital network on cultural heritage evaluation and digital resources so as part of that we're finishing our network activities after a few workshops with a symposium in Glasgow at the newly opened Kelvin Hall and because a lot of you are working in this area of digital cultural resources and trying to evaluate who uses them and how is at the very heart of our symposium and we just extended the calls for proposals there will be on a grid folder if you're interested in the details we have just in a few days if you want to submit one and join us in the conversation starting from here in Glasgow but moving on from that I wanted to very briefly to not take over my time mention two case studies that we have started exploring the ref impact and the use of the collection of the museum world so one of the exhibitions for example is one of my colleagues in the College of Arts of the French text and image studies Billy Grove, Professor Lawrence Grove has been working many years on the history of comics and the graphic communication and using special collections and the rest of the collections in Glasgow and beyond and a lot of his many years research resulted in an exhibition that closed a few months ago at the Hunterian Art Gallery in Glasgow and where we started collaborating and looking at the next ref again was trying to be a bit more strategic of how do we capture the impact to the visitors of the exhibition so you have started working with the ref this is just one of the ways and the areas of impact but trying to assess what the audience is actually getting out of maybe an hour or two of browsing an exhibition is quite complex and trying to do something that you feel is very close to the cultural institutions heart the academic one but also follow some of the ref requirements is not always very easy and one of the important things is to start planning about this at the very earliest possible start that you can do that so Billy's wider research had a specific aim and he's working a lot with building an academy about understanding comics the whole history of it he worked with a lot of different audiences but as far as the cultural heritage community is concerned with the specific exhibition it was important for him and I mentioned this for other researchers from your experience whichever side you're sitting or whether like me you had on trying to make the research more clear about what are the specific aims of an exhibition and for those of you putting exhibitions together you would know that this is standard anyway but trying to see how the wider research ties in with a specific exhibition the areas where the overlap was quite important so in this case was to raise awareness of the role of Glasgow and Scotland in the history and development of comics but also build an understanding among visitors about their everyday cultural reference and how we relevance and references and how we see them in our everyday lives but also try to break down some of the preconceptions about high and low art and try to expose existing and new audiences to this history and the importance of comics for the evaluation in this one we tried to evaluate the reach of the exhibition but mainly the visitors experience and we also wanted of course to see what was the impact of this so we used different methods and it was important we felt to talk face to face having interviews with our visitors and we are only starting an experimental small way with 50 people before and 50 people after they've been to the exhibition which we we think as a sample if you want to use these things if you want to do subgroup analysis afterwards you really need the larger one but we also use some of the comments from the visitors' book we had an online survey where there were additional users responding to this the social media and media coverage but also the different exhibition events that accompanied the exhibition we tried to analyse, evaluate and look at how this worked out even merchandising and how that worked in relation to the specific exhibition was also one of the indicators and all this worked more effectively because we're a university museum one of the greatest resources that our students so integrating the way Rachel was talking earlier on for example as part of a student work placement project for the museum studies was quite useful and this is one of the lessons learned afterwards for me that tried to explain the REF context to a graduate student requires quite a lot of effort and it's important to try to find the terminology and the language so it becomes the win-win situation we kept talking about in the morning some of the findings very quickly because we're still analysing some of the results it was interesting that people the before and after group for those of you who have worked in evaluation work these are really quite complex ideas all our collections and exhibitions related to them it's not very easy to analyse in this quite rigid before and after sort of splitting groups but because the REF quite clearly wants to see an indication that the specific research activity actually brought the kind of impact you are claiming at it we decided for different reasons to try this out as well that people had visited the exhibition they were likely for example to think in terms less likely in terms of stereotypes that we have they did suggest they did understand something about the importance of Glasgow in the origin of some of those artefacts they also challenged them in terms of the financial value they would attribute to some of the works of art you see a Lichtenstein we borrowed for example at the back there are some mentioned artefacts we had in the collection we tried to ask them to rank what kind of financial value but also personal value so there are some interesting results coming out of all of this but it was interesting for us as well to try to use the comic convention exhibition as also a test kind of lab testing a little bit environment and the case study to help us think ourselves strategically when we are working with all the different departments in the university from outside what are some of the guidelines what are some of the ways to not just do a successful exhibition but maybe a potential successful ref impact case study and do the two can they really work together at the same time effectively and successfully so this is another example that Moira did a lot of work with another of my colleagues from the School of Humanities this time Professor Tony Pollard who is a historian he is a conflicting historian and they worked a lot initially with welcome trust funding on the Erskine story and Erskine is one of the great hospitals just outside Glasgow where we have a very long history that we are celebrating the centenary this year it was one of the hospitals after first wall a lot of the soldiers were coming back to be rehabilitated and it was also because and that's the link with the University of Glasgow one of the professors of surgery Professor my QN was one of the first to work a lot on limb rehabilitation artificial limbs for the soldiers who were coming back from the war we collaborated with not just Erskine at the hospital and the charity but also the work that Moira and Tony did together was a lot with the volunteer and the charity that they have set up called also Erskine to try to put the exhibition together and bring different generations but also the families of the soldiers and the people who work there and this is one more of the examples where we're trying to look how the underlying research within the University of Glasgow can link with different communities and the impact it can have today and also using some of the comic invention example and experience to see how we can formulate our strategy for things like this project so just some wider lessons to from all of this work it's very important I think no matter what the political, academic and other economic drivers are to focus so much on the ref that it's we all have to do it's very important to not forget the importance of talking to your visitors and talking to your end-us anyway despite the fact that actually it's not necessarily the most resource efficient way to do that but it's a good ref impact case study for those of you who have dealt with this for example the impact on policy, getting testimonials the way the last if you look up Rachel mentioned it's actually up there on the web all the raw data getting testimonials for well-known figures academics and others or artists or getting people to also whether it's governmental bodies or other organisations to show what kind of impact your research has had on them easier if you have developed all these links much earlier on rather than getting the numbers required to talk just about public engagement but nevertheless I think it's a vital it's a very important part of our mission in all areas of cultural heritage so I think trying to combine quantitative and qualitative methods when you do that it's really very important there's a lot of talk about the next ref one of the things that have been floating around for example is that there will be increasing number of quantitative indicators performance indicators, downloads, numbers hits of how people are using the digital collections it might be the case or not, even if it's the case I think it's very important to not forget that you need the qualitative information there as well you need to talk to people also and record this in some ways and we saw in a very fascinating way with the keynote just before how they're dealing with the interviews of the survivors but you need to think and each institution way its own audience and its own means and capacity of how what's the best way to do this I'm just mentioning here that it's important just flagging the fact it's important to combine this information it's also very important to think as much as possible in real life to start thinking about impact not just ref related impact but how to evidence and record this as early as possible ideally we're talking about large funded research projects for example from the research project application stage not when the exhibition is sometimes the end process of a four or five year kind of long project so try to think what you think the impact will be and what would be a good way to evidence that and record it and what are the kind of audience this is a very useful questions to have I think very early on and discuss with your other partners it's also I found from experience clarifying what was the why the research project aims and clarifying what are the aims of the specific exhibition which might be an output of the project are not necessarily identical so trying to also get a consensus on some of these things we think is very important I don't have time to analyse we're looking at the rest of the last ref impact case studies and what's the relationship with memory institutions whether it was exhibitions like the examples I mentioned or creating online resources or other forms of engagement it's quite challenging to draw out the data on what exactly the role of the memory institutions will play because although it is free data it's available it's all up there actually trying to make sense reading between the lines is not always easy and it seems in some cases although there were cultural institutions involved in several of them it's not very clear how active at all they had and some of this issues that Moria mentioned earlier on but also other speakers but they need to more actively engage in these partnerships I think it's also coming up for some of you who are interested in all of this and are relatively new the public engagement website is up there because it's quite a lot of useful resources on some of the ways public engagement the forum took and also guidelines and some of the research projects and a lot of things you might want to look up so to finish off I think a lot of us are doing very important impact work anyway it's not always easy to fit this in the ref parameters but it's important for us to continue to do so while at the same time being a bit more strategic getting more informed as this is shaped up how would this effectively and efficiently fit in maybe a potential ref impact case study it's quite complex that form and type of impact this can have some of the children for example asking those 1000 questions from the survivors and what was the impact from listening to the interview would be so difficult to quantify or record in a way that makes sense but I think it's important for all of us collectively to talk and discuss maybe about the challenges that this process brings also I think the vocabulary somebody else mentioned this today the need for us to talk the same language whether it's for researchers to understand the impact language or whether it's for cultural heritage professionals students and the public understanding the ref language but also being more transparent about this whole process for our different kind of publics and communities I think it's also an important point this has created a lot of new roles within Glasgow but also in a lot of other places public engagement people knowledge exchange people, ref impact people recording all this and in some cases it's been added to promotion criteria but it still is another area that's problematic that although impact is very important needs to be valued it's slowly and not always happened yet it needs to also be integrated in the work we do not just in academia but also in the cultural heritage side so there's a lot of people some of them reflected some of those new roles that we wanted to thank not just our host for inviting this and the useful conversation and I'll just finish off there thank you very much


What's going on everyone Sam here with late in sports cards We are ripping one box of 2022 panini immaculate baseball first off the line for Nicholas S So good luck here Nicholas. We've got your first off the line sticker right there. Good luck. Let's see what's in here It's up Caleb and Caleb just addicted to the grind So we should get one of our first off the line parallels either number two Two or two eight on the RPAs well as your gold jersey to 10 We're not gold but pink jerseys the time I should say We've got nice Clayton Kershaw. That is eight out of ten on the pink jersey nice one there. That is gonna be a game worn Yeah baseball immaculate is very nice this year a great job with it We've got 20 out of 49. That is Alex Breitman For the Astros nice one there this nice Player worn on that we've got your first off the line Exclusive is gonna be two out of eight Coulson Montgomery on the prospect auto Nice hit Nick list. That's sweet dude. That is so sick player worn on the Coulson. Nice Let's go. Let's fire We've got 16 out of 26 16 out of 26, I guess that is Connor Wong on the I black at your auto for the Red Sox Nice one there Connor Wong Take that for sure. We've got 40 out of 99 going to the Tigers that is Matt Manning nice hit on that one two-colored RPA One of the better pitching kind of rookie slash prospects in all baseball.  How about one out of ten? Spencer Torkelson on the rookie signatures Wow, what a box. That is awesome. Nicholas Congrats on that one, buddy That is sweet That'll do it for your break there. Nicholas Congrats on the hits buddy. We'll get them right out to you


Okay, so returning to our description of circular reasoning, I want to make sure that I'm very clear that when we're talking about circular reasoning or circular logic, what I mean is that it's the situation where the hypothetical construct or the private event is considered both the cause of and evidence of an observed phenomenon. Now keep in mind that is exactly why most behavior analysts, even modern radical behaviorists tend not to use things like self-report measurements or private events like attitudes or thoughts or feelings as the primary explanatory variable in a lot of our studies. We tend to look at the environment in ways in which the environment changes around the organism to better understand why they're making those choices. So this then highlights some of the really big differences between behavior analysis and related fields. For instance, I'm going to just give you a quick breakdown of the differences between most mainstream psychology and that even itself is misleading because I'm making a broad generalization about an entire field of study, ignoring the fact that there are many different subcategories and subdomains of psychology. So take this with a grain of salt. Some of the big differences between behavior analysis and mainstream psychology include things like the fact that psychology uses a lot of indirect self-report measures like surveys or direct observation in their studies, meaning that they consider both direct observation and self-report surveys to be worthy independent variables, whereas we'll see some differences in behavior analysis. Mainstream psychology self-report tends to be used as a proxy of actual behavior. So when I say it's a proxy, what I mean is I might ask you, are you likely to attend a big party if you're going alone? I don't actually go and watch you observing the big party. I ask you whether you would or not. And your reporting of whether or not you would is taken at face value. We don't always question in the same way that we should whether a person would actually do that. And then also that some studies in psychology can be published without any kind of self-report observation. What I mean by that is a lot of studies in psychology tend to focus on relationships between two self-report variables. What you say that you would do in this circumstance and what you report on a different metric like your personality. As opposed to behavior analysis where for the most part our published studies only use direct observation. It's one of the core kind of foundational principles of our field that we only focus on direct observation. That is changing a little bit. We're starting to see a few more studies being published but for the most part when we're talking about clinical work, we're talking about only looking at observable client behavior. We also see that we do use self-report but we tend to use it as a tertiary or a secondary measure to the direct observation so I can see how the intervention is working, like actually observe the learner's response but then I might ask the learner about their experiences and what caused those responses. The primary and most important variable that we're looking at is the observation but we supplement that with self-report. Then we do this a lot when we're talking about social validity and when we're looking at quality measurements, when we start talking about reliability and social validity and so on and so forth. That's where I want you to keep in mind where we use self-report and then finally many behavior analytic journals will not publish a research study if it doesn't have direct observation so you can see that there's this really big difference between most mainstream psychology and behavior analysis. In this topic, I gave a few resources from other sources about why people choose to be behavior analysts, like what is it that behavior analysis offers to them that other fields don't and what I think this description helps offer, taking into account the private events and the way in which we interact with the learner, I see this idea of believing self-reports and the fact that self-reports don't always predict public behavior as being a big weakness in social science where we're trying to really understand what's happening to the learner. For the most part, we've gotten to this point where when the learner doesn't behave in the way that we need them to and when the learner maybe doesn't complete assigned tasks or if they thinking like of myself, I don't go to the gym as often as I should. There's two ways that you could explain that behavior. You could see it either as a sign of weak willpower or some sort of private event that is lacking for that learner or you could see it as a product of the environment. And for me, the reason that I choose to be a behavior analyst is because I want to try to first understand and explain and change the environment before I put blame on the learner because for the most part, it's kind of like this really beautiful quote here that I have on screen. When a flower doesn't grow, you fix the environment in which the flower grows, not the flower itself. We understand that for the most part, people will do the best that they can under the circumstances that they find themselves. And I consider behavior analysis to be perhaps one of the most hopeful sciences because we understand that even if behavior is not where we want it to be, even if it seems as if the learner is beyond hope, what's important is that we can help, even in a very small way, we can help change the environment to better support the learner. Even if we can't get them from here to 100, we can change the environment maybe to get them from here to 60 or here to 40. And doing this rather than trying to explore what variables exist inside the organism, what reason that they're broken, focusing on ways the environment can better support the learner, to me seems like the most helpful approach to solving a lot of the problems that we have for us as individuals and as a culture. So I hope that this helps clarify a little bit about what behavior analysis is and what our opinions about private events are. If you have any questions, please, of course, make sure that you post them in the great question form. But otherwise, I look forward to hearing what you have to say, either here or in the comments. I'll see you guys next time. Hey, everyone, it's Professor Howard. So I want to talk a little bit about what makes behavior analysis different than some related dimensions or some related domains of psychology as a whole. The way in which behavior analysts approach understanding behaviors is very different. And I think the hardest part about this particular course is the fact that we're going to have to talk about things differently. We, all of us, myself, yourself, anyone watching this video has grown up in a culture where, for the most part, we tend to explain the decisions that we make using a lot of internal variables. Like, why did I get up this morning and make a cup of coffee so I could come in here and record videos with you guys? Because I wanted to. You know, why did I choose to become an instructor and teach behavior analysis to people? Because I wanted to. And the way in which behavior analysts approach that is, well, then we have to account for why you want to, right? The way a psychologist might approach that could be looking at things like, what about my personal learning history? What about my personality? What about certain, if we're talking about biopsychology, are there any particular ways in which my physiology prepare me for that and make me well suited for that? But behavior analysts, we want to tie it back to the environment and we want to tie it back to what we've experienced in that environment to help explain that. So when we say that Skinner was different from earlier researchers, remember that Watson and all of the methodological behaviors were very, very clear that private events did not matter. They were explanatory fictions and we should not use them in science. That particular opinion gets ascribed or attributed to Skinner a lot more than it should and Skinner did not believe that. Skinner was a radical behaviorist. He believed that we have to account for all behavior, even private behavior. But what Skinner did say is that private events like thoughts and feelings, et cetera, while they exist, we have to still explain them. The problem is that those private events, like whether or not you want to do something, whether you have an attitude towards something, you still have to explain it. You have to explain where it came from, you have to account for it because ultimately, we're deterministic, we believe that things have causes. But we also know that when you look at the conditional probability between when a private event occurs and when the behavior occurs, the probability can be pretty low. So Skinner advocated for something we call the principle of public events, in this idea that while we could use the relationship between a private event, like whether I wanted to get up and make coffee this morning, and whether I actually made coffee this morning, whether we could look at that conditional probability, yes we could, but I can also look at the environment and see if there are environmental variables that are observable and objective to figure out whether or not that would have happened. So for instance, imagine for a moment that because you can't possibly know, right? You're watching the video, you don't know where I am or what time it is here when I'm recording the video. What if it's one in the morning, right? What if when I say I got up, I took a late nap and it was eight or nine PM, you look to see what time of day is it? So it's one in the morning. We could look at the conditional probability of me making coffee at 1 AM versus say 8 AM when most people, most Americans get up and get ready and start their day or six or seven AM or whatever. That's one way that we can look at public events to help explain behavior. We could look at things like, what's my relative level of energy before drinking coffee versus after drinking coffee, right? So if I'm waking up and I'm like, going into the kitchen to make that coffee and I drink it and then suddenly I'm chipper and et cetera, you can see the change in my behavior, which is, right, I am a part of my environment. You could see if that change, that environmental variable is added following the drinking coffee. And we start looking at the ways in which our environment changes as a function of the behavior. And that's how we want to explain behavior. Now, this one is particularly important. This idea of not using private events like self-report feelings, that idea of avoiding what we might call a mentalistic explanation is actually quite important from Skinner's perspective. Here's why. Skinner says that we have to really be careful about mentalistic explanations because they feel very self-satisfying for us. We grew up in a culture where we use a lot of mentalistic explanations, but they're flawed. Let me give you an example.  If you believe that there's a mentalistic mediator for that, then hearing the fire alarm should elicit from the organism. Remember, pulling out or drawing out this reflex of reaction of anxiety. And then that anxiety should set the occasion for us to leave the room.  A person can also leave the room, right? The ultimate product is leaving the room and you can leave the room under different circumstances. So Skinner says rather than seeing this mentalistic explanation as a mediating stimulus, what if instead that fire alarm sets the occasion not only for the organism to experience anxiety, which is one response, but also to leave the room to escape from the fire alarm situation, which is a different response. And what if these responses can occur independently of one another, right? So then that gives us the power to see that. There are situations under which the fire alarm can go off and we can experience anxiety and not actually leave the room. And there are situations in which the fire alarm can go off and we experience no anxiety and we leave the room.    And I'm taking my coffee with me because coffee's very important on my researcher. You can have one without the other. And we can look at this a different way, right? So we can think about this relationship that we get into as being problematic because then, sorry, let me go back a second here. This idea that you can have different responses is very important. It's important because if we always have to have the anxiety for the other thing to happen, right? If we always have to experience anxiety for us to leave the situation, then it makes it less strong. You can have a very weak relationship, a very weak correlation between anxiety and escape. And then when you have that weak correlation, the whole explanatory variable breaks down. Now, from this, you can also start getting into what we call circular reasoning. Let me give you a different example. You have a young person, you're dropping them off for school, they're new to school, so we're going to preschool. They take Steve to preschool. When you drop Steve off at preschool, they cry, right? And we might say, well, why is Steve crying? Well, because Steve's feeling separation anxiety, right? This young baby is having some trouble. It's very difficult. You can see the crying, but you can't actually see or touch or feel or measure the anxiety. The anxiety is deep within the organism. You can't get in there, right? But how do we know that the anxiety is happening? Well, you know that the anxiety is happening because the crying is happening, right? And we tend to explain the things that we see publicly with variables that we can't see, things that we see privately. And we have this tautology here. We have this problem because when you use a private event to explain something public, not only is there a problem with the conditional probability, there's every probability that Steve is crying for some other reason, right? Not related to separation anxiety, but that circular reasoning means that we can never break them apart because the public event will always be considered proof of the private event and the private event will always be considered the cause of the public event. And if you can't get at and measure and confirm that the private event is happening 100% of the time that the public event is occurring, then your explanation is ultimately flawed. Put another way, if a person in a meeting with me is always talking over me, right? They're always interrupting me and repeating the thing back to me. I could leave the meeting and be very frustrated and just say, oh, that person's a misogynist, right? They're just so mansplaining at me all the time. So them talking over me is seen as proof of their misogynistic attitude. And their misogynistic attitude is a cause of them talking over me. But what if it's something else? What if there's a third variable like this person has some hearing loss and my particular voice is just at a range where they can't hear it when they're talking over me? There's a third variable which breaks apart my entire proof and makes it more difficult to believe it. So when we're talking about the way in which behavior analysts approach understanding behavior, we always want to be looking at other concrete environmental variables, not because we don't believe that private events exist but because they're so flawed in a scientific explanation of behavior that we can't rely on them fully. And we want to be confident and strong in our explanations and we want the highest conditional probability between independent variables and dependent variables between environmental variables and their products as possible.


So we're gonna talk about setting up dumbbells for your exercises. I'm a little concerned. I'm gonna smash my mic, but we'll give it a shot. So when it's light, you can do it wrong, right? You can just curl it up and shrug your shoulders and just set it on there. And if you lay back and you don't have the right trajectory of the weights, you can just kind of like muscle them into place, right? The reason I have the 90s is to show you that's just not always gonna work. When you've got really heavy weights, you've gotta figure out, you know, relative to what you can do when the weights are heavy, you've gotta be very systematic about how you set up. So I'm going to show you exactly how I do it. So first, I need to make sure I'm gonna lay back in about the right spot. My elbow's a little close to the wall, so I'm gonna bias towards you guys. And I'm gonna set this up. So when I swing this up, when I'm setting up, first thing I'm gonna do is I'm gonna pull it really close to me. If it's really far away from me, I have to pull and drag and I gotta kind of do a lateral raise with my deltoid. Not a strong muscle, especially compared to like a bench pressing set of muscles. So I'm gonna pull it in really close to me and then I'm gonna tilt it up. I got my hand on the handle, my right hand on my handle for my right dumbbell. And then I'm just gonna kind of slide it up with two legs. This version of the power block that I have, these adjustable dumbbells, it's got this little nubbin that sticks out and comes medial. If I flipped it around, it wouldn't be that way, but what I do to avoid it is I set it on my leg like this first and then I tilt it, okay? So that's the goal. I'm gonna get it on this end right here because then as I lay back, it's just gonna be in my hand ready to bench. That's the easy one. The hard one is the other arm because I've got to somehow balance this one and I'm gonna just assume that maybe you don't have someone to help you. So don't test this with a one rep max. You gotta practice. I've got a bunch of clients who, it takes weeks to kind of learn this new movement.  You have to learn the timing of everything. So same idea over here. I'm gonna swing it in close, but not too close to squash my microphone. Oh, wish me luck. And I'm gonna use some body English to get this up. I'm even gonna shrug my shoulder.  Now that my right leg is numb, let's give this a go. Okay, so I even threw it into my chest to get myself in there. Hopefully that was okay on the mic there. And there we go. Now I'm mostly ready, but I'm not there yet. So from here, I'm gonna use my legs as best I can. I need to use my leg. I can't just curl these weights up as I fall back. I need to use my legs as a bracing, okay? More points of contact means more stability, right?  See? Try to go slow-mo for ya. And then I like to turn them a little bit cause it's more comfortable on my shoulder. And then when I'm done, I just set them down like this and then sit back like that, okay? So again, right? I'm not, there's a lot of tension on my arms. Like I'm not letting go of them at all, but most of that comes from the legs pushing the weight up. One more time to show you guys as possible, ready? Do my reps and then done just like that. And then I just reverse it to get the weights off.  Those are the two hardest parts. Getting them up there and then getting your arms straight, making sure you're using your legs long enough, right? So we wanna maximize your leverage. When you do a bench press, when you get to the top, your arms should be totally vertical. The weight should be over your forearm, over your elbow, over your humerus, over your shoulder because bones handle compression really well, okay? And that gives you good leverage. Your muscles hardly need to work to hold it there. I think that's all I got for you. Watch this video a couple of times.  When you get heavy enough weights, you can't cheat. So at some point you're gonna have to test with heavy enough weights, but that's the way to start benching heavy at home.


Okay, thanks for coming guys, I've been given the thumbs up so I can get started now. So today's talk that I'm giving you is just about mapping and geolocation in Drupal. I'm actually just mainly going through the Budget Victoria website that Solicitor Digital built back in April. So a little bit about me, I actually got our designer stupidly to take a look at this presentation and all of a sudden this very impressive slide turned up. So yeah, I've been working with Drupal for about eight years now and you can see that it looks like I've done lots of really impressive things. So a little bit about Solicitor Digital, an enterprise digital agency in Victoria. I've been around for about 12 years, mainly Acquia certified developers. One of the GovCMS partners, a lot of you have probably heard about GovCMS while you've been here and I'm the GovCMS trainer as well, so if anyone's in Canberra and wants some GovCMS training, I can come and see my face again. And here are a few of the Drupal and government projects that we've worked on in the past. Okay, so let's go on to some of the content. So in general, why do we need maps on websites? I don't think many people are building websites without a map these days. Basically everyone wants to know where are you? Where is the stuff that you're actually selling or doing? Also what things are actually around the location that whatever it is you are doing, what things are around there? Obviously responsive is one of the things you really need to think about when you're building a map. There's a lot of difficulties with mapping once you go down to a mobile size in particular. And so essentially the main thing you have a map for is to show people where they can actually get what they want. So geolocation I think is probably the other half of that story. Obviously a lot of traffic is actually moving to mobile, so people actually want to know what's relevant to them as they're actually walking around and doing things. So I mean one of the things I do because I travel a bit for work, as soon as I get somewhere I'm usually looking up the website or whoever it is I'm going to see, finding out where I can get coffee somewhere around there before I get to the meeting and how long that's going to take me from wherever I'm staying because those are kind of the really important things. One of the other things that people don't always think about with geolocation is taking that outside of mapping. We've got one of our large international corporate clients. They don't actually have any maps at all on their site, so they're using geolocation to actually serve up completely separate content. So people come in from a different country, so France or even Northern Ireland and they've actually landed on the UK site, we just redirect them back to the appropriate site for their location. So I mean that's one of the fairly basic things that you can do with geolocation, but it's still one of the uses that is quite important. One of the other things that you can do is actually use say Google Analytics events as well with your geolocation and start really pinpointing where the people are who are actually using your website and what those people are doing. So geolocation kind of goes a long way outside of just what's in a map. Actually, yeah, one other thing I think, I'm not sure if Accu has done a presentation on their Lyft product as well, but just around personalization. You can actually do a lot of personalization based on locations as well. So if someone's actually viewing your website in Melbourne, you can show sales for your Melbourne stores or something instead. So it should be quite easy and a lot of the time it kind of is depending on exactly what your requirements are. There are a number of modules and libraries out there. Lyft is probably one of the better ones that I've used. It's really great at actually putting a Lyft.js map on your site. The problem is it doesn't actually do the geolocation part of it. So in order to do that, you need to use another module called the IP geolocations views and maps that integrates in with views, integrates in with the Lyft module. All of a sudden, that's great. You've got geolocation, you've got a map, and everything's working quite well.  So that becomes a bit of a problem. There is a module as well for Google Maps. Once again, kind of similar story, it provides that mapping for you. You don't get all of the geolocation and things like that straight out of the box. So once again, there is actually a lot more work that you need to do outside of just clicking install the module. Instead of Drupal, there are other tools like national maps. We do quite a bit of work with government. So national maps actually integrates with data.gov.au. And it provides what is a very lightweight map, and it's a JavaScript library that you can just implement fairly easily. It actually delivers WMS tiles up, so it's actually a, it's very kind of light in terms of the download. But the problem is every time you want to click on something or do anything, it's actually sending a request back to the server again. So in terms of overall performance, it kind of is a little bit slow. So some of the requirements we had, whether we actually build an interactive map on the site, it needed to show all of the different projects. So it wasn't just a simple map, we had to implement a large number of pins. We actually had to use clustering as well on those pins and show a number of different regions. So unfortunately a lot of the modules that actually kind of come out of the box with Drupal weren't actually going to do what it was that we needed. And another issue we were facing is we were using GovCMS. GovCMS is a great tool for government. One of the problems is you can't actually use any extra module code. So you can't install new modules. You don't have access to any custom code. So you really have to use what is kind of in the box. So I'm just going to show you a couple of example sites of what we were trying to build. So regions.vic.gov.au was actually the site that we were being asked to model this new website off. And you can see that what we've ended up with is actually fairly close. The design is actually very similar. And one of the main components of this site is the explore the budget map. So you can see here what we've needed to implement was a list of all of the budget projects right across the state of Victoria. We've got some filters here that filter by local government area or local council. Those are then split up into what they've called priorities, which are just basically categories that are linked to each of these projects. And you can actually search there for our specific projects. I'm going to remove one of those filters. There we go. So we've got a number of pins that actually appear on the map. So you can see we're using clustering to actually show that there are five pins in this area rather than kind of dotting five pins right next to each other and making them difficult to click on. You can kind of click on those maps there, on those kind of areas there. And as we zoom in, we actually get to see the rest of these pins. So if we click on one of the projects and go to more info, kind of these pop-ups appear over the top of the map. Okay, how's it working? So I'm basically just showing you this is what we need to implement. And a couple of things we'll get into how it works in just a minute. I think it might be about five minutes in, so. Okay, so I'm having some mouse issues at the moment. I've just got some odd things happening with my mouse, sorry about that. Okay, beautiful. Back to where I was, so yeah, as I mentioned, we're using Cubs CMS. So one of the issues we had there was there are no mapping modules in the Cubs CMS platform. So we didn't have access to the leaflet module or anything else that could kind of help us along because there's no custom code. Once again, we're kind of a little bit hamstrung with that. It was also a project with very tight timelines. I think we started off with about 12 weeks initially. That kind of got shrunk down to 10 weeks. One of the problems we had was the federal government decided to bring the budget a week forward, which meant basically the launch date for our project got brought a week forward as well. One of the other issues we ended up facing was really large data files that we were going to have to present to people. So obviously, you can't really have people downloading very large files. So these were some of the things that we needed to kind of overcome. And mainly, that kind of affected performance. So in order to find a solution, what we did have access to was the theme layer in Drupal. And we actually added a module to Cubs CMS, which is the services module and services views. Basically, what services does is it allows you to take a view, just a standard view in Drupal, and output that as a serialized output. So we were actually outputting that as JSON. So all of a sudden, rather than having kind of a very large heavy view that we needed to consume on the front end, we actually had some JSON output where we could access that just through the theme layer, through our own custom JavaScript, and build their own leaflet.js maps. We also used SVGs in order to output another part of the map that I'll click through in just a moment. And in terms of GLOcation, we started looking at an external service called IPFI. The reason for that was, once again, we don't have any code that we can actually write. So we weren't able to do any of that IPGLOcation ourselves. So we had to kind of go outside to someone who can do it for us. It's actually a really great service. You just send a request through with the IP address. And it sends back a JSON string. And actually tells you exactly where the location of the person is. So very handy service if you overlaid it. So basically, yeah, services, as I mentioned, kind of has a serialized output. We ended up using the REST server, which comes out of that. And just accessing that via JSON. One of the lucky things we had, all of the data was actually public on this particular project. So we didn't actually worry about the authentication. But Services module does integrate with the OAuth module as well. So you can actually put some security around what you output from services. And we ended up using three separate views. So we actually had a list of all of the different regions. So the regions list that I showed you before on the map, a list of all of the priorities and things listed, linked to those. And another view that listed all of the different projects. And then we kind of combined those together in our own JavaScript. So, just going to click on this quickly. So I'll just show you a couple of things within the services module. It's actually really, really quick to set up. You basically just add in a name, a machine name for this. I've said that I want this to be a REST server and a path to my endpoint. And basically, that's most of your setup right there. In your server settings, I've gone through and said that basically I want this to be output as JSON. And under my resources, I've basically said I want access to retrieve views. So essentially, within a number of clicks, I've actually got some, don't you have a question? Okay, yeah, so very quickly we've actually got the output that we need. I'm not sure what I'm actually clicking there to keep popping out of my presentation. Yeah, so it gives me the speaker notes over here. But then, but then I can't see my notes. Yeah, okay, so here are some of the libraries that we used. Leaflet.js, it's a really popular JavaScript library for making maps. Really, really simple to use and the tutorials and stuff are fantastic if you want to actually use that on any site that you're going to build. Like I said, there is actually a Drupal module for Leaflet. It's in D7. The D8 port isn't working all that well as yet, but hopefully it'll be there sometime soon. We also used the marker cluster module. So that's how we kind of created those little clusters of pins. We used the extra markers library as well to actually come up with our own custom markers. We need to actually list all of the points in alphabetical order. Leaflet doesn't provide that functionality out of the box, but with extra markers we were actually able to add those letters in there. We ended up not using the shapefile library, but that was one of the libraries that we were looking at when we did initially receive the shapefiles, as well as the JS zip library in order to actually unzip the file that we got, and I'll go through why that was in just a second. So I'm just going to pop onto the first part of the map, which is essentially a way to explore which council you actually belong to. So this is a fairly basic SVG implementation as it is now. The initial problem that we had was we received all of the shapefile data very late in the process, and what we'd been planning for is essentially having just one single map in leaflet. So when this part of the process came in, what we were initially doing is displaying a leaflet JS map here using very flat tiles without any real design behind them. The big problem we had was the size of the shapefile meant that just to load up this page here for someone was going to be incredibly slow. So what we did, this is actually about a week after the initial go live was we took these files and used a program called QGIS to actually reduce the complexity of these files. So to simplify geometry is what it's called in QGIS, and then export all of these as SVGs, which means that all of a sudden what was initially actually a 27 meg download to get the shapefile came down to about 100k. So obviously that's a lot more reasonable if someone's trying to look at this on any device really. I managed to do it without getting out of my presentation. Okay and so here we have the actual map itself. So the main issue that we had when we first actually implemented this map was the size of the shapefile. It was 25 meg. Initially we were actually supposed to have a map that was going to render on mobile and obviously at that kind of size it's just not going to work. So we went through a process of looking at a few different options one of those was to actually zip the file up until we managed to get the file size down to about 7 meg. Still probably far too large and we ran into a number of issues then where actually unzipping that file was taking you know up to two minutes depending on the browser, a number of different browsers i.e obviously was just completely crashing whenever you tried to do that. So that was not a great option. Similar to the explore map we started talking to a Department of Premier and Cabinet about can we actually just reduce the complexity of these files. The map or the website that we were kind of looking at initially was the region's website which is this one here where they have nine separate regions and all of these shapes as you can see I mean they're quite nice squares there are only certain areas that are actually complicated so the shapefile that they were using was really quite small. As you can see in here these we actually have 79 separate regions. The shapefiles were incredibly complicated and they told us that because the legislative requirements we weren't actually allowed to simplify these down. So all of a sudden we didn't have much of an option to kind of reduce our file size. So things were looking a little bit scary because we had a very large file zipping didn't really work and basically we were trying to deliver a page that for a lot of people they weren't actually going to be able to see. So luckily we've actually got our front-end dev down the front here Alan who came up with a handy solution which is basically splitting out those 79 regions into individual regions and each one of those had their own shapefile. We also had the the largest shapefile which was all of Victoria and that was actually the largest part of the shapefile. I think that was about seven or eight megs in itself. Because that was all of Victoria we can kind of get around the legal requirements there and simplify that down so we can actually reduce that file size and by doing that we actually had a far more workable map. So the workflow for most people was to come in to the explore by map click on one of these regions and we can see that it's fairly quick now because the only shapefile we're downloading is this one shapefile here rather than all 79 areas. So yeah so that actually ended up working quite well. If someone actually does come in and they do want to see all of Victoria then once again we can still present that entire region of Victoria in that with that simplified shapefile and it actually still is quite snappy which is handy. If someone did decide to go through all 79 regions they do end up getting to that kind of 25 meg file size. It's probably going to be a real edge case that anyone does actually want to go through all of that data. I think I've actually gone through all of that a lot quicker than I expected. I'm just coming up on half an hour. Okay so that was actually pretty close. Beautiful. So I'm just trying to find my mouse again. So yeah time for questions. All right did anyone want to ask a question? We've got to start over here. So when you found you had like a really big layer like with a lot of data did you consider like having your own WMS server with tile location? Yeah so that was one of the first things that we were talking about. The problem was because we were getting all of the data from the government they actually needed to host all of that data as one of the requirements that we had. We started actually discussing it and just given the fact that the deadlines were looming we decided to kind of continue down the path we were going because essentially we didn't have a lot of confidence we were going to be able to hit that deadline and get something going but yeah that was actually a much more ideal option and what we wanted to do. Did you ever consider maybe like running a Postgres SQL database just to handle just to hold all the shape files and then now put as like Geo JSON into your leaflet map as a as another option so so then they're just getting like you know a blob of JSON and essentially out of and I know that Postgres tends to handle geometries pretty well. Actually I'm just realizing that I've said the wrong thing on when we split out all of those files we actually did convert all of that to Geo JSON but in the end we actually had those as file fields connected to the different nodes and that was once again just given the timelines and what we had coming out of data we needed to have something that was going to be a bit flexible. Postgres probably would have yeah might have been a good solution to that too. Just two questions if you could have used modules would you have used the modules instead of? It's a bit hard to say so leaflet is is really good and I've used it several times before. The issue is yeah I think there is actually a patch out there to get rid of the way that it actually manages sessions because we're hosting all of this on Acquia and we've got varnished and actually Akamai in front. As soon as leaflet starts using those sessions and authenticating the sessions we're just going straight past the cache and that's something that we just couldn't do. On the actual launch time of the budget the traffic spikes quite incredibly because you know all of the large accounting firms have basically half of their staff going in and actually downloading all of the budget documents so yeah destroying the cache just wasn't an option. And did you look at open layers or? I haven't actually used the open layers module. I know that yeah I know that it's out there but I haven't actually tried that one myself. Yeah two was good, three's crazy. Crazy good, crazy bad? Both. Oh okay. What about that thing in the 90s image maps or whatever? Maybe you could hover over the thing. Sorry. Don't know that one. Anyone remember that was cold? Any other questions? Scanning, scanning. Up here. Hey good thanks for the presentation it's really good. Just had a question. As far as I understand that page was just outputting pretty big dump of JSON. So what kind of caching strategies did you use to actually make it faster? Is it just views? It is just views and services views. So to be honest we're probably relying a lot on varnish and akamai in terms of caching but all of the views they could output they will get cached in the browser as well so once you've actually loaded it up the first time it is actually pretty quick. And there's only like a few hundred projects so the size of the JSON is actually quite small. One of the things we were looking at initially because services and services views weren't in GovCMS was something that we weren't overly happy with was basically outputting a view but using data attributes you know to actually add all of the extra data we needed and although it's possible it would have been pretty slow and we would have had to do a lot of thinking around how we were going to cache that and make it snappy and doing that on top of having the large data files and all of those things it was starting to kind of make us sweat a little bit and we were kind of as we actually got more and more of the data things just started to get a little bit scarier to be honest because for the first part of the project we were kind of flying blind a little bit in terms of knowing what we were going to have to work with. So yeah I mean it's likely that we had services there to actually use. One of the challenges of geolocation work is mobile and your experience in mobile. So could you perhaps touch on did you cater for mobile or optimise did you change layouts or that kind of thing? We ended up not being able to do mobile on this particular project which was a bit of a shame. One of the major reasons was actually just around the design and we didn't get in a design that was actually approved by the time we were ready to go live. I would say as you know mobile maps can be quite tricky if you just kind of dump one in the middle of the page as you're scrolling up all of a sudden you hit the map and then you're scrolling the map and you can't actually get back to what you were trying to do and it's it's quite painful. I think one of the good solutions to that is apps like you know Zomato and other places where you actually click on a map icon and then you go into a full screen map and you've got another little icon to flick back to a normal view. Something like that kind of gets around those issues. In terms of the size of the files like that actually ended up being one of the other main reasons that we couldn't go there but I think with the solution we delivered in the end there wasn't really a technical limitation in how we did that. Also in terms of the geolocation we haven't actually implemented the geolocation in this solution at the end either. Once again we weren't delivering it on mobile so it wasn't quite as relevant but we've actually used IPFI quite successfully on other projects. Sorry which one was that one? IPFI, IPIFY I think yeah and yeah it's actually been a fantastic solution so we do all of the geolocation essentially on the front end which means that we've still got varnish, akamai etc all running. We're serving up completely cased pages but we can then do the geolocation and react to it once the page is loaded. So in hindsight do you think there's an argument for if you had another GovCMS project doing mapping that out of the box GovCMS isn't really up for it or would you be like well we've worked out of the door let's just do it that way? No I think basically with services and services views you can actually push all of the data that you need out so that you can do most of it in the in the theme. It is a little bit tricky depending on the requirements. I think we've got possibly another client coming up soon and they almost want like a just a single page site that is a map. Been kind of causing me a little bit of stress coming up to that one and thinking okay just given no module code how are we going to tackle all of this with you know just elements kind of dynamically coming in and out of the page all the time. I think it is doable and yeah once again it's just services being able to output JSON and make those requests with JavaScript all of a sudden it all kind of opens up. Sure. Any more questions? Hi Guy, we've got Mt. Beck. Hi, yes thanks. Do you think it would make a difference if you were to serve these maps if you didn't have it in the GeoJSON format from something like a GeoServer, GeoNode instead of straight out of Drupal? Yeah look I probably would make a difference if we had access to something like that at the time. One of the things that we're looking at for the next mapping project we're doing is national maps so I don't know if you've seen that it's basically something that integrates with data.gov.au and you can immediately kind of just serve up any data from data.gov.au that has WMS or GeoJSON in it so that's actually a really good tool. What we'll be looking at isn't national maps itself but using Terrajs which is the JavaScript library that sits underneath it and doing a custom implementation of that. So in that particular project we are going to have access to a GIS server and all of a sudden our options kind of start to broaden out a little bit. Thank you. So I guess I need to thank two people. First is the designer of the slideshow that's fantastic and also okay so please give me a round of applause.