Shall we kick off ladies? If we can make our way to our chairs that would be good good morning all Anthony you've got it. I've got people trying to work out your acronyms So I'll get you to tell them at some point Okay Yeah Monday Monday okay Raj apologies for the delay starting but again just a reminder of whose country you're on Warundry country and also the values that we talked about yesterday around caring and sharing and respect and an acknowledgement of your own unique and special qualities and you all were thinking about this last night your desire to come together Make sense of this process Get some clarity around all the moving parts and identify the synergies and just commit to working together If you think that you've tricked me over there moving around I can see where you are And my deadly sister here Was there That's all right, but you know what I notice of you Same guys a different top No, don't worry about it. I'm the same. I'm the same now There'll be few Conversations that you can have throughout the day with yourselves, but at towards the end of the day I want us to start thinking table by table About what you think is needed to improve a process If that makes sense, yeah, how do we make this? Real for everybody there were some questions the issues that came up yesterday in terms of we can't assume All Aboriginal people struggle to understand some of the the terminology Some Aboriginal groups will just pick it up and rumble that they'll understand it completely They're capable of doing what they want to do, but there'll be needs to adjust in certain environments, but so I was saying that one one What works in one community won't necessarily work in another community So we just need to be mindful of that and the only thing I'll say is that at some point all of this language and acronyms and Words words words, they've got to be put into some sort of one-page picture So that everybody can see where it all fits pretty much and that would be helpful for a lot of Aboriginal people, I'm sure Okay, now So about that or not so about that or not. Good morning Raj Yeah Be polite and courteous and there's many languages as we can You're going to present today on The NRLs Upcoming season And you'll probably report a little bit on the Big Bash final for Saturday night. I wish the Brisbane heat got into No Raj is going to talk to us today about Just another acronym Iris services and sensitive data environment. So I'll get you to start coming up Raj Raji Raj Rajeev Yeah Rajeev Raj is your homie name. Yeah Rajeev Samaraj is a senior research fellow and the program coordinator for data and analytics at the Melbourne Institute applied economic and social research leading institute for applied economic and social research within the faculty of business and economics Rajeev has over 13 years experience in data analytics data visualization and developing statistical methodologies for data analysis past experiences involved transition of engineering concepts through the health Science as seen through the work. He did with for his phd In deriving meaningful quantifiable information from image data presently Rajeev Is translating his engineering experience into a to innovative data analytics and data visualization and the social sciences including oversight of Melbourne Institute data lab Lead for the foundation fellow training program and his integral and his integral to the iris Integrated research infrastructure and social service platforms. So we'll hand you the floor Hi everybody Good morning. I have the pleasure of Where's the little do the key? I have the pleasure of being your first talk today. So I'll try not to make it I'll try to keep it as upbeat as possible to get the pace going for the rest of the day Before I begin, I'd like to acknowledge the country We're on today, which is the Wurundjeri people But I'd also like to acknowledge the the Boon Wurrung and Boon Wurrung people of which the land I live in Because we all work from home for the past three years and a lot of what I'm going to show to you today was inspired Was done in this land and the land I live in as we work from home um So as uh Grant mentioned, I'm I am an engineer Um, so that's a disclaimer.  So this was a Joke we used to have there right now. Whenever I did my phd at monash, uh, this was Stuck on the door outside where all the phd students were working and we all thought it was funny, but um So I don't understand But I want to start by saying, um, so I guess yet another acronym. Um, what is iris? But no, I don't need to have a Michael and Wojtek did Too excellent talks yesterday talking about the Integrated research integrated research infrastructure for social sciences. Um yesterday um, so I'm not gonna start start on that but um We the iris project essentially splits into six work packages Of which is yet many more acronyms But around, um, you know, a lot of work packages around, you know, survey design Uh, the geo social elements that we heard about yesterday Um, also the curation aspect as well, but today I'm My work package is actually a part of the work package. Actually Is around sensitive data analysis demonstrator And what this work package is about is about so we have all its integration work we're doing And My work package our work package is about okay now How do we take that work that we're doing and how do we move it to a sensitive environment if we're using sensitive data A lot of time we cannot use sensitive data in our laptops on our own computers So we're going to take it to an external environment. So a lot of that work is done around how do we demonstrate that And for phase one we had when did some work around Looking at some of the requirements people had around working with data Some of the pitfalls when it comes to accessing data, especially sensitive data, um, and you know, some of the issues there Um, and now we're currently working towards the development phase, which is around, you know Architecting what that integration exercise looks like in a sensitive environment And then moving on to how do we create a pilot of that The message phase one will also touch on you know future work at the end of the end of the talk So I thought I'll start here with what I mean about sensitive data And no better place to start than Starting with a privacy act um, and so, you know personal information, um really means information about Identifiable information, um, and so what this really means, you know individuals name um signature address Record employee record information a few other things Um, so that's personal information, but there's also sensitive information And what this is defined is to be around your racial origin political opinions philosophical beliefs And a range of other sensitive information. So Now this is very sensitive data And where social scientists One access to this data is around making Perform creating undertaking research analysis and informing social policy and evaluating social policy. So As as you can understand, there's obviously a lot of a lot of issues with accessing this type of data Especially and we've talked a lot yesterday about, you know, the data owners were the rightful owners of that data We are Um, you know everybody everybody owns their own data But it's about how can we better use that data still enable research, but also be like be be um What do you call we we all know the owners of the data so Our experience usually with data is so we have a data custodian. They collect the data And They usually link the data to another another data set. Um Then they undertake some work around Curating the data to create something that's a bit more research ready And once that's done, that's what you call that's what you get the data set And this data set Usually is not something we can access right so depending on what information goes and especially with sensitive data So usually what happens is there's some treatment is done to this data Before we get access to it And so you so what we call open data we have we get access to a data we can just download it from the website But there's usually some licensing that we have to agree to We have to attribute where we get the data from and that's where we get that's how the user gets access direct access to the data Another model is the limited access model. So In this model you have specific agreements that you have to sign that you say you will you know use this data in a specific way um And usually have to create a project summary, you know, what what what do you intend to do the data for what are you going to do? do you have its experience and Usually there'll be a reduction of the level of detail in the data. So addresses won't be You know revealed They'll all be coded down to a specific geographical level You know ages might be done in brackets And or you might be even aggregate level at a national level or a state level data and you can get access to this data and you can use it in an environment The other method is accessing it through a secure access environment And this is once again, you have more controls again You have access agreements of confidentiality need polls You'll have to undertake some sort of security training Before you can access the data that tells you how you can use the data what you can do with it Also about what you need to do to the data before you can take it out of the environment, which is very very critical Once you get access to the environment Then you have your the data is going to get the data then you can clean your data some more You can then do your analysis and then once again I put treatment at the end there because you'll need to do specific things to make sure you can take only specific counts out of the environment Before you can even take the data out. So for example, this specific rules around You know Each table must have at least 10 counts before you can take it out because you might be able to identify someone within the data Um Other things like you know looking for dominance, which is where if you have you know Data set and you know, you know one value is much much larger than the other Then you'll be able to infer who that person or that individual or the business was to the data you're taking out So you'll be very careful. So once again to do more treatment Before you can take the data out so What is a sensitive access environment? There's lots of words for it. There's lots of names for it. Um Trusted research environment secure data environment data safe haven Um secure data laboratory. I love that one But there's lots of it and they all kind of do Mean um very similar things um Back then uh a long time ago, I guess some of you might remember. I think we still have this actually we have Secure access was you know, you'd apply for a data set and you'll have to go to a specific location They'd do a retina scan fingerprint Give the name, you know, your kids, but certificate And then you get in and then you would access your data set and then somebody will be watching over you You can almost hear them breathing down your neck while you're accessing you do certain things a lot and then you know You can get out and Be like, oh my goodness But that was that was just very physical Secure environments and then we've kind of from then we moved to Trusted execution environments where you'd come up with some code. You'd work with some dummy data You'll give it to someone you'll give your code to someone to your program To someone and then run it on the data for you. You don't actually see anything and then they'll give you the output a bit like table builder really Which we still use And then we from then on we've moved to okay, we can access an environment Looks, you know, looks like a virtual desktop. It even looks like windows has your data in there. So that's more of a modern concept of a data lab More data environment um, I'll be talking a lot more about sensitive data and sensitive environments next week At the summer workshop. So if you're ever if you are in sydney, um, I would like to say Hi to you and you know speak further on this matter, but just wanted to put an ad out there So I guess where I come into the picture Where we come into the picture with iris is we built the melbourne institute data lab middle Sorry grant yet another acronym um But we like the name middle I'll share a funny story. Um So we have middle which stands for melbourne institute data lab, which was the secure environment we built But I sit in the administration team and guess what we call them the meeting We call the middle management team meeting So Yeah, so um, so the middle uh is a is a purpose field environment that we built for analysis secure um social science data specifically to um Undertake analysis using survey data or government administrative data As well as random control randomized control trial data Um, we built it in late 2021 as an established as an agreement between billet issued and a company called second soul, which is a security professional services team in in camber Um, and we also got a lot of support from the university of melbourne. Um in building it Business services legal and risk and whatnot and was also built with funding from the paul ramsey foundation and the new melbourne Um And so what it is Is it's a remote access environment? Uh You the user would go to a web browser. He type of uh a browser. I would call um a web url Um This is how you access it. Um, not gain access well talked about a little later Um, but how you would normally access your data is you go to web browser You'd log in you'd get access to a windows environment It looks exactly like your windows environment, but it's a lot more closed down And then you'd have your um data in a in a drive And then you'd have all your statistical packages You'd need to analyze your data and you want to take all the analysis you want inside that windows environment I was going to put a picture up of it, but I would have just put a picture of What windows looks like and that would have been quite boring. So instead I made a pretty picture of it But the the main thing here is when you need to take data in you need someone needs to approve it Someone needs authorize and bid it bid it and approve it Um Before you can take it out of the environment And you don't have access to things like internet and email and things like that but you know So how do you get access to it? Um typically, um A researcher or a group of researchers would submit a project application And in this application, you'd write what you want to reach what you want the data for what data sets you want or what data sets you're bringing into the environment What are you using it for? What are your questions? What do you what do you what do you what is the research objectives and your plan? And this uh application would get better internally by the team But then it would also depending on what data sharing agreements we have we might have to Engage the data custodians to make sure Can I give access to that data? Can I give such and such person x access data if they say no, then we can't give you access but We haven't had that happen yet um And then you undergo training So we have a security awareness training which talks about you know what you can and cannot do in the data into the environment Um this includes things like you know try to identify yourself in the data set you see you can't do that identify your friends You know, or if you think you can identify somebody then you need to tell us about it So training around you know what you can and do cannot do in the environment We also give the option for data custodians to give us specific training material If they want users to go to additional material as well in on top of what we do because they might have specific things around you Which laws they need to abide by by accessing our data And once a project then we get the project approval. Once that's done we get the user agreements and confidentiality deed pools Signed See if it works. Hi works And then there's two ways you can access the data once through what we call a standalone project Which is where you have your project you have your data And that's it and you have your tools and you know people you that were on your form. They can access the environment And That's it. Nobody else can access the other method is what we call a shared data environment, which is where It's essentially a group of projects that can work together But under a specific research team, so they're essentially done by teams So it might be on we're investigating. We know we're we're a reshared data environment around employment around you're looking at Employment so we're bringing a whole range of data sets on that And the idea is this permitted data sets that you can have and different projects can access different data sets And once you have that you have the output clearance process Which means in all projects much all outputs must be Fitted by the data custodian and or someone delegated before they can be cleared out of the environment So let me talk about a bit more about the shared data environment because this is one of the things We really like about the environment is we want to build a community of practice and this is done basically through an internal wiki part of it's done through a wiki where We create a range of The users create material on the wiki and they can share within their shared environment without the projects. They can share code They can share Things they learned about a data set, you know, I was analyzing a data set and I found our income brackets were really useless or I found something was wrong and I wrote some code that Basically found a way to treat those income brackets to the way I want to do something Or I found that I was analyzing census data and I didn't like the way Depending on how the question was posed in the form that means there will be some issues with the data We're actually collecting about The household So those sort of issues I can write down in a wiki and then I can share with my colleagues within the environment And anybody uses that data set There's a data so every each data set has their own wiki And depending what you cannot what which data you can and cannot see you get access to different wikis So but then you can learn more about the data And you can access sample code and that you can then use that on your environment on your own project Another thing I should mention is shared data environments also mean you can have your own governance framework around who gets access to that project For obvious reasons if your project is about a specific Field of research employment poverty, then there'll be specific things around Well, if you're not doing, you know, there'll be mechanisms around, you know, who can access that data and that project and that those resources Another thing within the shared data environment is this concept of a research ready data set So we as well engineers And social scientists also we always find that we always do We get access to data and we sometimes we find ourselves doing the exact same thing on a data set before we need to analyze it We all do it, you know, we always take it. We always transform it a specific way And we're all doing it and there's all this lost Time in effort in creating that So what we want to do is if we find that we're always doing a specific thing, then we can go halfway And we can document what we do and then we can create a program In multiple languages, you know, state or python That can then mimic you to get to that point in time So you get the as provided data, which is what we call the data we get from the data custodian And then there's a step that takes you to the research ready data And so with the research ready data, some of the key features we want to have is, you know, it to be available for broad research Not just for a specific thing, right? Because then that the researchers themselves can do that bit But we know that we we make sure the data is meaningful And it's usable for research and statistical purposes You know, it should be accessible and be a lot to be reused Um, and there's sufficient robustness checks that we've done and we've documented and how we've done that data quality checks Data quality statements that we would incorporate if the data custodian hasn't provided them to us Um, and any measures of relevance specific to that shared data environments if you're investigating more poverty Then there will be poverty measures included into it. I mean new variables included into it um And then almost other relevant programs, um or code um, so I guess, um one of our biggest the the shared data or the side at all is what's called It's called the breaking down barriers shared data environments. This was the one that was funded by the poor emcee foundation And this was the first one and the idea behind this shared data environment is to inform And shape policy around understanding disadvantage and poverty in Australia. So we've done quite a few reports. Um Within the breaking down barriers project And the shared data environment we're working towards currently with a range of other data custodians ABS, ATO DSS or services Australia depending what you talk to um, you know, bringing a range of admin data into the environment We're also talking to a few other service providers like brotherhoods and Lawrence brotherhoods and Lawrence and um, you know, bringing out the data sets in as well um And as part of this, you know, we're building data sets where we're bringing data sets Um, we're undertaking reviews on, you know, specific topics relating to poverty and we're also, um Writing longer pieces of work called we call demons demonstration reports Here's an example of what it looks like what such a wiki would look like. Um, this is uh, you know the wiki Oh, this is never pointed what you can see on the left hand side of the of the wiki there No, there's specific, you know, we can get specific details about the data set um You know the how you get access to it, but we also give what we call the data snapshot Which tells you, you know, what's the name of the data? What's the overview of what the data set is who do you contact if you want to get access to the data? Very important Um, you know, what's the sampling framework? How is the data collected? um, you have the coverage, um, and you know any other data quality So it's like a very brief snapshot And then we do like a deep dive into the data. We know what variables are there So this is the data set we created for this project using census data using cross sectional Individual level census data. So Then, you know, we have what population measures are captured, you know, what question was used what was census question was variable How was it developed? So we capture all that information and put it into a big into a big wiki form um And so with this, um, we have a data governance model, um, that we are currently working on at the moment around, you know There's a data governance body which sits around, you know, between the data custodians and the data Uses so that sits around, you know, how is that access? Um, how do we look at that access, you know, what how do we talk to the data custodians around, you know Who gets access to data because not everybody can get access to the data. Let's be honest, right? So you have to You know, you know the data uses or the potential data users You really need to state why they need the added data what they need and what, you know What are they going to do with it and for how long? So that governance body is around making sure that we have that conversation and we have that vetting process to To vet that We also sit with a couple of the other middle governance structures, you know between, you know, our technical advisory group and executive council and information security council. That's related to the security of the system Oh, I forgot to mention the security bit. So yeah, so we um The system is uh We got our IRAP certification last year for protected level under the thrilling government standard And we're currently working towards accreditation of the new data availability and transparency act to data scheme So we're working towards accreditation for that at the moment Which is quite a process And so because of the security of the level of data our sensitivity of the data we host we had to get sign off from universities Vice chancellor and the CTO so because we have we have to be represented on Because of the risks associated with the data we host and the platform we provide we have to Be represented on the information security council. So I should have covered on security earlier Um, and under that we have the data stewards. So if you're bringing data, like I said with the breaking down barriers different different data sets um They get to work with what we call data specialists and data curators In creating this research ready data um, so they know what specific focus they need to have And then the data was under that we have the output fitting policies and other policies in there So for iris um what we're looking at for phase one is um, essentially taking the geosocial work that michael and boy tech went through yesterday and taking it out of the Computer environment, which is you know your personal laptop or your workstation at work And putting into a into a sensitive environment and with that comes specific complexities around Internet access, you know, if you want to access an api or you can't so we have to write in specific rules into the firewall specific to your project might be at specific user level to Um around how you can get access to specific api specific um other tools outside outside the environment So for us, it's around working with the geosocial so bringing the scripts in um And then so when a user, you know Goes in and write what they want. They want to the integration work We need to have specific scripts that talk to orange technology orange infrastructure UQ infrastructure and then bring that all back in To our environment so that we can still keep that integration exercise alive um And then we're putting the curation part in through the wiki that I was just talking about um back into the into the project um And then that creates an integrated data set and then the copies of the executed scripts and whatnot And then if you want to make it out you still have to go through that same process again as before That's what we're working towards phase one and what we're looking for the future Is really around okay, so we have an environment. So what? Right, that's what I always keep thinking. There's lots of other environments out there so For us it's about making sure we can get researchers access Through the data they want but also access, you know, specific features on apis and other cloud-based services But also kind of going back to what we call like a data market. So we have cadre which you know, um At a new we also have data place which is by on dc So there's all these data markets where you can access data or you can request data So we need to be able to talk to each other Talk to the data market but through that talk to other sensitive environments as well because right now I don't know like Right now I find it really difficult when I have to go to abs data lab I do my work there And then I get my results, you know finish my work and then I go take it out And then they vet then they when it goes through the vetting process I've already taken up half my counts And then I put it back into my lab and then it's like oh, that's kind of pointless Or if I put somewhere else like that's kind of pointless. So what if there needs to be a way where Sensitive environments need to talk to each other And the key part that that is the credentials or accreditation So if you have ira if you have iso ism five safes, you know, we need to have work towards a mechanism where You need to know, okay. I'm sending something in the middle the data cluster and it's no, okay Yep, they're better. They they have some, you know credentials. So it's safe to send the data. So I feel like We as scientists Talk to each other venues like this and I know the cyber security specialists talk to each other in their symposium But where are the scientists talking to the cyber security folks, right? And working towards, you know, how do we get how do we get to this right? So that's just my last comment there So there's the growing need I want to close with For granting access and enabling better use and reuse of data And there is no one size fits all when it comes to data labs So it's about making access to, you know, it's all based on what project and what work and what data you want And Lastly, you know enabling faster and richer analysis Using a broad range of data sets is critical With minimal risks to the to the data owner. It's critical for our research. Thank you Any questions Dark room in the middle of a of a building to access sensitive data is not that far back. I I did it in 2019 with You still have those rooms and yeah We were evaluating the Melbourne supervised injecting room and accessing Medicare data and pbs and all sorts of very very sensitive data So I wanted to ask that is is middle an accredited data service provider for for data sets curated by Groups like the Australian Institute of Health and Welfare for Medicare pbs and all of this That's one part of the question. Another part of the question is um I presume it operates on a cost recovery model of sorts. So there is a Is cost recovery and in terms of the ADSP. Yes, that's the we're putting in an application. Well once I can get Deputy vice-chancellor to sit down and have a chat with me and then I can Submit it, but we're very close to submitting that and the idea is it we're not thinking as it said as a university of Melbourne solution It's a national application. So yeah, we were open to working with others as well But we're not going in for a data integration Service. No, we're going to let a hw and no easy deal do that. Yeah, and the last question is Who can access middle to work? Is it Internal for University of Melbourne? Is it open to external partners anybody? Yeah, so if you're if you're from a research institute, or if you're in Australia, you can access it That's good. I should have mentioned that. Yeah, thanks Isabel Are you guys thinking of becoming one of those accredited Data facilities under the data availability and transparency act? Yes. Yes. So that's why the ADSP Accreditation, so we're very close to that Finishing that actually finished it. We're just waiting for approval to submit. So, um, yes Thanks. Thanks, Rashi. Um, this is operating now, right? Yes. Yeah, so that I was just wondering about, um the length of the process between when a Researcher conceives of an idea and then when they actually get access and they can start their analysis. What's the What's is it? Do you have a typical time frame or kind of what's the best case scenario between? I'm just thinking about the the Productivity Commission had a report about the Data and digital dividend and this is kind of the counter to this that this, you know, this process Is slow. That's my my kind of get can you give us some kind of real world data about How much time elapses between? The researcher creating their concept and then actually putting it into practice So if we already have the data within the environment Um, we've done it in three four days getting everything running So it once again, it's once you get you once we get the application is about how quickly we get them enrolled under the training And once the training is done, it's literally half a day to get the project up and running. So we've done it within three four days That said we it once again depends on that It's the data is there if we have the data within the environment So that's the main blocker for us. If you need to go and talk to somebody else, we're getting the data that's different Um, so one of the just to say one of our critical user requirements that we had was we have to do it within a week Right, or we have to try our best to do it within a week Because I know sometimes we do that and we would wait a month to get the data So it's it's it goes back to once again to the data if the data is available within the environment or not Hi, I have a question from online from margie smith. Uh, who asked with the data data and transparency act accreditation will you need to have accredited users Why do you for that? Yes, um, so the ondc has two parts to the accreditation. Um System so there's accredited users and then the accredited data service providers. You have to be an accredited user To access the data or to access the data services within the data service provider And um, I should have actually had a sign up there. Um with the data services provider There's three data services that they can provide. So that is secure access They can provide complex, um data integration or the identification or three Um, so we're going for the identification and For secure access, um, but yes, but you'll need to be an accredited user. Yes So we should just make a clarification on that. There's a very interesting part of the data act Which is there, which is none of the people in this room will be an accredited user It's actually your institution Okay, so the user in that system Is the you know the university melbourne's very national university and so forth Um, so there is a and the iodc is coordinating some of this work. Um, the a process of accreditation The institutions have to go through which is actually fairly high High intensity what has to be done in fact That that is sort of underpinning a lot of this in the background here um And that is part of the driver for court, you know, particularly why look at some of those sensitive data environments is This this is kind of an emerging field of how this will actually operate And we're doing some other work in the background to Sort of align some of those processes as well So very nice to get that respectful sharing, you know model that we got to yesterday And changing some of that language, but there is a lot of work going on on You know in different parts of the the overall community that's that's kind of driving this Thanks to you I have another question from online. Oh, sorry It's from julia who asks how long does it take if A i h w has to integrate their data first in your experience of such requests Does that does this include access to abs link data under my nap? Oh m m a d i p sorry under my dip. Yeah, so um with abs. We have to be very careful. So specific data sets we can't access because they fall under the census and statistics act And abs cannot give that data even if they wanted to um So we're working with abs on what data sets we can bring in in terms of the time it's How long is a piece of string? Unfortunately when it comes to data integration because it matters on what day what measures you want What level of data you want a little detail you want unfortunately um We had projects which took six months to get the data integrated first Um, and i'm still waiting with the ato. We're still waiting for data. It's been two years now But mind you that's not just access to data. That's that's separate to bring the data into hosted for everybody else. It's a bit different Yeah, I just wanted to add to steve's comment So so the university accreditation process is is happening now um, I know certainly in the case of the group of eight universities that they are working together um around the accreditation and sharing um information, um about how they're going Some of those institutions are at more mature stages in in preparing their accreditation as users Than others but that information is being shared outside the goa. Um, I'm not sure what's happening um I would say if if if you're a researcher in a university who wants to be able to take advantage of middle One of the things to try to do is to make sure that your university is in the process of seeking accreditation as a data user And for researchers to actually I think lobby Within their institutions for that to be happening if it's not The other thing I think is really important Is for people who have experience working with data like this in environments like this that researchers actually feed into the accreditation process Because there is a risk in fact that accreditation will sit Within it departments or it sort of central service divisions of universities and cyber security divisions And and it's important in fact that that it's also informed by the way in which research practice with these data and in these environments actually happens Just to add to that. Thanks. Thanks a lot mark. Thanks Steve as well. I'm just to add to that, you know, so If the accreditation applies if you're coming through data place if you're coming through that platform if you want access Data made available through that act and through that scheme Um, and there are ways you can access data without that environment. So as well. So just that's not the only way One two, and then we'll have to keep moving unfortunately Just on just on the point of uh accreditation. Indeed the go8s are talking to each other. Um ARDC is also facilitating a national community Which all the universities are invited to and I think at present there's 20 or more universities actually coming to these meetings So, um, there's there's both happening and we're also talking to the go8s and they're also in that meeting So if you want to know more about the ARDC community, please please get in touch That was exactly what I was going to say. So, uh, yeah, please write to us on contact at ARDC Do you do you and join our support group for those trying to become data place data user accredited accredited I wanted that part out because you know, you could mistake us as father and son Thanks. Oh, you okay? Yeah Thank you. Is that yours? Otherwise, I'll do your presentation again now. I'm mindful that we need to catch up on time here. So these um We've had a bit of a shuffle We're going to talk to uh, ryan this ryan perry is going to talk first um, so we switched to presentations around there ryan ryan's uh Uh, let's say activists, but no, you're an archivist. Um at ANU's Australian data archive working with management of longitudinal data data sets in the in the in the archive and developing improved achieving process archiving processes including for handling deposits privacy and risk assessment and archival archival systems social psychologists with 10 years research experience cross psychology management public health including the ANU center of research our social research and methods academic fellow at the university of melvin apartment of management and marketing and mckenzie research fellow at the university of melvin school um The population health ryan is presently working with hasson i rdc team on the iris Yeah, thank you. Um, and first I'd like to acknowledge the Uh, Wurundjeri people the traditional owners of the lands on which we meet today Uh, and where I live and work myself Uh, and kiora koto tenakue. Thank you. Um, so i'm gonna um speak uh, a little bit to um the the processes that we use Um, so i'm going to um speak uh, a little bit to um the the processes um that we use Internally at the australian data archive for handling sensitive data And and you'll notice there's a considerable bit of overlap here, um with what's happening in the the broader iris project Um, so uh, I'm also I'm also going to detail um some of the recent uh, scripts and apps that we've been working on Uh, working towards a self-service um Self-service process for um data owners that are interested in submitting their data to australian data archive Um, so uh, a little bit of overlap with um, rajah's slides. Uh, gladly. I'm it's good to be on the same page um, really all I'll add to that um is to say uh, a critical part of the the the privacy act for us is this idea that um sensitive information is uh, sensitive data is Defined as as that with both um identifying information and sensitive information And for much of the work that we're doing to uh reduce identification reduce some Risks around sensitive data um is targeted at the the uh identifiable side of this so it's it's more straightforward um for us to De-identify the data Which um, you know Sometimes means the sensitive data sensitive information is able to be published but um as was was clearly established yesterday That's that's not always the case. So there's definitely some exceptions That require more manual input from data owners and and from the archivists Okay, so um effectively We are trying to balance access and and utility in the data so not um not Changing it or or or removing too much information. Um, but this of course has to be balanced against Privacy risks due to sensitivity and and identifiability Um, we can modify the data in various ways um, but um, even so, uh, most Sensitive data is published with conditional access um, and the um, I'll I'll explain a little bit more about, um How we do that I think, um So, um Much of the access is is controlled, um manually at the data archive So we have a team who process each request for the data and And match up the the credentials of the person applying for the data With the customized access rules Determined with the data owners input And our system also ensures that there's detailed metadata attached to each of the Each of the data deposits with us meaning that, um That even if the information is is highly restricted or has a lot of access conditions It's still very findable on our catalog system So people can find it understand what's in there and then proceed with with the access process um, all right, so so just in summary we have Two main strategies for managing sensitive data of the Archive, so there's the licensing and access conditions Which I was just talking a little bit about so as well as the access conditions. We also develop a customized data sharing agreement or or license with the data owners And we as archivists we have a range of both automatic and manual risk assessment processes And I'm so I'm mostly going to be Going through a few of these data risk assessment tools So we've been developing a suite of R-based scripts and apps And these are working towards Not only to make the process a little more a little easier Automated for the archivist, but we want this is also to become more of an educational tool For the research community and a means of self-service data risk assessment and de-identification Okay, and as I mentioned So we have access conditions and these also include Publishing different versions of the data so we might publish both a general access with low or Low access conditions and a restrictive version which requires More criteria to gain access to the data And we're also gradually incorporating the the five states which is a more formal framework for restricting access and ensuring that those applying for access are deemed safe people and their Projects are safe and the settings in which they're using the data are safe Okay, so on to our Our scripts for assessing risk and de-identifying data so firstly Our first script that we work with is is really just using a keyword search or key term search of the data labels to the variable labels and names to You know to identify common identifiers so anything to do with names addresses Participant IDs So this is a good sort of automatic Check so that we don't miss anything but as you can probably imagine it throws up a lot of false positives as well Um And we're also trying to Trying to identify Indirect identifiers. So these might include geospatial terms So if there's geospatial information like postcodes, it's going to make the data riskier The ability to identify individuals increases And I'll talk a little bit later about the the importance of of testing for unique combinations of responses so being able to identify someone by combining A range of different demographics that that might be unique in that data Um as part of this we're also assessing the data quality And I'll just mention briefly that That we're automating it as much as possible But the process still includes a lot of manual assessment from the archivists including To evaluate sensitive information in the data qualitative responses And and other quality issues like Consistency in the naming and labeling Okay, so this is just a screenshot of the output from that that keyword Script that I was just describing So something really nice about using the markdown program is that the output of the script is a word document That we can edit you know As we evaluate whether these are true positives or false positives for privacy risks And it's also a Report that we can give to the data owners so that they can approve any suggestions so You can see there So this is a This is a very risky data set And you can see the the keywords that it's throwing up are things like name And I name an id mostly there and then you can see the the archivists Comments and the owner's responses At the other side Um, okay, so that is that's how we deal mostly with them direct identifiers like names and id's It gets a little more complicated when we are assessing The the combinations or the indirect identifiers that I mentioned before So we have again in r using the shiny package We've developed a web app Oh, it's in development Where you can load in SPSS data and then choose various variables from that to To examine How many people have these these different combinations of demographics? So in this example, you can see that there's a lot of relatively unique combinations, so we're interested in Um in combinations where there's three or fewer respondents And you can kind of imagine from this data that if it was a if it was a single workplace or institution Uh, you probably could identify You know the 18 and 19 year olds that were in certain roles in your organization There might be very few or only one of those um, so if there was also Sensitive information in this data set Then you would be in trouble So, uh, this is also, uh, as I said meant Eventually to be something of an educational tool So we're trying to make it Visually quite appealing with the you know the red highlights of when there's potential issues And then there's a second Dialogue is part of the app here Showing you the the frequency of each of the categories so Here you would be able to identify that that some of your More low frequency Occupation categories in their So sales workers machine operators And the other category and the app allows you to Select These categories that you you want to combine together so you might combine them all Into an other category So that they Wouldn't be identifiable anymore And once you've uh, once you've made that combination Does it to the data in the background and then you can go back to your Evaluation screen and you can see that we've removed Almost all of the unique combinations there And in the background there I've combined the h into Categories as well And so from there, maybe you would want to Combine your age groups to even broader categories to remove The remaining unique combinations Okay, and and so one final step so we are expanding that work now to deal with risk associated with panel data And this is also relevant to Data linkage as well So You know the the more pieces of data that you have Across different data sets on the same person the the higher the risk of being able to identify them That you so you might not notice in one wave of the data that there's a An identifiable person in that because you know in wave one they gave more information or in another wave They might have given sensitive information And you haven't sufficiently de identified them in the way of you working with so What we do in these situations is Is first of all limit the number of demographic variables And their categories So we Working with the life in Australia panel We only we only publish the data with with four key demographics and and recategorize Those if there's lots of categories And this is really just to reduce the demands of the The suppression that we're doing on the data So if you have lots of variables and lots of categories Then you have to suppress lots of responses to make sure there's no unique ones anymore And so again where the whether the our script is identifying A combinations with fewer than three respondents or three or fewer And then it's it's suppressing those unique combinations by replacing one of the responses in those unique combinations So if you're the only person with a with a specific Education age gender and Job Then the algorithm will decide to Replace one of your responses with missing data so that you no longer have a unique combination of responses And I'll I'll try and explain as well how the how the algorithm is is determining Which response to suppress there? So this this took us a long time to get it into a you know a coherent paragraph so So we suppress a given demographic value If the combination of the other three Is more frequent than other combinations containing the given demographic so So you might choose the person's education response so If their Age gender and job A really common combination in the data because that means their education is the most Risky or the most likely to identify them because it's As common when you combine it with everything else All right, so just to To leave you with the limitations of what we're working on here so Of course focusing on the Identifiable aspects of the data Is not going to sufficiently Protect all sensitive data So as as was established Yesterday the context And the cohort that you're working with Is important because sometimes the even if it's not Directly identifiable the sensitive data still might might not be appropriate for publishing So this requires a lot of Manual handling from the archivist and working closely with the data owners to establish like what's appropriate um We With the apps struggle to adapt to different populations and sampling Procedures might serve larger datasets are Less risky or if it's context specific like my Single organizational institution example before the risk increases Uh, likewise, um, we don't uh, what the this side of the The risk assessment and de-identification Doesn't approach the research ethics and consent side So that's also an avenue that we are trying to explore more is to ensure that Data owners the outset of their projects Um You know collecting consent appropriately Thank you Any quick questions if you do, uh Hello, oh, sorry To sorry. I said quick The um, do you see it problematic with indigenous people, you know, um When you know Any I just sort of saying do you see it problematic because sometimes say if we go, oh How many indigenous professors there are in Australia? We would know them all basically You know something I just Any I just put that to you just say and say in the community Everyone know that maybe uncle or auntie is Is the knowledge holder there and to deoid and they have sensitive stuff Um, anyhow Yeah, uh, yeah, it's it's a very good very good point. Um, if you have, you know, very very few numbers of certain demographics Um in your sample and your population then Uh, you know, I think one of the main dangers from this is that you you end up removing them or or categorizing people into What what I called the other category before Um, and the main way that we address this is through the the access side. So we might Uh, you know, depending on what the data owner wanted publish a general release That does have the data recategorized like that But also publish a a more restricted version For researchers that might want access to that more detailed information Thank you very much. Um in the interest of Well in the interest of saving time we've got to shut up, but um gen will proceed through we'll go to steve shortly And then I'm going to make an executive decision and say we're going to only have 15 minutes for little lunch And then we got to reconvene because then Levi starts after Little lunch. So steve mckechran Well, I mean, you know studying up steve Is the director of Australian data archive national Australian national university where is responsible for strategy and operations of the archive Has been actively involved in development of application of data archiving and survey research methodology and technologies For over 20 years in Australian university sexter Steve has also had leadership roles professional associations data archiving and Infrastructure including chair of the executive committee of the debacle data documentation initiative pressureer code data data Teach teaching Australian consortium of for social political research Um an international federation of data organizations now when you finish Steve we're figuring out some Structure on the fly When always my approach and Jenny Look at me. Look at me. Um I'll get you to come up straight out to steam or facilitate a conversation in the open discussion before little lunch and we'll Yeah, but we might make up time if we need Uh, yeah, so so we're figuring out a little bit on the fly I have a real strong incentive for this. I'm going to be on a plane at 12 15 So, um, I'm very good at beginning to be able to keep things short An incentive to at least okay Um, we've we moved the order around a little bit because I thought actually Ryan stuff would flow nicely from what Raj was talking about that I mean The iron iris the integrated part of iris and I'm going to say I'm going to talk a bit You know quite a lot about that is we actually have some quite good Separated services in the social sciences That that exists the problem is the integration part. So How do we connect these things up or how do we make choices between systems? How do we Liase between systems so to a couple of the answers to the questions that were raised in the past two presentations was This is not an either or it's an and in almost every case I could do this and I can do that And pushing people through different systems and connecting between systems is really the big challenge We have here and that's sort of the the lead into my presentation as well fundamentally is How do we enable those connections effectively? progressively from manual to some sort of mixed automation and manual semi-automatic processes So, you know, um, Ryan was talking about de-identification Well, if I'm downloading the data, that's the thing I do or all my alternative is to push it into rajah's system if it's got Yeah, different risk We do this in other places as well. That's the sort of story we're going to talk about in this last presentation as well So we're talking. I'm going to talk about metadata a lot. Let's say In this process. I'm also the reason for the all the acronyms to be fair. Okay. So that's my fault That's because saying integrated research infrastructure for social science and the coordination and research data services And social sciences just gets really long very quickly. I just need shortcuts um, okay So I apologize it for but don't apologize for it in a sense. Just say you went up with too many words too quickly Um, so we've talked a bit, you know talked about what is iris But I want to talk just touch on a couple of key points And this comes from from what we included in our original ideas Quite good resources, but they're disconnected and they're fragmented and that's you know Really the story we're looking at here and all the stories we've seen yesterday and in the south in this morning are really about Either, you know raising up the you know the capacity to connect to things or progressively, you know joining joining up that infrastructure fundamentally um, what we've been figuring out along the way though is actually that we need quite a lot more of Things that allow machines to talk to each other fundamentally is the story that you know that we're increasingly finding um, so You know movement of information between systems. We actually have quite a lot of data, but getting to it the access side We do have this history of restricted access And that comes from the sorts of data that we tend to use um, but we also have this um story of Thinking about how to get to things and then how do we describe things we describe things fairly well But we we don't reuse information which allows us to connect systems. Okay So let's say I mean that so we had a couple of you know diagrams that we've sort of flashed up throughout One we've we've tried to think about this in terms of research process So I'm just reiterating things here as we go through The different work packages that we have within iris are really designed to you know connect up different parts of the research process That was that's one view of how we're thinking about things is what do you need to do in different parts of the You know as you work through research activities So that's one framing we've got here is how do we make research easier fundamentally? And this this was in rajah's you know document this morning Michael nicely then talked about actually it's a combination of systems as well So we need systems to talk to each other. So we have curation the cards a vocabulary service That's all just social as the integration services. And we're also interested in doing survey data Managing of survey which is a sort of a workhorse in you know, a lot of the quantitative social sciences collecting and managing survey data It has some parallels as well with a lot of administrative data collection You might be using Government administrative sources as well We can use some of the the same approach as well and then the demonstrate approach that projects are the means for connecting those Okay, so what's I say we knew this from very early on but I say we would need quite a lot of you know Mechanisms for connecting between systems of really the first stages of what we've been doing is is surfacing what those requirements fundamentally are So we need to create Metadata the data is there, but we have to be able to give it meaning and be able to get let the machines to talk to each other Humans can read process and understand imprecise information machines can't That's fundamentally the story that you know that that we have I mean, you know, that's that's an obvious thing to say But what it does actually mean is creation and curation Or in order to effectively operate and interoperate these services is really a lot of the driver for Sort of feeding through what what we're doing So we require systems that can create metadata at the point of creation And that's a little bit of what I'll talk about now A lot of the systems that we have now producing information that allows us to do this if we can pass it to the next system And if we can reuse it And or we might have to curate metadata and data as it passes through systems And that was the sort of infinite thing that ryan was talking about and essentially that michael depends upon to run the geosocial system So i'm revisiting from from michael's, you know, michael's diagrams yesterday We we could see if we can find effective means for describing the data And you know that is essentially what metadata is Um, and we can provide Common vocabularies for the the way we do it. We have things like research vocabularies astral and a couple of other services We've been introducing as part of a part of iris as well Then we have the basis for interoperating But often these things are not there already So either we want to say we want to look at how we can make sure that they get carried through Or we have to think about doing it after the fact So we it's either at the time of creation or the As the process develops and different parts of our systems will need to do that And we've just certainly been discovering and the last couple weeks have been doing some work amongst the teams to say What's kind of missing here? uh And so nicely sort of say that the iran team been working through a metadata model there And you know it touched yesterday upon well, what are those common sets? You know the common standards nick was talking about common standards Really standardized sort of content, you know, is the easiest thing to do or at least comparable content. So So for michael to operate the geosocial service, he needs things that are essentially the same Certainly to do the sort of the the computer, you know mediated reasoning I said a human can do it But they have to do a lot of operations in the meantime The computer cannot do it until you give them sufficient information to do so No, I know we have ml and you know ai site type models that are there But there's only going to get so far. We start to feed them the that you know We have to get away from the garbage inside of it in order to be able to do that so What are the metadata requirements we're looking for and this is you know, really the story of where where we've come to So the sort of things that we're trying to build through in our in the the work package five, which is the survey Data management and work package six, which is the curation services is a combination of you know, some basic requirements for metadata We need some technical and semantic standards. We have to be able to say what a thing means. What is unemployment? What is education? You know these sorts of things to be able to say If I've got a tabular data set, what is in this column? You know, I can say I can give it an aim. I can give it a postcode Um, but if I don't have the the semantic standard to say it's actually a postcode I can probably figure it out if it's got four digits What happens if excel decides to round it to three digits because it doesn't like leading zeros as an example That's the sort of thing you kind of need to be able to do to that machines talk to each other So I need this the technical and I need the semantic. What is you know, um, you know, 2601 actually represent Now that represents the the postcode for anu in this case Or 3437 which is you know gizman in victoria where I spent, you know, I live for someone You know, I know this and I can remember this and you know, you need to present that information effectively You don't so what else do they need to be it needs to be persistent. Can I reuse that from previous work? Um I'm going to ask you to watch closely as they make my way through because it's the same I'm going to tell a story of what looks like persistence that actually isn't You know, can I reuse something and you know and make use of it over and over? If I can build that chain of evidence, I can then say these things are linked to each other It needs to be fine grained Um, so As said, what's the name of this variable? What are the semantics of this variable become important there? um But we also need the course grade and ryan and and and boy tech in the in the last few days have really touched upon this I need the context to understand under which circumstances can I do something or not do something? Um, you know ryan was touching up on sort of populations and sampling uh as as was one tech Do we need to do identify something? You're more like you need to de-identify something that's taken from the census than from a a survey and that's because A survey samples people. You don't know that someone's going to be you know in a list a population At least a census or the case that you were talking about the indigenous professors You know who that list is so you have to do different things. So you need the course and the fine Okay, so we have nicely we have a quite a lot of this Um in in a lot of the social science in you know infrastructure that we have It's just disconnected and often using different sorts of standards. We do try and standardize some of this This is an example the international social survey program, which I I'm involved in the Australian arm of this Um, we have the basic things that we can use to build this fine grained infrastructure So we have a variable a variable is a column in a in a spreadsheet Fundamentally, we can give it a name. We can persist that information and we can say this is the variable that I used in my my asker So that's nice But a variable in a survey and this is good. You know, how do I reuse of information comes from a question? I ask a question of an individual. I might have done it. How many of you have used qualtrics? Um in any that you've done Okay, I can get that information out of qualtrics and I can probably pass it the next system But I don't usually But what if we could why don't we do that? That gives us this word starting to build that sort of provenance change that question is there I also have a response domain. Here's the answer. So I have a question and an answer And the difference between the question and the answer might actually inhibit or support interoperability if I you reuse the same answers Essentially, that's a vocabulary. If I reuse that vocabulary, I've got the same answer to the question Um, so my you know, Ryan was talking about other categories. Who's in the other category or is that list of We won't have a point to hear not going to see it online. Anyway The response domains can be reused nicely. This actually aligns pretty well with Lists that are in up in other sources as well What is your current employment situation? You know in paid work unemployed in education That's something social sciences. We want to compare things pretty regularly We reuse essentially the same the same response categories over and over and we even standardize them into national and international classifications So our research processes support this we generally reuse the things but we don't persist them. We don't always use exactly the same thing so Okay, so we've got the pieces there. We even have a concept. This is essentially employment status We give it a name. We give it a definition But we might we say we've got to be consistent in our names and our definitions and this is some of the hard part So, you know, how I define employment status the abs There isn't this national classification the unemployment statistics that appear in Australia every month are determined by an agreement in 1984 that flows through to the abs And you say and there is a very specific things that are there But I might make it slightly different um So we do have the pieces that we have there and actually what we've been demonstrating in the work We've done so far is we can do a number of these things We actually have been able to in the the process of being working connecting a questionnaire in an archive so getting stuff out of survey services and into registry services um as I is We say so far we've been able to get you know from the using standards This is the means through which we're able to connect content up So we've established a registry based on a tool called collector and using two standards the quick some l standard which is used inside for describing surveys and the dvi life cycle standard which is used for describing Data content in social surveys and and related systems We're able to get content out of archives again using pretty standard systems using spss We could use data sass things that are essentially on every laboratory desktop in every universe in Australia to standardize things they generally describe things in the same way we can move them around Less success with having classifications to vocab. So I talked about classifications So the abs has a standard classification occupations. It's got 6 000 categories in it.  So the way in which they're presented matters We can move things in and out, but they're not always available in effective ways And they're not always exposed in effective ways for those who use apis Turns out the api we've been waiting for an api from abs for 10 years We hadn't got it. It turns out it was sitting there hiding behind the scenes But you've still got to find ways of exposing it But let's say a lot of these depend upon and this is the parts that we're increasingly having to do export formats use of standards Moot help, you know How are these things exposed by one system to pass it to the next system and the access points that are there? Preferably apis but there are other models that are there. So we we'd be able to progressively build up So we're our pilots we're getting we've managed to get things in and out of systems into an into a collector service here So we've got this stood up as a bit of a proof of concept We've got three instruments an instrument as a survey a data file is an sbss data file We have over a thousand variables. We can describe it, you know, 1700 columns of data We've got 180 questions in our system We've got pretty good metadata on the system This was all generated already by the systems that we used to collect the data We didn't do a whole lot of curation for these particular questions, but we would have to do this for the census questions Um, we're able to say here's the question. Sorry. That was the question in an instrument Here's the questions that came before and after here's the full description of the question with some standard categories The same questions I used before in my example And then here is the variable that appears in the dataset, which is the column of information the categories it uses So say we've got the pieces that are there. We can describe the content We can connect it up and talk about the pieces that we want So a third view of virus is say, what are those, you know, arrows from left to right? So we're progressively able to build up This is doesn't include the geosocial Which would be, you know, connect into some of these services as well But we have been able to demonstrate through different means some of those pipelines and how they exist And we're looking to progressively automate those But we still need reuse in particular. Now, I talked about, you know, persistence and reuse and sort of consistent use of Information and I kind of flicked over something quickly Here's a question It looks a lot like the question that I had there had there before So which of the following best describes your current situation? That was the same question sample I used before Here's another question. Which of the following best describes your current employment situation? Are these the same thing? The answer is nearly And one one talks about which the following best describes your current situation Which the following best describes your current employment situation We're essentially asking the same thing and using very similar categories, but we don't use exactly the same thing We do the human thing which was we copy and then we modify But the thing for us that we need to do next is connect those up We want to reuse the same thing or where we change things We want to be able to describe that we've changed and that's the bit that we're going on to next Next parts we're going into A registry A collect card and the research vocab is australia to describe to allow you to connect them back to a questionnaire to reuse those questions Those wordings were different and the response categories are different, which means they're not interoperable Can we build that interoperability in as the next part of the work things like question libraries? We're looking at content reuse Exactly, you know that that idea of reusing those questions, you know in effective ways, but also variables and classifications And the likely solution. This is probably some sort of graph You know a link data service plus a provenance model that goes with it and that's really where we're moving into the next stages of work So we have the pieces that are there We're saying we're telling a story of interconnection But progressive as we go through we're starting to think about all How do you actually make effective use of those? You know, we can move things from one system to the next But how do I reuse the things once they're there back into the systems that I have and that's kind of where we're going next And that's our story Hi Steve, um, can you You you've you've mentioned or name drop the vassal thing there And you made a couple of points about you need better Interaction between tools now on the one end of the vessel you've got the rba system You've done stuff to it to make it To make some content there more available for your tool. So what yet? So this is a bit we're actually figuring out now is Is actually what so what does rba is research vocabularies astray at an ardc service? What it does is make particularly good, you know, vocabularies are what it does best So in the in for the what we need to do things like a standard classification Or a list of response categories of what you do west, but it doesn't do the rest of those other pieces The question the variable and so forth It also is the case that an idea that that last point of demonstration The the answers that they're using a specific question Might be slightly different And it you know, so we what we're looking at now is the interaction between the standard Is this you know the list the pick list the things you can pick from and the specific ones that were actually used And what's the best place to locate those and we found that for we're doing some work with the census dictionary For example that it works well for the classifications and for the the standardized things But where we want to make modifications We've got to kind of look at where we host things locally on how do we make those Potentially reusable and probably put them back into rba is not the ideal case there So that's kind of where we again. This is this question of reusability How do we present that back out and describe the line of the other sort of the provenance chain? Thanks, dude. It's really interesting At this stage, do you have any idea of How researchers are going to interact with this? I'm thinking in my discipline There's a great reluctance for one person writing a grammar to say my past tense is exactly the same as your past tense We can use the same category. So if you got any kind of feedback So not yet the the question really is is can we Say because we know Actually in certainly in this area. This is is kind of how researchers work. It is an expectation that you reuse With a bit of a little bit of you know, it's the exactly as you know, so we got a slide similar to as opposed to same as The you know, we do reuse a lot of content though But we do it inherently we say this is the measure that I used Here's the questionnaire that I used but we forget to act. We don't have the systems actually to say This is the relationship between those two things Particularly classifications. We do want to use those because those are the things as that The you know, the geosocial work was talking to you say those are the things that allow us to connect them up and make those comparisons but again, we might We make you know slight changes around the edges So let's say there is a tradition of reuse Um I say with modification So it's really that you know, where do those adaptations occur that can we kind of describe that inheritance? Which is what we expect So the specifics of how that plays out for researcher is probably in those question libraries that I mentioned but You know, I say How do you describe what changes were made? It's going to be interesting question Yeah, I've got a request. Yeah Come in here. Yep. I want you to say this very clear voice. Yes This is Steve mckechran coming to you live from melbourne 3a w Yes, this is Steve mckechran coming to you live from 3a w Oddly that was my mother's favorite station growing it But you got a deadly radio voice And looks forward to yeah, I know that story Um Thank you very much, Steve and sorry I had to we had to rush through that but then You've allowed us 15 minutes to have a conversation now Jenny So Yeah, I mean I say you've kind of got a flavor of Of where we've come to so far and the sorts of pieces that we're looking into there Um, and we you've talked a bit about Let's say this is kind of end of part one Sort of a discussion. We're looking to the future and saying well, what else would you need to bring into the mix there? Um, uh, and what others, you know, what sorts of services what sorts of infrastructure would be You know sort of complimentary to this that doesn't start to appear in this picture now. We we've thought of some Uh things like you know how we support qualitative content So qualitative social research Um, and we have colleagues here at here at melbourne uni who are working actively on some of that work as well Similarly and we're going to say some of those in the room are involved the conversation things like new forms of of data um social media Instead of things type data, uh, so we have colleagues, uh, amanda michael Working on different parts of that um that thinking Um, the third part that we've certainly thought about is And this is a big driver for a lot of the the sort of research that we we tend to see is Is access to data that's not in the systems that we've just described But particularly and this this was touched upon in some of the questions um the uh those linked datasets Um or other government collections that that might be there. How do we enable access to those in an effective ways? So those are sort of initial things that we're thinking of that certainly you know extend the work that's there But you know, we're sort of wondering a little bit about what parts of the story. Haven't we got covered there? Or does that start to tell part of the story for us? So I want to open up the floor to say you know sort of first reflections on there What I mean, what are the other pieces there that you might you know be thinking of and that includes the same We've got a number of indigenous colleagues here Um, certainly looking at indigenous policy. We do see strong overlap certainly, you know occurring there um But you know other spaces as well that might be of interest for us to sort of explore as we go through Nick we've got Nick and Sandra yep A question about um maybe stepping back on and thinking about what kind of government structure long-term government structures are are around Defining the kinds of problems that these data sets and this activity Are about solving and who is at the table in terms of Those decisions and my question because you you know, you're engaging a lot with ATO and How for well funded organizations? um My question would be in regards to closing the gap priority area for Which is all about access to data And I'm wondering what is the thinking around Indigenous led co-design around the problem definition about And where is the space for um The appropriate indigenous bodies to be Defining the data they want to see and that reflects their needs and their requirements and You know, where are we at in these conversations with the government? I won't try and talk to where are we at with government Um, I say what I would say is this is what I think is what so to touch upon the Has an indigenous comments more generally this this is one of the joint problems I think actually is one of those shared you know shared parts of thinking that needs to occur for the has commons It's not specifically an iris problem. You know, we've got part of the story to talk to Um for particular types of processes and particular type of researchers But governance more generally and and I would say reflecting up, you know, so I'm involved a bit in Yeah, obviously an idea in as well Um But reflecting on some of the governance sort of questions that have been coming up These are There are some indigenous specific questions that are relevant there, but actually the governance process we're talking about here in Related communities as well. So I've been you know, I've done some work with the national disability data asset We're similar sorts of stories actually started to go started to come through in terms of thinking about Ownership governance, you know rights to access Certainly have come through in that sort of engagement as well. Um, so I would say I think that is a collective Um requirement that we actually have across the house commons and I would extend that into a little bit of other places as well Things like the health commons, you know The people commons are likely to have those sorts of questions too the other Heart knife and the the questions we got from raj You know for raj's presentation kind of allude to this is there is sort of a governance and and a technology You know discussion that needs to be thought about for I say I really like that the term you know respectful sharing, you know turning around that language Towards how you manage some of what is essentially Government driven processes for access to their stuff for turning things around to actually I actually think though some of those models work for the other way around imagine if government actually had to ask the same Sort of questions for access to your content as opposed to the other way around They're a consumer rather than a you know, they're rather than a producer of data So those sorts of models I think probably have some you know capacity use if we think about the Some of the the government structures we can put in place That hasn't been that work hasn't been done yet And I say I think extending into You know other communities as well I've done work with public housing communities with a disability data asset and the like and I say the the sorts of Questions that are asked and the sorts of considerations people are interested in Come through the interesting part. I think as we go through this is And the challenge that that has to be reconciled is It's a story of I want access to information about me And that's good, you know ownership and control over the information about me is good The problem is I also want access to information about other people And it's those other people whoever they might be Who say have the same thing they want information to access their information But it's that reconciliation the collective and the individual which is you know, there's no answer to that But how do you know? How do you put processes in place that actually laid to reconcile those two things that you know That the parts we find out to work our way through Hi again, Steve just before Sandra's question you you said how do we sort of integrate with other stuff? And I note that in the discussion thing here, it says future requirements for you know, social science infrastructure I mentioned it to do with modeling and so on yesterday, but There are lots of initiatives out there to do more with data That's got nothing to do with social science from their point of view But from our point of view it does and one example I'll use is we saw the The tooling about place names yesterday So when Queensland and hopefully the national governments improve their place names models That could have a positive impact on us But in terms of what we should do to be on board with that is we need to actually come up with Even in concept what we would like to see and then actually present that so when Queensland government says look We're actually rebuilding the place name system. They're doing it right now We should go to them and say Indigenous data network that the has community or whatever This is what we'd love to see now. They're sometimes they're going to say look, we can't do that But for instance if we just said, you know that the government there would understand the dual naming Or multiple name with indigenous names is a big deal But specifically how that's done this community has got the contacts to Indigenous groups and so on that would actually be able to express their wishes And as the mediators people like me in the sort of the technical space between the communities and maybe in this case The government would want to interpret those wishes into an actual proposal because one of the things the government's not going to do is try and Implement your intentions in their model because that's risk for them They're doing stuff for their purposes, but we can probably often add on to that as long as we kind of guarantee We say if you represent indigenous naming in this way in your system, we'd be happy with that They'll take that as that's great. There's no risk for them. They can go and do it. It keeps us happy. So my my I guess proposal here is to look at those other initiatives that are around And actually make concrete proposals to them Even if they really basic starting ones that we think represent our community's interests and and this is an ongoing I guess advocacy task but just Looking at the initiatives that are actually happening and then trying to jump in on them. That's what we need to do Yeah, I flicked It's disappeared off the screen so on my screen it could be pop. Yeah, excellent. Thank you I flicked back to this slide but for the two in response to it with and I'll say now our thinking is exactly that You know, as we know there are some things that are happening in other, you know in You know, you're trying to pull together things from lots of different sources generally speaking and knowing about those I sort of mentioned, you know Use of my standard That's never, you know, that's you know, ideally that's what I want, but that's actually not what happens It's what I want is concorded or crosswalk, you know to be able to connect so Looking at you know situations where I can reuse You know, and I know that I can you know use that information in my system become is equal important So, you know, sort of Michael's got this to interoperate these things. You need to follow all of the chain But at this point here things like Providence Who hosts it? What else we got in their collection methods and so forth I say it's probably the case that I can reuse those in pretty effective ways So spatial temporal the other the other is the kind of the social science the terminology the conceptual side The spatial and the temporal should be able to reuse and I think that holds in a lot of places as well so as I said, you know, it's Looking at common, you know common practices and as you say and feeding in this is our requirements there and be able to say No, how do I how do I align those things effectively? I think is the kind of the model for doing that and then be able to again follow that chain down You know, can I say what the relationship or what the similarity or difference between these two things is? But not trying to do it all ourselves at the same time We know it's like we know there's a lot out there We know that probably it's not going to be our us that does that you know that work But knowing that we can talk to it becomes a key part of that Very good over there. Yeah Thinking about the kind of data that we're producing from a range of projects at at six in brisbane We frequently don't use surveys Because people want to yarn And so, you know, we have these what we we call narrative assessment tools So the the drawings that people collaboratively do as part of an interview process But you know in the course of asking a range of people about the same topic we might get An interview transcript will get a drawing will get notes from the person who was doing the interview So all of this and a recording of the interview frequently as well. So all all of those things Other data I'm wondering if there's there's a scope for a project that is looking at okay Indigenous people were designing a metadata system for this kind of data, which is frequent, you know Ask Blackfella About something he'll tell you a story So, you know, the the idea of of narrative being the the basis of the answer rather than a variable Yep, maybe there's Maybe there's scope for a I look, I I think data project. Yeah. No, I think absolutely again, there are there are It's why I get a little bit concerned about talking about my project as opposed to the has commons as well Which is as I say the I think absolutely Um There's sort of two sides that one is They're all just data Okay, so we've got to be able to store stuff. We've got to be able to talk to stuff We've got to you know figure out what's what's there and you know, so there actually aren't that many types I think, you know, it's image. Yeah, as you say, it's images text audio video Spreadsheets and then there's probably a little bit more Jason, you know, sort of the web, you know the web data standards that are there and you've kind of got to cover So that, you know, be able to access those things is part of that Then there's the semantics of what is there actually in that, you know, in the content that's there as well And how do I how does a particular domain or a particular group make use of that in an effective ways? How do I make that information? You know accessible And and surface that for what are going to be quite diverse You know, um research needs But might not be as diverse as actually, you know, we think that they might be so using natural language Processing to go through and identifying, you know places in a in an interview transcript You know, it is one example that that might be there Now I can see two immediate cases for that which is one is I can identify the place names Which is great for being able to say something about place place, you know Place-based understandings the other applications I can De-identify the places which from the point of view of thinking about data security And and re-identification Is is an immediate, you know application of it as well So I say I think some of the the services that we actually need are probably going to have multiple cases It's how do we take that and be able to think about? What are fairly common data types and data services and tools that we need? And then apply them to particular methodologies of particular domain traditions And requirements that are specific to a particular, you know research community Um, and that's you know, so the the things that we actually do in common. That's the that's the commons as it were And I say and I think absolutely there's a capacity to be thinking about, you know, where we might use those same thing with images We were working with images 10 years ago, we couldn't do this 10 years ago, which was where there was a colleague working on Indigenous football competition, um out in, you know, uh, western New South Wales You could tell you where it was taken could tell you who you know What time was taken what size the file was what the geographic location is the thing I can tell you was what's in the photo You know You can do that now, of course And that's great But I can tell you who's in the photo and that might not be great as well Um, so what again, how do we apply the technology particular techniques that that we're interested in there? So I think absolutely that's going to be the case and we can think about across the sorts of content that we have And then think about well for a given application What's the you know, what's the what's the needs we have there? Um, but in that say we so we thought about certainly some of the access side of that in a related project that we're doing Now what are you know, particularly between you know, the qualitative social research traditions You know and and some you know, the oral history traditions is probably not a big leak You know, so there are certainly some requirements there Uh a quest a comment from online from Julia for local problem solving and local solutions for communities that want to understand their local issues to find solutions Only census or specific administrative data that is geocoded is useful Unless those communities have resources for local surveys This is a problem as otherwise all these conversations are top down Yes and no So as I I made my start doing community surveys in particular parts of the local community Yes, you need the resources to do those things But again, it's not an either or sort of question So be able to work downwards from those, you know, large collections is important to provide some part of the equation Being able to provide access to Local like I mean say the work I was doing was training local people to do surveys of their own community with some with some supported resources Um, but those tools are becoming increasingly active. The the survey tools that I was discussing Uh are not free, but they're not expensive. They're getting their desktop tools at the university level They're relatively cheap for a particular community survey monkeys, you know, google docs Uh, sorry google forms can do these sorts of things So the technology is getting less and less expensive than they were the capability is different Um The the yes side of that question is Once you start getting to those low levels That information starts becoming again, we get back into confidential deli and privacy issues as well Um That that become part of the equation too. So to say it's always this trade-off Um, and there are I say some really good work going in and certainly indigenous communities to to think about how you do that Uh Yaru up in uh outside of broom, uh, for example, we've been doing work with Andalaqua And just out off Groot Island Who are working on these in their communities to do addressing because sometimes the high level data just isn't isn't worthwhile Frankly, it's not sufficient And so you do want to do some local stuff Again, I think it's got it getting to an end rather than an or needs to continue to be part of that story Shall we kick back in ladies and gentlemen? We're still in the process of making up time. Um Hello, Anika so Levi and Kristen Levi Murray and Dr. Kristen Smith are going to Do their presentation or improving indigenous research capability stream one social architecture Now Levi are you related to arnold? bumper Yeah Yeah, him and I played football together Yeah, um Levi is an Aboriginal man of walker walker and cubby cubby descent Um, what am I? Lee Sorry, Levi they go and leave on then they've pronounced you Murray Um Well, Levi isn't Murray Um the expert on health strategist was over 16 years of cross-sector experience in health and education Worked as a that dynamic range of pro in a dynamic range of primary healthcare settings throughout Australia Error error medical youth and adolescent forensic health rule and remote health health age care and disability committed to perpetual independence growth evolution of healthcare infrastructure for our first nations people and their respective communities throughout the global COVID pandemic Levi delivered senior clinical leadership and advocacy to victoria's Aboriginal community controlled health sector and nationally as an executive manager of clinical excellence Murray Murray Is it Levi or Murray? What's going on here? Hey Yeah I don't know what you're smoking when you put this together Johnny, but the expertise in both public population health was central to develop in developing COVID positive pathways for Aboriginal and Torres Strait Islander people and the co-development of new clinical models of care for COVID-19 vaccinations pathology and diagnostics April 22 as appointed a strategic manager of indigenous data with the indigenous studies unit at Melbourne school of population and global health overseeing the house the research data commons and indigenous research capability program project Murray will adjunctively can co-continue to the relaunching of my god Nadia Yep, and you know what it is and the development of their five-year strategic plan and dr. Kristen spear Is a research director of indigenous studies unit in the center of health equity at the melbourne school of population and global health the university of melbourne Kristen holds phd a medical anthropology master social science international development From rmit and a bachelor of arts with distinction from deacon university her interdisciplinary work traverses the fields of medical anthropology epi epi deamoled the epi Yeah, epi deamology human geography public health and health promotion Kristen's unique contribution to health research include her innovative work in Australian indigenous medical anthropology policy analysis data analysis complex multi-disciplinary theoretical and methodological methodological development And that'll do I think So narrow one and all my name is Levi. That was a very long winded and very complicated by an intro So apologies for that. Um, I would like to pay my respect by acknowledging The burundry people of whose land and country that We're joining from here today I'd also like to extend that to all Aboriginal and Torres Strait Island people joining both here in the room in those virtually Um and extend that also to the many partners of the many Communities in which we work with throughout the multitude of programs and projects that we function within the indigenous studies Thanks, Levi. So we're also going to give a bit of an overview of the improving indigenous research capabilities project As although a lot of the other projects have had quite good overviews and details We're going to give a very brief update on some of the activities in the first part of the project and then following us Sandra Len and nick will be talking about two of the other streams of work so The project partners and like the other projects you've been hearing about over yesterday and today We have a significant number of research partners organizations. Some of the key ones are named here But there are a number of other organizations who we are working with as well Again, this is just some of the key team project Project team members There are many more people working on different activities in sub activities around the project This is just a representation of some of the key people working within this project So just to give you a little bit of a background on I guess initially the indigenous data network itself so for many years Personally myself. I've been working with Professor Marcia Langton for a bit over a decade So we've been working on a range of different research projects both being anthropologists Mainly across the northern jurisdictions of Australia from Cape York to northern territory And more recently in the last four or five years We've done a lot of work up in the east kimberley and we've started doing some more work In central australia across the mpy region so I guess probably for quite some time during our research. We always work with community controlled organizations And one of the key things that we always found frustrating and that the communities that we were working with found Extraordinarily frustrating was the lack of access that they had to data So when i'm talking about that it's primarily we're thinking about government data Assets that were about them that often they are sending off data So particularly if we're thinking about health services or any other range of services in different communities across australia Yet they have very little access of that data coming back to them And some some organizations are working with this data very well and collecting their own data But other organizations who have far less resources and capacity to work with that found it extraordinarily frustrating So as I mean a lot of the researchers in the room and listening in online would understand it even for Researchers in different fields. It's very difficult to get access to government data And government data that is meaningful for particular community groups for particular issues So on the back of that marcia in a lot of her working Um Decided with a group of us to put together a symposium looking at indigenous data sovereignty. So that was back in 2017 We had about 200 delegates that we invited from all over australia from government from the Different peaks across australia from community controlled organizations But also a series of different experts across the university sector In all majority of universities across australia So that symposium was co-hosted by iaccess the australian national university and the university of melbourne And so one of the key I guess outputs from from that symposium was the call for a develop developing a network of interested parties in promoting indigenous data sovereignty across australia. So really that's where the indigenous data network itself came from So I guess fast forward to today The idn really is now a national network and it really aims to provide this collective base To support and drive better data outcomes for Aboriginal and Torres Strait Islander people across australia It's made up of a series of you know community controlled organizations There's indigenous privately owned businesses There's a lot of people in academics across the sector predominantly Aboriginal Academics but also other non-indigenous academics who are working in different areas that are focusing on indigenous studies issues So one of the primary aims of the indigenous data network is to support community controlled organizations to collect manage and utilize data assets relevant to their needs and aspirations and to really think about how we can collectively promote indigenous data empowerment Yeah So some of the core issues that the indigenous uh, um improving indigenous research capability project Set out to to answer and review is indigenous research data One of the things that we knew is that it exists in a wide variety of formats um And in a wide variety of context, but these assets are ultimately scattered and inadequately cataloged There's many unidentified yet highly significant indigenous data assets located across the nation, which many are orphaned Or held within five broad communities of indigenous data research custodians Thus including original Torres Strait Islander communities and their organizations universities researchers and other organizations The gland sector which is galleries libraries archives and museums Commonwealth state territory local governments and The fifth one the private sector So As many people have already been talking about over the last day or so What what we do know is that you know, many of these cost data custodians are really siloed So there's not a great deal of integration between them And they also have really widely varying data science practices and capabilities And so we're not just talking about the community controlled sector We're also talking about you know different data holdings within Commonwealth state and territory and local governments There will be different ways that data is managed multiple systems And it's really very complex for you know, just average researcher, let alone Say a data officer in a community controlled organization to access Also, there's there's Really been an increasing need for a variety of solutions for data storage and management across all sectors and all of these different data custodians So for example, you know Some of the communities that we work with have really large holdings of data whether that be video data Increasingly so which is as we all know really large files that they're holding on hard drives some of them in remote communities and often in areas where they are really at risk of Of damage from whether it be during wet season the cyclones coming through or for fire and For one one community that we're working with They really have little ability to upload it to the cloud because the lack of internet service or the limited internet service that they have in that location So thinking through solutions for really varied problems such as this is okay So how do we get you know, however many well a quarter of of a Pedabyte of data onto the cloud from a remote community So I mean there are a number of different ways that you can go about that But what actually is going to be the best solution for that community who is really concerned about ensuring the safety of that data The the longevity of that data and ensuring that they safeguard particular elements of that data in the way that they culturally wish to either share or keep themselves So that's just one of multiple Issues that are arising in different ways for communities across Australia Um, there's also a number of different indigenous data custodians who are calling for advice and practical solutions Of how to actually embed indigenous data governance and indigenous data sovereignty principles So at the indigenous data network, and I know probably a lot of other organizations out there We it's a common request that we get from particularly government or government agencies of saying, okay, we're custodians of all of this data We want to implement indigenous data governance principles. How do we do that? And so in this project We're really wanting to think through some practical ways of different agencies and organizations And how they can start thinking through embedding these principles within their data holdings And in the way they collect the way they analyze it the way they share it so across the entire data life cycle Um, there is also, you know a variety of other complex issues emerging Regarding data access for indigenous people and that's already come up a couple of times across the last few days people talking about I guess we'll go back again to government data custodians holding access to data and often there's gatekeepers who Do not provide access where access should be granted. So there's a a seriously Large problem looming there and how we deal with that is something that the that this project is trying to start to build solutions for So again, sorry So again, some of the key questions addressed by the project is how do we embed and support sustained indigenous data governance across Australian data infrastructure? How might individuals organizations and government use best practice models to ensure Good governance and what incentives might assist the prevention and use of data into the future? What types of authentication practices processes embedded in IT infrastructures could appropriately protect data on behalf of individuals and their communities? What are practical ways to apply fair and care principles? Are there missing pieces to the puzzle that need further examination? How might we legislate regulate data governance to benefit Aboriginal and Torres Strait Islander data within the jurisdictions across Australia? And how can indigenous data data assets be improved by embedding indigenous knowledges in new and innovative ways? So really it's it we're not being ambitious at all in this project thinking we're going to solve all these things Obviously, that's not what we're trying to do. So this project is about starting to build those foundations That nobody actually has the answers to any of these particularly in an Australian context Where there is such a wide variety of different needs and understandings and uses So the project itself really is split into three streams of work Of which each of these streams have a series of I guess what you would like to call mini projects embedded within them So the first stream as you can see here is the social architecture work The second stream being the technical architecture work and the third being the building of national data assets So of these three streams, um, they're really we've designed them to collectively to lead to improved indigenous research data practices across Australia So although this project is relative, you know, when we were planning it is relatively short So 18 months from start to finish by you know, I again quite an ambitious task that we're embarking upon We really see this as more of you know, maybe a 10 to 20 year prospect of actually doing this properly So what we're doing in this phase of the project is really trying to get some solid foundations to work forward in the future So stream one which we'll go into a little bit more detail as we go along We're just we're just going to give a brief over really brief overview of all of the three streams And the the next presentation with our technical team are going to give more details about about stream two and three But stream one really is made up of three sort of minor projects or activities the first being national scoping and engagement of indigenous research communities and place based application of indigenous data governance principles So that this activity of work is well underway It's consisting of a range of things including we're doing a major literature review scoping review of both international and national literature Relevant to indigenous data governance. So also issues around indigenous data sovereignty That's being drafted at the end of This phase of the project. So end of june We'll be producing a working paper which outlines the findings of each of that these activities and gives a bit of an overview of the work that we've done So activity 1.2, which we'll also talk to it in a bit more detail as we go along We had a national leaders of indigenous data governance and sovereignty roundtable that we held Precisely here in this room over two days in june the 9th and 10th So we'll give a little bit more information about some of the really fascinating sessions that were held there and discussions With a variety of different groups from across australia There's also a link in in one of our slides later If you weren't there if you're interested in catching up on that the majority of the sessions we recorded on video and available to watch in the future So the third activity is actually one that's going to take us quite a lot longer than the 18 months to do Is looking at place-based case studies of aboriginal and Torres Strait Islander data governance principles So in this phase the last 12 months of the the project we've been Doing consultations with a range of different communities across australia Trying to get a grasp of some of the key issues where different communities are doing very well at embedding indigenous data Governance into their practices in their work And looking also at some of the barriers and needs going forward So we're we're working at the moment with Three communities, but it's going to as as we've all been talking about again over the last few days. This isn't a short-term process There is a high level of sensitivity around the data that's being collected by a lot of communities and we've got to be respectful It's not a quick process So we're we're making steps through that and we we do have a good deal of work yet to be done But the start has been made on that as well Talk briefly just The overview of string to yeah um, so string to the technical architecture like christin said Nick and some of our partners will do a demonstration talk through that in a little bit more depth but Brief overview is working to establish the foundations of an aboriginal Torres Strait Islander research data commons Exploring repository services to ensure that the preservation of data assets Catalog services to make them discoverable in the metadata generation to improve asset description and facilitate data linkage and aggregation So key activities again breaking down in there. There's three of them 2.1 is the aboriginal Torres Strait Islander Research data engagement scoping activity. So that works been currently underway and what you'll notice about A lot of the activities and a lot of the projects across The three streams is that they are all interconnected. So One might proceed the other but it doesn't necessarily mean that that work stops at the at that point of the project activity 2.2 is national aboriginal Torres Strait Islander research data catalog An activity 2.3 is the research data capability building for aboriginal Torres Strait Islander organizations and researchers So really going to understand him again one of our primary focuses is about improving that capacity Not just from a research perspective, but obviously from an operational and a workforce perspective as well So then just briefly the third stream so that as you can note there's three activities in each stream It really aims to build the foundations for a set of core national indigenous data assets focusing on the development of an indigenous locife framework, which parallels the ABS hierarchy and can be applied to any data, which includes location information So as we've noted more detail will be spoken about these two streams of work as we go along Um, and just think I want one thing I wanted to note So the activity 3.1 looking at vocab development and metadata labelling for traditional knowledge and biocultural labels A little bit of well that has been worked on for the last 12 months But some of the development work from the technical perspective We have realized that that actually needs to go back up into the social social architecture because Although there's been a lot of international work and there's developing work in Australia There's still a lot of governance issues that need to be worked through with that In the second quarter of this year We will be convening an in-house workshop of a number of different Stakeholders across Australia specifically to look at TK and BC labels and notices and looking how they can practically be applied, but also thinking more broadly about How they can be usefully Used in Australia and really looking at specific communities again There's such a very context across Australia. We can't assume that one size fits all So that will be happening in the second quarter of this year as well Yeah As we mentioned last year in June we convened a round table and we had over 180 participants come from around the country Again across many different sectors And including the Aboriginal community control sector Three of our three of our research partners Did present some of their key concerns and some of their key interests In the realms of data and research and also of particular significance data governance and data sovereignty within the context of First Peoples So the internet's data around table are provided and for all of those attendees to Collaboratively explore and discuss those practical solutions key barriers and models of governance for a shared benefit The presenters and attendees discussed and shared international best practice data science data governance and Aboriginal and Torres Strait Islander knowledges and world views So just to give you a better understanding of the key sessions and some of the issues raised As I said, here's the link to the Vimeo if you want to go and actually look at those sessions yourselves We also published in the pursuit, which is the university's Monthly magazine online We've got an article in there that we wrote after this symposium sort of Highlighting some of the key issues. I should have given you the link, but we can send it through if you want to send us an email So for that the first session was looking at Indigenous data governance and sovereignty in action in a community controlled organization. So that was a fabulous presentation by the Aboriginal and Torres Strait Islander community health service So three of the people at that health service. So there was Raymond Broncker Jared Alexson and Jonathan Leach gave a really good presentation of the journey that they've been on Working substantively with QUT Becky Cook over here and a few other people have been really involved in that work And I'm just trying to see where John Willis is around here somewhere John could talk to us Extensively about that that as well But if you want to have a look at that session, it's really interesting the journey that they have gone on To try and start working with their data utilizing it in particular ways And the way that they are managing it and look it's a really interesting and I guess I would say Australian best practice example of what to look for in Indigenous data governance and sovereignty practice across Australia And then next up we had the Indigenous data sovereignty into Indigenous data Indigenous data governance into Indigenous data sovereignty presentation from the Mayam Nairi Wengara Collective Which is a series of three really interesting presentations from members of that group It was then followed on by The National Indigenous Data Catalog and Practical Applications of Indigenous Data Governance By members of our project team. So Sandra and Len and Nick We gave that presentation We also had a session on the traditional knowledge and biocultural labels from Stephanie Von Gavel at Syro And Professor Rachel Ankeny from the University of Adelaide. It's Rachel here today. No So they gave a really interesting update on the work that they're doing going forward and some of the key issues that they were coming across We also had a Session on co-designing an Indigenous data roadmap and building capability by Professor Peter Anderson Professor Matt Belgard and Professor Professor Kerry Minguson and Becky Cook who have already pointed out over here from QUT Following that we had a session on working with international standards the European Data Protection Act so that was from Dr. Chris Wilson who was an expert in the area Has done his PhD in cyber security over there and gave a really fascinating talk Looking at how I guess what is happening in Europe? We really should be thinking about significantly in Australia to improve the way we deal with some of these issues um following that we had a fascinating Talk from Michael ed at the University of Queensland from the Anthropology Museum Who Jenny already referred to yesterday Starting to think through some of the ways that I guess as I mentioned before some of the gatekeeping occurs around materials data and objects So Michael went through a whole series of ways where I guess gatekeepers were keeping Indigenous people out from accessing In particular photographs of their ancestors. So if you're interested in checking that out that also that session is online I would highly recommend it Following that we had a presentation from Steve McKerrin who has left the building now But he was talking about starting to think through some of the federated Data models that could be really useful when thinking through data holdings for Indigenous Indigenous data per se So as I've already mentioned a lot of the the communities who hold their own data really don't want it open for everyone so thinking at least how can we make data findable so The catalog team the team who've been working on the catalog will talk about that in a little more detail um Then following that it was another great session. I'd highly recommend checking out if you weren't there um that was delivered by empowered communities and a member of the Aboriginal and Torres Strait Islander community health services looking specifically and and talking about the data that the communities need so their communities themselves um Calling out I guess to governments that they've been looking for access to data for a very long time And I mean I guess there's the side issue with that that has been happening with the new legislation that came through last year And the data code for the data transparency and availability act um From the IDN's perspective, we've got significant concerns about The further barriers potentially that they that will put in place for communities trying to access their own data So I believe I do you want to tell talk a little bit about some of the conversations and the groups that you've been involved with in that context yeah, so part of that work of I've been sitting on uh the deputy secretaries uh data champions working group. So the Australian public sector is currently Moving towards developing designing a framework and how it is that they actually manage those holdings particularly those of indigenous peoples With data sovereignty and governance embedded throughout every every part of that the data life cycle from creation from conception to creation and all the way through to management Like rosen was saying with obviously the introduction of the data and that passing through one of our main concerns is the I guess the the potential for that to bottle that Information and put a further strangulation for community to be able to really access critical information and to be able to make determination and Do decision making and all that kind of stuff? um, so yeah, we've been largely advocating around that and so that works progressive and ongoing and um, so we'll continue that work as part of an advisory group Over the coming year But I guess one of the other things that we're doing is we're essentially focused on improving uh research capability And there was a lot of conversation yesterday um Around like research and I guess that's what everyone's essentially here for today I will kind of Go off on a tangent here, but I did want to make a few comments about yesterday. We were talking about research. Um language matters and I think All the way through. Yes, I found it really interesting. We We definitely do identify like researchers as a very particular cohort within community and throughout our society as a whole But you know at the end of the day people like everyone's people And you know as human beings we're born with a very innate sense of um ability to you know, functionally filter through even data Like a whole world is built up on data. Everything is about that um, and so what When we're looking at, you know, indigenous data governance sovereignty when we talk about long-term infrastructure and you know reform and all of these things that um Our high priorities and concerns for us all We can't have that without changing the language at the same time so you know When we talk about research community that in itself is exclusive for Aboriginal and Torres Strait Islander people It ignores the fact that Aboriginal and Torres Strait Islander people their knowledges their practices culture and laws Um far exceed any of the research in more contemporary times because it really is you know a couple hundred years is very contemporary so, um One of the things that we're also doing at the moment is developing Uh further training and trying to roll that out low cost and you know, ultimately free Um, we are participating as well next week in the ARDC summer skill school Um, as Jenny mentioned, there's been a specific part that we've designed for Aboriginal community control and so the idea there is to Basically change the language and we want to be able to create space and opportunity For for them to come into that and ensure them that they have a seat at the table because Even now when we're talking about innovation everything there's not really a clear idea of where people sit particularly Aboriginal and Torres Strait Islander people so Thanks Levi And really that's that's the main part of our talk today. We've tried to keep it short I just I guess in in concluding look as I said initially We really just just are at the start of a really long-term process We're going to be planning out and I guess learning from our findings thinking about okay What's going to happen in the next year? What's going to happen in the next five years and beyond that? And ultimately this is a collective Project, it's can't be something that's just done by one group or one Organization or one discipline if we're thinking about research It really has to be a collaborative effort across Australia So if anyone wants to be is interested in being involved, please do reach out We're based Administratively in the indigenous studies unit, which is actually now not the Center for Health Equity with a Namda Center for Aboriginal and Torres Strait Islander health and well-being That was launched Tuesday Again here in this room, but please do reach out. We're really interested in hearing about Different ideas from different people across Australia is as I said, it really has to be that collective effort But thank you very much Any questions? Any questions? You're accessing information that allows for a recognition of kinship decisions you're making As in not one person holds all the story Yeah, yeah That's a very good question And I think that's very much centered around like that exploratory part of it is understanding the the incredibly The incredibly I guess nuanced elements of not just governance, but also policy and also Respect and rationality as well. So, yeah, any other questions? Yes Thank you My questions about something that Louva said was around the data champions the depth sex data champions. Forgive me because I Know nothing about it, but I'd love you just to say you talked about you sitting on that around that table And what their kind of agenda is and does it include, you know The entire public service or are they sort of select departments? It'd be interesting to know what that forum is doing Yeah, so I'm sitting on that. I'm sitting on the working group of them. So Professor Langton sits in the actual Committee above and the working group is actually sitting there and it's got a quorum of equal indigenous Participants and non from the APS sector Central focus on looking at reforming. So the framework the framework that they want to introduce it. It's theoretical But again, that'll probably they want to introduce that over a two to three year period So that is currently being socialized in March And so if approved and that that's moved in that ultimately would probably start at a very smaller portion of the APS Of particularly interested to probably be the likes of the Australian Institute of Health and Welfare Land water environment some of those The more central pressed ones and the ones that have been identified as priority areas from Aboriginal and Torres Strait Islander people Because I don't see a question enough or yeah Are you guys having any? I won't say blockades, but if you've got are you having trouble with any Communities, I know you guys are trying to do more on ground and in community talks Are you having any communities and or elders that are? Refusing to want to give them information because they want to keep it within community or within just their section of culture And if so have you got strategies around that? Are they working? Well, we're not necessarily going out to seek people's data It's really more about supporting them to use data different groups to use data in whatever way that they want to do I mean if for example, there is need for Repositories, which we're hearing a lot We will be in that role of trying to support and think through best case solutions and scenarios for each individual group But a lot of this I think in this particular initial work is starting to find out Is starting to find out what are some of the variety of issues that different community groups are having So we're not having any specific issues in getting access to whether it be data or communities We work with a broad range Of communities across Australia through a lot of our research works through the IDN and other work that we're doing But it's more about starting to document some of the different challenges different groups are having Yeah, is that is that yeah, and I guess to kind of further add on to that One of the things is is we haven't actually kind