All right closing the door looks like you're all trapped now this is going to work very well. Okay welcome everyone thanks for coming along to my presentation which is about transitioning to GovCMS as you've seen for quite a few minutes I'm Glenn Martin I'm from the Department of Finance in Canberra and today I'm going to be talking about GovCMS and the GovCMS program and for agencies and vendors alike the things that you need to take into account when you're looking to moving to GovCMS. So it's an open source Drupal distribution built on Drupal 7 and when we use it with Acquia with Acquia Cloud Site Factory or Acquia Cloud Enterprise we have a whole of government security assessed open source cloud etc solution for government agencies at any level so we have federal state and local government that are on GovCMS all good and to you'll need to forgive me sometimes I'll lapse into a bit of government speak so a government entity just so you know some government websites are really obvious that their government finance.gov.au okay but government also runs a lot of campaigns and and other sorts of websites which at first blush might not be appear to their government also educational institutions and similar sorts of things so it's not just just for government to give you a quick bit of context about this transitioning to GovCMS this is where you're going to use a GovCMS distribution in our hosting environment is what I'm going to be talking about the differences today if you took the distribution to use on your own hosting you can do whatever you want we'd adjust like in any other distro you there's no restrictions it's it's not a freemium setup where we've put out there like the cut down restricted bits and then you've got to pay more to get the whole lot full distro is available it is on Drupal.org and GitHub all out there in the open we do our issues queues in GitHub so that's if you want to get involved and see what's going on definitely go to there see the conversations that they're being had through both government agencies vendors and just interested citizens basically getting right into the community get in there get involved get a part of it we're seeing some really really interesting things coming out of it the quick history is we actually went live in Drupal South Melbourne last year like last April is when when I stood up with Adam Malone the sharp dress man you might have seen from this morning and I spoke about it we have two hosting environments we have our software as a service our SAS and our platform as a service our pass environment which I'll be describing a bit more we have a hundred and five sites in the GovCMS program that are live today there's 28 in development as we speak we have 49 government agencies that have signed up to be part of the program in the next month month and a half we have about 10 10 sites that are in various states of development that are planning to go live so where I say at the moment our SAS environment is serving up three million page views a month across the sites that are over there that's going to grow dramatically and real soon and the caveat there it's possible since I wrote this up yesterday somebody has either gone live or signed up or started development since then I'm actually getting a nod from the big boss so it is that busy we have that much interest in it so as far as the environment that you should use it's it's deciding between the SAS or the pass is is what it comes down to when agencies are in the SAS environment it's it's a shared code base but it's one that is supported by the program so the case of you having to apply security security patches module updates etc where an agency doesn't want to do that doesn't have the skill doesn't have the money doesn't have the inclination we look after it you get CDN DDoS WAF web application firewall all by default it's always on we know agencies prior to GovCMS coming into being they were paying a hundred thousand dollars for CDN and DDoS alone so forget the website forget anything else I haven't done anything except put some protection in front of it and it's all sitting on Acquia cloud site factory which is hosted by Amazon web services the pass environment the requirement there must be Drupal we do prefer the GovCMS distribution but for various reasons as long as it's Drupal that's okay we have security accredited up to the infrastructure layer and as you can see in the SAS we've actually accredited to the infrastructure and application for a government agency this represents months and months of effort in saving and a lot of money as well that we've gone and done this and and hang finances name on it the pass environment is sitting out on Acquia cloud enterprise so it's it is different and it does allow agencies that want to be out on their own looking after themselves air gap from from other sites to be able to do that the SAS versus pass for both administrators and developers in a SAS environment there's no user one you don't have administrator access you can't install a module on a whim you have access to when I say there that you can configure limited modules there's a couple of hundred that make up the GovCMS distribution of that we allow you to access some of them but some we don't so the security complexity the password complexity module you're sitting there and you're thinking 13 characters this is a real pain I want to turn that off well you can't because there goes our security accreditation if we let you do that but you do have access to other things so the Google analytics you can drop your Google snippets into that and sell some areas you don't have to worry about the distribution maintenance you don't have to worry about doing a security assessment unless you want to so some agencies have come to us and said we still want a pen test we still want to do a full security assessment and that's fine for the others that don't want to blow six months of their life they can use the assessment that we've already put on it in the past you do have full admin and full code base access so you can do whatever you want essentially you can install any modules but you are responsible for maintaining it you want to drop that module in you better test it first because if you put that in you turn it on your white pages site you broke it you're going to have to fix it or find somebody to help help you fix it so this is where in the SAS environment it's an element of protecting an agency from itself because they they'll often get get the command from on high we want the latest Twitter widget just make it happen you just can't do it there because we're protecting the environment for all the other websites that are there even though I talk about that there's no admin in SAS and you can't just drop in a module and it's not to say by the way that you can't actually ever get a module that you want not talk about that in a little bit there's still so much you can do so I'm talking to a room full of Drupal people you know through the admin console as far as content displaying and being dynamic fields views blocks filters panels content types you still have access to all of those things you can still do all of those normal administrative Drupal level types that that you've had in the past it just means you need to know some good Drupal site building right the SAS because of that does mean that it is still good for complex sites we have some little myths that go around that our Gov CMS SAS it's only for really basic stuff it's not we've got some very really complex sites in their department of communications for example communications.gov.au the things that they've got going on in the backhand is really impressive so check out the site if you are interested but it does help out an agency but it's got low no good Drupal skills or they don't want to look after a distribution they don't want to have a dev team and a security team and a testing team to look after that and it also comes with the benefit that anything that we put into the Gov CMS distribution its functionality applies to everybody in a SAS environment now they might not want it but it is still there and it goes in there at no cost to them not so great for if you do have an explicit module or explicit functionality but our distribution cannot serve for agencies that love a good tinker and we know and sites that are really experimental so where you're sort of pushing the boundaries of what you might be able to do. As far as pricing goes that's large enough before I bring it up that the hosting price don't think of it as just hosting so where an agency comes on board with this you get the Amazon web services it's two data sensors in Australia in Sydney so you've got your cross-border jurisdiction there we've got a 99.95% uptime SLA it's IRAP assessed it means that it's been independently assessed up to the application to unclassified so it's Gov CMS is all for public facing websites we don't throw any wall gardens around our SAS sites manage code base CDN etc always HTTPS always on scalable there's a link for the pricing and very briefly if that's even visible you see we do our hosting pricing on page views for sites so we do start at very small sites where yeah 5,000 page views a month up to 2 million page views a month and then we have custom plans beyond that because we have some big agencies coming in. The pass again complex sites needing strong CMS it's it's exactly the same but it's for agencies with high Drupal dev skills or access to and usually access to means cost okay so it's having the budget to do it. Drupal sites that are not already on the Gov CMS distribution but you need to move hosting for some reason and those those other points there but it's not good for reducing resourcing and costs it's not good for sites that are light touch so one ones at once they're up and running that you don't really need to sort of keep using again and especially low low volume ones and and agencies that have limited Drupal and limited access to Drupal skills it's not great for because you really do have to look after yourself or be able to get someone to do it. As far as those development options for bringing a site over you've got the two ends of a scale okay so you either do all the development internally if the agency has got it or you outsource the development for government agencies they can go to a limited tender open tender depending on the value of the contract I'm not going to get into procurement here and we're also setting up the panel and so we're we're really excited about this that we've been wanting to do a panel for quite some time and if you're not familiar with what panels are in government procurement in government can be really painful there's lots and lots of lots of rules we have to follow and as an agency it's very hard for us in the GovCMS program to recommend a vendor so if an agency comes to us and says oh who can we get to build our Drupal site our answer is well you'll have to go to market you'll have to do an RFR and RFT go out lose a lot of months of your life doing that sometimes so a panel though is where we will open up the doors to have vendors apply to be on the panel there will be set criteria for what you need to do to be on that panel and then when an agency comes along they will be able to as an option they don't have to use a panel to potentially select a vendor because there's been a pre vetting process that's happened it's not set up yet we're hoping it we've started the wheels in motion hopefully early next year we'll have that going if you're interested keep an honest on on Twitter on our GovCMS website send us an email and we can alert you as well so but other than the panel the somewhere in between is for an agency to skill themselves up so that's to bring in an external vendor with the remit to take an existing site that you want to migrate over and this is an agency that might have technical skill but just not Drupal technical skill and they can be taken along on a journey to help self-serve themselves and learn more Drupal and be able to stand up more sites any questions by the way you can actually yell at me if you really want to but yeah don't hesitate to ask questions along the way and there's no questions okay so for four big factors to consider when when you're looking at coming across and it's like okay do it do I want to go SAS or do I want to go pass and I'll come into some small case studies here so the first one is considerations about internal capability and inclination it's it's really important so the boss says yeah I've heard this open source let's go cloud sounds awesome and I want you to do it now but the web team is quite literally a half-timer and that's that's all they are who is able to go out and do an evaluation do the security assessments and do all of the things that that government agency really should with this or separately okay so the decisions made to go open source this is great and you're thinking we don't want to outsource the support so you go to your internal ICT say hey guys we want to go to open source and be on Drupal it's going to be awesome can you help us and basically this is your answer so that happens a lot I love the ICT teams within government some of my best friends work in ICT but yeah when you come up against that that can be a problem so and the last one you want to you want to migrate you want to get off the mailing internal infrastructure or an external bad contract but yeah who wants to burn six months of their life doing all the research those things above that's where SAS starts looking pretty good and the case study is a SATA a SATA was our first customer that went live on the system last year they are the point five full-time employee so Nick who was there at the time never going to be able to do it small budget no in-house ability so we've stood up the a SATA site and ever since even with that small team one once it was up there and running they've been happy ever since all the maintenance all the security all the updates is all taken care for them and it's been really good inclination so this is the ATO's annual report ATO a full stack Drupal these guys are hardcore what what they're up to but an annual report once an annual report is published that even the content you don't touch again because it's the annual report right but you don't want to maintain it you don't want to update this what is now essentially a static site so the ATO chose to put their annual report into our SAS environment because we're going to maintain the distribution second consideration is does our distribution meet the required functionality so maybe you've got an existing Drupal site already that you want to bring over but it's too too bespoke to there's too many modules in there it's it's existed for 10 years and it's had the functionality creep and there's no way you're going to be able to migrate it across or maybe the ICT area is on board but they demand control they they don't want anybody else looking after it all there are modules that are drop-dead requirements pass could be a suitable choice there an example is cancer Australia so cancer Australia came across to us very recently they already had extensive Drupal holding so had quite quite a number of sites and they needed new hosting no way that they were going to be able to migrate their sites over to the GovCMS distribution but they were already on Drupal so we were able to put them into the pass environment and we're actually able to put them in quite quickly too which which was good timing so agencies have a habit of coming to us pretty darn late so the things nine-tenths of the way there and then they contact us and we have a look at what's been done it's like oh you know what guys you've really gone off reserve and we can't bring you into our sass environment or maybe there's an emergency migration bad contract coming to an end sites been hacked we've actually had a few customers come over where the previous environment security just not up to scratch or there is a module requirement that we know we're going to put in our distribution but it's not actually there as yet so we can actually have agencies that start their life in pass and then move over to sass an appropriate time the example I have here is budget.vic.gov.au hey jitma jitma you're on your phone give him an edge it's your site so we had we had a hard deadline so the budget doesn't get pushed back because the site's not ready right you don't go to the state treasurer to say sorry can you delay a few days everything was ready to be for sass except for the fact that we didn't have the services module in the distribution but we knew it was coming so we launched the budget site on the pass environment once we put the services module in into the gov cms distribution we have now forklifted them over to sass you see my little mention at the bottom there the Victorian budget and Department of Environment federal Department of Environment actually co-developed on a ccam module which was really exciting this is a module that allows the websites to pull data from data sources such as data.gov.au Department of Environment had started doing it got along to a point and budget.vic came along and it's like hey we want to be able to pull some data in and visualise with pretty graphs and tables etc so we quite genuinely had a federal and state government collaboration on module functionality which is now folded into the distribution that anybody else now has access to so that was really great for us. The budget consideration so you've got all of the capability but none of the money. Got to remember with the sass including out of the box fully maintained CDN DDoS and all of the costs there directly benefiting from any enhancements that we do this really works with a budget constrained department. The pass does genuinely have that greater flexibility there is no question about it but your cost of entry is much higher especially for sites that run under 120,000 page views a month so this is based on our small plan in the sass pricing. It is up to an agency really to decide so if you have a 5000 page views a month site we've got a perfect sass plan but if you really want to go over to a pass and have all of the overhead for what is really a niche audience site I mean less than 5000 page views you're probably generating most of your traffic out of your own department looking at yourself anyway but it's up to an agency to do that but when you're looking at budget and you're thinking about the sass you've got to never forget 80-20 I love 80-20 I live my life by this. We always receive arguments about the sass environment but I don't have full control it's my website but I don't have full control I'm at the whim of somebody else that you guys are going to make decisions that are directly going to affect me I mean we don't do this. Our site is unique where I've sass sounds great but we're really special with your informational brochure where website that's special so I've heard all of them I really have so but you know what if you could get across to an agency that GovCMS sass in particular will get you 80% of the way to the idea of perfection of a site that has nothing wrong with it and all the functionality that you want for 20% of the effort okay you can stand these things up quickly and simply in very little time it's only when you sort of flip and we've got we've got our site now but now we want the widget and the widget takes as long to do as the whole site it was itself the reduced effort means reduce cost and time to launch okay you all know this so it's actually isn't that revolutionary but countless times we come up against agencies that they see the value of proposition that is over in the sass environment thanks very much and but they're still like oh but we we're still special and no you're actually not that special I mean special to us but at the end of the day the sass of the pass it's not an either or so agencies can have both and we do have agency so ATO I mentioned already they've got their annual report over in a sass site but in the past they've got some complex sites going on so you can have both use the sass for sites that you've finished development and you're not really beyond your BAU running of it I'm not really going to change anymore use the pass for the constantly moving the things that you want to be putting those modules in pushing the boundaries you can do that the quick little wrap-up is kind of getting to the end because I just want to show you some themes real quick when you're doing a migration or a transition don't try to match your existing whatever so that whatever might be your publishing workflow that has six layers of approval in it that nobody can actually remember why you have six layers of approval anymore but that's how we've done it for the last 15 years now see time to actually throw that out and stop doing it and get a bit more realistic so it is a really real opportunity for change and we're in the team we're working on a new theme which is going to match the the digital transformation office the DTO their UI kit so finally we've got this sort of almost bootstrap idea of for a government website when an agency sitting there burning 10 hours on the discussion of what font should a heading to be I tell you you can now go to the UI kit and and there's all of these things that we are baking them into a theme for the distribution and with the theme so why reinvent the wheel we've got a lot of public themes available on github there's a link download them review them modify them reuse them any of them you you can actually get in fork it do your changes there's no restrictions it is all open source we saw via site a site earlier this was their first design is the Ackley site feel a little familiar okay where where we look at the two one of those straw man arguments that I get about reusing existing themes of tweaks are but why people get confused if my site sort of looks like the other site if your sites content can't differentiate itself from another site you've actually got bigger issues than it looks similar okay so from that though we do have an agency white site template so you can start both both of these were built off this so it's a starting point and it's only one of many but as I get to the end you can still be a unique and beautiful snowflake so the next few slide because every but remember but I'm really unique my site's really special my informational brochure where boring website so here's stay smart online okay so they they're actually under Department of Communication so you actually see their site looks quite similar to communications dot all dot gov.au there's AFSA the Australian Financial Security Agency authority there it is right in the top there currently in beta this is live at the moment they're about they're gonna cut over in about a month and the last one the ATO this is not a beta site like AFSA is this is where they test functionality looks like I'm gonna be getting a wrap-up real soon so they what they do here is put out functionality get uses to test it and then it gets baked into the proper big ATO website and so you can see the obvious differences there it's not you don't have to be a cookie cutter at the theme layer you can still do what you want now last bit about how enterprise are we so I spoke about three million pages a month in our SAS environment that's a cross 30 or 40 websites at the moment that's gonna double real soon but the biggest sites that we have in the Gov CMS program is this fellow Australia gov.au and this guy so human services those two are in the top 10 government websites in Australia and individually they're running probably three anywhere from three to seven million page years a month on their own and they're sitting environments that haven't blinked so it's not just for small stuff it is truly for enterprise level and that's how how we've built it thanks everybody I've got a question straight here in the front right for most of that I'll have to take that on notice which means I don't know the full answer but currently the Gov CMS program so the program board broadly where it's supported by the Department of Finance yes it is on well not so much aqueer but Amazon web services I'll plan for D8 so our to answer the first part of your question is a quick I don't know so you can shoot us an email we can get your proper answer on that but let me just say though the Gov CMS program we don't think that we one have all the answers or actually want to hold on to it we're actually keen for a state in Australia in particular to grab up the concept and the idea and go run Gov CMS state we've offered to mentor give everything that we have learned through the process our what the our mistakes and our successes so we don't want to run this thing for absolutely everybody into infinity so and similar if NZ actually wanted to stand up the same idea and if they can't use our system but they want to run it themselves we'll we'll tell you what we've done so yeah there's no there's no secrets in it there's no secret source and yeah we're totally open to that D8 yes we we are discussing it it's on our roadmap that's coming I cannot say when we are flat out I mean we got 105 sites already we got 50 agencies on the boil yeah it's it's coming so the question is about theming in the sass environment so the way the super high level of how it all hangs together the themes live out in github so you can do anything that you want so an agency can update a theme in github and then you come into the Acre Cloud site factory console and you pull the new versions in when we started Gov CMS in the very early days we did that because we didn't trust anybody no we just we needed to make sure that people knew what they were doing as an agency proves themselves that they actually do understand what they're doing and their theme isn't going to pull in some malformed code that then effectively choose up system resources we handle the keys and site agencies can update their their own things yeah probably the key difference is we've done the security assessment to the infrastructure and and we're happy to share that with an agency whereas if an agency just went to Acre Cloud Enterprise directly completely around and outside us they don't get to leverage that there's also some smaller light touch things about contract management that they can also benefit from if they come through us but that that's the main thing Alfred yeah so can agencies stand up their own sass playground essentially it's on our roadmap in so much as we just need a state that wants to do it quite simply so there's so many things that we would love to be able to do within the program itself but we have one limited time and our own resources and to unless somebody actually comes along and says yeah I want that really cool functionality I'm ready to sponsor it and support it put dev time into it so it all sits there waiting so yeah definitely a state running its own sass separate to our sass with their own code base and their own unique distribution yeah not there's nothing stopping anyone doing it and we want to help great so that looks like it I hope that was useful for you the last little plug there the community dot gov CMS in particular for non-technical people so github for all the issues cues and you can see whether devs hang out and chat but if you want a sort of more business in kind of discussions and maybe not as deep deep tech go to community dot gov CMS it's you got to make an account at the moment to get in we're actually going to turn that off so anybody can see it there's for no other reason that that's how it was set up you can be government you can be a business you can be a private citizen there's it's all open so there's no restrictions to go in there and have a look at it you'll see things about road map questions functionality questions in there what we're up to what we hope to do so yeah thanks everyone


I'm Matt Mann and we're the Shine Runners. The song's called Big Easy Living. Under the train yard, catch a ride to San Antonio. Shots of cane and tables, beers that cool the browns, Heaven Street tops, we comin' down.  And the tip of the teeth is here, the legendary Dr. John. We throw the drunken heads back in my room, Surrounded by bed by the rivers, all the ghosts of old. Gets our slam with some things that you used to do. Taking a swim, the over-surgeon, over-strained. No longer tell the difference between the sinners and the saints.  Run down to the preacher, have a ride.   Big Easy Living, for too long.


The largest seaport in Russia's St. Petersburg region has stopped handling explosive ammonium nitrate amid drone attacks. Comersant writes about this with reference to informed sources.An official source told the publication that the Russian government is wary of a possible provocation that could have devastating consequences, the port receives in ships about 3 million tons of saltpeter annually. The interlocutors of the newspaper noted that producers are looking for other export options. The most convenient option may be the UST-LUF terminal. But for this, the terminal needs to be improved. The complex receives some 7 million metric tons a year of gas condensate, a type of light oil, from Novakets-Pirovsky plant in western Siberia to produce oil products such as naptha, jet fuel, and gas oil. Novatech's complex produces mostly naptha for Asia, including China, Singapore, Taiwan and Malaysia, as well as jet fuel with delivery to Istanbul for Turkish airlines. Analysts said Novatech will now be forced to export more gas condensate instead of high margin fuel via other terminals.Sources of the newspaper said that the demand for saltpeter in the market is expected to increase. Ammonium nitrate is an inorganic chemical used as a fertilizer in agriculture. When the temperature rises to 170 degrees, the decomposition process begins. In case of ignition of ammonium nitrate, the explosion can have destructive power. Since the beginning of the war, the Ukrainian army has started targeting Petersburg for the first time since the beginning of the year. The city has already been attacked by drones several times.


Fighters of the two groups that claimed responsibility for the Belgrade raid, the Russian Volunteer Corps and Freedom of Russia Legion, held a news conference in a forest clearing in northern Ukraine near the Russian border on Wednesday. The Russian military said on May 23 it had routed militants who attacked the Russian border region of Belgrade with armored vehicles the previous day, killing more than 70 Ukrainian nationalists and pushing the remainder back into Ukraine. The fighters on Wednesday posed for a vast crowd of assembled reporters brandishing guns and holding the group's banners. Leaders of the group said the Belgrade raid was the first step and they would conduct more incursions into Russian territory in the near future. The groups were set up during Russia's full-scale invasion and attracted Russian Volunteer fighters wanting to fight against their own country alongside Ukraine and topple President of different people these are these could be like our friends in Russia. In the beginning, there was a lot of chaos, we managed to get our hands on any case that was obviously like a semi-leader situation because we all were volunteers. And were you also involved in those famous assassinations like Dugina and others? That is, in fact, the stronger we are, the more powerful we are, let's say, we enter the territory of the Russian Federation, the longer they need time, the longer the number of tanks there, they could not even resist us, we just do not have any to thank you there representative of region and Russian Volunteer for now we only in one minute by cars and by bus is the same way


Speaker of the House of Representatives Femi Bajabiamila has called on the striking academic staff union of universities ASU and the government on the way out of the ongoing strike in the interest of Nigerian students. Bajabiamila, who made the call at a tripartite meeting, called at his instance to offer an immediate solution to the seven-month-old strike embarked upon by the university teachers and assisted that the horrific chapter must be closed. He stressed that the House would do all within the Constitution and its past to make sure the children are back to school and cautioned all the warring parties that negotiations are about to be made. Here to rehash the issues. I'm not going to yield to that temptation where we're going to be talking about what happened, where we got here, what government has done, what government... No, no, no, no. I believe everybody in Nigeria, we all know the issues. If by now we don't know the issues, then we haven't been existing in Nigeria. So the issues are known to all of us. What we're here for is a solution and a way forward. We are at crisis stage and it's time, unfortunately, the House has been on recess once or twice. We try to recall the House what everybody was all over the place but now we're back and we're going to do all we can constitutionally and that is in our powers to try and resolve this issue once and for all because I believe we are all on the same page on one thing and that is that our students have to go back to class. As the national president Emmanuel Oshodike, while responding to the speaker's call, lamented the indifference of the government towards the strike. By saying that one of the problems we seem to have in this country is that you learn a way to resolve all problems. It's not looked at symptom as problem, but look at the issues. What we do in this country will look at strike as a problem. But when you check, strike is just a symptom of the problem in the system. Nobody will go around our university today and will say our universities are good. Nobody, whether it is federal, it is state, nobody but we seem to look at strike as a problem and that's why in the past it's 2009, we have so many of them. When we are on strike, we have the urge to stop the strike and when the strike is over, we go back to the not to happen to issue for when there were strikes and that is the problem. To us, I also want to say that it is the seventh month this strike is on. We have never and you can check and lately we have never been called to a formal meeting by the Minister of Education, formal meeting where ministers are taking and the short taking. You can check, not one. We have only called to a meeting twice by the Minister of Labour for the seventh of February and first of March. Between there and now, we have never called for any formal meeting. I'm using the word formal.  It's not a formal meeting. And for issues that involve collective bargaining, you don't just issue a talk on this issue. So there will never be any and we challenge the Minister of Education to produce one document, one meeting to show that the Minister of Education has called up for any formal meeting in seventh. It can never happen anywhere in the world. On his part, the Minister of State for Education, Good Law Kopia, said that the strike has become a concern and worry for all stakeholders in the education sector, including the government. About a week ago, Mr. President granted the audience to a committee of Pro-Chancellors of Nigeria universities who also took similar steps and Mr. President is listening to both sides and has resolved to make further consultations after which he will also come up with the final government stand on the issue. Mr. Speaker, this step is not out of place at all. I think it rather adds to the steps already being taken by the Executive with the intention of finding a quicker solution to this problem. And don't forget to hit the notification button so you get notified about fresh news updates.


Okay, let me start by way of introduction. Thanks a lot to the organizers for having me here. Thanks to the discussions that I agree with Alan, we're giving you an unfair job by not providing you much detail before. So what I'm gonna try to do is focus a little bit more in on households in particular. And somebody yesterday said in a conference like this, you should talk about what you know a little bit more about. So that's what I'm gonna do. I'm gonna talk about some specific things. Alan just gave the big overview. And so I'm gonna talk about some specific teams in the economics of the microeconomics of kind of still microeconomics of development focusing on households. And I'm gonna illustrate them with the examples of conditional cash transfer programs and early childhood development. And so Santiago in a certain way has motivated that for me in the plenary. So I'm gonna take off from there. So what I'm gonna do is I'm gonna kind of make a step back first and kind of to the kind of the last 30 years broadly defined in terms of what is it that the microeconomics in terms of household analysis has been focusing on how have we been thinking about household decision making. And what that has implied for policy design, where in certain cases at least that hasn't formed policy design, drawing for instance from the CCTs and then talking indeed about the more recent kind of wave towards impact evaluation causal inference and what we've taken from that. And then subsequently what I'm gonna do is kind of thinking a little bit forward about kind of what are the next steps and next challenges thinking in particular and linking to Pete Lanyo's presentation earlier, kind of thinking of the long term kind of longitudinal studies where arguably when we think of development, development is not kind of one year, two years. It's something that kind of almost by the nature of the word suggests a long term horizon, yet when we do a lot of the kind of the current research is very short term. By the lot of the current research when we do these randomized experiments, we're thinking, you know, there is even studies looking at the impacts of three months, of six months, maybe one year, two years. And so kind of the question is how do we go from there in terms of longer term dynamics. And so, of course, the Palembourg study is a great example. You know, there's not that many of them but at least we should start thinking kind of going forward of doing this type of stuff, this type of research. Kind of thinking also about, okay, now that we have more and more evidence, kind of how do we go back to theory and but also back to policy linking a little bit to kind of the last point that Lanyo has made in terms of kind of thinking from the learning back to the bigger scale policies. And then I want to make a final point in terms of measurement. And there in a certain way, I think, you know, in micro, we've kind of focused a lot on causal inference and getting the identification right. In macro, I think there's a lot of discussion on measurement before there's a couple of cases in this conference on, you know, which one is the right, aggregate measure we should be using and how can we relate to them. A lot of debates there about measurement. I think in micro, there might be room for some more of that and so I'll come back to that. And as I said, I'll illustrate these points with evidence on CCTs in ECD. One thing I forgot is when I'm talking about impact evaluations, I also want to kind of make the link in terms of kind of in a certain way going back from what Lanyo was saying, where the kind of the development economics started from a multi-disciplinary way of thinking. We've been thinking a lot on economics per se but I think more recently, there has been also more linkages with other disciplines and that's kind of exciting and then that offers opportunities. Okay, so in terms of the last 30 years, again, broadly defined, initially, and again, the Palembourg study is a good example of that. Initially, the literature was largely theoretical, though motivated by very careful case studies and field observations. And gradually, there was an incorporation of more kind of more, it says here more rigorous, I guess what I wanted to say really is kind of more a little bit larger scale empirical analysis to test the predictions of the theory that went together with the development of the LSMS methods and household service more general, kind of the analysis of household data, how we take about it and thinking of the Deaton book that when I was a graduate student, that was the Bible that we should be thinking about and almost slightly baffled when I tell my graduate students about the Deaton book and they give me a blank look and I'm like, you know, how can you not know this? Of course, from in the beginning, there were some very well-known panels where there's the Ikrisat, there's the Palembourg in a certain way, data set that the lot of recent, a lot of the knowledge was based on those panels, which were relatively small panels, few villages, but a lot of learning from that. A lot of the focus was on household decision-making, which is broadly defined, although some work on intra-hostile issues, too, and I'm gonna come back to that. So just kind of to think of why are we thinking of households as kind of the unit of analysis in a certain way, and so this kind of go back to this idea that, okay, households in developing countries, in rural settings in particular, but certain also in urban, kind of act, make decisions, subject to a number of constraints that are linked to the market imperfections, right? And so this is kind of development economics 101, but I think it's worth kind of coming back to this for a second in terms of thinking, okay, why do we think when we do a household survey, why is that we collect data on education and help together with production and together with income? And why do we kind of, why do we think of these things together? And why does it still make sense to do that? Well, that goes back to the basic idea that with perfect markets, the consumption and the production decisions are separately, so we could just focus on one thing and do that well. With imperfect markets, we have insurparability, so the idea that the household decision in the production sphere depends or is gonna be related to the ones in the consumption sphere, and hence we need to understand both of these things, right? That also means that from a policy perspective, if you do these analysis to print from policy, we need to account of these different market failures because it could be that by moving one constraints, the other constraints become more important when we're making actually the situation worse. The other kind of key insight, I guess, of that literature and is that, you know, bit imperfect market as the denoments matter, so inequality matters, there's not necessarily the equity efficiency trade-off and again, and I think this kind of links to some of the things we want to think about the future, kind of the importance in a certain way of heterogeneity of those households and to what extent that informs the way we think about policy. And so the profession as a whole kind of took those insights and tried to advise policy based on that and so here I'm gonna come to the condition cash transfer programs because I think it's a good example of a place where we can be one that's very well illustrated, right? So the design of the CCTs, and I'm feeling slightly intimidated by having Santiago in the room, but let me try anyway, kind of certainly recognizes a number of microeconomic insights from the start. I'm just listing a few here but basically this idea that parental demand for children's health and schooling is going in these contexts is driven by a number of different factors and microeconomic stinking in terms of market imperfections really helps there, right? So there is kind of the issue that the private benefits for the child are better than the social benefit for the household and hence there is an argument there for intervention. There is the insight that was there that if you step away from the unitary household model that mothers and fathers might have different preferences and that hence targeting the mothers might have different results than targeting the fathers. There is the kind of the, in a certain of the elementary insight on at least for the education part that there's an opportunity cost of education that those children might be working that that income is important. Again, going back to the issue of inseparability of the consumption and the production decisions and kind of underlying a lot of the design, the idea that there is an asymmetric information on the returns to early childhood development so health and early childhood development nutrition during the early childhood period also about the returns to education to reproductive health care and potential and under investment from the parents in addition to all these other factors just because of an asymmetric information constraint and hence the focus of these programs not only to just give cash so kind of the idea here is that all these insights led to a very particular design of these programs, right? So this cash for the opportunity cost it's targeted to models because of the insights on the household it's conditional on the child enrollment and the health care to think about the issue of the private benefits and there is the, they go together with information campaigns on social marketing on the health care on the education part of things in order to shift behavior on the long run and I'm going to come back to the shifting behavior in a second. So as Alain Obelli kind of indicated so at the same time we have and going back to kind of the discipline, right? So you have gradually a move maybe not that gradually in fact to the focus on causal inference and impact evaluation and so basically here what has happened is that as development economists we've started first adopting and then adapting the toolkits for causal inference that came from labor economics initially on the one side and from medicine on the other side, right? And one of the things that I think that me has meant for the profession is that as a development economist we become partly development practitioners but in a very different way than it used to be why it used to be that kind of at least some of the development economists would be giving policy advice almost at the kind of the, at the highest level type of things they do directly with governments and derived from the models from the theory there were certain implications that we're deriving making a number of assumptions on the way now what we're doing is in a certain way at the very micro level we're on the ground and we designed the RCT and we are kind of we ourselves or kind of graduate students are on the ground to make sure that it's being implemented the way it was envisioned to kind of document how it's working and so in a certain way that has its pros and cons clearly but certainly in that sense it has become much more micro too. And then we started to test so within the impact evaluation part of things we started to test insights of all the disciplines so I think the examples of notching which has been mentioned a couple of times in the conference already is a key one but there's no economics didn't bring nudging to the table I guess but what we have done is trying to test the nudging in different sentics and see what it works. The other thing we've done is on the one hand and on the other hand kind of the behavioral insights bringing them into our models of imperfect markets where we say well there is imperfect markets but in addition to that there might be also kind of the behavioral constraints and we should be thinking of those things at the same time. The other thing we've done is in a certain way tests with those kind of bring economic insights to the testing or to think about interventions that traditionally were the domain of the other disciplines. So the de-warming studies that most of you probably know and indeed that have been a lot again in the publicity recently is a good example. De-warming is clearly not an economic intervention. The kind of the scientific insights come from medicine but what the economics literature has brought is kind of saying, okay, now let's think about this. This is a context where there are important spillovers where the social learning is gonna play in certain ways and they're clearly kind of the economic theory helps us think about the impact that the behavioral ways that people affect that react to these interventions help us understand better the impacts and the potential impacts of that. I think early childhood development is another example of that where the insights on early childhood development in terms of the interventions that would be things like nutrition and health come from medicine, come from psychology to a certain extent, come from nutrition but as economists what we can bring to the table is kind of a testing and then bringing it back to kind of the importance of the behavioral part too, right? So I'm gonna give one example here to be a little bit less abstract and as I said to talk more about what I actually know. So early childhood development kind of generally taught as kind of an important predictor of success through life, right? And in medicine and in nutrition evidence of the importance of these factors at the very early ages and small-scale experiments or small-scale interventions that have shown impacts in terms of nutritional supplements in terms of simulation programs, et cetera. What is less known, so a lot of the initial interventions in a certain way in this domain were very supply driven and again the parallel with CCTs in a certain way comes there but so what the doctors would do is they give the micronutrients to the child and they see what happens or they would send a social worker or psychologist to the household to stimulate the children and see what happens. Now arguably kind of if you wanna think about this on a large scale of kind of how do we do this and kind of clearly the parents would need to play a role and so there the household decision making that becomes important and how the parents make decisions about this part of the human capital intervention. So this is evidence from, in fact this is evidence from the impact of a conditional case on mixing your two things. It's the impact of a conditional cash transfer program on early childhood development. This is data from Nicaragua where it's a somewhat unique experiment because the CCT there, one CCT, there was a particular pilot lasted one year, right? And so what we did and this is the context where the children would be children zero to six years old with large delays in ECD. And so what we see is that during the program you have changes of the additional cashier additional nutrition that lead to kind of an improved cognitive development. More importantly here is the blue line, the blue dots which is two years after the end of the program. And two years after the end of the program we still see better cognition and better social emotional development. And what's the story here is something kind of again this is what kind of the economics brings here to the mechanical issue of the nutrition is that during the program, this is not during the program basically the angle could change. So it's true that the households had more income but it's also true that again the money was given to the mothers and it came with a lot of information campaigns. And so basically the angle curve shifts for the same amount of income they're no investing more in this case in food. And so in our interpretation as a result they key and so sorry, that's the next one and they keep on doing this to a lesser extent but to a certain extent still they keep us and significantly they keep on doing this after the program ends. And so what do we see there? We see a behavioral shift that has that kind of a behavioral shift in the risk factors that the other sciences explain us but that is there sustainable and that hand suggests something that economics can bring to the table. So that directly related to the ideas for kind of the ideas I wanna focus on for the next 30 years. So basically kind of the first part is this issue of the sustainability of impacts I hinted at it already kind of moving from the very short term to kind of the longer term both in terms of impact evaluation in terms of household dynamics more generally I'll make a point about going back to theory and other types of policy and then measurements. So let me kind of borrow here from some things that from a kind of a statement that Joe Staglitz made in his talk saying kind of development is about the transformation of societies about changing norms changing people's attitudes. So kind of the evidence on the ECD part I just show was kind of a suggestion of a changing in attitudes or a change in the investment behavior of the households. It's also kind of true that when you read this kind of obviously this is not about one or two years but transformation of society sounds like it should take a while. And hence if we wanna think about studying this then we probably need to think of longer term studies in a certain way going back to the kind of the idea of the initially crisis data where you would follow households for a long time. Now the good news is that the first RCTs are now about 15 years ago and so we can actually start looking at the longer term impacts I probably shouldn't call this long term. And on the one hand and on the other hand that we have more and more nationally represented of original represented data sets that are panels that are being constructed that have high quality and that allow this type of work. Of course it comes with different mythological challenges in terms of attrition but also in terms of mobility and in terms of thinking about in a certain way the dynamic parts of inequality. So let me give an example more than kind of the theory. And so kind of I think what the longer term also allows is to think and kind of look at more final outcomes. So going back to the condition cash transfer programs and again this is data from a different CCT in Nicaragua where there is two, it's experimental but the unique part of this experiment is that both groups got a program but some got it earlier than others and what we are doing here is focusing on a group of kids that arguably got it during their key years in primary schools. So basically when they were about to drop out compared to those that got it a little bit later and so here we see learning once we focus in on the right ages that we would expect to see differential that is there in language and in math more importantly and kind of going to the long term here we see changes in the labor market outcomes. So this is kind of just a non-parametric so this is the off-farm earnings. Per month, they are still relatively young they're only 90 to 22 years old but there is a shift here that is significant and that is depending on the estimate between 10 to 30% of the off-farm earnings. So not peanuts. Now I think so this is kind of directly related to the next step, you can say okay this is Nicaragua it's a specific program, it's a relatively poor country in Latin America, how can we generalize from this and more generally when we do these RCTs how can we generalize by onto specific households that we study. So they are small and then this is kind of going to the debate that I was talking about where these RCTs are small scale they are about a very defined population and so this is where kind of theory can help us because going back to these kind of taking these estimates into structural models and then thinking about the redesigning of these policies and I'm gonna jump because I'm running out of time but just making one point here about measurement. So we focused a lot, we are focusing a lot on getting causality, right? So we're interested in the impact of X and Y and that is very difficult to do when we don't know how to measure X or Y or when X or Y are measured with a lot of problems, right? And I think that the importance of non-cognitive skills is a very good example there, you know if we believe Hackman and others non-cognitive skills should be very important for success in life. In developed countries we measure these things with things like big five surveys, et cetera. When we do this in developed countries those questions are obviously not made for developing countries and hence we might not find anything but we might not find anything just because we measure it wrong because there is nothing and so the zero result there is a complicated zero result and it's something we really need to think about. Of course there is other questions about biases and errors in household surveys. There's a lot of perceived wisdom in this domain. My people, every development economist you talk to will tell you this is the perfect survey length and the order and the scale that you should be using. There is very little hard evidence and so as much as we've been very rigorous in terms of identification I think there's a lot of things to do in terms of rigor, in terms of what we observe and how we measure things and there also I think kind of other disciplines can show us a little bit more than what we've been doing. Thank you.