g to open it yes so okay let's tilt this down and then we'll watch it okay go ahead uh something like that you just cut off a leaf particularly and usually do generally use a bit an inch of it an inch and a half of it at a time cut off that wee bit yes and cut it apart okay and you can see that the inside was covered in gel oh can I have it yeah absolutely but that's why that's actually very gooey yes but it's absolutely brilliant for any sort of skin conditions or if it's actually for sunburn particularly this time of year that's brilliant there's no particular smell of it now yeah but no i'm smelling that i think i'm smelling the actual structure of the plant yeah you could rub that into a burn sunburn exactly first your second degree burns yeah like you scald in the hand or something like that there's perfect for it heals generally cuts even as well it's really running now it will heal a bit nine times quicker than normal stuff you know yeah so but sunburn particularly is very good for soothing it and treating it a bit right and is it a moisturiser as well yes absolutely so it's supposed to have a lot of beauty products made out of it yeah there's no smell off it actually no it's your aloe vera smells it's scented yes well what do you call it but no it's there's no no real thing of it but no it's absolutely brilliant plant to have about the place so it is and this bit the excess bit of the leaf yes you can actually leave in the fridge for up to a week just wrap it and cling film stick it in the fridge so that that plant that you have that we're looking at here it's got like one two three four five six seven eight well it used to have nine kind of branches to it right how quickly does that return or grow I presume it's a slow grower of it it's quite a slow grower but that they will grow to about 12 inches or so so we can actually just cut the ends off them yeah wouldn't be so bad but they also also reproduce but put the re-side plants and you can actually just add certain time of year just take them off and replant them into their own separate pot yeah and they'll be happy to grow so in just cutting that little bit and it's really it's it's got a constituency to it with that I wasn't expecting is like a moisturizer yeah that's a real jail and it's not really liquid so even yeah exactly um so you could just rub that straight on then yeah exactly you're not going to rub it onto the affected area and and just keep rubbing it because I presume that the leaf is sodden in it as well because it's going to soak up that's the way they store their water basically in the desert conditions um and no problem growing those indoors in this country yeah yeah exactly that has to be indoors it won't stick the frost outside but they love it okay oh absolutely yeah and how old is that plant that you have there would be suggestive maybe two or three years old yeah I would say it's quite uh octopussy looking isn't it it doesn't but alright it's very very desert looking it's going to want to get cactus all right okay brilliant stuff all right uh 08 660 25 000 one second here 08 660 25 000 if you wish to get in contact with us right moss on the lawns is is is going to keep coming and I can and I and I get that because people are you know they're well into the sort of the probably on the third cot at this stage right and they're still seeing the blade goes down and that's just under the carpet yeah you're into the carpet there now so what what can people manageably do I wonder to address the problem probably the easiest way of dealing with it is to hire a scarifier as a machine just hire it and go over in that pose actually the moss from between the things yes any bare patches then treat with um treat with grass seed because any where you leave a bare patch is going to the moss is going to recall this basically but to be honest going back to your point earlier in terms of lawns been sort of dry and under stress I would nearly leave it at the stage until we get a bit of rain yes because you're gonna and you're actually ripping ripping at the lawn about yeah while it's under stress you don't want to be more stressing it basically and do you think we're too frosty maybe sometimes too a little bit I don't mean that nicely like I mean I kind of come to terms with what I have in front of the house it's never going to be a bowling green do you know what I mean and it's short you can kick a ball on it you know that sort of I suppose it's just what what people are into basically some people expect a pristine lawn to be honest my lawn is far from it the more cloverant than anything else but like say it's green you cut it every so often and you can do wins play away at it that's everybody's happy enough no more may no more may yes very popular there has become more and more popular so it was such a success for me I'm actually going to do no washing up June oh excellent yeah so and I can't wait to figure out what I'm going to do in July you've just got to justify it to yourself but now the no more may is actually a lot of people have embraced it and I see a lot of like areas within housing states and stuff you see the pollinator signs up on that so apparently it is very beneficial it is kind of interesting because I did notice that one local multinational has adopted that approach right it's kind of like wildflowery stuff but they put a sign up to state that because I presume they don't want people to think that they're neglecting the property exactly so it's kind of a double advantage to seem to be doing something for the environment but at the same time they're saying it's not that we're lazy here it's just that this is what we're doing yeah I see that's it I mean it's coming to terms really with the fact that it's not going to maybe depending on your what you like it's not going to look as nice as a lot as a as tightly cut grass yeah pretty much but a lot of people are sort of like big companies especially they're trying to offset carbon and stuff like that so suppose any wee bit helps and it saves them on maintenance costs as well Neighbours cat coming into my garden from next door what do we do about that yes cats cats can make huge problems sort of be divisive between neighbours and stuff generally there are a few sort of repellents you can get and actually the last time I was on you were we were discussing this fantastic I have a poo for every okay okay exactly so the new one I've seen online actually it partly works very well is lion poo lion's poo yeah basically you can get essence of it now you buy it online and spread it about and the theory is that the cat actually smells that there is a predator about or a lion about so he says oh there's a bigger fellow about here the meese will stay out of that so that really is because I mean obviously a local cat's never seen a lion that really gets into sort of you know yeah apparently it's in their DNA in their DNA that's exactly it right so how do you source lion poo the minute I've only seen it online now but it's I suppose it's distilled and that's how I was going to actually get a jar to bring in if I had was very expensive no we'll stick with the aloe vera plants if that's all right yeah so I'm going to go bought them the thing about that do you know the repellents you can buy a certain garden centre's hardware shops they're based on citrus fruits yeah I mean cats I mean you can you know you take them a cat and it's house pets and all that but I mean by nature they retain it's not like a dog like a cat does retain an awful lot of its instinctive behaviour doesn't it absolutely you know what I mean I'm not sure really you can train that out of them as such you know they go off and do their thing and all right no funny I actually the whole lion poo I had a million dollar idea one day there go on the biggest problem we have right here is deer gardens and I thought I wanted a deer be afraid of a wolf or something like that the wolf poop that's exactly what I thought oh yeah I chatted to a wolf expert because it wouldn't work because wolves have been gone out of the environment for so long yeah but look how long lines have been removed from cats true true so it's worth it I mean there's a wild ardent yes that's it was him who was talking to you oh him right oh well forget it then so but no he reckoned he reckoned it's out of the it's out of the deer's DNA recognize what a wolf is right okay be fascinating though to get a bucket of it wouldn't it absolutely because deers are the main problem people's gardens around here at the minute really unbelievable yeah it is thousands for young trees and stuff yeah but getting back to the cats the thing I've found most reliable would be just basically get the hose or get a water pistol yeah and if you see the cat coming in discourage it just exactly and sort of he negatively associates your garden we're getting wet and if you keep that up for a bit a week and also it's not easy for people that aren't there all the time but once he gets that negative association he'll find somewhere easier and more pleasant he'll choose the path of least resistance exactly yeah I had a load of flowers on my apple tree but there appears now or they appear now to be falling off so no apples appearing what's going on there yeah it would be natural for the flowers to fall off and generally what what should have happened was that the flower could pollinate us and then that sort of feeds the seed that's behind the flower so given another few weeks you might see the wee apple starting to form so it's not it's not over yet it's not lost yet yeah okay so it's not but if you don't as possible there were didn't get pollinated enough so it might be an idea to actually just maybe introduce another one next year I'm trying to grow a hedge planted it earlier this year should I put grass cuttings around the roots so keep the roots clear of all grass I would tend to keep the roots clear of all grass generally if you bought a plant there someone like poultry manure someone would get to put on it but what can happen is the grass cuttings become sort of very stodgy and very they'll retain a lot of moisture and if they're up against the trunk of the plant I can actually sort of rot the bark of it so now I would tend to leave the grass cuttings fairly well away I'm trying to do a bit for wildlife and I'm wondering at the moment I've just left a patch of the garden on cut but should I plant some type of flowers or plants in it? Yeah well generally what you're doing if you actually read on a lot of stuff the best thing you can do for nature is to do nothing yeah so just let it go and let whatever natural flowers native to your area come up so chances are just leave it the way it is if you want to make it a bit more attractive you can introduce some stuff but generally you're doing your bit by doing nothing relatively speaking because we're talking about something that's not important but I'm tortured with little white fluffs coming off trees they're blowing into the back of that as they're sticking to everywhere you know everywhere there's a cobweb they stick in it they're sticking to any furniture that's there what are they? Do you know what you're saying you're probably thinking it was a dandelion no they're coming off a tree it's like a tree with a white flower on it they're coming off Sallys or wolves right I would say yeah they think we can be quite sticky all right then things then and is that how it populates the world with itself pretty much that's what I got back about sort of March April forms these we sort of yellow catkins and the white fluffy bits come off but I think that is the seed distributing itself or less but they seem to be more like I've had it in the past but it was like for a short period of time they've just floating around the place now for weeks on end yeah I suppose I would say what happened there is we have had no sort of big sort of spring storm or such yeah wind and it wouldn't come along and clean them off in one day whereas now it seems real because there's been no one that's just sort of prolonging the process any advice on growing gooseberry bushes and a blueberry bush we used to have them in my grannies and I'd like to grow them for my grandchildren what's the best time to plant them best time to plant them once again garden centers have them now in pots so you can plant them any time of year probably I'll don't have to plant them just now because it's very hot if you know what I mean but sort of getting into August September would be a perfect time to plant them they're hearty aren't they you know I've seen them next to the sea you know producing grapefruit yeah the gooseberries in particular yes gooseberries are actually very easy to grow they won't grow pretty much anywhere and you could plant one in any stage of the year the blueberries different kettle of fish it's an ericaceous plant it actually doesn't like lime sort of makes real acidic soil sort of the their natural habitat would be baggy ground and pete ground which done it all should be quite good for growing them you know but so if you're planting a blueberry bush it'd be important to get a bag of ericaceous compost to put around it what feed would be best for a cherry blossom tree a cherry blossom tree probably once again your poultry manure just a generally but well balanced fertilizer something with an NPK that's sort of fairly regular like 777 which the poultry manure would be but generally something that's got to be organic as well and I think it's fairly balanced that you're going to sort of feed the the whole aspect of the tree and the the whole aspect of the tree and the flowers isn't interesting well actually and kind of timely because it is the first of June I did no more May and as you can imagine my lawn is like a mini jungle for all the bees etc June has come so what's the best way to tackle it mow without a bucket on and rake it up stop start what I do what I've done is actually stick it at its highest height now it depends on how long it is stick it on its highest height and you have to go over it a couple of times but I don't know is there a better way to do it pretty much if it's very long what you could do actually just go in very high with a strimmer or something actually strimm it off quite high like you're chatting maybe six eight inches up and then take that stuff off I think going without the bucket you know without the the collector at its highest setting it might be alright but the thing is now that now it's so dry this is the optimum time to cut it because the grass is actually less bulked or less moisture in the grass yeah because sometimes when I've had to cut it when it was high the ground the grass is always got some sort of a moisture to it in the ground and it gets very buggy then and it sort of mulches yes the grass into the because like the heat doesn't get to the bottom of the grass so it's going to be naturally wet anyway so if you cut it at the highest setting maybe left at a day yeah and then actually cut it lower yeah it's going to take a couple of days so take the long way just let it dry out as you go alright okay may I ask what happened the mantanas this year no flowers at all I cut it well back thank you yes a very good question because I actually my next door neighbour has actually lost hers as the climatist Montana Rubens she's lost hers I think it was a frost and mines is looking very sad of itself so it is now um I think there's a very hard frost just before Christmas and I think that's what's done for them and they're sort of struggling to come back basically but they're not performing anyway like what they should be yeah so one event can disrupt absolutely there's a very sudden frost just a bit of week before Christmas seems to have destroyed a lot of plants even the card lanes around the country a lot of them are destroyed as well right okay listen we better just talk about watering then because there's very little air moisture either yes just briefly so whether your stuff's inside or outside as they say not everyone has a garden some of we balcony or just the windowsill or a place by the by the window in the kitchen whatever it might be they need a lot of water at the moment because the the the soil it will dry out and actually when it dries out if you just pour it on the top sometimes the dry soil can repel it to some extent so we have to give it a little bit of extra attention to our little flowery friends exactly so now generally the best time to water is morning or evening if you do it in the middle of the day you're scorching the plants and the water evaporates too quickly so generally if you can do it morning or evening and at this in this sort of current heat we've definitely pretty much bedding plants that every day and generally get in other plants in the garden get into the habit of checking them sort of pretty much every day if you can and if it's a newly established plant definitely watered every couple of days all right Colette McCrae is out in Saloo and she says good morning Greg from Sonny Saloo yes lovely spot okay well I'm looking at the so it is I'm looking at the way the forecast here 22 degrees and cloudy but it's Sonny cloudy do you know when there's a half a sun behind the cloud so I'm glad you're enjoying your holiday Colette if indeed it is a holiday but I'm looking at the window here now and there is not a cloud in the sky and there is no wind and I think it's probably around about 23-24 out there right now so Colette whilst normally I'd be very envious of you on this occasion I'm envious probably at the pool exactly imagine watching me and you at the pool in Saloo surely there'll be better things no never all right okay but we're matching you Colette for the weather just at the moment but enjoy your break it is indeed a holiday and it's great to have you on yesterday in the polytunnels was 45 down the garden isn't it lovely it's like being in Dubai yes exactly as grand if you weren't working all you needed now was a bottomless brunch yes exactly and you would be in Dubai listen thanks very much Paul Paul McLaughlin at Balakdur garden center all your bed and plants and everything all ready to go and all that yeah pretty much all gone the stage all gone all right pretty much well that's been a good season yeah that's a lot of work got them to that to that and a lot of money yeah a lot of money okay good I hope yeah I hope it worked worked very well for yous Paul McLaughlin gardener there at Balakdur Garden center he'll be back with us in a few weeks or a week or two weeks having a clue but for now he's away and we'll be back with more after this break the county's number one talk show the 9 till noon show on Highland radio this summer enjoy the tastiest burger in town for less at Kelly's Diner letter Kenny with Jake's famous burgers there's your choice of burger beef chicken or veggie all freshly prepared with your pick of delicious toppings and sides selected burger deals every weekend find the best value burger in town Jake's burgers at Kelly's Diner mountain top letter Kenny Mark Paul Mooney we reveal how farmers will be incentivized to DNA tag animals find out how many farmers applied for the new suckler scheme in your county fears grow that rewetting plans will devalue farmland department moves and hedgerow removal rules as summer silage sizzles we examine rising diesel prices and Ireland leads the way in sustainable farming read our exclusive interview with the EU commissioner for agriculture all in this week's Irish Farmers Journal on sale now Oak Fest the family friendly music festival is back for two days September the 9th and 10th at Oakfield Park on Saturday join the legendary Susie Quattro the lineup also includes the Bay City Rollers the Davy Kay Project the Whaling Banshees and local favorites Sheer Buzz then on Sunday there's Boys Life with Keith Duffy and Brian McFadden Lisa McHugh Anor Rory on the Island and more Oak Fest Saturday the 9th and Sunday the 10th of September at Oakfield Park we'll phone tickets now on sale at OakfieldPark.com Highland radio time checks with Expressway travel route 32 from letter Kenny to Dublin when you book online and travel for less Expressway bringing you the time us radio 27 minutes past 11 I want to say a big happy birthday to our Judith Wilkin in Drumada who will be the big 50 this month from your fabulous friends okay any chance oh that's something else let me see here hi could you please wish Bill and Breed Porter from Montcran I'm happy a massive happy 52nd wedding anniversary love from their daughter Nairene and the rest of the family thank you well done be Bill and Breed would you be able to reach out would you be able to be able to read out the following about the Church of Ireland church farts taking place this Saturday the 3rd of June at the church grounds and hole in Kilmackrennan okay get along to that if you can Padda McDade in Brocker in Chrysler happy birthday from Granny Grandad Aunty Bridget and Godfather Lurkin Padda McDade have a wonderful birthday there uh good morning Greg just seeing the one-stop man thumbing out the dual carriage where you think he's heading for dairy no that must be someone else it's not our guy he's not that unamated what about the road from Balabafe to the cross it's in terrible condition since Irish water put in the pipes indeed hopefully that gets sorted sooner rather than later I'm after waiting on the phone to the Intrio office for near 30 minutes to be told they can't help me it's a total disgrace you can get a contact number for a local office instead having to talk to the national intro office I misplaced Son's appointment letter to get the PSC card was trying to get time for it he took day off from apprenticeship to get the card for a theory the lady said they will get back to me by email but she said it won't be today and sorry I asked her can I contact a local intro office and she said they have no contact only by email they can be contacted it's a total disgrace how people can't directly contact for local services I'll go up later but for something so simple they make it so complicated now I had to register for a PSC card recently and I just called them in Donogholtan and set up an appointment now the appointment wasn't until the following week I think I called in a Thursday but I didn't speak nationally on the website if this is to if I'm if I'm on about the same thing I just called Donogholtan and there was a list of numbers for all of them a caller says maybe all this money that we are flushed with in nonexistent these multinationals that get huge tax cuts and low interest rates are of getting away with everything and the workers getting hammered why increase everything across the board when we have so much well you see the problem is is not the problem but the reality is is that all our excess income in this country that none of us see comes from multinationals that are invested here and it's a tax on their profits and if I think two or three companies make up a huge proportion of the excess income coming into the country the government's coffers are swollen they're swollen it's not a it's not a myth or a theory they're swollen with cash but it's just some might say not filtering down to the man and woman on the street I agree with you Greg why did the council hand back surplus money instead of allocating it for more houses for the community and the mica people and why they added three million to the funds at Donary Fort instead of helping the housing situation I can't work it out thank you I get you and I think maybe you've text on this Donary thing before and I've said my feelings on that in the past look at it's not about saving three million from that project and all of a sudden it fixes the mica crisis it just doesn't work like that well Don Greg I'm putting it to Thomas Pringle about taxing Airbnb's the housing crisis is of the government's making it's a pretty our national broadcaster doesn't ask hard questions it seems they're afraid of offending their masters well you see what happens sometimes is if you ask hard questions people refuse to be answerable to you or the general public of Donegal isn't it strange so maybe that's why RTE doesn't ask hard questions because when I do ask hard questions certain people run for the hills and won't speak to the people of Donegal that elected them so anyway that's just the way it is I'm prepared to if that's what happens that happens but I'm here to represent the people it's not I'm not self appointed in doing so I'm on about ask the questions that affect us all all right so maybe that's why the national broadcaster doesn't because they're afraid that they won't get their minister every other day on to Morning Island I have no clue right okay we are going to be talking about the water situation in Letter Kenney after these watch the show live now on youtube facebook and at highlandradio.com for the biggest names into perfume and aftershaves visit McGee's chemist Letter Kenney Dolce and Gabbana Paco Rabanne Carolina Herrera Calvin Klein Jimmy Chu and Burberry Ariana Grande Jean-Paul Gaultier Vera Wang and many more from timeless classics to celebrity favorites there's a perfume or aftershave for everyone at McGee's chemist Letter Kenney and online at McGee's.ie 30th of June and Saturday 1st of July get your tickets now at BunkranaMusicFestival.com who said electrification can't spark excitement from introducing Arland's first EV to redefining the family car Nissan has always led from the front and now we're breaking new ground once more with e-power Nissan's unique hybrid driving system fueled by petrol driven by electric no need to recharge giving you the pleasure of electric driving without the need to plug in new Nissan Kashkai and X-Trail with e-power drive it to believe it at your nearest Nissan dealer Nissan innovation that excites don't waste time have your say on the national waste management plan this plan by the local authorities of Arland sets out a path for our transition to a circular economy to reduce pressure on our natural resources increase reuse repair and recycling and promote sustainable growth we want your view on Arland's plan go to mywaste.ie at Centra feel good and shop smart with great offers this long weekend like inspired by Centra's Sirloin steak 440 gram only 8 euro selected chocolates soft drinks and hunky dory sharing bags any 3 for 5 euro and Centra retail 120 selected range 8 euro each Centra live every day enjoy alcohol sensibly the reverend Jim Lamont presents an evening of music and song an angrily theater letter Kenny on Friday 9th of June at 8 p.m with UP and Maria Doherty Deanne and Iona Holt Deanne Lecky Andrea Long Amy Mehan and the region quartet tickets 15 euro on sale now from the theater box office proceeds in aid of the Dunnegal Hospice and the evening of music stories and a Dunnegal farewell at angrily theater letter Kenny on Friday 9th of June okay Amanda joins us on the program now she's uh living in the bottomy area of letter Kenny thanks for taking the call Amanda good morning Greg nice to speak to you right you've had problems with your water supply talk to us about the problems the outages and and your interaction with Iska Heron aka Irish Water so I suppose we've been having these problems for going on three and a half years now but most recently in recent months they've got really bad we have had outages in the last month for nearly every second day if not nearly every day sometimes and I know that you had my neighbour on the show a couple of weeks ago now in saying that for the last two weeks we have had no water outages at all so it's just it's miraculous really um but for the last three days since Monday morning our water went off due to a large burst in Lisbonna and I believe but it still took 48 hours before our water supply was restored so where there is an outage or a burst it seems to take that length of time before it gets to to our properties and our neighbouring properties so this situation has been on going for three and a half years but certainly deteriorated for the last couple of months and it falls on deaf ears whenever you contact Irish Water I used to ring them I stopped doing that now because you just spent so long on the phone they ask you the same questions it's just the bureaucracy is is unbelievable I email them now instead and you just get these generic text messages from them but I have lots to complain with them on numerous occasions the results of the most recent complaints then came back on to basically tell us that we're on our own financially we have to sort this out ourselves so they never talked about any future investment any future plans they're saying because of your location that they can't presumably guarantee a water supply and for you to try and source or invest in one for yourself correct yeah they said that they had a field engineers investigation carried out and that there was no operational solution on the ground now let's point out we are connected to the means planning permission was granted for our property and Donegal County Council were paid a water charge for the connection to supply water to our property and to all of the other properties on our road but to say that there's no operational solution is just it's infuriating and it's a slap in the face for us when you know we've been through so much trouble and we are really at our what's end we have children we have our house just shuts down when there's no water supply but what they've told us is that we need to invest privately ourselves for private water storage and for pumping systems okay that line is failing us it's awful yeah I mean there's a human right to water though and sanitization so they're effectively saying and they are an arm of the state and you paid your water charges to get connected and everything else as I say it is human right but they're saying it is not their responsibility to provide you with an adequate water supply for you to do that yourself that's really unbelievable it really is unbelievable I mean we were totally shocked when we received the email and we circulated it among our neighbours and you know apart from taking to the streets we just feel where do we go from here our house and our neighbours houses back onto a forest that the forest is only about 15 feet away so if there was a fire particularly given the warm weather you know it's there actually isn't any fire hydrant visible on our road either so that's another issue that we have with Irish water which is besides the point but it's there's a lot that's wrong with all of this and we just don't know where to go now after this no and I think Irish water can't be let off the hook on this either stay where you are Amanda the mayor of let it Kenny municipal district is Councillor Donal Mandy Kelly I mean I've heard a lot of things attributed to Irish water but nothing like this before Donal I mean it's a dereliction of duty is it at the very least that's absolutely unbelievable Greg that's what it is that's ridiculous and that's this is the firm that that the talks is about that their duty go over four less fall control of the weather supply with unbunny goll and the county fat matter and for for any residents and in particular for Amanda and I want to welcome her on there and they can be fully engaged with Amanda and the residents there of Balmoney Newmills Cornwall Tully gay and these people are suffering day in day out as Amanda every second day was there without water and we were in 2023 and this carry on or still go wrong and absolutely ridiculous and as well as that too if Irish water are not capable of maintaining the water network which Amanda is connected to well then we need to make sure that they do not take over the running of that network because by their own admission they can't fulfill that commitment So it's not a doubt Greg and Greg you're fully aware this is something that I'm very vocal on I've had my way and I'm pushing as hard as I can Irish water would not be taken full control but listen I feel myself Greg and there's come to a point that I have had a wall and you know for Irish water they come back with a response to arrest and such as that that the more they have to put their hand on their own have pocket to resolve this problem that's absolutely shocking and I mean Greg we have TDS there as well and Dahl, Aaron and Dublin and their actors and I feel they need to be making more noise of this as well because they're too quiet and much to go on here and should Irish water get full control of our water here within the county of Donegal that's going to be nothing less of a disaster it'll be a catastrophe because I feel I mean we have great men on the ground here within our own local authority that is more than one I'm trying hard to get all these problems resolved within these areas that we're talking about and again and Ross Bracken there as well and an issue that I went to as well there as well as the reservoir and our Dahl where it's being leaking come the heavy rain there and I mean they're not lost and they're not coming out they're not getting these problems addressed and as I say Greg and I can't see it highly enough of our own men that don't go county council they are doing their damnedest but just on the point of on the point of national representation I mean obviously you have access to a minister's office in Minister Charlie McConnelogue what is have you made contact with him or his office and what's he going to do about this issue because he's the most senior politician in this county I have Greg I have and I've been fully engaged with Charlie and Charlie and Charlie our minister has pushed him very hard on us but Greg I'm going to state it again there's not more than Charlie McConnelogue in this county that's in Dublin and Charlie McConnelogue is doing as damnedest for me I'm in contact with him and his office very regularly on us but I'm yet to have a call or engagement from any other TD that's representing the people of Donegal and that's something that I find about alarming and that's why I would like to have more engagement than the rest of our TDs within the county have them come out and be vocal on us as well we can't we can't offload everything on there Minister Greg you know at the end of the day there's a lot of other issues that he's trying to resolve as well and you know we have other TDs there and I think everybody needs to pull their own weight on us be vocal get out and get the points addressed and hold Irish water accountable because what's gone on here that's absolutely shagging all right well I mean Amanda separate from the political side of things at this stage you know what I mean this is everyday life for you you just want a resolution to this and it seems a bit hopeless at the moment I mean what can we do to better hold Irish water to account I mean I want them to release to us in a press release what they said to you that I think it should be publicly on the record to a media organisation that they are saying that it's not their responsibility that it's down to residents to do this and then we need to start talking about getting your fees restored to you if that's the case because you paid for a water supply they're saying that they can't provide it so you know what I mean like this this opens up an awful lot of avenues that we need to pursue here Amanda absolutely I mean we certainly don't want to give back the fees we just want our water supply yeah but you know what I mean if they're saying that they can't do it you know what I mean like I'm not putting words you know like yeah absolutely no we just feel hopeless we really do and it's just it's fine when the water is back but then once the water goes off again you know everyone is just put it back into the same position again we all have young families we have lots of things to do in the house and connected with water and as I say our house just shuts down I had to replace the dishwasher two weeks ago because the one that we had just cut out because it was been starved of water and you know these are the practical day-to-day things and the motor burned out it could happen to an electric shower you know you're heating then you wonder can you put it on or off or on and all that stuff okay well we're going to make our inquiries to to irish water as well Amanda with a view to to as I say at least getting that shocking statement from them on the record as well as I know they've already informed you of that and from your perspective Councillor Kelly what can you do next do you you said you feel you've hit a brick wall on this issue with irish water well yeah I may have had a brick wall but I'm not going to stop to get through it I can assure you that I mean for irish water to turn around and say that that there's no that they can't find a solution there's always a solution there's always a way around things and I have no doubt in my mind there's a solution to this as well and irish water needs to get the finger out and get it resolved and and I mean as Amanda stated there the water Boston and the smaller one now you could have been a factor to this but outside of the Boston and the smaller one Greg this has continuously been going on and I feel personally myself this is only my own opinion but I feel that the infrastructure that's in place there within them areas is not adequate enough to do the job it should be doing and on top of that I feel that the reservoir up around the speed in these areas is far too small now to hold the capacity of water that is needed for something like this I find it amazing that irish water can pump water from the eddy fulettan dam in Anishone all the way down that road in across the dual carriageway up and into homes in letterkenny and they can pump it all that way and that is the future of development in letterkenny seemingly but they can't get water from a local reservoir up to Bonomy I mean that is just bloody remarkable to me Greg that's just on that point and I mean that's the point of time to make I mean at the end of the day you know you talk about the development that irish water is the elephant in the room here you know that's not only what the supply that the control of that's why the connections that the cost that they're pulling out of the sky is unbelievable you know our construction our planning you know that's all revolver in irish water and make no doubt about it all right you know that's the fact should irish water get all controlled I think there's housing developments that are being refused housing developments in the show and are being refused because there's inadequate water supplies so your point is is there and mate Amanda thank you for joining us I appreciate your time Jackie I'm not sure it's you're in the conwall area and you've kind of pretty much got the same message from from irish water it's like you know there's nothing we can do tell us the situation with you Jackie yeah Greg I just probably now going back over a year and a half we start contacting them basically every weekend we have no water it just stops no pressure you see so there's Saturday Sundays you'll go for maybe most of the day without any water washing machines nothing's you know nothing's working and when we contacted them you know we were just logged a call and given a residence number kept ringing them back got no got nowhere with them basically said to us you know user at the end of the line we use our and that's it there's nothing we can do bar putting in maybe a pressure pump somewhere along the line but it's just gone over so and that's it I mean you know you sometimes you can go right well I'm going to kick up a fuss and maybe make some progress they've effectively said that's it so in terms of solutions I just can't understand like moving water that they can't put something in between you and where there is decent pressure to get it further up the line that probably is a solution to Amanda's problems as well like it doesn't it can't be beyond us from an engineering perspective if they wanted to Jackie and I wonder is the the wills not there it doesn't seem to be it doesn't and you know it's very frustrating you're getting nowhere and you know he spent hours on the phone waiting to hear back from somebody in these places and trying to get through to them it's disheartening and I mean you know I mean like everybody else you need to line your water supply but I know I know Donna's looking into it and that it's just but it's very frustrating and this has gone on like every weekend and you're on the week as well when you're out of work you don't notice it as much but when you're in the house you do yeah and Jackie too it's not just the inconvenience it is the dishwasher the washing machines the showers it's the value of your property as well I mean this is probably your fear for every home but say you wanted to downsize or move somewhere I mean you know like you don't have a house with a proper you know what I'm on about like this is really impacting the value of your property and your lifestyle you know what I mean it's not just an inconvenience we invest in a huge big tank a new tank because just to have you know so it would fill up and you'd have that for the showers but the mains like that come in for the rest of it that's that's still an issue yeah you know yeah okay okay Jackie listen thanks for that as I say it's frustrating normally like to see the wood for the trees or a solution or something we can do but for Jackie and Amanda Donal it does seem a little bit desperate helpless you know and the problem is is getting answers from Irish water they seem to be especially for a semi-state body they seem to be a a lore into themselves in terms of whether the answer you or or meet local councillors or speak to the media that's unbelievable Greg and you know I totally understand the frustrations of Jackie, Amanda and every other resident out that area I mean the state there about the responses are getting from Irish water it's hard to believe that Michelle and my colleagues as local representatives that's the same responses that we get you know and it's absolutely shocking and you know I'm a firm believer Greg in common sense and on this day and age and on this issue here common sense seems to have gone completely out the window and I mean it's time that Irish water all the upper sleeves come out and get this resolved once and for all because these people's paying their taxes they're paying their water bills they're doing everything right and they deserve to be treated in the same manner as every other citizen was on the country and that's not happening and it's not good enough all right and thanks very much for that councillor Amanda Kelly as I say access to a good water supply is a human right I don't know if this is something that actually needs challenging in the courts or something because obviously what we're doing already is not working but I mean can Irish water because there's a they're bound by you know code of practice or what have you I don't know exactly what the terminology might be but is it challengeable in the courts Liam before we take a break Liam good morning to you what's your experience well I mean the experience of everybody is is that Irish water is set up not to be contactable not to respond it sets up would you have to go through central call centers or emails and they simply don't respond and if you do get anybody that we passed it to the local operation so you don't know where it's hanging up and Irish water was created for one purpose it was created for Enron off the book accounting of all the capital that has to be spent to do up the water system you know that was the only purpose of it because if it could claim that it was a commercial operation the debts wouldn't go on to the state accounts so that we would keep within the 3% normal EU limits that was the only reason it was created it was for finance purposes and for what is essentially false accounting which was allowed under the system the function doesn't exist anymore relied on water water charges to do that there are no water charges so it's it reasons for its existence have disappeared so Irish water should disappear it's a disaster and you believe you believe that the responsibility should return to the councils and that they should be properly financed in terms obviously of the infrastructural financing and staffing financing to address the problems locally I don't think the council would get away you see it's interesting because I don't think the council could get away with saying that it's not our problem we can't do anything about it build your I don't believe so but Irish water is so it's so mysterious and it's that they can get away with it because you know they have us chasing our tail just to get an answer the councils have their own problems but the Irish water is the worst of both worlds it is a big anonymous thing you cannot approach anybody locally to get anything done you can't get a response even the councillors can't get a response out of them to say what needs to be done locally and this thing operational issues that's that's effectively a lie I mean as Vandy says there is an engineering solution it may be a very expensive engineering solution and nobody has probably looked at but there is a solution for this problem I mean we have but see we have a scheme in this country and I and I agree with it and it's not perfect but it is working to connect broadband at a certain minimum speed to every house in Ireland now that doesn't even matter if your house is three kilometres the scheme is there to attach you to that with minimum skis with minimum speeds yeah here we have what gives us life water okay and there doesn't seem to be any actual unless Irish water are misleading Amanda and Tracy there doesn't seem to be anything that guarantees a service of a certain level to every house in Ireland now we're not talking about on the north tip of an island off the coast here we're talking about houses that are in and around letter Kenny and I can't like I appreciate what they're doing with broadband that don't get me wrong but there are minimum requirements and obligations so you can go on the internet we're talking about water here Liam I have to go unfortunately it's been lovely having you on and you made strong points and I appreciate that The Northwest Opera returned to a Greenin Theatre this June 2nd and 3rd with the musical comedy Sweeney Todd The Demon Barber of Fleet Street with music by Steven Sondheim and the iconic film adaptation by Tim Burton starring Johnny Depp this chilling tale of revenge will leave you breathless book your tickets now at Angrenin Theatre don't miss Sweeney Todd at Angrenin Theatre June 2nd and 3rd she cuts in for the wing oh that's superb she's through and go she's scored a world-class win Sarah huh oh Capri Buns or Dairy Milk oh gosh sorry uh don't dream about a world-class win enter to win one meet a world-class footballer and win an epic holiday worth 8k only with Cabri T's and C's apply visit worldclass.cabriFC.com National Heritage Week returns from August 12th to 20th and this year celebrates living heritage organize an event by exploring and sharing the traditions, crafts and skills passed down through generations in your family or community visit heritageweek.ie for more National Heritage Week is a program of the Heritage Council supported by the local authorities Heritage Officer Network and the Department of Housing local government and heritage The Cob Dunlowe's bank holiday sale is now on in-store and online massive savings across all departments 25% off homeware 50% off selected furniture 30% off lighting and there's 30% off selected wall art for more deals check out their website thecob.ie or call in store today Shop LK at Brian McCormick Sports and Leisure Main Street, Lerick Annie All the kids are back playing football with longer days and shorter nights Kids football boots from only 25 euro available in Velcro or lace check our new range of kids boots shorts socks and accessories Visit our new club room with quarter zips t-shirts and matching bottoms for your favorite local clump Click on team wear at vmcsports.ie for more details OK that's pretty much where we have to leave it on the 9 till noon show for this Thursday as I glance out the window the sun has broken through the clouds across Lerick Annie here on the mountain top Don't forget we're back with you tomorrow morning from 9 am We have a brilliant Friday panel in studio or joining us remotely or in studio I don't know it doesn't matter anyway they'll be joining us one way or other to run through some of the big stories and topics of the week or of the day so stay tuned for that always a popular item from 9 Michael and Fanoodle Fanoodle Michael and Fanoodle will join us then from 11 o'clock and there's so much besides guests between 11 and 12 and other things to keep you informed and entertained between 10 and 11 so for me and the team Caroline Orr who researched and produced assisted by Neve who is also working in our social media have a wonderful day stay tuned John Breslin is coming up around the Northwest after the news at 12


What's happening? It's broken the pins. What are you doing? She don't want to come. You can't. I don't think those are for you. Who are those not for? Good job grandma caught you. She said no markers. Those are mommy's markers. Today we're setting up the cage. Is this for you? Do has a new house. Brando has a new house. There's no rhyme or reason to the way you're doing this. No, it's at the end of the year for us. First of all, she needs more purchase. When it comes to your chain, you're real. Welcome. What do you have to say? Welcome to my channel. My name is Marlene McCohen.   But I decided today I'm going to show you Shabbat dinner.  And if you have birds, you're going to be like, uh-huh, you excited? Let's go. Megan? Literally every Friday night. Every Friday night. Literally every Friday night. After dinner? Uh. No, you can't. I was actually just leaving. Yeah, that doesn't happen. Now that I put it out there, she cannot say no. She has to stay. But I was actually just leaving, but I only stayed because I wanted to show you something. So you're going to stay for dinner? I'm going to stay to show you something. So that means she, I don't need to see it now. After dinner. No, after I show you this thing, I need to show you something. After dinner. No. Where are you going? Where's that? We have so much food. It's like, why? No, I've got to go, but, uh. You have to promise me that you'll stay in there. No, I'll come see you later. You want to see what she has? Yeah. Okay, I do want to see. You have to close your eyes though.  I have to close my eyes? Yeah. You're going to like this, okay. I promise. Hold out your hand. What's in my head? Am I supposed to look? Yeah. It feels like an egg. Wait, we have an egg? Who's egg? You're the father.  Is Cody? Cody has an egg that small. Wait, I'm confused. Wait. Huh? Look at how small it is. Not that small. It's not Merlin, is it?  Name all the girls, haven't I? No. Why am I showing you this? Iluca? No way.  No way. That's Iluca? Yeah, that's Iluca. This is a pretty big egg. It's pretty small. This came out of Iluca?  This thing is huge. Yeah, it's really small. It's really small, but actually come to think of Iluca.  I don't know about that. That's pretty big. How many did she like? Just this one. That's it? How long have you had Iluca for? She's two. The same behind us, Brando. Wow, that's quick. Yeah, I know. She moves quick. Is there another bird or is there? No, there's no other bird. Is there another bird? Is there a father in the picture? Is there a father in the picture? There's no relationship. No, oh God, no. I wouldn't be able to handle that. No way. She didn't introduce the parents yet? Just the one bird. I never thought I would be able to have that big of an egg. That is definitely a cockatiel-sized egg. Cody's egg? We're about almost the same size. No, Cody's egg was bigger. Were they? Yeah. Maybe I needed to compare it.  Congratulations. I think? I think. Is it a boy or a girl? I'm kidding. Hi, Brando. Hi, baby. I found this in my closet. Yeah. Isn't it cool? It looks good on me, doesn't it? Yes. That's because it's my shirt. Have you seen it? Have you seen it at anybody else that looked as good? No, I think you win. I've seen it on a few people, but it looks best on you. I'm thinking Michelle knowing the Shabbat routine already. There are birds everywhere and we're going to have dinner. Usually, I don't film during all this, except for on Instagram. Follow me on Instagram. George, no candy. Who was that beside her? Marlon's ready to eat. Are you going to be a good boy? See, I now want to be a good boy. What do you want? Is he going to want? She doesn't like people coming and eating this and this and this. It's like quiet time. We need to understand Hebrew. Listen. I don't care. Shabbat shalom. He's like that. Shabbat shalom. She's talking to me again. Instagram. Shabbat dinner now. Here you go. What's happening? It's broken the fence. What are you doing? She don't want to come. You can't. I think those are for you. Who are those not for? Those aren't for you. Good job grandma caught you. She said no markers. Those are mommy's markers. You can't have those markers, okay? So let's go and eat dinner. Oh, you mad? No. Come on. No. Your last word? Okay. No. You gotta go up and close that door. No, he says he's going to come down for dinner. He's just working up an appetite. He'll fly exercise adventures. George shut those doors up there.   Now come downstairs swiftly. Bless the bread. Let's show her. You know. Don't seem like that. George wants her song. Please start with her song.


Welcome everybody, welcome to the talk that we will present today, banking observability at scale. My name is Arjan Leike, I'm a father of two, and in the weekend I'm a volunteer at a dog school where I teach students about dog behaviour and training, and with me is... Yeah, I'm Salotore Vitale, I'm Italian living in the Netherlands for around 10 years. If you wonder if I speak any Dutch, just a little bit to get some information at the kindergarten about my two years' daughter, that's it, I hope that she will help me with the Dutch in the future, and I'll let Arjan continue the talk. We are here on behalf of the ING, the ING is a bank with a global presence, but by far the biggest presence that we have is in Europe. So our job within the organisation, and that's quite an interesting job, because only two years ago, I guess, we were still using monitoring systems like Tiffly, HP OpenView, and we basically identified that the open source was the way forward. So we started working, and what we want to provide is a self-service platform for our engineers so that they can simply spin up the observability that they need. In order to design such a system, we had to think about some concepts behind the design, and basically what we did, if you're probably familiar with the optometry and the pipeline within the collector, basically what we did is take that pipeline and basically take it out single process and spread it out over multiple processes. The first stream that we identified was metrics, and that's what this talk today is about. If you talk about design drivers, everybody knows about scalability and those kind of things. The thing that I really want to highlight today is the architecture building blocks, because everybody knows that in enterprise it makes sense to reuse those building blocks but even more so in the bank, because there's a thing called risk and compliance, and we are very concerned about risk and compliance. So if you walk on our floor, where we work, you hear things like risk appetite, risk controls, in control statements, risk scores, so that means that if you design a system within the bank, you have basically a choice where I reuse the architectural building blocks where the risk is managed for you by a different team, the second day operations are managed, or roll your own. So basically it's a trade-off between the best technical solution or the best solution for the bank and also for the effort that you have in order to support your system. So today we're going to talk about how we handle metrics, and we created self-service platform for this, and we like to call that the reliability toolkit, together with a single view. So before we dive into how we solve the metric observability, we have some numbers. These tend to change on a day-by-day basis because we still have team onboarding. So currently we are handling the load of around 5,000 Prometheus instances and around 1,700 Grafana instances. So if you look at how we handle scalability, basically we went to sharding route because each computer system has limits, and it can come in many forms. So an egress interface can have a bandwidth limit. A cluster might have limits, even a metric store might have a limit. So in order to overcome those limits, we shard. So basically we have the ING container hosting platform. It's an Kubernetes environment, and what we do is that we create namespaces in that environment, and there we have also a control plane, and the control plane is basically responsible for allocating the workloads, and it can be done in different ways. It can be done with the placement policy, and the placement policy can either be like okay, this team should be pinned to a specific shard, or we're going to use the least used shard that we have available to us. The container hosting platform is stateless, so that means we don't have persistent volumes. That also means that we need to store our state somewhere else. So what we did is that we deployed MIME in the ING private cloud, so MIME is deployed in a monolithic mode on VMs, and we have hardware appliance with an S3 compatible interface, and that is what we actually use to store the metrics. So that handles scalability, but what about availability? The way that we handle availability is quite simple. Each time you request a deployment, a logical deployment, you get actually two physical copies, one in data center one, and one in data center two. So let's have a look at shards and what's in there. If we zoom in a bit in what resides in the shard, we first see the security proxy. The security proxy is something that we built in-house, and it's basically a reverse proxy between the Prometheus interface and the Grafana interface. So the proxy handles a couple of things. First we present the consumer with the deployments that they have access to, and also it handles the authentication. And for that we delegate the authentication to Active Directory via OpenID Connect. Based on the access token that we get back, in the token we have a lot of group memberships, and what we did is that each deployment is also tagged with the different groups that can have access to it. And by intersecting those two pieces of information, we know what to present to our consumers in the interface. Then we have a couple of shared components within each shard. The thing that we use to load balance is Envoy. So Envoy is between Prometheus and Grafana. And it's basically ensuring that we balance over our memory cluster. Then we have a shared alert manager, and that alert manager will forward alerts that it receives to also a custom build service, that's the MDPL service as we like to call it. And the service basically has a webhook that understands the Prometheus alert manager payload. And we use that to forward the alert. Then we have the federation service, and the federation service is what we use to get data from collecting, to processing, and delivery. So basically we use labels. So if the consumer has a desire to use a specific capability, later on the pipeline had to think about anomaly detection, air budget reporting, trend prediction, they can label their data set with a specific label. It will be picked up by the federation service, and the federation service will use remote write to write to that same MDPL service. That MDPL service will forward all the data it receives to Kafka, and Kafka is used then to transport certain metrics to the different capabilities. For example, the long term metric store, because we have actually multiple memory clusters. We want to keep tabs on the footprint that we have as a company on monitoring data. So basically what we expect our users to do is that certain metrics that should be kept for a longer retention period should be labeled so that we move that data into a different store where they have a much higher retention. Then we have a custom alerting backend, and of course our analytics and reporting capabilities. So that concludes the overview. Now my colleague will show you something more about the orchestration. Thanks, Arjen. So yeah, let's dive a bit into the some technical aspect of what we want to focus today, which is basically how we provide Prometheus and Grafana as a service to our engineers. As Arjen mentioned today, we actually have, we maintain almost 5,000, 6,000 Prometheus and almost 2,000 Grafanas. So how this works, on the left you see the engineer that is basically communicating or sending a request to what we call the resource manager, a resource manager. This resource manager always following the approach that he was highlighted by Marianne at the beginning of this talk is that he's a component within ING that we want to reuse. And he's basically, in ING, he's called Touchpoint Automation Framework. And if you want to know more, some engineers at the ING, both from tomorrow on, will actually explain about it a bit more. But basically it works like a sort of Kubernetes API where you can send a manifest, and this manifest has some resource definitions. And then the resource manager is aware of what sort of resource the user, the consumer in this case, the engineer wants to create. The resource manager actually extracts some, let's say, some logic and does some logic for us. First of all, he does all the authorization and the authentication. So again, against the ID that Arjen showed in the previous slide. But also he runs an open agent policy. So he has, as an actually provider of a service, we can use open agent, let's say, what are called rego files to specify what kind of constraint we want to put on the resource. For example, one of the constraints we have is that if the resource is actually for a production environment, we would like to have at least four eye principle. So another engineer or another team members needs to approve the pipeline with which the resource will be either created, updated, or deleted. After that, after the resource manager has done his job, so received the request, he knows there are a Prometheus resource or a Grafana resource that he wants to create. He send it into our queue, where our control plane, where we have our controller, pickups the message, does some extra validation. And then if everything is all right, he stores the state into our DB. And then he sends a message to the orchestrator in the shard, either with the least utilization or either with some dedicated service that we want for particular teams. Let's say we have platform teams like the Kafka teams or other teams that require a highly amount of pods. So for those kind of teams, we would like to have a dedicated shard. The orchestrator then spins up a pod, which communicates actually with the Kubernetes API and actually creates other Prometheus or a Grafana pod, depends on what the consumer is requesting. And then the user can actually, at this point, use the resource manager CLI to actually request what is the status of his request, if it has been completed. And then once it's completed, you see that the status isn't completed. You can actually log in into the security proxy, where you will see an overview, and basically, you will see if his Grafana or Prometheus are ready, on a state ready. And they can basically monitor, basically, and can visualize and access the UI of Grafana and Prometheus. But this is nice on paper, so we have prepared a small demo for this. Before, in which I basically will show exactly this process from the engineers, but by using the CLI. I would like to basically say a bit what the demo of the scope will be. So in this demo, we will create a Prometheus instance using the resource manager CLI, then we create a second Prometheus instance. Just to highlight out the fact that scraping is completely decoupled from visualizing. Then we will start a Grafana instance, where basically this Grafana will have automatically access to the data scraped by the Prometheus instance that were previously added. And finally, we will apply also using the resource manager at dashboard. And before starting, I would like to mention that we will refer to Prometheus internally as a reliability toolkit too. And to Grafana as a single view, which is basically our internal name for the resource manager definition. And finally, we will not use the Kube-CTL, but as I said, we will use the Touch-CTL, which is the internal product that we use at ING. Okay, I'm going to avoid issue with VPN and stuff, security in the bank. So I just recorded, but you can trust that this video has not been manufactured with this reality. I can show it to you later in case. So let's start. This is a reality-bidded toolkit too. So it's a Prometheus resource definition. And then, oh, sorry, it's not showing. Good, Rian, good catch. Why not? Maybe I need to exit the presentation mode. Yeah, good catch. Yes. Yeah. Yes. Okay, I'll start again. Yeah, good catch, guys. We were losing a lot of nice information. Yes, okay. So I will start with a Prometheus resource definition. So this is a Prometheus resource definition. You can see here some similarity to a Kubernetes manifest, where basically most is just the resource definition that the resource manager needs. Here I'm giving a name, which is the demo for the conference. Then we have some specs regarding basically the deployed model, where in which region our consumers wants to really deploy. Then we have some configuration. You will recognize the Prometheus configuration. In this case, for the sake of this, we are just scraping Prometheus itself. Then we have some alerting. In this case, we want to be alerted if the Prometheus itself is down. Let me just put this up, sorry, guys. As you can see here, I'm using the Touch CTL, and I'm applying actually the manifest. You can see that it returned like that the state is impending. So after that, I can actually retrieve the state of my request with a get command. And here I'm basically seeing that my request has been completed, and it has been deployed to Shart13, where I can basically access Shart13, where I have my overview page, and here I can see that the pod is spinning up, and I can monitor it until basically it will be in a ready state. Here I'm actually creating a second instance, which is exactly the same, so I'm not just the name is different, so I'm not actually bothering you again with the manifest. Again, here we are seeing that the first instance actually is already on a ready state, while the second is currently being spinned up by Kubernetes. Now it's ready, so actually we can dive a bit into the Prometheus UI. Here we will look at the configuration. You can see that, in fact, Prometheus is scraping exactly itself in the localhost. Then automatically, of course, we configure the remote write to our Mimir cluster, so that's completely managed, and then you will see also that the simple alert that I put in place is there. The first two steps, so we have two premises, so now we can go to create the Grafana instance. Again, another manifest, where most of it is basically the boilerplate for the resource manager. In this case, we call it single view for the demo, and again, in this case, we have a simple manifest because the specs are just the deployment model because all the other logic is handled by us, so I don't need to make it simple, basically, for our engineers. Again, we apply the manifest using the apply model, my apply command. First, we get, again, status pending, and now if I go to the proxy for the single view, I see that my pod is basically getting into a ready state, and now I'm ready, so the consumer now can access the Grafana for the first time, and then here it will have like a default dashboard in which you will see in its data source which promethuses it can access, so here you can recognize that this Grafana automatically has access to the two promethuses that I previously created, and now, basically, I have the data, I want to create a simple dashboard to show that all this as a sense and works, so now we have another resource definition. Basically, the engineer has already created a dashboard, exported into JSON, and then applied via this CLI. We need to say, in rich Grafana instance, we want to apply this dashboard, and then you basically, yeah, this is just the JSON, and then once the dashboard is applied, it will be shown in a few seconds in your Grafana, and now you have basically this dashboard which has been applied, and you can see that, in fact, for very few minutes already, the two promethuses are producing data, and then, basically, these data are available. Of course, engineers in ING has way more complicated targets to scrape and way more complex dashboard, but for the sake of the presentation, this basically explains the entire flow that our engineers follow. And of course, our engineers, they don't use actually the command line, but they use the pipeline version of it that we run on our cloud. So this basically concludes the demo. I go again to presenting mode. So yeah, next step. So basically, for the coming future, short term, what we would like to do is to migrate all our recording rules and alerting to Mimir. For that, we are waiting to have the possibility to actually run Mimir on microservices. At the moment, as Ariane explained, we are currently running on VMs with the monolith approach. And then, in line with all, let's say, the conference of today, we would like actually to move towards open telemetry collectors for our managed solutions. And so that's basically the trend also for us. So we are happy that, actually, we saw today that we are going on the right direction. We will go in the right direction. If you want to follow other talks from ING, tomorrow our colleague will be pretty busy with very interesting talks. So I invite you to, if you are interested, to follow them. You can follow us on the Various Channel of ING, or we hope very contacted us on our LinkedIn that you actually find on the website of the conference. And that's it. Let's conclude our talk. Wow. That is an awesome thing. 5,800 Prometheus instances. That blows my mind. We have a few minutes for questions. Any questions for the ING folks? Oh, yeah. We have a question there. Why do you need 5,300 Prometheus instances? That's a good question. It depends on the, what, what, no, no. The thing is, we concern ourselves with least privilege, right? So if we would collect all the data, put it in one big bucket, then basically everybody could see potential sensitive data. So within our IAM model, we made it explicit that we want to separate basically what the team can see. So basically each team gets its own Prometheus instance. And maybe not only one, but multiple, right? If they have a large environment and they want to monitor a light of moment, one team might even have like five instances. Now, then we have also test development acceptance. So they might spin up multiple containers for multiple purposes for multiple environments. And then that number sums up quite quick. Yeah, to give you some numbers, for example, I think, yeah, the Cassandra team, which is a managed database for the entire bank, use like maybe 25 Prometheus for their own service because they are on or maybe 25 million times series, active time series. Any other questions? Oh, yeah, we have one here. Hi, why did you decide to wrap all the CRDs in your custom CRDs? What are the properties that they are giving you? When we started to design the system, we had two choices. We could either use something that was already available within our organization, or we could roll our own. The idea at first was to just use operators like you suggest and then just apply the resource definition on the operator level, but due to this risk and compliance, teams tend to restrict the openness of a system, right, to ensure that we as a bank can stay in control of what happens with that system. And then, yeah, it's a trade-off, right?  Do you have the engineers to do the second day ops for that instance? Do you have the engineers to do risk and compliance? Do the pen tests each regular interval? Do the evidencing of all the risk? So it's basically, yeah, what I mentioned earlier is this trade-off between using something that's already within the bank or rolling your own solution. Cool, we are out of time, but yeah, the speakers will be around.


I'm William Yoon and this is the new edition of Bach Partita on Henle and I'm very happy to make a contribution to this wonderful new edition by sharing my fingerings. Personally I was working on this project during the first weeks of pandemic so it was a very special project for me because every day I was playing Bach and I realized how much joy this brings into my life and I hope you will also explore this wonderful music and find joy and I can help you with my fingerings.